2024-09-16T01:46:04.331 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T01:46:04.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:46:04.467 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906499' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3eRxg6b/SIjmAI7WfIYi0vy0demaaJ8mI/0BX2JXaIttE4uhV1zZ/5f7kEgN9CwNYsZ7HjovDXbB266guu8HM= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8IRzTu6GV0CieGm8T/tQ2/aE/tWdwKJYx8BN1We1VDQdvMhRgaN8mdSNy35Sjc/vdRHzsP80givuuSzlr7JPY= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-16T01:46:04.468 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T01:46:04.468 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T01:46:04.469 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T01:46:04.470 INFO:teuthology.task.internal:Checking packages... 2024-09-16T01:46:04.491 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T01:46:04.491 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:46:04.492 INFO:teuthology.packaging:ref: None 2024-09-16T01:46:04.492 INFO:teuthology.packaging:tag: None 2024-09-16T01:46:04.492 INFO:teuthology.packaging:branch: squid 2024-09-16T01:46:04.492 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:46:04.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T01:46:04.719 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T01:46:04.721 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T01:46:04.729 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T01:46:04.729 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T01:46:04.746 INFO:teuthology.task.internal:Saving configuration 2024-09-16T01:46:04.766 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T01:46:04.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T01:46:04.797 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 01:41:06.159333', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3eRxg6b/SIjmAI7WfIYi0vy0demaaJ8mI/0BX2JXaIttE4uhV1zZ/5f7kEgN9CwNYsZ7HjovDXbB266guu8HM='} 2024-09-16T01:46:04.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 01:41:06.160978', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8IRzTu6GV0CieGm8T/tQ2/aE/tWdwKJYx8BN1We1VDQdvMhRgaN8mdSNy35Sjc/vdRHzsP80givuuSzlr7JPY='} 2024-09-16T01:46:04.822 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T01:46:04.829 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-16T01:46:04.829 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-16T01:46:04.829 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T01:46:04.879 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb40e9ffbe0>, signals=[15]) 2024-09-16T01:46:04.879 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T01:46:04.887 INFO:teuthology.task.internal:Opening connections... 2024-09-16T01:46:04.887 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T01:46:04.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:46:04.967 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-16T01:46:04.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:46:05.043 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T01:46:05.050 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-16T01:46:05.068 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-16T01:46:05.068 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:46:05.125 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:46:05.126 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:46:05.126 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:46:05.126 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:46:05.126 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-16T01:46:05.138 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-16T01:46:05.156 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-16T01:46:05.157 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-16T01:46:05.214 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-16T01:46:05.214 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-16T01:46:05.214 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:46:05.215 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:46:05.216 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-16T01:46:05.230 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T01:46:05.238 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T01:46:05.244 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T01:46:05.244 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:46:05.246 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:46:05.271 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T01:46:05.278 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T01:46:05.278 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:46:05.303 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:46:05.399 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T01:46:05.441 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T01:46:05.468 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T01:46:05.468 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T01:46:05.468 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:46:05.469 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:46:05.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:46:05.486 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-16T01:46:05.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:46:05.487 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-16T01:46:05.544 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:46:05.544 INFO:teuthology.task.kernel:Running kernel on smithi165: 5.14.0-503.el9.x86_64 2024-09-16T01:46:05.544 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2024-09-16T01:46:05.545 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:46:05.545 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.14.0-503.el9.x86_64 2024-09-16T01:46:05.546 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2024-09-16T01:46:08.061 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.2 MB 00:00 2024-09-16T01:46:09.114 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-16T01:46:11.115 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-16T01:46:12.328 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-16T01:46:15.724 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.5 MB 00:00 2024-09-16T01:46:17.425 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-16T01:46:17.594 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-16T01:46:18.421 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-16T01:46:19.137 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-16T01:46:20.658 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-16T01:46:23.893 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T01:46:25.950 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:46:25.950 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:46:26.037 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:46:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:46:26.045 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:46:26.045 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:46:26.045 INFO:teuthology.orchestra.run.smithi110.stdout:Install 4 Packages 2024-09-16T01:46:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:46:26.045 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 79 M 2024-09-16T01:46:26.045 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 126 M 2024-09-16T01:46:26.046 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:46:26.153 INFO:teuthology.orchestra.run.smithi110.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 260 kB/s | 23 kB 00:00 2024-09-16T01:46:26.371 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T01:46:28.412 INFO:teuthology.orchestra.run.smithi110.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-09-16T01:46:28.453 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:46:28.453 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:46:28.544 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:46:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:46:28.555 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-16T01:46:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:46:28.555 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-16T01:46:28.556 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:46:28.557 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 79 M 2024-09-16T01:46:28.557 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 126 M 2024-09-16T01:46:28.557 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:46:28.789 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 240 kB/s | 23 kB 00:00 2024-09-16T01:46:29.165 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-16T01:46:29.623 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-16T01:46:29.890 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-16T01:46:29.890 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:46:29.890 INFO:teuthology.orchestra.run.smithi165.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-16T01:46:30.568 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:46:30.936 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:46:30.936 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:46:31.520 INFO:teuthology.orchestra.run.smithi110.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.3 MB/s | 35 MB 00:05 2024-09-16T01:46:31.787 INFO:teuthology.orchestra.run.smithi110.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.1 MB/s | 29 MB 00:05 2024-09-16T01:46:31.787 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:46:31.787 INFO:teuthology.orchestra.run.smithi110.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-16T01:46:31.922 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:46:31.922 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:46:32.463 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:46:32.833 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:46:32.833 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:46:33.769 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:46:33.769 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:46:34.401 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:46:35.102 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:46:35.183 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:46:36.227 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:46:36.938 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:46:37.022 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:46:37.991 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:46:38.116 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:46:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:46:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:46:42.946 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:46:42.982 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:46:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:46:44.899 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:46:47.812 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:46:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:26.278 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:26.328 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:26.668 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:26.668 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:47:26.668 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:47:26.668 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:47:27.511 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:47:27.869 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:47:27.946 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:47:27.946 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:47:27.946 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:47:27.946 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:47:27.946 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:47:27.947 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-16T01:47:27.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:47:27.947 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:47:28.005 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:47:28.006 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:47:28.006 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.06 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 82.el9 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Group : Unspecified 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 8274670 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2024-09-16T01:47:28.049 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : builder@centos.org 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:47:28.050 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2024-09-16T01:47:28.051 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:47:28.051 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:47:28.051 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:47:28.052 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:47:28.052 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:47:28.076 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:28.116 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:28.494 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:28.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:47:28.494 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:47:28.495 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:47:28.740 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-09-16T01:47:29.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:47:29.333 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:47:29.736 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:47:29.821 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:47:29.821 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:47:29.821 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:47:29.821 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:47:29.822 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:47:29.822 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-16T01:47:29.822 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:47:29.822 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:47:29.880 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:47:29.880 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:47:29.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-09-16T01:47:29.911 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 82.el9 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8274670 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:47:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:47:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:47:29.915 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:47:29.915 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:47:29.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:47:30.080 INFO:teuthology.orchestra.run.smithi165.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:47:30.115 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-09-16T01:47:30.118 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-16T01:47:30.133 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.YGD8IJNOAw 2024-09-16T01:47:30.133 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YGD8IJNOAw 2024-09-16T01:47:30.199 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.YGD8IJNOAw 2024-09-16T01:47:30.330 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.YGD8IJNOAw is 6KB 2024-09-16T01:47:30.380 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.YGD8IJNOAw 2024-09-16T01:47:30.395 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:47:30.458 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:47:30.458 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:47:30.458 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:47:30.458 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:47:30.459 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:47:30.601 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-16T01:47:30.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2024-09-16T01:47:31.936 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:47:31.968 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-16T01:47:31.970 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-16T01:47:31.985 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.6kcp6BplaB 2024-09-16T01:47:31.985 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6kcp6BplaB 2024-09-16T01:47:32.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.6kcp6BplaB 2024-09-16T01:47:32.199 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.6kcp6BplaB is 6KB 2024-09-16T01:47:32.246 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.6kcp6BplaB 2024-09-16T01:47:32.261 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:47:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:47:32.334 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:47:32.334 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:47:32.334 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:47:32.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:47:32.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-16T01:48:00.621 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-16T01:48:00.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:48:00.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:48:02.514 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-16T01:48:02.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T01:48:02.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:48:19.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-16T01:48:20.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-16T01:48:28.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:48:28.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:48:29.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T01:48:29.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:48:31.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-16T01:48:43.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:48:43.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:49:01.632 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-16T01:49:16.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:49:16.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:49:17.014 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-16T01:49:17.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:49:17.361 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:49:17.361 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-16T01:49:17.375 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:49:17.375 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:49:17.376 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:49:17.376 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:49:18.376 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-16T01:49:18.376 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T01:49:18.441 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2024-09-16T01:49:18.466 DEBUG:teuthology.parallel:result is None 2024-09-16T01:49:29.931 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T01:49:41.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T01:49:41.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:49:42.221 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-16T01:49:42.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T01:49:42.621 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:49:42.621 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-16T01:49:42.637 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:49:42.638 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:49:42.638 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:49:42.638 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:49:43.639 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-16T01:49:43.639 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T01:49:43.720 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-09-16T01:49:43.740 DEBUG:teuthology.parallel:result is None 2024-09-16T01:49:43.740 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T01:49:43.746 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T01:49:43.746 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:49:43.749 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:49:43.770 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T01:49:43.777 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T01:49:43.784 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T01:49:43.784 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:49:43.809 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:49:44.039 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T01:49:44.048 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T01:49:44.048 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:49:44.050 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:49:44.082 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:49:44.082 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:49:44.093 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:49:44.094 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:49:44.096 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T01:49:44.105 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T01:49:44.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:49:44.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:49:44.167 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T01:49:44.176 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T01:49:44.176 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:49:44.208 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:49:44.224 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:49:44.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:49:44.353 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:49:44.435 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:49:44.477 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:49:44.477 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:49:44.542 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:49:44.588 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:49:44.636 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:49:44.720 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:49:44.763 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:49:44.764 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:49:44.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-16T01:49:44.833 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-16T01:49:44.885 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:49:44.931 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:49:45.241 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T01:49:45.249 INFO:teuthology.task.internal:Starting timer... 2024-09-16T01:49:45.249 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T01:49:45.261 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T01:49:45.270 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T01:49:45.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-09-16T01:49:45.328 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-09-16T01:49:45.329 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-16T01:49:45.379 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-16T01:49:45.381 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T01:49:45.382 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-09-16T01:49:45.404 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-09-16T01:49:45.404 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-16T01:49:45.428 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-16T01:49:45.428 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-09-16T01:49:45.428 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:49:45.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:49:45.470 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:49:45.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:49:45.497 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T01:49:45.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:49:45.541 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:49:45.574 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T01:49:45.583 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T01:49:45.586 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T01:49:45.698 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T01:49:45.708 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T01:49:45.709 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T01:53:30.613 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-16T01:53:30.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T01:53:30.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:53:30.694 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-16T01:53:30.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T01:53:30.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:53:30.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:53:30.817 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-16T01:53:30.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-16T01:53:30.897 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T01:53:30.906 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T01:53:30.906 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:53:30.906 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:53:30.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:53:30.909 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:53:30.940 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:53:30.956 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:53:30.967 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:53:30.982 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:53:30.982 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-09-16T01:53:30.994 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-09-16T01:53:31.006 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-16T01:53:31.008 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:53:31.017 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-16T01:53:31.023 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:53:31.031 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:53:31.045 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:53:31.080 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:53:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:53:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-16T01:53:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.102 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:53:31.106 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:53:31.106 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-16T01:53:31.106 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.106 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.106 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.107 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:53:31.107 INFO:teuthology.run_tasks:Running task install... 2024-09-16T01:53:31.116 DEBUG:teuthology.task.install:project ceph 2024-09-16T01:53:31.116 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T01:53:31.116 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T01:53:31.116 INFO:teuthology.task.install:Using flavor: default 2024-09-16T01:53:31.121 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T01:53:31.121 INFO:teuthology.task.install:extra packages: [] 2024-09-16T01:53:31.121 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:53:31.122 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:53:31.122 INFO:teuthology.packaging:ref: None 2024-09-16T01:53:31.122 INFO:teuthology.packaging:tag: None 2024-09-16T01:53:31.122 INFO:teuthology.packaging:branch: quincy 2024-09-16T01:53:31.122 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:53:31.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-16T01:53:31.124 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:53:31.124 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:53:31.124 INFO:teuthology.packaging:ref: None 2024-09-16T01:53:31.124 INFO:teuthology.packaging:tag: None 2024-09-16T01:53:31.125 INFO:teuthology.packaging:branch: quincy 2024-09-16T01:53:31.125 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:53:31.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-16T01:53:31.337 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/ 2024-09-16T01:53:31.338 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1633.g6d025bc2 2024-09-16T01:53:31.356 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/ 2024-09-16T01:53:31.356 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1633.g6d025bc2 2024-09-16T01:53:31.448 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:53:31.449 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:53:31.449 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:53:31.463 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6d025bc26f3176c910707f8cb4c8d8e076640615/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:53:31.463 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:53:31.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:53:31.475 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T01:53:31.475 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:53:31.475 INFO:teuthology.packaging:ref: None 2024-09-16T01:53:31.475 INFO:teuthology.packaging:tag: None 2024-09-16T01:53:31.475 INFO:teuthology.packaging:branch: quincy 2024-09-16T01:53:31.475 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:53:31.476 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:53:31.489 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T01:53:31.489 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:53:31.489 INFO:teuthology.packaging:ref: None 2024-09-16T01:53:31.489 INFO:teuthology.packaging:tag: None 2024-09-16T01:53:31.490 INFO:teuthology.packaging:branch: quincy 2024-09-16T01:53:31.490 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:53:31.490 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:53:31.542 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:53:31.556 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:53:31.618 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:53:31.633 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:53:31.683 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-16T01:53:31.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-16T01:53:31.696 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-09-16T01:53:31.698 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-09-16T01:53:31.929 INFO:teuthology.orchestra.run.smithi110.stdout:45 files removed 2024-09-16T01:53:31.937 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-16T01:53:31.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw 2024-09-16T01:53:31.966 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw 2024-09-16T01:53:32.518 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 276 kB/s | 77 kB 00:00 2024-09-16T01:53:32.522 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 286 kB/s | 77 kB 00:00 2024-09-16T01:53:32.794 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-16T01:53:32.814 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-09-16T01:53:33.053 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 8.0 kB/s | 1.8 kB 00:00 2024-09-16T01:53:33.090 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-16T01:53:33.837 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-16T01:53:34.773 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-16T01:53:36.055 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-16T01:53:36.816 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-16T01:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T01:53:41.384 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.5 MB 00:00 2024-09-16T01:53:42.965 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-16T01:53:43.035 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-16T01:53:44.361 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-16T01:53:44.547 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-16T01:53:49.692 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-16T01:53:49.994 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T01:53:52.083 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 14 M 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 3.1 M 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 2.9 M 2024-09-16T01:53:52.095 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 5.0 M 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 22 M 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 25 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 637 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 457 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 4.9 M 2024-09-16T01:53:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 45 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 120 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 156 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 320 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 295 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 99 k 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:53:52.097 INFO:teuthology.orchestra.run.smithi110.stdout:Install 22 Packages 2024-09-16T01:53:52.098 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 2 Packages 2024-09-16T01:53:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:53:52.098 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 58 M 2024-09-16T01:53:52.098 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:53:52.354 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:53:52.374 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:53:52.374 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:53:52.374 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:53:52.374 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:53:52.375 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 14 M 2024-09-16T01:53:52.375 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-16T01:53:52.375 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 3.1 M 2024-09-16T01:53:52.375 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 2.9 M 2024-09-16T01:53:52.375 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:53:52.375 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 5.0 M 2024-09-16T01:53:52.376 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 22 M 2024-09-16T01:53:52.376 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 25 k 2024-09-16T01:53:52.376 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:53:52.376 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 637 k 2024-09-16T01:53:52.376 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:53:52.376 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 457 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 4.9 M 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 45 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 120 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 156 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 320 k 2024-09-16T01:53:52.377 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 295 k 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 99 k 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout:Install 22 Packages 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 2 Packages 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:53:52.378 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 58 M 2024-09-16T01:53:52.379 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:53:52.685 INFO:teuthology.orchestra.run.smithi110.stdout:(1/24): ceph-base-17.2.7-1633.g6d025bc2.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-16T01:53:52.744 INFO:teuthology.orchestra.run.smithi110.stdout:(2/24): ceph-selinux-17.2.7-1633.g6d025bc2.el9. 432 kB/s | 25 kB 00:00 2024-09-16T01:53:52.844 INFO:teuthology.orchestra.run.smithi110.stdout:(3/24): libcephfs2-17.2.7-1633.g6d025bc2.el9.x8 6.2 MB/s | 637 kB 00:00 2024-09-16T01:53:52.936 INFO:teuthology.orchestra.run.smithi110.stdout:(4/24): libradosstriper1-17.2.7-1633.g6d025bc2. 4.9 MB/s | 457 kB 00:00 2024-09-16T01:53:53.295 INFO:teuthology.orchestra.run.smithi110.stdout:(5/24): librgw2-17.2.7-1633.g6d025bc2.el9.x86_6 14 MB/s | 4.9 MB 00:00 2024-09-16T01:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout:(6/24): python3-ceph-argparse-17.2.7-1633.g6d02 601 kB/s | 45 kB 00:00 2024-09-16T01:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout:(7/24): python3-ceph-common-17.2.7-1633.g6d025b 1.8 MB/s | 120 kB 00:00 2024-09-16T01:53:53.504 INFO:teuthology.orchestra.run.smithi110.stdout:(8/24): python3-cephfs-17.2.7-1633.g6d025bc2.el 2.3 MB/s | 156 kB 00:00 2024-09-16T01:53:53.581 INFO:teuthology.orchestra.run.smithi110.stdout:(9/24): python3-rados-17.2.7-1633.g6d025bc2.el9 4.2 MB/s | 320 kB 00:00 2024-09-16T01:53:53.821 INFO:teuthology.orchestra.run.smithi165.stdout:(1/24): ceph-radosgw-17.2.7-1633.g6d025bc2.el9. 10 MB/s | 14 MB 00:01 2024-09-16T01:53:53.838 INFO:teuthology.orchestra.run.smithi110.stdout:(10/24): ceph-common-17.2.7-1633.g6d025bc2.el9. 14 MB/s | 22 MB 00:01 2024-09-16T01:53:53.862 INFO:teuthology.orchestra.run.smithi165.stdout:(2/24): ceph-selinux-17.2.7-1633.g6d025bc2.el9. 608 kB/s | 25 kB 00:00 2024-09-16T01:53:53.913 INFO:teuthology.orchestra.run.smithi165.stdout:(3/24): libcephfs2-17.2.7-1633.g6d025bc2.el9.x8 12 MB/s | 637 kB 00:00 2024-09-16T01:53:53.972 INFO:teuthology.orchestra.run.smithi165.stdout:(4/24): libradosstriper1-17.2.7-1633.g6d025bc2. 7.6 MB/s | 457 kB 00:00 2024-09-16T01:53:53.988 INFO:teuthology.orchestra.run.smithi110.stdout:(11/24): ceph-radosgw-17.2.7-1633.g6d025bc2.el9 8.4 MB/s | 14 MB 00:01 2024-09-16T01:53:54.014 INFO:teuthology.orchestra.run.smithi110.stdout:(12/24): python3-rbd-17.2.7-1633.g6d025bc2.el9. 680 kB/s | 295 kB 00:00 2024-09-16T01:53:54.039 INFO:teuthology.orchestra.run.smithi110.stdout:(13/24): python3-rgw-17.2.7-1633.g6d025bc2.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T01:53:54.106 INFO:teuthology.orchestra.run.smithi110.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-16T01:53:54.131 INFO:teuthology.orchestra.run.smithi110.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-16T01:53:54.173 INFO:teuthology.orchestra.run.smithi110.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-16T01:53:54.180 INFO:teuthology.orchestra.run.smithi165.stdout:(5/24): librgw2-17.2.7-1633.g6d025bc2.el9.x86_6 24 MB/s | 4.9 MB 00:00 2024-09-16T01:53:54.198 INFO:teuthology.orchestra.run.smithi110.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-16T01:53:54.222 INFO:teuthology.orchestra.run.smithi165.stdout:(6/24): python3-ceph-argparse-17.2.7-1633.g6d02 1.1 MB/s | 45 kB 00:00 2024-09-16T01:53:54.240 INFO:teuthology.orchestra.run.smithi110.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-16T01:53:54.272 INFO:teuthology.orchestra.run.smithi165.stdout:(7/24): python3-ceph-common-17.2.7-1633.g6d025b 2.3 MB/s | 120 kB 00:00 2024-09-16T01:53:54.274 INFO:teuthology.orchestra.run.smithi110.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-09-16T01:53:54.299 INFO:teuthology.orchestra.run.smithi110.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-16T01:53:54.323 INFO:teuthology.orchestra.run.smithi165.stdout:(8/24): python3-cephfs-17.2.7-1633.g6d025bc2.el 3.1 MB/s | 156 kB 00:00 2024-09-16T01:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 820 kB/s | 67 kB 00:00 2024-09-16T01:53:54.381 INFO:teuthology.orchestra.run.smithi165.stdout:(9/24): python3-rados-17.2.7-1633.g6d025bc2.el9 5.4 MB/s | 320 kB 00:00 2024-09-16T01:53:54.425 INFO:teuthology.orchestra.run.smithi110.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-16T01:53:54.448 INFO:teuthology.orchestra.run.smithi165.stdout:(10/24): python3-rbd-17.2.7-1633.g6d025bc2.el9. 4.3 MB/s | 295 kB 00:00 2024-09-16T01:53:54.490 INFO:teuthology.orchestra.run.smithi165.stdout:(11/24): python3-rgw-17.2.7-1633.g6d025bc2.el9. 2.3 MB/s | 99 kB 00:00 2024-09-16T01:53:54.500 INFO:teuthology.orchestra.run.smithi110.stdout:(23/24): librados2-17.2.7-1633.g6d025bc2.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-16T01:53:54.558 INFO:teuthology.orchestra.run.smithi165.stdout:(12/24): ceph-base-17.2.7-1633.g6d025bc2.el9.x8 2.3 MB/s | 5.0 MB 00:02 2024-09-16T01:53:54.558 INFO:teuthology.orchestra.run.smithi110.stdout:(24/24): librbd1-17.2.7-1633.g6d025bc2.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-16T01:53:54.564 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:53:54.564 INFO:teuthology.orchestra.run.smithi110.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-16T01:53:54.624 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:53:54.656 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:53:54.656 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:53:54.691 INFO:teuthology.orchestra.run.smithi165.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 340 kB/s | 45 kB 00:00 2024-09-16T01:53:54.724 INFO:teuthology.orchestra.run.smithi165.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 685 kB/s | 160 kB 00:00 2024-09-16T01:53:54.850 INFO:teuthology.orchestra.run.smithi165.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-16T01:53:54.875 INFO:teuthology.orchestra.run.smithi165.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-16T01:53:54.909 INFO:teuthology.orchestra.run.smithi165.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 715 kB/s | 42 kB 00:00 2024-09-16T01:53:54.951 INFO:teuthology.orchestra.run.smithi165.stdout:(18/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-16T01:53:54.976 INFO:teuthology.orchestra.run.smithi165.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-16T01:53:55.002 INFO:teuthology.orchestra.run.smithi165.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 536 kB/s | 49 kB 00:00 2024-09-16T01:53:55.102 INFO:teuthology.orchestra.run.smithi165.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-16T01:53:55.286 INFO:teuthology.orchestra.run.smithi165.stdout:(22/24): librbd1-17.2.7-1633.g6d025bc2.el9.x86_ 16 MB/s | 2.9 MB 00:00 2024-09-16T01:53:55.347 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:53:55.347 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:53:55.711 INFO:teuthology.orchestra.run.smithi165.stdout:(23/24): librados2-17.2.7-1633.g6d025bc2.el9.x8 4.3 MB/s | 3.1 MB 00:00 2024-09-16T01:53:56.582 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:53:56.966 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-16T01:53:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/26 2024-09-16T01:53:57.112 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/26 2024-09-16T01:53:57.198 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/26 2024-09-16T01:53:57.246 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/26 2024-09-16T01:53:57.335 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/26 2024-09-16T01:53:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-16T01:53:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-16T01:53:57.628 INFO:teuthology.orchestra.run.smithi165.stdout:(24/24): ceph-common-17.2.7-1633.g6d025bc2.el9. 4.3 MB/s | 22 MB 00:05 2024-09-16T01:53:57.633 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:53:57.634 INFO:teuthology.orchestra.run.smithi165.stdout:Total 11 MB/s | 58 MB 00:05 2024-09-16T01:53:57.696 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:53:57.730 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:53:57.730 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:53:57.861 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-16T01:53:57.891 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 8/26 2024-09-16T01:53:57.954 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 8/26 2024-09-16T01:53:57.990 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-16T01:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:17.2.7-1633.g6d025bc2.el9. 10/26 2024-09-16T01:53:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 11/26 2024-09-16T01:53:58.141 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 12/26 2024-09-16T01:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_6 13/26 2024-09-16T01:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_6 13/26 2024-09-16T01:53:58.282 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-16T01:53:58.319 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-16T01:53:58.361 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-16T01:53:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:53:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:53:58.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-16T01:53:58.690 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 18/26 2024-09-16T01:53:58.781 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 18/26 2024-09-16T01:53:58.853 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 19/26 2024-09-16T01:53:58.884 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:17.2.7-1633.g6d025bc2.el9.x8 20/26 2024-09-16T01:53:59.634 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:53:59.969 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-16T01:54:00.071 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/26 2024-09-16T01:54:00.174 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/26 2024-09-16T01:54:00.252 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/26 2024-09-16T01:54:00.281 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/26 2024-09-16T01:54:00.369 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/26 2024-09-16T01:54:00.415 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-16T01:54:00.445 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-16T01:54:00.883 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-16T01:54:00.910 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 8/26 2024-09-16T01:54:00.972 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 8/26 2024-09-16T01:54:01.000 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-16T01:54:01.040 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:17.2.7-1633.g6d025bc2.el9. 10/26 2024-09-16T01:54:01.081 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 11/26 2024-09-16T01:54:01.143 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 12/26 2024-09-16T01:54:01.171 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_6 13/26 2024-09-16T01:54:01.237 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_6 13/26 2024-09-16T01:54:01.284 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-16T01:54:01.318 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 21/26 2024-09-16T01:54:01.320 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-16T01:54:01.347 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 21/26 2024-09-16T01:54:01.354 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-16T01:54:01.650 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-16T01:54:01.683 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 18/26 2024-09-16T01:54:01.774 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 18/26 2024-09-16T01:54:01.846 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 19/26 2024-09-16T01:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 21/26 2024-09-16T01:54:01.877 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:17.2.7-1633.g6d025bc2.el9.x8 20/26 2024-09-16T01:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 22/26 2024-09-16T01:54:02.011 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 22/26 2024-09-16T01:54:02.012 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:54:02.012 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:54:02.012 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:02.044 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 23/26 2024-09-16T01:54:04.342 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 21/26 2024-09-16T01:54:04.383 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 21/26 2024-09-16T01:54:04.912 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 21/26 2024-09-16T01:54:04.945 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 22/26 2024-09-16T01:54:05.044 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 22/26 2024-09-16T01:54:05.044 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:54:05.044 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:54:05.044 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:05.079 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 23/26 2024-09-16T01:54:11.858 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 23/26 2024-09-16T01:54:11.858 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-09-16T01:54:11.858 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-09-16T01:54:11.858 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-09-16T01:54:11.859 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-09-16T01:54:11.859 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-09-16T01:54:11.859 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-09-16T01:54:11.859 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-09-16T01:54:11.859 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 24/26 2024-09-16T01:54:13.240 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 24/26 2024-09-16T01:54:13.240 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:13.241 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:54:13.241 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:54:13.241 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:54:13.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:13.242 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-16T01:54:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-16T01:54:13.326 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 5/26 2024-09-16T01:54:14.628 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_6 6/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 7/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1633.g6d025bc2.el9. 8/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:17.2.7-1633.g6d025bc2.el9.x8 9/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 10/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 11/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 12/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 13/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-16T01:54:14.629 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 23/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-16T01:54:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 25/26 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 23/26 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-16T01:54:14.634 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.670 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:54:15.671 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:15.672 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:15.952 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 24/26 2024-09-16T01:54:16.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-test 2024-09-16T01:54:16.030 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 24/26 2024-09-16T01:54:16.031 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:16.031 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:54:16.031 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:54:16.031 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:54:16.031 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:16.032 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-16T01:54:16.122 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-16T01:54:16.122 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-16T01:54:16.578 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:27 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:16.719 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:16.719 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:16.719 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:54:16.719 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:16.719 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 48 M 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 163 k 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout:Install 4 Packages 2024-09-16T01:54:16.720 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:16.721 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 48 M 2024-09-16T01:54:16.721 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 193 M 2024-09-16T01:54:16.721 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:54:16.976 INFO:teuthology.orchestra.run.smithi110.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-16T01:54:17.001 INFO:teuthology.orchestra.run.smithi110.stdout:(2/4): libcephsqlite-17.2.7-1633.g6d025bc2.el9. 698 kB/s | 163 kB 00:00 2024-09-16T01:54:17.026 INFO:teuthology.orchestra.run.smithi110.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T01:54:17.313 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-16T01:54:17.314 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/26 2024-09-16T01:54:17.314 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/26 2024-09-16T01:54:17.314 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/26 2024-09-16T01:54:17.314 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/26 2024-09-16T01:54:17.314 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 5/26 2024-09-16T01:54:17.315 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_6 6/26 2024-09-16T01:54:17.315 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 7/26 2024-09-16T01:54:17.315 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1633.g6d025bc2.el9. 8/26 2024-09-16T01:54:17.315 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:17.2.7-1633.g6d025bc2.el9.x8 9/26 2024-09-16T01:54:17.315 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 10/26 2024-09-16T01:54:17.315 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 11/26 2024-09-16T01:54:17.316 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 12/26 2024-09-16T01:54:17.316 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 13/26 2024-09-16T01:54:17.316 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-16T01:54:17.316 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-16T01:54:17.316 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-16T01:54:17.317 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-16T01:54:17.317 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-16T01:54:17.317 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-16T01:54:17.317 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-16T01:54:17.317 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-16T01:54:17.317 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-16T01:54:17.318 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 23/26 2024-09-16T01:54:17.318 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-16T01:54:17.318 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 25/26 2024-09-16T01:54:18.278 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:54:18.279 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.280 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:54:18.281 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.281 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.281 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:18.281 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:54:18.281 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:18.281 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:18.293 INFO:teuthology.orchestra.run.smithi110.stdout:(4/4): ceph-test-17.2.7-1633.g6d025bc2.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-16T01:54:18.295 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:18.295 INFO:teuthology.orchestra.run.smithi110.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-16T01:54:18.322 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:54:18.340 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:54:18.340 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:54:18.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-test 2024-09-16T01:54:18.704 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:54:18.704 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:54:19.218 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:30 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:19.243 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:54:19.333 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T01:54:19.357 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:19.358 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:19.358 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:54:19.358 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:19.358 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 48 M 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 163 k 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-16T01:54:19.359 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:19.360 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 48 M 2024-09-16T01:54:19.360 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 193 M 2024-09-16T01:54:19.360 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:54:19.387 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T01:54:19.411 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/4 2024-09-16T01:54:19.628 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-16T01:54:19.653 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): libcephsqlite-17.2.7-1633.g6d025bc2.el9. 678 kB/s | 163 kB 00:00 2024-09-16T01:54:19.678 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T01:54:20.937 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): ceph-test-17.2.7-1633.g6d025bc2.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-16T01:54:20.939 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:20.940 INFO:teuthology.orchestra.run.smithi165.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-16T01:54:20.968 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:54:20.988 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:54:20.988 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:54:21.355 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:54:21.355 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:54:21.894 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:54:21.964 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T01:54:22.011 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T01:54:22.047 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/4 2024-09-16T01:54:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/4 2024-09-16T01:54:23.851 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/4 2024-09-16T01:54:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/4 2024-09-16T01:54:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/4 2024-09-16T01:54:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/4 2024-09-16T01:54:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T01:54:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T01:54:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:26.362 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:26.443 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/4 2024-09-16T01:54:26.528 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/4 2024-09-16T01:54:26.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph 2024-09-16T01:54:27.226 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:38 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:27.371 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 6.5 k 2024-09-16T01:54:27.373 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 2.1 M 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 1.4 M 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 240 k 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 3.9 M 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 15 M 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:54:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:54:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi110.stdout:Install 34 Packages 2024-09-16T01:54:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:27.378 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 27 M 2024-09-16T01:54:27.378 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 96 M 2024-09-16T01:54:27.378 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:54:27.836 INFO:teuthology.orchestra.run.smithi110.stdout:(1/34): ceph-17.2.7-1633.g6d025bc2.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-16T01:54:28.403 INFO:teuthology.orchestra.run.smithi110.stdout:(2/34): ceph-mon-17.2.7-1633.g6d025bc2.el9.x86_ 6.9 MB/s | 3.9 MB 00:00 2024-09-16T01:54:28.445 INFO:teuthology.orchestra.run.smithi110.stdout:(3/34): ceph-mgr-17.2.7-1633.g6d025bc2.el9.x86_ 1.7 MB/s | 1.4 MB 00:00 2024-09-16T01:54:28.520 INFO:teuthology.orchestra.run.smithi110.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1633.g6d02 3.1 MB/s | 240 kB 00:00 2024-09-16T01:54:28.562 INFO:teuthology.orchestra.run.smithi110.stdout:(5/34): ceph-mds-17.2.7-1633.g6d025bc2.el9.x86_ 2.2 MB/s | 2.1 MB 00:00 2024-09-16T01:54:28.704 INFO:teuthology.orchestra.run.smithi110.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-16T01:54:28.746 INFO:teuthology.orchestra.run.smithi110.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T01:54:28.780 INFO:teuthology.orchestra.run.smithi110.stdout:(8/34): python3-cryptography-36.0.1-4.el9.x86_6 5.6 MB/s | 1.2 MB 00:00 2024-09-16T01:54:28.780 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/4 2024-09-16T01:54:28.780 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/4 2024-09-16T01:54:28.781 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/4 2024-09-16T01:54:28.781 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T01:54:28.796 INFO:teuthology.orchestra.run.smithi110.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T01:54:28.822 INFO:teuthology.orchestra.run.smithi110.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 2.9 MB/s | 125 kB 00:00 2024-09-16T01:54:28.847 INFO:teuthology.orchestra.run.smithi110.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-16T01:54:29.125 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:29.126 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:29.131 INFO:teuthology.orchestra.run.smithi110.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 123 kB/s | 35 kB 00:00 2024-09-16T01:54:29.290 INFO:teuthology.orchestra.run.smithi110.stdout:(13/34): ceph-osd-17.2.7-1633.g6d025bc2.el9.x86 17 MB/s | 15 MB 00:00 2024-09-16T01:54:29.365 INFO:teuthology.orchestra.run.smithi110.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 317 kB/s | 172 kB 00:00 2024-09-16T01:54:29.415 INFO:teuthology.orchestra.run.smithi110.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 272 kB/s | 77 kB 00:00 2024-09-16T01:54:29.426 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph 2024-09-16T01:54:29.457 INFO:teuthology.orchestra.run.smithi110.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-16T01:54:29.482 INFO:teuthology.orchestra.run.smithi110.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 355 kB/s | 42 kB 00:00 2024-09-16T01:54:29.516 INFO:teuthology.orchestra.run.smithi110.stdout:(18/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-16T01:54:29.541 INFO:teuthology.orchestra.run.smithi110.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 457 kB/s | 11 kB 00:00 2024-09-16T01:54:29.566 INFO:teuthology.orchestra.run.smithi110.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 706 kB/s | 18 kB 00:00 2024-09-16T01:54:29.591 INFO:teuthology.orchestra.run.smithi110.stdout:(21/34): python3-jaraco-collections-3.0.0-8.el9 929 kB/s | 23 kB 00:00 2024-09-16T01:54:29.617 INFO:teuthology.orchestra.run.smithi110.stdout:(22/34): python3-cherrypy-18.6.1-2.el9.noarch.r 2.6 MB/s | 358 kB 00:00 2024-09-16T01:54:29.642 INFO:teuthology.orchestra.run.smithi110.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-16T01:54:29.667 INFO:teuthology.orchestra.run.smithi110.stdout:(24/34): python3-pytz-2021.1-5.el9.noarch.rpm 135 kB/s | 51 kB 00:00 2024-09-16T01:54:29.693 INFO:teuthology.orchestra.run.smithi110.stdout:(25/34): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-16T01:54:29.726 INFO:teuthology.orchestra.run.smithi110.stdout:(26/34): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-09-16T01:54:29.752 INFO:teuthology.orchestra.run.smithi110.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 707 kB/s | 16 kB 00:00 2024-09-16T01:54:29.777 INFO:teuthology.orchestra.run.smithi110.stdout:(28/34): python3-more-itertools-8.12.0-2.el9.no 722 kB/s | 79 kB 00:00 2024-09-16T01:54:29.802 INFO:teuthology.orchestra.run.smithi110.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-16T01:54:29.827 INFO:teuthology.orchestra.run.smithi110.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-16T01:54:29.853 INFO:teuthology.orchestra.run.smithi110.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-16T01:54:29.887 INFO:teuthology.orchestra.run.smithi110.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-16T01:54:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 339 kB/s | 20 kB 00:00 2024-09-16T01:54:29.937 INFO:teuthology.orchestra.run.smithi110.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-16T01:54:29.942 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:29.942 INFO:teuthology.orchestra.run.smithi110.stdout:Total 11 MB/s | 27 MB 00:02 2024-09-16T01:54:29.994 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:40 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:30.070 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:54:30.108 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:54:30.108 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:54:30.133 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 6.5 k 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:54:30.136 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 2.1 M 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 1.4 M 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 240 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 3.9 M 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 15 M 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections 2024-09-16T01:54:30.137 INFO:teuthology.orchestra.run.smithi165.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:54:30.138 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout:Install 34 Packages 2024-09-16T01:54:30.139 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:30.140 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 27 M 2024-09-16T01:54:30.140 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 96 M 2024-09-16T01:54:30.140 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:54:30.509 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:54:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:54:30.938 INFO:teuthology.orchestra.run.smithi165.stdout:(1/34): ceph-17.2.7-1633.g6d025bc2.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-16T01:54:31.180 INFO:teuthology.orchestra.run.smithi165.stdout:(2/34): ceph-mds-17.2.7-1633.g6d025bc2.el9.x86_ 5.6 MB/s | 2.1 MB 00:00 2024-09-16T01:54:31.214 INFO:teuthology.orchestra.run.smithi165.stdout:(3/34): ceph-mgr-17.2.7-1633.g6d025bc2.el9.x86_ 3.5 MB/s | 1.4 MB 00:00 2024-09-16T01:54:31.297 INFO:teuthology.orchestra.run.smithi165.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1633.g6d02 2.8 MB/s | 240 kB 00:00 2024-09-16T01:54:31.423 INFO:teuthology.orchestra.run.smithi165.stdout:(5/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-16T01:54:31.531 INFO:teuthology.orchestra.run.smithi165.stdout:(6/34): ceph-mon-17.2.7-1633.g6d025bc2.el9.x86_ 6.6 MB/s | 3.9 MB 00:00 2024-09-16T01:54:31.582 INFO:teuthology.orchestra.run.smithi165.stdout:(7/34): python3-cryptography-36.0.1-4.el9.x86_6 7.7 MB/s | 1.2 MB 00:00 2024-09-16T01:54:31.757 INFO:teuthology.orchestra.run.smithi165.stdout:(8/34): ceph-osd-17.2.7-1633.g6d025bc2.el9.x86_ 27 MB/s | 15 MB 00:00 2024-09-16T01:54:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:54:31.782 INFO:teuthology.orchestra.run.smithi165.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 675 kB/s | 135 kB 00:00 2024-09-16T01:54:31.808 INFO:teuthology.orchestra.run.smithi165.stdout:(10/34): python3-ply-3.11-14.el9.noarch.rpm 386 kB/s | 106 kB 00:00 2024-09-16T01:54:31.832 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-16T01:54:31.865 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-16T01:54:31.883 INFO:teuthology.orchestra.run.smithi165.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 997 kB/s | 125 kB 00:00 2024-09-16T01:54:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-16T01:54:31.933 INFO:teuthology.orchestra.run.smithi165.stdout:(12/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.4 MB/s | 215 kB 00:00 2024-09-16T01:54:31.967 INFO:teuthology.orchestra.run.smithi165.stdout:(13/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-16T01:54:31.990 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-16T01:54:32.009 INFO:teuthology.orchestra.run.smithi165.stdout:(14/34): python3-markupsafe-1.1.1-12.el9.x86_64 277 kB/s | 35 kB 00:00 2024-09-16T01:54:32.034 INFO:teuthology.orchestra.run.smithi165.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-09-16T01:54:32.062 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-16T01:54:32.076 INFO:teuthology.orchestra.run.smithi165.stdout:(16/34): python3-packaging-20.9-5.el9.noarch.rp 541 kB/s | 77 kB 00:00 2024-09-16T01:54:32.103 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-16T01:54:32.111 INFO:teuthology.orchestra.run.smithi165.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-09-16T01:54:32.146 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-16T01:54:32.152 INFO:teuthology.orchestra.run.smithi165.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 370 kB/s | 43 kB 00:00 2024-09-16T01:54:32.185 INFO:teuthology.orchestra.run.smithi165.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 436 kB/s | 11 kB 00:00 2024-09-16T01:54:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-16T01:54:32.219 INFO:teuthology.orchestra.run.smithi165.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-16T01:54:32.232 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-16T01:54:32.244 INFO:teuthology.orchestra.run.smithi165.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 310 kB/s | 18 kB 00:00 2024-09-16T01:54:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-16T01:54:32.270 INFO:teuthology.orchestra.run.smithi165.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-16T01:54:32.295 INFO:teuthology.orchestra.run.smithi165.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-16T01:54:32.311 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-16T01:54:32.320 INFO:teuthology.orchestra.run.smithi165.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-16T01:54:32.346 INFO:teuthology.orchestra.run.smithi165.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 918 kB/s | 46 kB 00:00 2024-09-16T01:54:32.364 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-16T01:54:32.371 INFO:teuthology.orchestra.run.smithi165.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T01:54:32.396 INFO:teuthology.orchestra.run.smithi165.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-16T01:54:32.400 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-16T01:54:32.430 INFO:teuthology.orchestra.run.smithi165.stdout:(28/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-09-16T01:54:32.455 INFO:teuthology.orchestra.run.smithi165.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-16T01:54:32.456 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-16T01:54:32.480 INFO:teuthology.orchestra.run.smithi165.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-16T01:54:32.493 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-16T01:54:32.514 INFO:teuthology.orchestra.run.smithi165.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-16T01:54:32.548 INFO:teuthology.orchestra.run.smithi165.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-16T01:54:32.566 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-16T01:54:32.573 INFO:teuthology.orchestra.run.smithi165.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 340 kB/s | 20 kB 00:00 2024-09-16T01:54:32.615 INFO:teuthology.orchestra.run.smithi165.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-09-16T01:54:32.619 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:32.619 INFO:teuthology.orchestra.run.smithi165.stdout:Total 11 MB/s | 27 MB 00:02 2024-09-16T01:54:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-16T01:54:32.749 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:54:32.785 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-16T01:54:32.787 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:54:32.787 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:54:32.838 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-16T01:54:32.877 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-16T01:54:32.933 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-16T01:54:32.989 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-16T01:54:33.174 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-16T01:54:33.180 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:54:33.181 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:54:33.223 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-16T01:54:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-16T01:54:33.389 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-16T01:54:33.434 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-16T01:54:33.550 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-16T01:54:33.710 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1633.g6d025bc2.el9. 29/34 2024-09-16T01:54:33.739 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 30/34 2024-09-16T01:54:33.765 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 30/34 2024-09-16T01:54:33.765 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:33.765 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:54:33.765 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:54:33.766 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:54:33.766 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:34.442 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:54:34.505 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-16T01:54:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-16T01:54:34.579 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-16T01:54:34.671 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-16T01:54:34.749 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-16T01:54:34.790 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-16T01:54:34.825 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-16T01:54:34.855 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-16T01:54:34.890 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-16T01:54:34.923 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-16T01:54:34.964 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-16T01:54:35.007 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-16T01:54:35.042 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-16T01:54:35.065 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 31/34 2024-09-16T01:54:35.090 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-16T01:54:35.093 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 31/34 2024-09-16T01:54:35.093 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:35.093 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:54:35.093 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:54:35.093 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:54:35.093 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:35.131 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-16T01:54:35.235 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-16T01:54:35.394 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-16T01:54:35.466 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 32/34 2024-09-16T01:54:35.473 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-16T01:54:35.490 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 32/34 2024-09-16T01:54:35.490 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:35.490 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:54:35.490 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:54:35.490 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:54:35.490 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:35.526 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-16T01:54:35.572 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-16T01:54:35.629 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-16T01:54:35.686 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-16T01:54:35.692 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 33/34 2024-09-16T01:54:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 33/34 2024-09-16T01:54:35.715 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:35.715 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:54:35.716 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:54:35.716 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:54:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 34/34 2024-09-16T01:54:35.881 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-16T01:54:35.934 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-16T01:54:36.012 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-16T01:54:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-16T01:54:36.168 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-16T01:54:36.290 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-16T01:54:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1633.g6d025bc2.el9. 29/34 2024-09-16T01:54:36.476 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 30/34 2024-09-16T01:54:36.502 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 30/34 2024-09-16T01:54:36.502 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:36.502 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:54:36.502 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:54:36.503 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:54:36.503 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:37.523 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 34/34 2024-09-16T01:54:37.523 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/34 2024-09-16T01:54:37.523 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/34 2024-09-16T01:54:37.523 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/34 2024-09-16T01:54:37.523 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 5/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1633.g6d025bc2.el9. 6/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-16T01:54:37.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-16T01:54:37.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-16T01:54:37.526 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-16T01:54:37.526 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-16T01:54:37.526 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-16T01:54:37.526 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-16T01:54:37.526 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-16T01:54:37.527 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-16T01:54:37.527 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-16T01:54:37.527 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-16T01:54:37.820 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 31/34 2024-09-16T01:54:37.848 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 31/34 2024-09-16T01:54:37.848 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:37.849 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:54:37.849 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:54:37.849 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:54:37.849 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:38.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 32/34 2024-09-16T01:54:38.262 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 32/34 2024-09-16T01:54:38.262 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:38.262 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:54:38.263 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:54:38.263 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:54:38.263 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:38.471 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 33/34 2024-09-16T01:54:38.495 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 33/34 2024-09-16T01:54:38.495 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:38.496 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:54:38.496 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:54:38.496 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:54:38.496 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:38.504 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-16T01:54:38.504 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:38.504 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:54:38.504 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:38.504 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:38.504 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:54:38.505 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:54:38.506 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:54:38.507 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:54:38.508 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:54:38.509 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:38.509 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:38.562 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 34/34 2024-09-16T01:54:38.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-base 2024-09-16T01:54:39.544 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:50 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:39.634 INFO:teuthology.orchestra.run.smithi110.stdout:Package ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:54:39.676 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:39.677 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:54:39.677 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:39.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install cephadm 2024-09-16T01:54:40.319 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:51 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:40.329 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 34/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 3/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 4/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 5/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1633.g6d025bc2.el9. 6/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-16T01:54:40.330 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-16T01:54:40.331 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-16T01:54:40.332 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-16T01:54:40.450 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 83 k 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:54:40.451 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:40.452 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 83 k 2024-09-16T01:54:40.452 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 375 k 2024-09-16T01:54:40.452 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:54:40.649 INFO:teuthology.orchestra.run.smithi110.stdout:cephadm-17.2.7-1633.g6d025bc2.el9.noarch.rpm 419 kB/s | 83 kB 00:00 2024-09-16T01:54:40.649 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:40.650 INFO:teuthology.orchestra.run.smithi110.stdout:Total 416 kB/s | 83 kB 00:00 2024-09-16T01:54:40.650 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:54:40.655 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:54:40.655 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:54:40.657 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:54:40.657 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:54:40.729 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:54:41.182 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:41.413 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:54:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:54:41.415 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:41.416 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:41.628 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:41.801 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-base 2024-09-16T01:54:41.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:41.865 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:41.865 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:54:41.866 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:41.866 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:41.866 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:42.124 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T01:54:42.372 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:53 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:42.464 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-base-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:54:42.507 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:42.507 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:54:42.508 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:42.580 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install cephadm 2024-09-16T01:54:42.704 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:53 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:42.837 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:42.838 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T01:54:42.838 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 137 k 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 137 k 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 379 k 2024-09-16T01:54:42.839 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:54:43.047 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-immutable-object-cache-17.2.7-1633.g6d025b 657 kB/s | 137 kB 00:00 2024-09-16T01:54:43.048 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:43.048 INFO:teuthology.orchestra.run.smithi110.stdout:Total 653 kB/s | 137 kB 00:00 2024-09-16T01:54:43.049 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:54:43.056 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:54:43.056 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:54:43.112 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:54:43.112 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:54:43.145 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:54 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:43.266 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:54:43.277 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:43.277 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 83 k 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:54:43.278 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:43.279 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 83 k 2024-09-16T01:54:43.279 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 375 k 2024-09-16T01:54:43.279 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:54:43.357 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2. 1/1 2024-09-16T01:54:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2. 1/1 2024-09-16T01:54:43.383 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:43.383 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:54:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:43.471 INFO:teuthology.orchestra.run.smithi165.stdout:cephadm-17.2.7-1633.g6d025bc2.el9.noarch.rpm 432 kB/s | 83 kB 00:00 2024-09-16T01:54:43.472 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:43.472 INFO:teuthology.orchestra.run.smithi165.stdout:Total 428 kB/s | 83 kB 00:00 2024-09-16T01:54:43.472 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:54:43.477 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:54:43.477 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:54:43.479 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:54:43.479 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:54:43.548 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:54:44.021 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:44.124 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:44.323 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2. 1/1 2024-09-16T01:54:44.323 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:44.323 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:54:44.323 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:44.323 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:44.323 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:44.448 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:44.535 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr 2024-09-16T01:54:44.697 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/1 2024-09-16T01:54:44.697 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:44.697 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:54:44.697 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:44.697 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:44.697 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:44.909 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T01:54:45.097 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:56 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:45.190 INFO:teuthology.orchestra.run.smithi110.stdout:Package ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:54:45.231 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:45.232 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:54:45.232 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:45.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T01:54:45.489 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:56 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:45.625 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:45.625 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 137 k 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:54:45.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:45.627 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 137 k 2024-09-16T01:54:45.627 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 379 k 2024-09-16T01:54:45.627 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:54:45.829 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-immutable-object-cache-17.2.7-1633.g6d025b 682 kB/s | 137 kB 00:00 2024-09-16T01:54:45.830 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:45.830 INFO:teuthology.orchestra.run.smithi165.stdout:Total 676 kB/s | 137 kB 00:00 2024-09-16T01:54:45.830 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:54:45.837 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:54:45.838 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:54:45.865 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:56 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:45.896 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:54:45.897 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:54:46.000 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 3.4 M 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 24 k 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 15 k 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:54:46.001 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout:Install 7 Packages 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:46.002 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 3.7 M 2024-09-16T01:54:46.003 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 80 M 2024-09-16T01:54:46.003 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:54:46.045 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:54:46.121 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2. 1/1 2024-09-16T01:54:46.147 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2. 1/1 2024-09-16T01:54:46.147 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:54:46.147 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:54:46.147 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:46.310 INFO:teuthology.orchestra.run.smithi110.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1633.g6d0 161 kB/s | 24 kB 00:00 2024-09-16T01:54:46.336 INFO:teuthology.orchestra.run.smithi110.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1633.g6d02 82 kB/s | 15 kB 00:00 2024-09-16T01:54:46.377 INFO:teuthology.orchestra.run.smithi110.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-16T01:54:46.403 INFO:teuthology.orchestra.run.smithi110.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-16T01:54:46.428 INFO:teuthology.orchestra.run.smithi110.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-16T01:54:46.461 INFO:teuthology.orchestra.run.smithi110.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-16T01:54:46.561 INFO:teuthology.orchestra.run.smithi110.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1633.g6d025bc2 8.3 MB/s | 3.4 MB 00:00 2024-09-16T01:54:46.565 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:46.565 INFO:teuthology.orchestra.run.smithi110.stdout:Total 6.5 MB/s | 3.7 MB 00:00 2024-09-16T01:54:46.565 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:54:46.573 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:54:46.573 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:54:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:54:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:54:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:54:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-16T01:54:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2. 1/1 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-16T01:54:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-16T01:54:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1633.g6d025bc2.el9.n 5/7 2024-09-16T01:54:47.324 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr 2024-09-16T01:54:47.905 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:58 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:47.998 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-mgr-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:54:48.040 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:48.041 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:54:48.041 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:48.118 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T01:54:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1633.g6d025bc2.el9. 6/7 2024-09-16T01:54:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarc 7/7 2024-09-16T01:54:48.682 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:59 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:48.831 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 3.4 M 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 24 k 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 15 k 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:54:48.832 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout:Install 7 Packages 2024-09-16T01:54:48.833 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:48.834 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 3.7 M 2024-09-16T01:54:48.834 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 80 M 2024-09-16T01:54:48.834 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:54:49.359 INFO:teuthology.orchestra.run.smithi165.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1633.g6d0 159 kB/s | 24 kB 00:00 2024-09-16T01:54:49.384 INFO:teuthology.orchestra.run.smithi165.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1633.g6d02 81 kB/s | 15 kB 00:00 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarc 7/7 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1633.g6d025bc2.el9. 1/7 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarc 2/7 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1633.g6d025bc2.el9.n 3/7 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-16T01:54:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-16T01:54:49.434 INFO:teuthology.orchestra.run.smithi165.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 121 kB/s | 9.0 kB 00:00 2024-09-16T01:54:49.459 INFO:teuthology.orchestra.run.smithi165.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-16T01:54:49.485 INFO:teuthology.orchestra.run.smithi165.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 406 kB/s | 41 kB 00:00 2024-09-16T01:54:49.518 INFO:teuthology.orchestra.run.smithi165.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-16T01:54:49.635 INFO:teuthology.orchestra.run.smithi165.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1633.g6d025bc2 7.8 MB/s | 3.4 MB 00:00 2024-09-16T01:54:49.638 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:49.639 INFO:teuthology.orchestra.run.smithi165.stdout:Total 4.5 MB/s | 3.7 MB 00:00 2024-09-16T01:54:49.639 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:54:49.648 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:54:49.648 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:54:49.680 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:49.681 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:54:49.726 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:54:49.726 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:54:49.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T01:54:50.036 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:54:50.103 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-16T01:54:50.137 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-16T01:54:50.183 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-16T01:54:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-16T01:54:50.244 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1633.g6d025bc2.el9.n 5/7 2024-09-16T01:54:50.468 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:01 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:50.600 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:54:50.601 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-09-16T01:54:50.601 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:54:50.601 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-09-16T01:54:50.601 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 7.4 M 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:54:50.602 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout:Install 12 Packages 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:54:50.603 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 38 M 2024-09-16T01:54:50.604 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 212 M 2024-09-16T01:54:50.604 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:54:50.896 INFO:teuthology.orchestra.run.smithi110.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 953 kB/s | 191 kB 00:00 2024-09-16T01:54:50.996 INFO:teuthology.orchestra.run.smithi110.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-16T01:54:51.012 INFO:teuthology.orchestra.run.smithi110.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-16T01:54:51.055 INFO:teuthology.orchestra.run.smithi110.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-09-16T01:54:51.172 INFO:teuthology.orchestra.run.smithi110.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-16 15 MB/s | 7.4 MB 00:00 2024-09-16T01:54:51.188 INFO:teuthology.orchestra.run.smithi110.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-16T01:54:51.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1633.g6d025bc2.el9. 6/7 2024-09-16T01:54:51.273 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarc 7/7 2024-09-16T01:54:51.305 INFO:teuthology.orchestra.run.smithi110.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-16T01:54:51.398 INFO:teuthology.orchestra.run.smithi110.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.4 MB/s | 3.0 MB 00:00 2024-09-16T01:54:51.464 INFO:teuthology.orchestra.run.smithi110.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-09-16T01:54:51.598 INFO:teuthology.orchestra.run.smithi110.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-16T01:54:51.674 INFO:teuthology.orchestra.run.smithi110.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.8 MB/s | 4.9 MB 00:00 2024-09-16T01:54:52.007 INFO:teuthology.orchestra.run.smithi110.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-16T01:54:52.008 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:52.008 INFO:teuthology.orchestra.run.smithi110.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarc 7/7 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1633.g6d025bc2.el9. 1/7 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarc 2/7 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1633.g6d025bc2.el9.n 3/7 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-16T01:54:52.322 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-16T01:54:52.359 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:54:52.386 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:54:52.386 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:54:52.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-16T01:54:52.600 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:52.601 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:54:52.809 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T01:54:52.886 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:54:52.887 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:54:53.373 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:04 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:54:53.505 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 7.4 M 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:54:53.506 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-16T01:54:53.507 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-16T01:54:53.508 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:54:53.508 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 38 M 2024-09-16T01:54:53.508 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 212 M 2024-09-16T01:54:53.508 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:54:53.638 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:54:53.712 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T01:54:53.755 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T01:54:53.855 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T01:54:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T01:54:54.027 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-16T01:54:54.075 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T01:54:54.097 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T01:54:54.127 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-16T01:54:54.153 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 262 kB/s | 33 kB 00:00 2024-09-16T01:54:54.182 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T01:54:54.203 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-16T01:54:54.253 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-16T01:54:54.295 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-16T01:54:54.479 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.5 MB/s | 3.0 MB 00:00 2024-09-16T01:54:54.596 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-16T01:54:54.621 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 752 kB/s | 245 kB 00:00 2024-09-16T01:54:54.655 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.2 MB/s | 250 kB 00:00 2024-09-16T01:54:54.738 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-16T01:54:54.837 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T01:54:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T01:54:55.814 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-16T01:54:55.814 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:54:55.814 INFO:teuthology.orchestra.run.smithi165.stdout:Total 17 MB/s | 38 MB 00:02 2024-09-16T01:54:56.164 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:54:56.190 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:54:56.190 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:54:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T01:54:56.713 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:54:56.713 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:54:57.254 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T01:54:57.281 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025 12/12 2024-09-16T01:54:57.468 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:54:57.549 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T01:54:57.595 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T01:54:57.702 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T01:54:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T01:54:57.933 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T01:54:57.979 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T01:54:58.056 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T01:54:58.722 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T01:54:58.861 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025 12/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025 1/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T01:54:59.865 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T01:54:59.866 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T01:54:59.866 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T01:54:59.866 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T01:55:00.118 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T01:55:00.322 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T01:55:00.322 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:00.322 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:55:00.323 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:55:00.324 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:00.324 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:00.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-rook 2024-09-16T01:55:01.149 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T01:55:01.179 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025 12/12 2024-09-16T01:55:01.313 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:12 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:01.453 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 47 k 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:55:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:55:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:01.456 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:01.456 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:01.456 INFO:teuthology.orchestra.run.smithi110.stdout:Install 13 Packages 2024-09-16T01:55:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:01.456 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 2.2 M 2024-09-16T01:55:01.456 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 26 M 2024-09-16T01:55:01.457 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:01.699 INFO:teuthology.orchestra.run.smithi110.stdout:(1/13): ceph-mgr-rook-17.2.7-1633.g6d025bc2.el9 293 kB/s | 47 kB 00:00 2024-09-16T01:55:02.050 INFO:teuthology.orchestra.run.smithi110.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 37 kB/s | 19 kB 00:00 2024-09-16T01:55:02.100 INFO:teuthology.orchestra.run.smithi110.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-16T01:55:02.459 INFO:teuthology.orchestra.run.smithi110.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 293 kB/s | 222 kB 00:00 2024-09-16T01:55:02.751 INFO:teuthology.orchestra.run.smithi110.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-16T01:55:02.792 INFO:teuthology.orchestra.run.smithi110.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 789 kB/s | 32 kB 00:00 2024-09-16T01:55:02.809 INFO:teuthology.orchestra.run.smithi110.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 843 kB/s | 14 kB 00:00 2024-09-16T01:55:02.835 INFO:teuthology.orchestra.run.smithi110.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.6 MB/s | 220 kB 00:00 2024-09-16T01:55:02.894 INFO:teuthology.orchestra.run.smithi110.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 351 kB/s | 279 kB 00:00 2024-09-16T01:55:02.927 INFO:teuthology.orchestra.run.smithi110.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 11 MB/s | 1.0 MB 00:00 2024-09-16T01:55:02.961 INFO:teuthology.orchestra.run.smithi110.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.3 MB/s | 90 kB 00:00 2024-09-16T01:55:02.978 INFO:teuthology.orchestra.run.smithi110.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-16T01:55:03.078 INFO:teuthology.orchestra.run.smithi110.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 87 kB/s | 54 kB 00:00 2024-09-16T01:55:03.081 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:03.081 INFO:teuthology.orchestra.run.smithi110.stdout:Total 1.4 MB/s | 2.2 MB 00:01 2024-09-16T01:55:03.143 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:03.159 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:03.159 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:03.246 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:03.248 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:03.753 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025 12/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025 1/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T01:55:03.825 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T01:55:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T01:55:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T01:55:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T01:55:03.826 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T01:55:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T01:55:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T01:55:04.036 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T01:55:04.072 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T01:55:04.114 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T01:55:04.216 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T01:55:04.283 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:55:04.284 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:55:04.285 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:55:04.285 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:55:04.285 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:04.285 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:04.325 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T01:55:04.374 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T01:55:04.657 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-rook 2024-09-16T01:55:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T01:55:05.154 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T01:55:05.189 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T01:55:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T01:55:05.239 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:16 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 13/13 2024-09-16T01:55:05.372 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 47 k 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:55:05.374 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout:Install 13 Packages 2024-09-16T01:55:05.375 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:05.376 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.2 M 2024-09-16T01:55:05.376 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 26 M 2024-09-16T01:55:05.376 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:05.905 INFO:teuthology.orchestra.run.smithi165.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 188 kB/s | 19 kB 00:00 2024-09-16T01:55:05.930 INFO:teuthology.orchestra.run.smithi165.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 202 kB/s | 26 kB 00:00 2024-09-16T01:55:05.955 INFO:teuthology.orchestra.run.smithi165.stdout:(3/13): ceph-mgr-rook-17.2.7-1633.g6d025bc2.el9 312 kB/s | 47 kB 00:00 2024-09-16T01:55:06.031 INFO:teuthology.orchestra.run.smithi165.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 13/13 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 1/13 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T01:55:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T01:55:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T01:55:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T01:55:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T01:55:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T01:55:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T01:55:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T01:55:06.056 INFO:teuthology.orchestra.run.smithi165.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-16T01:55:06.081 INFO:teuthology.orchestra.run.smithi165.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-16T01:55:06.123 INFO:teuthology.orchestra.run.smithi165.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-16T01:55:06.149 INFO:teuthology.orchestra.run.smithi165.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-16T01:55:06.174 INFO:teuthology.orchestra.run.smithi165.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-16T01:55:06.207 INFO:teuthology.orchestra.run.smithi165.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-16T01:55:06.233 INFO:teuthology.orchestra.run.smithi165.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-16T01:55:06.258 INFO:teuthology.orchestra.run.smithi165.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-16T01:55:06.325 INFO:teuthology.orchestra.run.smithi165.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-16T01:55:06.328 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:06.328 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-16T01:55:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T01:55:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:55:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:55:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:55:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:55:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:55:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:55:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:55:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:06.394 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:06.409 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:06.409 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:06.496 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:06.497 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:06.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T01:55:07.029 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:07.202 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:18 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:07.206 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T01:55:07.268 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T01:55:07.323 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T01:55:07.335 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:07.335 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:07.335 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:55:07.335 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 124 k 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout:Install 6 Packages 2024-09-16T01:55:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:07.337 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 7.0 M 2024-09-16T01:55:07.337 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 33 M 2024-09-16T01:55:07.337 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:07.361 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T01:55:07.402 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T01:55:07.513 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T01:55:07.623 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T01:55:07.680 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T01:55:07.998 INFO:teuthology.orchestra.run.smithi110.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1633.g6d025bc2.e 568 kB/s | 124 kB 00:00 2024-09-16T01:55:08.023 INFO:teuthology.orchestra.run.smithi110.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-16T01:55:08.074 INFO:teuthology.orchestra.run.smithi110.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-16T01:55:08.099 INFO:teuthology.orchestra.run.smithi110.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 765 kB/s | 58 kB 00:00 2024-09-16T01:55:08.124 INFO:teuthology.orchestra.run.smithi110.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-16T01:55:08.393 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T01:55:08.452 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T01:55:08.486 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T01:55:08.531 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T01:55:08.555 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 13/13 2024-09-16T01:55:08.783 INFO:teuthology.orchestra.run.smithi110.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-09-16T01:55:08.785 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:08.785 INFO:teuthology.orchestra.run.smithi110.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-16T01:55:08.856 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:08.867 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:08.867 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:08.965 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:08.966 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:09.379 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 13/13 2024-09-16T01:55:09.379 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 1/13 2024-09-16T01:55:09.379 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T01:55:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T01:55:09.429 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T01:55:09.476 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T01:55:09.723 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T01:55:09.723 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:09.723 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:09.723 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:55:09.723 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:55:09.723 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:09.724 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:09.977 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T01:55:09.992 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T01:55:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T01:55:10.142 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T01:55:10.172 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 6/6 2024-09-16T01:55:10.558 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:21 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:10.691 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1633.g6d025bc2.el9 ceph-noarch 124 k 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:55:10.692 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:55:10.693 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:55:10.693 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:10.693 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:10.693 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:10.693 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2024-09-16T01:55:10.693 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:10.694 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 7.0 M 2024-09-16T01:55:10.694 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 33 M 2024-09-16T01:55:10.694 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:10.904 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-16T01:55:10.933 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 6/6 2024-09-16T01:55:10.933 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/6 2024-09-16T01:55:10.933 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T01:55:10.933 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T01:55:10.933 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T01:55:10.934 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T01:55:10.962 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T01:55:10.988 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): ceph-mgr-cephadm-17.2.7-1633.g6d025bc2.e 579 kB/s | 124 kB 00:00 2024-09-16T01:55:11.013 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T01:55:11.055 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-16T01:55:11.122 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-16T01:55:11.124 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:11.124 INFO:teuthology.orchestra.run.smithi165.stdout:Total 16 MB/s | 7.0 MB 00:00 2024-09-16T01:55:11.195 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:11.203 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:11.206 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:11.206 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:11.305 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:11.305 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:11.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-fuse 2024-09-16T01:55:11.610 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:11.779 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T01:55:11.823 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T01:55:12.031 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:23 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:12.165 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:12.166 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:12.166 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T01:55:12.166 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:12.166 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 814 k 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:12.167 INFO:teuthology.orchestra.run.smithi110.stdout:Install 2 Packages 2024-09-16T01:55:12.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:12.168 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 893 k 2024-09-16T01:55:12.168 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 2.6 M 2024-09-16T01:55:12.168 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:12.353 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T01:55:12.377 INFO:teuthology.orchestra.run.smithi110.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 490 kB/s | 80 kB 00:00 2024-09-16T01:55:12.451 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T01:55:12.494 INFO:teuthology.orchestra.run.smithi110.stdout:(2/2): ceph-fuse-17.2.7-1633.g6d025bc2.el9.x86_ 2.8 MB/s | 814 kB 00:00 2024-09-16T01:55:12.495 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:12.495 INFO:teuthology.orchestra.run.smithi110.stdout:Total 2.7 MB/s | 893 kB 00:00 2024-09-16T01:55:12.506 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:12.507 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T01:55:12.527 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:12.527 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:12.536 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 6/6 2024-09-16T01:55:12.605 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:12.605 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:12.789 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:12.928 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T01:55:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/2 2024-09-16T01:55:13.323 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 6/6 2024-09-16T01:55:13.323 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 1/6 2024-09-16T01:55:13.323 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T01:55:13.324 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T01:55:13.324 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T01:55:13.324 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:17.2.7-1633.g6d025bc2.el9.noarch 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:55:13.596 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:55:13.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:55:13.597 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:13.597 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/2 2024-09-16T01:55:13.622 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/2 2024-09-16T01:55:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T01:55:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:13.903 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T01:55:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:13.903 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:14.029 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-fuse 2024-09-16T01:55:14.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librados-devel 2024-09-16T01:55:14.599 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:14.730 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 814 k 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:55:14.731 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:14.732 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:14.732 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:14.732 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2024-09-16T01:55:14.732 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:14.732 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 893 k 2024-09-16T01:55:14.733 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 2.6 M 2024-09-16T01:55:14.733 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:14.796 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:14.932 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:14.932 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 126 k 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 126 k 2024-09-16T01:55:14.933 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 448 k 2024-09-16T01:55:14.934 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:15.142 INFO:teuthology.orchestra.run.smithi110.stdout:librados-devel-17.2.7-1633.g6d025bc2.el9.x86_64 606 kB/s | 126 kB 00:00 2024-09-16T01:55:15.142 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:15.142 INFO:teuthology.orchestra.run.smithi110.stdout:Total 603 kB/s | 126 kB 00:00 2024-09-16T01:55:15.143 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:15.148 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:15.148 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:15.191 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 440 kB/s | 80 kB 00:00 2024-09-16T01:55:15.213 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:15.213 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:15.308 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): ceph-fuse-17.2.7-1633.g6d025bc2.el9.x86_ 2.7 MB/s | 814 kB 00:00 2024-09-16T01:55:15.308 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:15.309 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.5 MB/s | 893 kB 00:00 2024-09-16T01:55:15.321 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:15.343 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:15.343 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:15.423 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:15.423 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:15.473 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:15.641 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:15.797 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T01:55:15.864 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/2 2024-09-16T01:55:15.888 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:16.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:16.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:16.154 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:16.154 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:16.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:16.155 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:16.410 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install libcephfs2 2024-09-16T01:55:16.592 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2/2 2024-09-16T01:55:16.592 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/2 2024-09-16T01:55:16.875 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T01:55:16.876 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:16.876 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:16.876 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T01:55:16.876 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:16.876 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:16.990 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:17.083 INFO:teuthology.orchestra.run.smithi110.stdout:Package libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:17.127 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:17.128 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:17.128 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:17.179 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados-devel 2024-09-16T01:55:17.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install libcephfs-devel 2024-09-16T01:55:17.765 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:17.777 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:17.900 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 126 k 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:17.901 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 126 k 2024-09-16T01:55:17.902 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 448 k 2024-09-16T01:55:17.902 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:17.910 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:17.910 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T01:55:17.910 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:17.910 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 25 k 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:17.911 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 25 k 2024-09-16T01:55:17.912 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 110 k 2024-09-16T01:55:17.912 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:18.063 INFO:teuthology.orchestra.run.smithi110.stdout:libcephfs-devel-17.2.7-1633.g6d025bc2.el9.x86_6 166 kB/s | 25 kB 00:00 2024-09-16T01:55:18.063 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:18.063 INFO:teuthology.orchestra.run.smithi110.stdout:Total 164 kB/s | 25 kB 00:00 2024-09-16T01:55:18.063 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:18.067 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:18.067 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:18.068 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:18.069 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:18.113 INFO:teuthology.orchestra.run.smithi165.stdout:librados-devel-17.2.7-1633.g6d025bc2.el9.x86_64 598 kB/s | 126 kB 00:00 2024-09-16T01:55:18.113 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:18.114 INFO:teuthology.orchestra.run.smithi165.stdout:Total 593 kB/s | 126 kB 00:00 2024-09-16T01:55:18.114 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:18.120 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:18.120 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:18.152 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:18.183 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:18.183 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:18.389 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:18.510 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:18.884 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:18.885 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:18.885 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:18.885 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:18.885 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:18.885 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:18.956 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:19.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librados2 2024-09-16T01:55:19.195 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:19.196 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:19.196 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:19.196 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:19.196 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:19.196 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:19.452 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs2 2024-09-16T01:55:19.649 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:19.740 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:19.782 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:19.783 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:19.783 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:19.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librbd1 2024-09-16T01:55:20.045 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:20.136 INFO:teuthology.orchestra.run.smithi165.stdout:Package libcephfs2-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:20.178 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:20.179 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:20.180 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:20.268 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs-devel 2024-09-16T01:55:20.418 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:20.508 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:20.551 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:20.551 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:20.552 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:20.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rados 2024-09-16T01:55:20.832 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:20.964 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:20.964 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:20.964 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 25 k 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 25 k 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 110 k 2024-09-16T01:55:20.965 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:21.109 INFO:teuthology.orchestra.run.smithi165.stdout:libcephfs-devel-17.2.7-1633.g6d025bc2.el9.x86_6 174 kB/s | 25 kB 00:00 2024-09-16T01:55:21.109 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:21.110 INFO:teuthology.orchestra.run.smithi165.stdout:Total 172 kB/s | 25 kB 00:00 2024-09-16T01:55:21.110 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:21.113 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:21.114 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:21.115 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:21.115 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:21.190 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:32 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:21.194 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:21.279 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:21.298 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:21.323 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:21.323 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:21.323 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:21.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rgw 2024-09-16T01:55:21.694 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:21.960 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:21.960 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:21.960 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:21.960 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:21.960 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:21.960 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:21.972 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:32 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:22.062 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:22.104 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:22.105 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:22.105 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:22.143 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados2 2024-09-16T01:55:22.185 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-cephfs 2024-09-16T01:55:22.712 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:22.746 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:22.801 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:22.834 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:22.843 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:22.844 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:22.844 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:22.881 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:22.882 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:22.882 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:22.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librbd1 2024-09-16T01:55:22.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rbd 2024-09-16T01:55:23.488 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:34 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:23.521 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:34 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:23.579 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:23.610 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:23.621 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:23.622 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:23.622 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:23.652 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:23.653 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T01:55:23.653 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:23.693 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rados 2024-09-16T01:55:23.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-fuse 2024-09-16T01:55:24.253 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:35 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:24.295 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:35 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:24.344 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rados-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:24.386 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:24.387 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:24.387 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:24.426 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:24.427 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:24.427 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-16T01:55:24.427 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:24.427 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:24.427 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 82 k 2024-09-16T01:55:24.427 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 82 k 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 222 k 2024-09-16T01:55:24.428 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:24.460 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rgw 2024-09-16T01:55:24.624 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-fuse-17.2.7-1633.g6d025bc2.el9.x86_64.rpm 415 kB/s | 82 kB 00:00 2024-09-16T01:55:24.625 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:24.625 INFO:teuthology.orchestra.run.smithi110.stdout:Total 412 kB/s | 82 kB 00:00 2024-09-16T01:55:24.625 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:24.632 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:24.632 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:24.695 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:24.695 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:24.839 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:25.025 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:25.112 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rgw-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:25.153 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:25.155 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:25.155 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:25.224 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-cephfs 2024-09-16T01:55:25.340 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:25.592 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:25.593 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:25.593 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:25.593 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:25.593 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:25.593 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:25.793 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:25.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-mirror 2024-09-16T01:55:25.883 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-cephfs-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:25.926 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:25.927 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:25.927 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:26.002 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rbd 2024-09-16T01:55:26.411 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:37 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:26.545 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 2.9 M 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:55:26.546 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:26.547 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 2.9 M 2024-09-16T01:55:26.547 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 12 M 2024-09-16T01:55:26.547 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:26.570 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:37 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:26.660 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 is already installed. 2024-09-16T01:55:26.703 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:26.704 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-16T01:55:26.704 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:26.785 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-fuse 2024-09-16T01:55:26.878 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-mirror-17.2.7-1633.g6d025bc2.el9.x86_64.rpm 8.9 MB/s | 2.9 MB 00:00 2024-09-16T01:55:26.879 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:26.879 INFO:teuthology.orchestra.run.smithi110.stdout:Total 8.8 MB/s | 2.9 MB 00:00 2024-09-16T01:55:26.879 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:26.888 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:26.888 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:26.967 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:26.968 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:27.352 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:38 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:27.454 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:27.480 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:27.480 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:55:27.480 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:55:27.481 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:55:27.481 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:55:27.481 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:27.484 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 82 k 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:27.485 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:27.486 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:27.486 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:55:27.486 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:27.486 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 82 k 2024-09-16T01:55:27.486 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 222 k 2024-09-16T01:55:27.486 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:27.671 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-fuse-17.2.7-1633.g6d025bc2.el9.x86_64.rpm 441 kB/s | 82 kB 00:00 2024-09-16T01:55:27.671 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:27.672 INFO:teuthology.orchestra.run.smithi165.stdout:Total 438 kB/s | 82 kB 00:00 2024-09-16T01:55:27.672 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:27.678 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:27.679 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:27.741 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:27.741 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:27.899 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:28.009 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:28.432 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:28.571 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:28.571 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:28.701 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:28.702 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:28.702 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:28.702 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:28.702 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:28.702 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:28.852 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-nbd 2024-09-16T01:55:28.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-mirror 2024-09-16T01:55:29.435 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:29.531 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:29.567 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T01:55:29.567 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 165 k 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 165 k 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 477 k 2024-09-16T01:55:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 2.9 M 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:29.666 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:29.667 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:29.667 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:55:29.667 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:29.667 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.9 M 2024-09-16T01:55:29.667 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 12 M 2024-09-16T01:55:29.667 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:29.775 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-nbd-17.2.7-1633.g6d025bc2.el9.x86_64.rpm 798 kB/s | 165 kB 00:00 2024-09-16T01:55:29.775 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:29.776 INFO:teuthology.orchestra.run.smithi110.stdout:Total 793 kB/s | 165 kB 00:00 2024-09-16T01:55:29.776 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T01:55:29.784 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T01:55:29.784 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T01:55:29.847 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T01:55:29.847 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T01:55:29.983 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-mirror-17.2.7-1633.g6d025bc2.el9.x86_64.rpm 9.3 MB/s | 2.9 MB 00:00 2024-09-16T01:55:29.984 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:29.984 INFO:teuthology.orchestra.run.smithi165.stdout:Total 9.3 MB/s | 2.9 MB 00:00 2024-09-16T01:55:29.984 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:29.993 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:29.993 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T01:55:30.073 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:30.073 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:30.485 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:30.551 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:30.576 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:30.577 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:55:30.577 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:55:30.577 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:55:30.577 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:55:30.577 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:30.824 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:30.825 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:30.825 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T01:55:30.825 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:30.825 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:55:30.825 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T01:55:31.061 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:31.676 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:31.676 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:31.676 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:31.676 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:31.676 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:31.676 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:31.991 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-nbd 2024-09-16T01:55:32.568 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:43 ago on Mon 16 Sep 2024 01:53:49 AM UTC. 2024-09-16T01:55:32.703 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-16T01:55:32.704 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:32.705 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-16T01:55:32.705 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:32.705 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-16T01:55:32.705 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:17.2.7-1633.g6d025bc2.el9 ceph 165 k 2024-09-16T01:55:32.705 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:32.705 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-16T01:55:32.706 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-16T01:55:32.706 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-16T01:55:32.706 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:32.706 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 165 k 2024-09-16T01:55:32.706 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 477 k 2024-09-16T01:55:32.706 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-16T01:55:32.913 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-nbd-17.2.7-1633.g6d025bc2.el9.x86_64.rpm 792 kB/s | 165 kB 00:00 2024-09-16T01:55:32.914 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:55:32.914 INFO:teuthology.orchestra.run.smithi165.stdout:Total 786 kB/s | 165 kB 00:00 2024-09-16T01:55:32.914 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-16T01:55:32.921 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-16T01:55:32.922 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-16T01:55:32.984 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-16T01:55:32.985 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-16T01:55:33.135 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-16T01:55:33.236 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:33.670 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:33.933 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 1/1 2024-09-16T01:55:33.933 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:33.933 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-16T01:55:33.933 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:17.2.7-1633.g6d025bc2.el9.x86_64 2024-09-16T01:55:33.933 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:55:33.933 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-16T01:55:34.204 DEBUG:teuthology.parallel:result is None 2024-09-16T01:55:34.204 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:55:34.204 INFO:teuthology.packaging:ref: None 2024-09-16T01:55:34.204 INFO:teuthology.packaging:tag: None 2024-09-16T01:55:34.204 INFO:teuthology.packaging:branch: quincy 2024-09-16T01:55:34.204 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:55:34.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-16T01:55:34.411 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:55:34.438 INFO:teuthology.orchestra.run.smithi110.stdout:17.2.7-1633.g6d025bc2.el9 2024-09-16T01:55:34.439 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1633.g6d025bc2.el9 2024-09-16T01:55:34.439 INFO:teuthology.task.install:The correct ceph version 17.2.7-1633.g6d025bc2 is installed. 2024-09-16T01:55:34.442 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:55:34.442 INFO:teuthology.packaging:ref: None 2024-09-16T01:55:34.442 INFO:teuthology.packaging:tag: None 2024-09-16T01:55:34.442 INFO:teuthology.packaging:branch: quincy 2024-09-16T01:55:34.442 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:55:34.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-16T01:55:34.646 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:55:34.672 INFO:teuthology.orchestra.run.smithi165.stdout:17.2.7-1633.g6d025bc2.el9 2024-09-16T01:55:34.672 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1633.g6d025bc2.el9 2024-09-16T01:55:34.672 INFO:teuthology.task.install:The correct ceph version 17.2.7-1633.g6d025bc2 is installed. 2024-09-16T01:55:34.674 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T01:55:34.674 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:55:34.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:55:34.705 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:55:34.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:55:34.742 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T01:55:34.742 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:55:34.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:55:34.774 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:55:34.842 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:55:34.842 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:55:34.870 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:55:34.940 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T01:55:34.940 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:55:34.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:55:34.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:55:35.035 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:55:35.035 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:55:35.065 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:55:35.131 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T01:55:35.131 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:55:35.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:55:35.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:55:35.223 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:55:35.224 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:55:35.249 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:55:35.316 INFO:teuthology.run_tasks:Running task print... 2024-09-16T01:55:35.326 INFO:teuthology.task.print:**** done install task... 2024-09-16T01:55:35.326 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T01:55:35.496 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T01:55:35.496 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-16T01:55:35.496 INFO:tasks.cephadm:Cluster fsid is c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:55:35.496 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T01:55:35.497 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-16T01:55:35.497 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi110': '172.21.15.110', 'mon.smithi165': '172.21.15.165'} 2024-09-16T01:55:35.497 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T01:55:35.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname $(hostname -s) 2024-09-16T01:55:35.524 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname $(hostname -s) 2024-09-16T01:55:35.551 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-16T01:55:35.552 DEBUG:teuthology.orchestra.run.smithi110:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T01:55:35.796 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 16 01:55 /home/ubuntu/cephtest/cephadm 2024-09-16T01:55:35.797 DEBUG:teuthology.orchestra.run.smithi165:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T01:55:35.941 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 16 01:55 /home/ubuntu/cephtest/cephadm 2024-09-16T01:55:35.941 DEBUG:teuthology.orchestra.run.smithi110:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T01:55:35.958 DEBUG:teuthology.orchestra.run.smithi165:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T01:55:35.987 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-16T01:55:35.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-16T01:55:36.001 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-16T01:55:37.563 INFO:teuthology.orchestra.run.smithi165.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-16T01:55:37.634 INFO:teuthology.orchestra.run.smithi110.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-16T01:56:22.834 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-16T01:56:22.835 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_version": "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)", 2024-09-16T01:56:22.835 INFO:teuthology.orchestra.run.smithi165.stdout: "image_id": "33ed8dba399669a1d738ac1a85bc5f36daf3048afed44b7a93f620fc77496a99", 2024-09-16T01:56:22.835 INFO:teuthology.orchestra.run.smithi165.stdout: "repo_digests": [ 2024-09-16T01:56:22.835 INFO:teuthology.orchestra.run.smithi165.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4" 2024-09-16T01:56:22.835 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-16T01:56:22.835 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-16T01:56:27.750 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T01:56:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)", 2024-09-16T01:56:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "image_id": "33ed8dba399669a1d738ac1a85bc5f36daf3048afed44b7a93f620fc77496a99", 2024-09-16T01:56:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "repo_digests": [ 2024-09-16T01:56:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4" 2024-09-16T01:56:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-16T01:56:27.751 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T01:56:27.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph 2024-09-16T01:56:27.821 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph 2024-09-16T01:56:27.855 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /etc/ceph 2024-09-16T01:56:27.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /etc/ceph 2024-09-16T01:56:27.925 INFO:tasks.cephadm:Writing seed config... 2024-09-16T01:56:27.926 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T01:56:27.927 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-16T01:56:27.928 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T01:56:27.929 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T01:56:27.930 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T01:56:27.930 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T01:56:27.930 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-16T01:56:27.930 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-16T01:56:27.930 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-16T01:56:27.931 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:56:27.931 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T01:56:27.946 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c3aa8d62-73ce-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-16T01:56:27.946 DEBUG:teuthology.orchestra.run.smithi110:mon.smithi110> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service 2024-09-16T01:56:27.988 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T01:56:27.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.110 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:56:28.188 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:56:28.188 INFO:teuthology.orchestra.run.smithi110.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'c3aa8d62-73ce-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.110', '--skip-admin-label'] 2024-09-16T01:56:28.212 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 5.2.2 2024-09-16T01:56:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T01:56:28.213 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying podman|docker is present... 2024-09-16T01:56:28.234 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 5.2.2 2024-09-16T01:56:28.234 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying lvm2 is present... 2024-09-16T01:56:28.234 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying time synchronization is in place... 2024-09-16T01:56:28.242 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T01:56:28.242 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T01:56:28.249 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T01:56:28.249 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-16T01:56:28.256 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout enabled 2024-09-16T01:56:28.263 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout active 2024-09-16T01:56:28.263 INFO:teuthology.orchestra.run.smithi110.stdout:Unit chronyd.service is enabled and running 2024-09-16T01:56:28.263 INFO:teuthology.orchestra.run.smithi110.stdout:Repeating the final host check... 2024-09-16T01:56:28.284 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 5.2.2 2024-09-16T01:56:28.284 INFO:teuthology.orchestra.run.smithi110.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-16T01:56:28.285 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl is present 2024-09-16T01:56:28.285 INFO:teuthology.orchestra.run.smithi110.stdout:lvcreate is present 2024-09-16T01:56:28.291 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T01:56:28.291 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T01:56:28.298 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T01:56:28.298 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-16T01:56:28.305 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout enabled 2024-09-16T01:56:28.311 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout active 2024-09-16T01:56:28.311 INFO:teuthology.orchestra.run.smithi110.stdout:Unit chronyd.service is enabled and running 2024-09-16T01:56:28.312 INFO:teuthology.orchestra.run.smithi110.stdout:Host looks OK 2024-09-16T01:56:28.312 INFO:teuthology.orchestra.run.smithi110.stdout:Cluster fsid: c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:28.312 INFO:teuthology.orchestra.run.smithi110.stdout:Acquiring lock 140043480195424 on /run/cephadm/c3aa8d62-73ce-11ef-bceb-c7b262605968.lock 2024-09-16T01:56:28.312 INFO:teuthology.orchestra.run.smithi110.stdout:Lock 140043480195424 acquired on /run/cephadm/c3aa8d62-73ce-11ef-bceb-c7b262605968.lock 2024-09-16T01:56:28.312 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying IP 172.21.15.110 port 3300 ... 2024-09-16T01:56:28.312 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying IP 172.21.15.110 port 6789 ... 2024-09-16T01:56:28.313 INFO:teuthology.orchestra.run.smithi110.stdout:Base mon IP(s) is [172.21.15.110:3300, 172.21.15.110:6789], mon addrv is [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-09-16T01:56:28.316 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.110 metric 100 2024-09-16T01:56:28.316 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.110 metric 100 2024-09-16T01:56:28.319 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T01:56:28.319 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-16T01:56:28.320 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-16T01:56:28.322 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T01:56:28.322 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T01:56:28.322 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T01:56:28.322 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-16T01:56:28.322 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link noprefixroute 2024-09-16T01:56:28.322 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T01:56:28.323 INFO:teuthology.orchestra.run.smithi110.stdout:Mon IP `172.21.15.110` is in CIDR network `172.21.0.0/20` 2024-09-16T01:56:28.323 INFO:teuthology.orchestra.run.smithi110.stdout:Mon IP `172.21.15.110` is in CIDR network `172.21.0.0/20` 2024-09-16T01:56:28.323 INFO:teuthology.orchestra.run.smithi110.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T01:56:28.323 INFO:teuthology.orchestra.run.smithi110.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T01:56:28.324 INFO:teuthology.orchestra.run.smithi110.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 33ed8dba399669a1d738ac1a85bc5f36daf3048afed44b7a93f620fc77496a99 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Getting image source signatures 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying blob sha256:16f62ad1b9e7009e3336687c29bef330814f97ad91514d727da356692f597064 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying config sha256:33ed8dba399669a1d738ac1a85bc5f36daf3048afed44b7a93f620fc77496a99 2024-09-16T01:56:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-16T01:56:29.723 INFO:teuthology.orchestra.run.smithi110.stdout:ceph: stdout ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable) 2024-09-16T01:56:29.723 INFO:teuthology.orchestra.run.smithi110.stdout:Ceph version: ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable) 2024-09-16T01:56:29.723 INFO:teuthology.orchestra.run.smithi110.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T01:56:30.728 INFO:teuthology.orchestra.run.smithi110.stdout:stat: stdout 167 167 2024-09-16T01:56:30.728 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial keys... 2024-09-16T01:56:31.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQBPkOdmC3T4AxAA4NRjZ6eySRyQbx6YhQeHmQ== 2024-09-16T01:56:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQBPkOdmFkdyOxAArcD2+iEFQGymA7k+7PW+SQ== 2024-09-16T01:56:33.653 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQBQkOdmhMVKORAAKflXsetPW6k4FgHX0NqTnA== 2024-09-16T01:56:33.654 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial monmap... 2024-09-16T01:56:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T01:56:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-16T01:56:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T01:56:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool for smithi110 [v2:172.21.15.110:3300,v1:172.21.15.110:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T01:56:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = octopus 2024-09-16T01:56:34.593 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: set fsid to c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:34.593 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T01:56:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:56:34.593 INFO:teuthology.orchestra.run.smithi110.stdout:Creating mon... 2024-09-16T01:56:35.405 INFO:teuthology.orchestra.run.smithi110.stdout:create mon.smithi110 on 2024-09-16T01:56:35.614 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-16T01:56:35.751 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-16T01:56:35.896 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968.target. 2024-09-16T01:56:35.896 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968.target. 2024-09-16T01:56:36.060 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110 2024-09-16T01:56:36.060 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service: Unit ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service not loaded. 2024-09-16T01:56:36.217 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968.target.wants/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service → /etc/systemd/system/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@.service. 2024-09-16T01:56:36.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:36 smithi110 ceph-mon[27270]: mon.smithi110 is new leader, mons smithi110 in quorum (ranks 0) 2024-09-16T01:56:36.764 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:56:36.765 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-16T01:56:36.772 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:56:36.772 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-16T01:56:36.772 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-16T01:56:36.772 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T01:56:36.773 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mon to start... 2024-09-16T01:56:36.773 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mon... 2024-09-16T01:56:37.018 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:36 smithi110 bash[27251]: 7fa25faa8cd4912d32bfff24df477a5ca858918c6b1ae2e38a381f27d734a001 2024-09-16T01:56:37.018 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:36 smithi110 systemd[1]: Started Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T01:56:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:37 smithi110 ceph-mon[27270]: mon.smithi110 is new leader, mons smithi110 in quorum (ranks 0) 2024-09-16T01:56:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:37 smithi110 ceph-mon[27270]: monmap e1: 1 mons at {smithi110=[v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-16T01:56:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:37 smithi110 ceph-mon[27270]: fsmap 2024-09-16T01:56:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:37 smithi110 ceph-mon[27270]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T01:56:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:37 smithi110 ceph-mon[27270]: mgrmap e1: no daemons active 2024-09-16T01:56:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:37 smithi110 ceph-mon[27270]: from='client.? 172.21.15.110:0/2009756074' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T01:56:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T01:56:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout id: c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T01:56:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout services: 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi110 (age 0.820085s) 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout data: 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.420+0000 7f9fb57c3640 1 Processor -- start 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.420+0000 7f9fb57c3640 1 -- start start 2024-09-16T01:56:44.185 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.420+0000 7f9fb57c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.420+0000 7f9fb57c3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb01029c0 con 0x7f9fb0102070 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.421+0000 7f9faeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.421+0000 7f9faeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53842/0 (socket says 172.21.15.110:53842) 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.421+0000 7f9faeffd640 1 -- 172.21.15.110:0/917351729 learned_addr learned my addr 172.21.15.110:0/917351729 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.421+0000 7f9faeffd640 1 -- 172.21.15.110:0/917351729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0102b00 con 0x7f9fb0102070 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.423+0000 7f9faeffd640 1 --2- 172.21.15.110:0/917351729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009e50 tx=0x7f9fa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fe656df171ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.423+0000 7f9fadffb640 1 -- 172.21.15.110:0/917351729 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fa0031560 con 0x7f9fb0102070 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.423+0000 7f9fadffb640 1 -- 172.21.15.110:0/917351729 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa002d050 con 0x7f9fb0102070 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.423+0000 7f9fadffb640 1 -- 172.21.15.110:0/917351729 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fa0031880 con 0x7f9fb0102070 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 -- 172.21.15.110:0/917351729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 msgr2=0x7f9fb0102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 --2- 172.21.15.110:0/917351729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009e50 tx=0x7f9fa0009840 comp rx=0 tx=0).stop 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 -- 172.21.15.110:0/917351729 shutdown_connections 2024-09-16T01:56:44.186 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 --2- 172.21.15.110:0/917351729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0102480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 -- 172.21.15.110:0/917351729 >> 172.21.15.110:0/917351729 conn(0x7f9fb00fd850 msgr2=0x7f9fb00ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 -- 172.21.15.110:0/917351729 shutdown_connections 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 -- 172.21.15.110:0/917351729 wait complete. 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.424+0000 7f9fb57c3640 1 Processor -- start 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fb57c3640 1 -- start start 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fb57c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fb57c3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb0110a80 con 0x7f9fb0102070 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9faeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9faeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53846/0 (socket says 172.21.15.110:53846) 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9faeffd640 1 -- 172.21.15.110:0/2009756074 learned_addr learned my addr 172.21.15.110:0/2009756074 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9faeffd640 1 -- 172.21.15.110:0/2009756074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0009ae0 con 0x7f9fb0102070 2024-09-16T01:56:44.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9faeffd640 1 --2- 172.21.15.110:0/2009756074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0110540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9fa002ac70 tx=0x7f9fa0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fa0007a10 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0007b70 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb0110c80 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.425+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fa0007e80 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.426+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb0111810 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.426+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9fa0038070 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.426+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9fa0045c60 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.426+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb01014d0 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.429+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9fa0040070 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.486+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f9fb0112240 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.486+0000 7f9fa77fe640 1 -- 172.21.15.110:0/2009756074 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f9fa0036070 con 0x7f9fb0102070 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 msgr2=0x7f9fb0110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 --2- 172.21.15.110:0/2009756074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0110540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9fa002ac70 tx=0x7f9fa0036000 comp rx=0 tx=0).stop 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 shutdown_connections 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 --2- 172.21.15.110:0/2009756074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fb0102070 0x7f9fb0110540 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 >> 172.21.15.110:0/2009756074 conn(0x7f9fb00fd850 msgr2=0x7f9fb0107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 shutdown_connections 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:37.487+0000 7f9fb57c3640 1 -- 172.21.15.110:0/2009756074 wait complete. 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mon is available 2024-09-16T01:56:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T01:56:46.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:46 smithi110 ceph-mon[27270]: from='client.? 172.21.15.110:0/4154005998' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T01:56:46.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:46 smithi110 ceph-mon[27270]: from='client.? 172.21.15.110:0/4154005998' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T01:56:46.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout fsid = c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T01:56:46.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.383+0000 7f35849e7640 1 Processor -- start 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.383+0000 7f35849e7640 1 -- start start 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.383+0000 7f35849e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.383+0000 7f35849e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35801029c0 con 0x7f3580102070 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.384+0000 7f357e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.384+0000 7f357e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58668/0 (socket says 172.21.15.110:58668) 2024-09-16T01:56:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.384+0000 7f357e59c640 1 -- 172.21.15.110:0/442845100 learned_addr learned my addr 172.21.15.110:0/442845100 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.384+0000 7f357e59c640 1 -- 172.21.15.110:0/442845100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3580102b00 con 0x7f3580102070 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f357e59c640 1 --2- 172.21.15.110:0/442845100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3570009840 tx=0x7f35700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acc9647300bcd60 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f357dd9b640 1 -- 172.21.15.110:0/442845100 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3570032440 con 0x7f3580102070 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f357dd9b640 1 -- 172.21.15.110:0/442845100 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35700325a0 con 0x7f3580102070 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f357dd9b640 1 -- 172.21.15.110:0/442845100 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3570032890 con 0x7f3580102070 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 -- 172.21.15.110:0/442845100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 msgr2=0x7f3580102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 --2- 172.21.15.110:0/442845100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3570009840 tx=0x7f35700091d0 comp rx=0 tx=0).stop 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 -- 172.21.15.110:0/442845100 shutdown_connections 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 --2- 172.21.15.110:0/442845100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580102480 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 -- 172.21.15.110:0/442845100 >> 172.21.15.110:0/442845100 conn(0x7f35800fd850 msgr2=0x7f35800ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 -- 172.21.15.110:0/442845100 shutdown_connections 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.385+0000 7f35849e7640 1 -- 172.21.15.110:0/442845100 wait complete. 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f35849e7640 1 Processor -- start 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f35849e7640 1 -- start start 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f35849e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f35849e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3580110a80 con 0x7f3580102070 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f357e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f357e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58680/0 (socket says 172.21.15.110:58680) 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.386+0000 7f357e59c640 1 -- 172.21.15.110:0/4154005998 learned_addr learned my addr 172.21.15.110:0/4154005998 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f357e59c640 1 -- 172.21.15.110:0/4154005998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570009450 con 0x7f3580102070 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f357e59c640 1 --2- 172.21.15.110:0/4154005998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f357002a790 tx=0x7f3570032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3570031be0 con 0x7f3580102070 2024-09-16T01:56:46.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570031d40 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f357003b5a0 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3580110c80 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3580111090 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3570039040 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.387+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3570041030 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.388+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358004b720 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.390+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f357002ae60 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.448+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3580109e40 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.451+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3570046c80 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.451+0000 7f3576ffd640 1 -- 172.21.15.110:0/4154005998 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7f3570054d80 con 0x7f3580102070 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 msgr2=0x7f3580110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 --2- 172.21.15.110:0/4154005998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f357002a790 tx=0x7f3570032000 comp rx=0 tx=0).stop 2024-09-16T01:56:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 shutdown_connections 2024-09-16T01:56:46.994 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 --2- 172.21.15.110:0/4154005998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3580102070 0x7f3580110540 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:46.994 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 >> 172.21.15.110:0/4154005998 conn(0x7f35800fd850 msgr2=0x7f3580107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:46.994 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 shutdown_connections 2024-09-16T01:56:46.994 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:46.452+0000 7f35849e7640 1 -- 172.21.15.110:0/4154005998 wait complete. 2024-09-16T01:56:46.994 INFO:teuthology.orchestra.run.smithi110.stdout:Generating new minimal ceph.conf... 2024-09-16T01:56:47.702 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:47 smithi110 ceph-mon[27270]: from='client.? 172.21.15.110:0/3488093418' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f1552a8e640 1 Processor -- start 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f1552a8e640 1 -- start start 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f1552a8e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c1070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f1552a8e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c102ad0 con 0x7f154c076a90 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f155082a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c1070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f155082a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c1070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58690/0 (socket says 172.21.15.110:58690) 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f155082a640 1 -- 172.21.15.110:0/2919414901 learned_addr learned my addr 172.21.15.110:0/2919414901 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.346+0000 7f155082a640 1 -- 172.21.15.110:0/2919414901 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c076ea0 con 0x7f154c076a90 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.347+0000 7f155082a640 1 --2- 172.21.15.110:0/2919414901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c1070e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1540009840 tx=0x7f15400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca7581cea79c235 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.347+0000 7f154b7fe640 1 -- 172.21.15.110:0/2919414901 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1540032440 con 0x7f154c076a90 2024-09-16T01:56:48.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.347+0000 7f154b7fe640 1 -- 172.21.15.110:0/2919414901 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1540032a00 con 0x7f154c076a90 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.347+0000 7f154b7fe640 1 -- 172.21.15.110:0/2919414901 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1540031a10 con 0x7f154c076a90 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 -- 172.21.15.110:0/2919414901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 msgr2=0x7f154c1070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 --2- 172.21.15.110:0/2919414901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c1070e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1540009840 tx=0x7f15400091d0 comp rx=0 tx=0).stop 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 -- 172.21.15.110:0/2919414901 shutdown_connections 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 --2- 172.21.15.110:0/2919414901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c1070e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 -- 172.21.15.110:0/2919414901 >> 172.21.15.110:0/2919414901 conn(0x7f154c0fc790 msgr2=0x7f154c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 -- 172.21.15.110:0/2919414901 shutdown_connections 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 -- 172.21.15.110:0/2919414901 wait complete. 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 Processor -- start 2024-09-16T01:56:48.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.348+0000 7f1552a8e640 1 -- start start 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f1552a8e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f1552a8e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1134a0 con 0x7f154c076a90 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f155082a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f155082a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58696/0 (socket says 172.21.15.110:58696) 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f155082a640 1 -- 172.21.15.110:0/3488093418 learned_addr learned my addr 172.21.15.110:0/3488093418 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f155082a640 1 -- 172.21.15.110:0/3488093418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1540009450 con 0x7f154c076a90 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f155082a640 1 --2- 172.21.15.110:0/3488093418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c112f60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15400329d0 tx=0x7f154002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1540031d10 con 0x7f154c076a90 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1540031e70 con 0x7f154c076a90 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f154003b670 con 0x7f154c076a90 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.349+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c1136a0 con 0x7f154c076a90 2024-09-16T01:56:48.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.350+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c113b10 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.350+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1540039070 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.350+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f15400464e0 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.350+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c04b720 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.352+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f15400657a0 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.407+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f154c114230 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.407+0000 7f15497fa640 1 -- 172.21.15.110:0/3488093418 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f1540054020 con 0x7f154c076a90 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 msgr2=0x7f154c112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 --2- 172.21.15.110:0/3488093418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c112f60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15400329d0 tx=0x7f154002c040 comp rx=0 tx=0).stop 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 shutdown_connections 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 --2- 172.21.15.110:0/3488093418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f154c076a90 0x7f154c112f60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 >> 172.21.15.110:0/3488093418 conn(0x7f154c0fc790 msgr2=0x7f154c0fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 shutdown_connections 2024-09-16T01:56:48.023 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:47.408+0000 7f1552a8e640 1 -- 172.21.15.110:0/3488093418 wait complete. 2024-09-16T01:56:48.024 INFO:teuthology.orchestra.run.smithi110.stdout:Restarting the monitor... 2024-09-16T01:56:48.282 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 systemd[1]: Stopping Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T01:56:48.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[27266]: 2024-09-16T01:56:48.280+0000 7fa1e25d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi110 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:56:48.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[27266]: 2024-09-16T01:56:48.280+0000 7fa1e25d0640 -1 mon.smithi110@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T01:56:48.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 podman[27513]: 2024-09-16 01:56:48.393355735 +0000 UTC m=+0.215541057 container died 7fa25faa8cd4912d32bfff24df477a5ca858918c6b1ae2e38a381f27d734a001 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=quincy-6d025bc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:56:48.907 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 podman[27513]: 2024-09-16 01:56:48.688758321 +0000 UTC m=+0.510943632 container cleanup 7fa25faa8cd4912d32bfff24df477a5ca858918c6b1ae2e38a381f27d734a001 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=quincy-6d025bc, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:56:48.907 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 bash[27513]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110 2024-09-16T01:56:49.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:48 smithi110 podman[27526]: 2024-09-16 01:56:48.906525866 +0000 UTC m=+0.511466336 container remove 7fa25faa8cd4912d32bfff24df477a5ca858918c6b1ae2e38a381f27d734a001 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=quincy-6d025bc) 2024-09-16T01:56:49.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service: Deactivated successfully. 2024-09-16T01:56:49.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 systemd[1]: Stopped Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T01:56:49.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 systemd[1]: Starting Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T01:56:49.484 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 podman[27615]: 2024-09-16 01:56:49.135955744 +0000 UTC m=+0.015749936 image pull 33ed8dba399669a1d738ac1a85bc5f36daf3048afed44b7a93f620fc77496a99 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-16T01:56:49.484 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 podman[27615]: 2024-09-16 01:56:49.240686024 +0000 UTC m=+0.120480208 container create 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=quincy-6d025bc, GIT_CLEAN=True, ceph=True) 2024-09-16T01:56:49.484 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 podman[27615]: 2024-09-16 01:56:49.459599094 +0000 UTC m=+0.339393274 container init 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=quincy-6d025bc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-16T01:56:49.484 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 podman[27615]: 2024-09-16 01:56:49.462680588 +0000 UTC m=+0.342474767 container start 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, RELEASE=quincy-6d025bc, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-16T01:56:49.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T01:56:49.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable), process ceph-mon, pid 2 2024-09-16T01:56:49.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: pidfile_write: ignore empty --pid-file 2024-09-16T01:56:49.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: load: jerasure load: lrc 2024-09-16T01:56:49.598 INFO:teuthology.orchestra.run.smithi110.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: RocksDB version: 6.15.5 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Compile date Sep 15 2024 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: DB SUMMARY 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: DB Session ID: XDEK224OTTGVV537UUF5 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: CURRENT file: CURRENT 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T01:56:49.793 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi110/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi110/store.db: 000010.log size: 98148 ; 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.error_if_exists: 0 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.create_if_missing: 0 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.paranoid_checks: 1 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.env: 0x56323be35440 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.fs: Posix File System 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.info_log: 0x56323c8e70c0 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.statistics: (nil) 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.use_fsync: 0 2024-09-16T01:56:49.794 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_log_file_size: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.allow_fallocate: 1 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.use_direct_reads: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.db_log_dir: 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi110/store.db 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T01:56:49.795 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.write_buffer_manager: 0x56323c9a4810 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-16T01:56:49.796 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.unordered_write: 0 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T01:56:49.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.row_cache: None 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.wal_filter: None 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.preserve_deletes: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.two_write_queues: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.atomic_flush: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T01:56:49.798 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.log_readahead_size: 0 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_background_jobs: 2 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_background_compactions: -1 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_subcompactions: 1 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T01:56:49.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_open_files: -1 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T01:56:49.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_background_flushes: -1 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Compression algorithms supported: 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kZSTD supported: 0 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kXpressCompression supported: 0 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kBZip2Compression supported: 0 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kLZ4Compression supported: 1 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kZlibCompression supported: 1 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: kSnappyCompression supported: 1 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi110/store.db/MANIFEST-000009 2024-09-16T01:56:49.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.merge_operator: 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_filter: None 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56323c88da38) 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: cache_index_and_filter_blocks: 1 2024-09-16T01:56:49.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: pin_top_level_index_and_filter: 1 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_type: 0 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_block_index_type: 0 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_shortening: 1 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: hash_index_allow_collision: 1 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: checksum: 1 2024-09-16T01:56:49.804 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: no_block_cache: 0 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache: 0x56323c8c31f0 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_name: BinnedLRUCache 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_options: 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: capacity : 536870912 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: num_shard_bits : 4 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: strict_capacity_limit : 0 2024-09-16T01:56:49.805 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: high_pri_pool_ratio: 0.000 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_compressed: (nil) 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: persistent_cache: (nil) 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_size: 4096 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_size_deviation: 10 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_restart_interval: 16 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_block_restart_interval: 1 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: metadata_block_size: 4096 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: partition_filters: 0 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: use_delta_encoding: 1 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: whole_key_filtering: 1 2024-09-16T01:56:49.806 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: verify_compression: 0 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: read_amp_bytes_per_bit: 0 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: format_version: 4 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: enable_index_compression: 1 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_align: 0 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression: NoCompression 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T01:56:49.807 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.num_levels: 7 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T01:56:49.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T01:56:49.809 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T01:56:49.810 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.arena_block_size: 4194304 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T01:56:49.811 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.inplace_update_support: 0 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.bloom_locality: 0 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.max_successive_merges: 0 2024-09-16T01:56:49.812 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.ttl: 2592000 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.enable_blob_files: false 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.min_blob_size: 0 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi110/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-16T01:56:49.813 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726451809486086, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726451809486884, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93380, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91460, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84042, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726451809, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "a5e326a4-e354-4437-8b2d-acbe1ede8657", "db_session_id": "XDEK224OTTGVV537UUF5"}} 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726451809487213, "job": 1, "event": "recovery_finished"} 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi110/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56323c8f6700 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: DB pointer 0x56323c8c6000 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** DB Stats ** 2024-09-16T01:56:49.814 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: L0 2/0 93.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Sum 2/0 93.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.815 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T01:56:49.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative compaction: 0.00 GB write, 28.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval compaction: 0.00 GB write, 28.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: L0 2/0 93.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Sum 2/0 93.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-16T01:56:49.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 164.3 0.00 0.00 1 0.001 0 0 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative compaction: 0.00 GB write, 28.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: starting mon.smithi110 rank 0 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi110 fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???) e1 preinit fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).mds e1 new map 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).mds e1 print_map 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: e1 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:56:49.819 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T01:56:49.820 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: legacy client fscid: -1 2024-09-16T01:56:49.820 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T01:56:49.820 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: No filesystems configured 2024-09-16T01:56:49.820 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T01:56:49.820 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:56:49.821 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:56:49.821 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:56:49.821 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 ceph-mon[27634]: mon.smithi110@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T01:56:49.821 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 bash[27615]: 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 2024-09-16T01:56:49.821 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:49 smithi110 systemd[1]: Started Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T01:56:50.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.956+0000 7fed25264640 1 Processor -- start 2024-09-16T01:56:50.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.956+0000 7fed25264640 1 -- start start 2024-09-16T01:56:50.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.956+0000 7fed25264640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed201023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.956+0000 7fed25264640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed201028e0 con 0x7fed20101f90 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.957+0000 7fed1effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed201023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.957+0000 7fed1effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed201023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58708/0 (socket says 172.21.15.110:58708) 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.957+0000 7fed1effd640 1 -- 172.21.15.110:0/235831071 learned_addr learned my addr 172.21.15.110:0/235831071 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.957+0000 7fed1effd640 1 -- 172.21.15.110:0/235831071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20102a20 con 0x7fed20101f90 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.959+0000 7fed1effd640 1 --2- 172.21.15.110:0/235831071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed201023a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddf6a72d60ef4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.959+0000 7fed1dffb640 1 -- 172.21.15.110:0/235831071 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed10031560 con 0x7fed20101f90 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.959+0000 7fed1dffb640 1 -- 172.21.15.110:0/235831071 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fed1002d050 con 0x7fed20101f90 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.959+0000 7fed1dffb640 1 -- 172.21.15.110:0/235831071 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed100079b0 con 0x7fed20101f90 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 -- 172.21.15.110:0/235831071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 msgr2=0x7fed201023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 --2- 172.21.15.110:0/235831071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed201023a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed10009840 comp rx=0 tx=0).stop 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 -- 172.21.15.110:0/235831071 shutdown_connections 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 --2- 172.21.15.110:0/235831071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed201023a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 -- 172.21.15.110:0/235831071 >> 172.21.15.110:0/235831071 conn(0x7fed200fd730 msgr2=0x7fed200ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 -- 172.21.15.110:0/235831071 shutdown_connections 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.960+0000 7fed25264640 1 -- 172.21.15.110:0/235831071 wait complete. 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed25264640 1 Processor -- start 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed25264640 1 -- start start 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed25264640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed20110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed25264640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20111310 con 0x7fed20101f90 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed1effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed20110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed1effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed20110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58724/0 (socket says 172.21.15.110:58724) 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed1effd640 1 -- 172.21.15.110:0/1210505546 learned_addr learned my addr 172.21.15.110:0/1210505546 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:50.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed1effd640 1 -- 172.21.15.110:0/1210505546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009ae0 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.961+0000 7fed1effd640 1 --2- 172.21.15.110:0/1210505546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed20110dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fed10007690 tx=0x7fed10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed10031b70 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fed10031cd0 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed20111510 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed100443e0 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed20111f60 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fed10038040 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.962+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fed10040030 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.963+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed201013f0 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:49.965+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fed1004a060 con 0x7fed20101f90 2024-09-16T01:56:50.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.019+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fed20103d40 con 0x7fed20101f90 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed177fe640 1 -- 172.21.15.110:0/1210505546 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fed100520c0 con 0x7fed20101f90 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 msgr2=0x7fed20110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 --2- 172.21.15.110:0/1210505546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed20110dd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fed10007690 tx=0x7fed10009840 comp rx=0 tx=0).stop 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 shutdown_connections 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 --2- 172.21.15.110:0/1210505546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed20101f90 0x7fed20110dd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 >> 172.21.15.110:0/1210505546 conn(0x7fed200fd730 msgr2=0x7fed200fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 shutdown_connections 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:50.022+0000 7fed25264640 1 -- 172.21.15.110:0/1210505546 wait complete. 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:56:50.587 INFO:teuthology.orchestra.run.smithi110.stdout:Creating mgr... 2024-09-16T01:56:50.588 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T01:56:50.588 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T01:56:50.588 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-16T01:56:50.792 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mgr.smithi110.hfirap 2024-09-16T01:56:50.792 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mgr.smithi110.hfirap.service: Unit ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mgr.smithi110.hfirap.service not loaded. 2024-09-16T01:56:50.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:50 smithi110 ceph-mon[27634]: mon.smithi110 is new leader, mons smithi110 in quorum (ranks 0) 2024-09-16T01:56:50.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:50 smithi110 ceph-mon[27634]: monmap e1: 1 mons at {smithi110=[v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-16T01:56:50.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:50 smithi110 ceph-mon[27634]: fsmap 2024-09-16T01:56:50.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:50 smithi110 ceph-mon[27634]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T01:56:50.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:50 smithi110 ceph-mon[27634]: mgrmap e1: no daemons active 2024-09-16T01:56:50.799 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:50 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1210505546' entity='client.admin' 2024-09-16T01:56:50.941 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968.target.wants/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mgr.smithi110.hfirap.service → /etc/systemd/system/ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@.service. 2024-09-16T01:56:52.385 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:56:52.385 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-16T01:56:52.394 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:56:52.394 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-16T01:56:52.395 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-16T01:56:52.395 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T01:56:52.406 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:56:52.406 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-16T01:56:52.415 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:56:52.415 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-16T01:56:52.415 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-16T01:56:52.415 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-16T01:56:52.415 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr to start... 2024-09-16T01:56:52.416 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr... 2024-09-16T01:56:53.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:53 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1817606756' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "c3aa8d62-73ce-11ef-bceb-c7b262605968", 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T01:56:54.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "smithi110" 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T01:56:54.391 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.392 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T01:56:54.392 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:54.392 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T01:56:54.392 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T01:56:54.392 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T01:56:54.400 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T01:56:54.401 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T01:56:36.667714+0000", 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.598+0000 7fe805714640 1 Processor -- start 2024-09-16T01:56:54.402 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.598+0000 7fe805714640 1 -- start start 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.598+0000 7fe805714640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe8001013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.598+0000 7fe805714640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8001018e0 con 0x7fe800100f90 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.599+0000 7fe7feffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe8001013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.599+0000 7fe7feffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe8001013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41286/0 (socket says 172.21.15.110:41286) 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.599+0000 7fe7feffd640 1 -- 172.21.15.110:0/1973859578 learned_addr learned my addr 172.21.15.110:0/1973859578 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.599+0000 7fe7feffd640 1 -- 172.21.15.110:0/1973859578 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800101a20 con 0x7fe800100f90 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe7feffd640 1 --2- 172.21.15.110:0/1973859578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe8001013a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000baf0 tx=0x7fe7f000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1480f2bde97dbb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe7fdffb640 1 -- 172.21.15.110:0/1973859578 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f0031790 con 0x7fe800100f90 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe7fdffb640 1 -- 172.21.15.110:0/1973859578 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe7f0031d50 con 0x7fe800100f90 2024-09-16T01:56:54.403 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe7fdffb640 1 -- 172.21.15.110:0/1973859578 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f0039e10 con 0x7fe800100f90 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe805714640 1 -- 172.21.15.110:0/1973859578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 msgr2=0x7fe8001013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe805714640 1 --2- 172.21.15.110:0/1973859578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe8001013a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000baf0 tx=0x7fe7f000b460 comp rx=0 tx=0).stop 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe805714640 1 -- 172.21.15.110:0/1973859578 shutdown_connections 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe805714640 1 --2- 172.21.15.110:0/1973859578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe8001013a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.600+0000 7fe805714640 1 -- 172.21.15.110:0/1973859578 >> 172.21.15.110:0/1973859578 conn(0x7fe8000fc750 msgr2=0x7fe8000feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.601+0000 7fe805714640 1 -- 172.21.15.110:0/1973859578 shutdown_connections 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.601+0000 7fe805714640 1 -- 172.21.15.110:0/1973859578 wait complete. 2024-09-16T01:56:54.404 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.601+0000 7fe805714640 1 Processor -- start 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.601+0000 7fe805714640 1 -- start start 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.601+0000 7fe805714640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe80010eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.601+0000 7fe805714640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80010f0e0 con 0x7fe800100f90 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7feffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe80010eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7feffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe80010eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41288/0 (socket says 172.21.15.110:41288) 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7feffd640 1 -- 172.21.15.110:0/1817606756 learned_addr learned my addr 172.21.15.110:0/1817606756 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7feffd640 1 -- 172.21.15.110:0/1817606756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f000b700 con 0x7fe800100f90 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7feffd640 1 --2- 172.21.15.110:0/1817606756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe80010eba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0003080 tx=0x7fe7f003c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f003a5b0 con 0x7fe800100f90 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe7f003ab70 con 0x7fe800100f90 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80010f2e0 con 0x7fe800100f90 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f0044b20 con 0x7fe800100f90 2024-09-16T01:56:54.405 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.602+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80010f750 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.603+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe7f004d400 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.603+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe7f00436e0 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.603+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80004b720 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.605+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe80010f750 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.664+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe800102c10 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.664+0000 7fe7e77fe640 1 -- 172.21.15.110:0/1817606756 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe7f0035070 con 0x7fe800100f90 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 msgr2=0x7fe80010eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 --2- 172.21.15.110:0/1817606756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe80010eba0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0003080 tx=0x7fe7f003c040 comp rx=0 tx=0).stop 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 shutdown_connections 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 --2- 172.21.15.110:0/1817606756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe800100f90 0x7fe80010eba0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 >> 172.21.15.110:0/1817606756 conn(0x7fe8000fc750 msgr2=0x7fe800105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 shutdown_connections 2024-09-16T01:56:54.406 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:53.665+0000 7fe805714640 1 -- 172.21.15.110:0/1817606756 wait complete. 2024-09-16T01:56:54.407 INFO:teuthology.orchestra.run.smithi110.stdout:mgr not available, waiting (1/15)... 2024-09-16T01:56:56.108 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: Activating manager daemon smithi110.hfirap 2024-09-16T01:56:56.108 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: mgrmap e2: smithi110.hfirap(active, starting, since 0.00279885s) 2024-09-16T01:56:56.108 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:56:56.108 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:56:56.108 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:56:56.108 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: Manager daemon smithi110.hfirap is now available 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' 2024-09-16T01:56:56.109 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:55 smithi110 ceph-mon[27634]: from='mgr.14100 172.21.15.110:0/1039985984' entity='mgr.smithi110.hfirap' 2024-09-16T01:56:57.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "c3aa8d62-73ce-11ef-bceb-c7b262605968", 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:56:57.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "smithi110" 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T01:56:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T01:56:57.623 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T01:56:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T01:56:36.667714+0000", 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:56:57.625 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb6ed2640 1 Processor -- start 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb6ed2640 1 -- start start 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb6ed2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0107070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb6ed2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0076f40 con 0x7f4cb0076b30 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb4c6e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb4c6e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41370/0 (socket says 172.21.15.110:41370) 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.811+0000 7f4cb4c6e640 1 -- 172.21.15.110:0/4034093286 learned_addr learned my addr 172.21.15.110:0/4034093286 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.812+0000 7f4cb4c6e640 1 -- 172.21.15.110:0/4034093286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0102a60 con 0x7f4cb0076b30 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.813+0000 7f4cb4c6e640 1 --2- 172.21.15.110:0/4034093286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0107070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009840 tx=0x7f4ca40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7d442394163b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.813+0000 7f4caf7fe640 1 -- 172.21.15.110:0/4034093286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ca4032440 con 0x7f4cb0076b30 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.813+0000 7f4caf7fe640 1 -- 172.21.15.110:0/4034093286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4ca4032a00 con 0x7f4cb0076b30 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.813+0000 7f4caf7fe640 1 -- 172.21.15.110:0/4034093286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ca40319e0 con 0x7f4cb0076b30 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/4034093286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 msgr2=0x7f4cb0107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:57.626 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 --2- 172.21.15.110:0/4034093286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0107070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009840 tx=0x7f4ca40091d0 comp rx=0 tx=0).stop 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/4034093286 shutdown_connections 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 --2- 172.21.15.110:0/4034093286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0107070 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/4034093286 >> 172.21.15.110:0/4034093286 conn(0x7f4cb00fc6e0 msgr2=0x7f4cb00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/4034093286 shutdown_connections 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/4034093286 wait complete. 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 Processor -- start 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.814+0000 7f4cb6ed2640 1 -- start start 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb6ed2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0112f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb6ed2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0113440 con 0x7f4cb0076b30 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb4c6e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0112f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb4c6e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0112f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41376/0 (socket says 172.21.15.110:41376) 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb4c6e640 1 -- 172.21.15.110:0/3959128928 learned_addr learned my addr 172.21.15.110:0/3959128928 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:57.627 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb4c6e640 1 -- 172.21.15.110:0/3959128928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4009450 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb4c6e640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0112f00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40098a0 tx=0x7f4ca4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ca4032880 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4ca403d8b0 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb01136a0 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ca403b8e0 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.815+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb01141d0 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.816+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb0100380 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.816+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 3) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f4ca4039070 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.817+0000 7f4cad7fa640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f4ca0039380 0x7f4ca003b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.817+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4ca406cdd0 con 0x7f4cb0076b30 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.817+0000 7f4caffff640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f4ca0039380 0x7f4ca003b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.817+0000 7f4caffff640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f4ca0039380 0x7f4ca003b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c006fd0 tx=0x7f4c9c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:57.628 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:56.821+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ca404e7c0 con 0x7f4cb0076b30 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.038+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4cb0114570 con 0x7f4cb0076b30 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.038+0000 7f4cad7fa640 1 -- 172.21.15.110:0/3959128928 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f4ca4041070 con 0x7f4cb0076b30 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.040+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f4ca0039380 msgr2=0x7f4ca003b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.040+0000 7f4cb6ed2640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f4ca0039380 0x7f4ca003b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c006fd0 tx=0x7f4c9c006db0 comp rx=0 tx=0).stop 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.040+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 msgr2=0x7f4cb0112f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.040+0000 7f4cb6ed2640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0112f00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40098a0 tx=0x7f4ca4008040 comp rx=0 tx=0).stop 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.041+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 shutdown_connections 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.041+0000 7f4cb6ed2640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f4ca0039380 0x7f4ca003b830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.041+0000 7f4cb6ed2640 1 --2- 172.21.15.110:0/3959128928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cb0076b30 0x7f4cb0112f00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.041+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 >> 172.21.15.110:0/3959128928 conn(0x7f4cb00fc6e0 msgr2=0x7f4cb00fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.041+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 shutdown_connections 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:57.041+0000 7f4cb6ed2640 1 -- 172.21.15.110:0/3959128928 wait complete. 2024-09-16T01:56:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:mgr is available 2024-09-16T01:56:57.862 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:57 smithi110 ceph-mon[27634]: mgrmap e3: smithi110.hfirap(active, since 1.00605s) 2024-09-16T01:56:57.862 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:57 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3959128928' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T01:56:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:58 smithi110 ceph-mon[27634]: mgrmap e4: smithi110.hfirap(active, since 2s) 2024-09-16T01:56:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:58 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2297124330' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout fsid = c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T01:56:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.023+0000 7f0848ab4640 1 Processor -- start 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.023+0000 7f0848ab4640 1 -- start start 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.024+0000 7f0848ab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f08440771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:59.134 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.024+0000 7f0848ab4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844078f80 con 0x7f0844078ae0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.024+0000 7f084259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f08440771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.024+0000 7f084259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f08440771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41392/0 (socket says 172.21.15.110:41392) 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.024+0000 7f084259c640 1 -- 172.21.15.110:0/4131586616 learned_addr learned my addr 172.21.15.110:0/4131586616 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.024+0000 7f084259c640 1 -- 172.21.15.110:0/4131586616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440790c0 con 0x7f0844078ae0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.025+0000 7f084259c640 1 --2- 172.21.15.110:0/4131586616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f08440771f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0834009840 tx=0x7f08340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe04c3ff5de8e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.025+0000 7f084159a640 1 -- 172.21.15.110:0/4131586616 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0834032440 con 0x7f0844078ae0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.025+0000 7f084159a640 1 -- 172.21.15.110:0/4131586616 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0834032a00 con 0x7f0844078ae0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.025+0000 7f084159a640 1 -- 172.21.15.110:0/4131586616 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08340319e0 con 0x7f0844078ae0 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 -- 172.21.15.110:0/4131586616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 msgr2=0x7f08440771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 --2- 172.21.15.110:0/4131586616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f08440771f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0834009840 tx=0x7f08340091d0 comp rx=0 tx=0).stop 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 -- 172.21.15.110:0/4131586616 shutdown_connections 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 --2- 172.21.15.110:0/4131586616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f08440771f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:59.135 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 -- 172.21.15.110:0/4131586616 >> 172.21.15.110:0/4131586616 conn(0x7f08440fd850 msgr2=0x7f08440ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 -- 172.21.15.110:0/4131586616 shutdown_connections 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.026+0000 7f0848ab4640 1 -- 172.21.15.110:0/4131586616 wait complete. 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0848ab4640 1 Processor -- start 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0848ab4640 1 -- start start 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0848ab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f0844112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0848ab4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844113450 con 0x7f0844078ae0 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f084259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f0844112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f084259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f0844112f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41404/0 (socket says 172.21.15.110:41404) 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f084259c640 1 -- 172.21.15.110:0/2297124330 learned_addr learned my addr 172.21.15.110:0/2297124330 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f084259c640 1 -- 172.21.15.110:0/2297124330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009450 con 0x7f0844078ae0 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f084259c640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f0844112f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0834006f00 tx=0x7f0834008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0834032880 con 0x7f0844078ae0 2024-09-16T01:56:59.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f083403b8d0 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0844113650 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f083403a8f0 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.027+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08441141e0 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.028+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f083403abb0 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.028+0000 7f0832ffd640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f082c039450 0x7f082c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.028+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f083406cb60 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.028+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0844101510 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.029+0000 7f0841d9b640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f082c039450 0x7f082c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.029+0000 7f0841d9b640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f082c039450 0x7f082c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0838006fd0 tx=0x7f0838006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.033+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0834037030 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.189+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f084404b720 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.190+0000 7f0832ffd640 1 -- 172.21.15.110:0/2297124330 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f0834045460 con 0x7f0844078ae0 2024-09-16T01:56:59.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f082c039450 msgr2=0x7f082c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f082c039450 0x7f082c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0838006fd0 tx=0x7f0838006db0 comp rx=0 tx=0).stop 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 msgr2=0x7f0844112f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f0844112f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0834006f00 tx=0x7f0834008040 comp rx=0 tx=0).stop 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 shutdown_connections 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f082c039450 0x7f082c03b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 --2- 172.21.15.110:0/2297124330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0844078ae0 0x7f0844112f10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 >> 172.21.15.110:0/2297124330 conn(0x7f08440fd850 msgr2=0x7f08440fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 shutdown_connections 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:58.193+0000 7f0848ab4640 1 -- 172.21.15.110:0/2297124330 wait complete. 2024-09-16T01:56:59.138 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling cephadm module... 2024-09-16T01:57:00.013 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:56:59 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/963527306' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T01:57:00.408 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd24be1640 1 Processor -- start 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd24be1640 1 -- start start 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd24be1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd20102840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd24be1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20102d80 con 0x7efd20102430 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd1e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd20102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd1e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd20102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41418/0 (socket says 172.21.15.110:41418) 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd1e59c640 1 -- 172.21.15.110:0/3565903804 learned_addr learned my addr 172.21.15.110:0/3565903804 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.521+0000 7efd1e59c640 1 -- 172.21.15.110:0/3565903804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20102ec0 con 0x7efd20102430 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.522+0000 7efd1e59c640 1 --2- 172.21.15.110:0/3565903804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd20102840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efd10009840 tx=0x7efd100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5957d41344eaaa61 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:00.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd1dd9b640 1 -- 172.21.15.110:0/3565903804 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd10032440 con 0x7efd20102430 2024-09-16T01:57:00.416 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd1dd9b640 1 -- 172.21.15.110:0/3565903804 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7efd10032a00 con 0x7efd20102430 2024-09-16T01:57:00.416 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd1dd9b640 1 -- 172.21.15.110:0/3565903804 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd100319e0 con 0x7efd20102430 2024-09-16T01:57:00.416 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 -- 172.21.15.110:0/3565903804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 msgr2=0x7efd20102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:00.416 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 --2- 172.21.15.110:0/3565903804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd20102840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efd10009840 tx=0x7efd100091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 -- 172.21.15.110:0/3565903804 shutdown_connections 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 --2- 172.21.15.110:0/3565903804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd20102840 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 -- 172.21.15.110:0/3565903804 >> 172.21.15.110:0/3565903804 conn(0x7efd200fbdd0 msgr2=0x7efd200fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 -- 172.21.15.110:0/3565903804 shutdown_connections 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.523+0000 7efd24be1640 1 -- 172.21.15.110:0/3565903804 wait complete. 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd24be1640 1 Processor -- start 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd24be1640 1 -- start start 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd24be1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd2010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd24be1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20110140 con 0x7efd20102430 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd1e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd2010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd1e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd2010fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41432/0 (socket says 172.21.15.110:41432) 2024-09-16T01:57:00.417 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.524+0000 7efd1e59c640 1 -- 172.21.15.110:0/963527306 learned_addr learned my addr 172.21.15.110:0/963527306 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd1e59c640 1 -- 172.21.15.110:0/963527306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10009450 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd1e59c640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd2010fc00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efd100098a0 tx=0x7efd10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd10032880 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7efd1003d8b0 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd20110340 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd1003b910 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.525+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd201107b0 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.526+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7efd10039070 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.526+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2004b720 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.526+0000 7efd177fe640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7efd0c039450 0x7efd0c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.526+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efd1006cdb0 con 0x7efd20102430 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.526+0000 7efd15d9b640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7efd0c039450 0x7efd0c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:00.418 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.526+0000 7efd15d9b640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7efd0c039450 0x7efd0c03b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd08006fd0 tx=0x7efd08006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.530+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efd10071070 con 0x7efd20102430 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.727+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7efd20101bd0 con 0x7efd20102430 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.765+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7efd1004e9a0 con 0x7efd20102430 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.766+0000 7efd177fe640 1 -- 172.21.15.110:0/963527306 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7efd100396e0 con 0x7efd20102430 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7efd0c039450 msgr2=0x7efd0c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7efd0c039450 0x7efd0c03b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd08006fd0 tx=0x7efd08006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 msgr2=0x7efd2010fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd2010fc00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efd100098a0 tx=0x7efd10008040 comp rx=0 tx=0).stop 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 shutdown_connections 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7efd0c039450 0x7efd0c03b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 --2- 172.21.15.110:0/963527306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20102430 0x7efd2010fc00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 >> 172.21.15.110:0/963527306 conn(0x7efd200fbdd0 msgr2=0x7efd200fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:00.419 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 shutdown_connections 2024-09-16T01:57:00.420 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:56:59.769+0000 7efd24be1640 1 -- 172.21.15.110:0/963527306 wait complete. 2024-09-16T01:57:00.801 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:00 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/963527306' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T01:57:00.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:00 smithi110 ceph-mon[27634]: mgrmap e5: smithi110.hfirap(active, since 4s) 2024-09-16T01:57:01.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:57:01.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T01:57:01.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T01:57:01.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "active_name": "smithi110.hfirap", 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f871842c640 1 Processor -- start 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f871842c640 1 -- start start 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f871842c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710107000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f871842c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8710076df0 con 0x7f87100769e0 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f87161c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f87161c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44084/0 (socket says 172.21.15.110:44084) 2024-09-16T01:57:01.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.799+0000 7f87161c8640 1 -- 172.21.15.110:0/3619587577 learned_addr learned my addr 172.21.15.110:0/3619587577 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.800+0000 7f87161c8640 1 -- 172.21.15.110:0/3619587577 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710107540 con 0x7f87100769e0 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.800+0000 7f87161c8640 1 --2- 172.21.15.110:0/3619587577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710107000 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f870c009840 tx=0x7f870c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe19100a469dcd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f87151c6640 1 -- 172.21.15.110:0/3619587577 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f870c032440 con 0x7f87100769e0 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f87151c6640 1 -- 172.21.15.110:0/3619587577 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f870c032a00 con 0x7f87100769e0 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f87151c6640 1 -- 172.21.15.110:0/3619587577 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f870c031a10 con 0x7f87100769e0 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 -- 172.21.15.110:0/3619587577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 msgr2=0x7f8710107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 --2- 172.21.15.110:0/3619587577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710107000 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f870c009840 tx=0x7f870c0091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 -- 172.21.15.110:0/3619587577 shutdown_connections 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 --2- 172.21.15.110:0/3619587577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710107000 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 -- 172.21.15.110:0/3619587577 >> 172.21.15.110:0/3619587577 conn(0x7f87100fc6d0 msgr2=0x7f87100feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 -- 172.21.15.110:0/3619587577 shutdown_connections 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.801+0000 7f871842c640 1 -- 172.21.15.110:0/3619587577 wait complete. 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f871842c640 1 Processor -- start 2024-09-16T01:57:01.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f871842c640 1 -- start start 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f871842c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f871842c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8710113490 con 0x7f87100769e0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f87161c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f87161c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44092/0 (socket says 172.21.15.110:44092) 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.802+0000 7f87161c8640 1 -- 172.21.15.110:0/2812781289 learned_addr learned my addr 172.21.15.110:0/2812781289 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f87161c8640 1 -- 172.21.15.110:0/2812781289 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c009450 con 0x7f87100769e0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f87161c8640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710112f50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f870c006a70 tx=0x7f870c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f870c031d10 con 0x7f87100769e0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f870c031e70 con 0x7f87100769e0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8710113690 con 0x7f87100769e0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f870c03b6f0 con 0x7f87100769e0 2024-09-16T01:57:01.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.803+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8710113b00 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.804+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f870c039070 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.804+0000 7f8706ffd640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 0x7f86fc03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.804+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f870c06c970 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.804+0000 7f87159c7640 1 -- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 msgr2=0x7f86fc03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/750341792 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.804+0000 7f87159c7640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 0x7f86fc03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.804+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87101002f0 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:00.809+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f870c037030 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.005+0000 7f87159c7640 1 -- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 msgr2=0x7f86fc03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/750341792 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.005+0000 7f87159c7640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 0x7f86fc03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.025+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f87101080e0 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.025+0000 7f8706ffd640 1 -- 172.21.15.110:0/2812781289 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f870c045db0 con 0x7f87100769e0 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 msgr2=0x7f86fc03b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:57:01.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 0x7f86fc03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 msgr2=0x7f8710112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710112f50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f870c006a70 tx=0x7f870c02c040 comp rx=0 tx=0).stop 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 shutdown_connections 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f86fc039490 0x7f86fc03b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.027+0000 7f871842c640 1 --2- 172.21.15.110:0/2812781289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87100769e0 0x7f8710112f50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.028+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 >> 172.21.15.110:0/2812781289 conn(0x7f87100fc6d0 msgr2=0x7f87100fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.028+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 shutdown_connections 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:01.028+0000 7f871842c640 1 -- 172.21.15.110:0/2812781289 wait complete. 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for the mgr to restart... 2024-09-16T01:57:01.618 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr epoch 5... 2024-09-16T01:57:01.881 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:01 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2812781289' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: Active manager daemon smithi110.hfirap restarted 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: Activating manager daemon smithi110.hfirap 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: osdmap e2: 0 total, 0 up, 0 in 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: mgrmap e6: smithi110.hfirap(active, starting, since 0.00342642s) 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T01:57:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: Manager daemon smithi110.hfirap is now available 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:57:04.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:04 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T01:57:05.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:05 smithi110 ceph-mon[27634]: Found migration_current of "None". Setting to last migration. 2024-09-16T01:57:05.420 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:05 smithi110 ceph-mon[27634]: mgrmap e7: smithi110.hfirap(active, since 1.00533s) 2024-09-16T01:57:05.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:57:05.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T01:57:05.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T01:57:05.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.046+0000 7f7f045cc640 1 Processor -- start 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.046+0000 7f7f045cc640 1 -- start start 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.047+0000 7f7f045cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc1013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.047+0000 7f7f045cc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc101910 con 0x7f7efc100fc0 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.047+0000 7f7f02368640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc1013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.047+0000 7f7f02368640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc1013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44096/0 (socket says 172.21.15.110:44096) 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.047+0000 7f7f02368640 1 -- 172.21.15.110:0/540518652 learned_addr learned my addr 172.21.15.110:0/540518652 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.047+0000 7f7f02368640 1 -- 172.21.15.110:0/540518652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc101a50 con 0x7f7efc100fc0 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.048+0000 7f7f02368640 1 --2- 172.21.15.110:0/540518652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc1013d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800baf0 tx=0x7f7ef800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4914b65bb94eda82 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.048+0000 7f7f01366640 1 -- 172.21.15.110:0/540518652 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ef8031790 con 0x7f7efc100fc0 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.048+0000 7f7f01366640 1 -- 172.21.15.110:0/540518652 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7ef8031d50 con 0x7f7efc100fc0 2024-09-16T01:57:05.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.048+0000 7f7f01366640 1 -- 172.21.15.110:0/540518652 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ef8039e10 con 0x7f7efc100fc0 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- 172.21.15.110:0/540518652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 msgr2=0x7f7efc1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 --2- 172.21.15.110:0/540518652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc1013d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800baf0 tx=0x7f7ef800b460 comp rx=0 tx=0).stop 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- 172.21.15.110:0/540518652 shutdown_connections 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 --2- 172.21.15.110:0/540518652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc1013d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- 172.21.15.110:0/540518652 >> 172.21.15.110:0/540518652 conn(0x7f7efc0fc6e0 msgr2=0x7f7efc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- 172.21.15.110:0/540518652 shutdown_connections 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- 172.21.15.110:0/540518652 wait complete. 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 Processor -- start 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- start start 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f045cc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1134c0 con 0x7f7efc100fc0 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.049+0000 7f7f02368640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:05.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7f02368640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44104/0 (socket says 172.21.15.110:44104) 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7f02368640 1 -- 172.21.15.110:0/1376175853 learned_addr learned my addr 172.21.15.110:0/1376175853 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7f02368640 1 -- 172.21.15.110:0/1376175853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef800b700 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7f02368640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc112f80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8003080 tx=0x7f7ef8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ef803a5b0 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7ef803ab70 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc1136c0 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ef8044b60 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.050+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc113b30 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.051+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f7ef803a710 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.051+0000 7f7ef2ffd640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.051+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 --> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ee803c0a0 con 0x7f7ee80394e0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.051+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7ef806de20 con 0x7f7efc100fc0 2024-09-16T01:57:05.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.051+0000 7f7f01b67640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 msgr2=0x7f7ee803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/750341792 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.051+0000 7f7f01b67640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.252+0000 7f7f01b67640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 msgr2=0x7f7ee803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/750341792 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.252+0000 7f7f01b67640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.653+0000 7f7f01b67640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 msgr2=0x7f7ee803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/750341792 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:02.653+0000 7f7f01b67640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:03.454+0000 7f7f01b67640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 msgr2=0x7f7ee803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/750341792 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:03.454+0000 7f7f01b67640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:04.102+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7f7ef8043d40 con 0x7f7efc100fc0 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:04.102+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 msgr2=0x7f7ee803b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:04.102+0000 7f7ef2ffd640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.103+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f7ef8043750 con 0x7f7efc100fc0 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.103+0000 7f7ef2ffd640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7ee803cdf0 0x7f7ee803f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.103+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ee803c0a0 con 0x7f7ee803cdf0 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.103+0000 7f7f01b67640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7ee803cdf0 0x7f7ee803f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.104+0000 7f7f01b67640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7ee803cdf0 0x7f7ee803f1d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7eec003940 tx=0x7f7eec009350 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.105+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f7ee803c0a0 con 0x7f7ee803cdf0 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7efc113b30 con 0x7f7ee803cdf0 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7ef2ffd640 1 -- 172.21.15.110:0/1376175853 <== mgr.14116 v2:172.21.15.110:6800/3914114363 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7efc113b30 con 0x7f7ee803cdf0 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7ee803cdf0 msgr2=0x7f7ee803f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7ee803cdf0 0x7f7ee803f1d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7eec003940 tx=0x7f7eec009350 comp rx=0 tx=0).stop 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 msgr2=0x7f7efc112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc112f80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8003080 tx=0x7f7ef8008040 comp rx=0 tx=0).stop 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 shutdown_connections 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7ee803cdf0 0x7f7ee803f1d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:6800/750341792,v1:172.21.15.110:6801/750341792] conn(0x7f7ee80394e0 0x7f7ee803b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 --2- 172.21.15.110:0/1376175853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc100fc0 0x7f7efc112f80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:05.710 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 >> 172.21.15.110:0/1376175853 conn(0x7f7efc0fc6e0 msgr2=0x7f7efc1053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:05.710 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 shutdown_connections 2024-09-16T01:57:05.710 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:05.110+0000 7f7f045cc640 1 -- 172.21.15.110:0/1376175853 wait complete. 2024-09-16T01:57:05.710 INFO:teuthology.orchestra.run.smithi110.stdout:mgr epoch 5 is available 2024-09-16T01:57:05.710 INFO:teuthology.orchestra.run.smithi110.stdout:Setting orchestrator backend to cephadm... 2024-09-16T01:57:06.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T01:57:06.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T01:57:06.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:05] ENGINE Bus STARTING 2024-09-16T01:57:06.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:05] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T01:57:06.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:05] ENGINE Bus STARTED 2024-09-16T01:57:06.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:05] ENGINE Error in HTTPServer.serve 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Traceback (most recent call last): 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._run(expiration_interval) 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s = self.context.wrap_socket( 2024-09-16T01:57:06.837 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: return self.sslsocket_class._create( 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self.do_handshake() 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._sslobj.do_handshake() 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:06.838 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:06 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:57:06.843 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.053+0000 7f8300bf1640 1 Processor -- start 2024-09-16T01:57:06.843 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.053+0000 7f8300bf1640 1 -- start start 2024-09-16T01:57:06.843 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.053+0000 7f8300bf1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc102520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.053+0000 7f8300bf1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc102af0 con 0x7f82fc102110 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.053+0000 7f82fa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc102520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.054+0000 7f82fa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc102520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44174/0 (socket says 172.21.15.110:44174) 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.054+0000 7f82fa59c640 1 -- 172.21.15.110:0/2088405820 learned_addr learned my addr 172.21.15.110:0/2088405820 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.054+0000 7f82fa59c640 1 -- 172.21.15.110:0/2088405820 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc102c30 con 0x7f82fc102110 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.054+0000 7f82fa59c640 1 --2- 172.21.15.110:0/2088405820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc102520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009840 tx=0x7f82ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccde2f56ea903ba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f82f959a640 1 -- 172.21.15.110:0/2088405820 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82ec032440 con 0x7f82fc102110 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f82f959a640 1 -- 172.21.15.110:0/2088405820 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f82ec032a00 con 0x7f82fc102110 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f82f959a640 1 -- 172.21.15.110:0/2088405820 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82ec0319e0 con 0x7f82fc102110 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 -- 172.21.15.110:0/2088405820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 msgr2=0x7f82fc102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 --2- 172.21.15.110:0/2088405820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc102520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009840 tx=0x7f82ec0091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:06.844 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 -- 172.21.15.110:0/2088405820 shutdown_connections 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 --2- 172.21.15.110:0/2088405820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc102520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 -- 172.21.15.110:0/2088405820 >> 172.21.15.110:0/2088405820 conn(0x7f82fc0fd8b0 msgr2=0x7f82fc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 -- 172.21.15.110:0/2088405820 shutdown_connections 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.055+0000 7f8300bf1640 1 -- 172.21.15.110:0/2088405820 wait complete. 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f8300bf1640 1 Processor -- start 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f8300bf1640 1 -- start start 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f8300bf1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f8300bf1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc111360 con 0x7f82fc102110 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f82fa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f82fa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44190/0 (socket says 172.21.15.110:44190) 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f82fa59c640 1 -- 172.21.15.110:0/4271825084 learned_addr learned my addr 172.21.15.110:0/4271825084 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f82fa59c640 1 -- 172.21.15.110:0/4271825084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec009450 con 0x7f82fc102110 2024-09-16T01:57:06.845 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.056+0000 7f82fa59c640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc110e20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f82ec006a70 tx=0x7f82ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.057+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82ec032880 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.057+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f82ec03b8d0 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.057+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc111560 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.057+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82ec03a800 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.057+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc112040 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.057+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f82ec03aa40 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.058+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc101570 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.058+0000 7f82eaffd640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f82e4039380 0x7f82e403b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.058+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f82ec06c8d0 con 0x7f82fc102110 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.058+0000 7f82f9d9b640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f82e4039380 0x7f82e403b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.058+0000 7f82f9d9b640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f82e4039380 0x7f82e403b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82f0006fd0 tx=0x7f82f0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:06.846 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.062+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f82ec042310 con 0x7f82fc102110 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.226+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f82fc0feba0 con 0x7f82e4039380 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.233+0000 7f82eaffd640 1 -- 172.21.15.110:0/4271825084 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f82fc0feba0 con 0x7f82e4039380 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.235+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f82e4039380 msgr2=0x7f82e403b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.235+0000 7f8300bf1640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f82e4039380 0x7f82e403b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f82f0006fd0 tx=0x7f82f0006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.235+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 msgr2=0x7f82fc110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.235+0000 7f8300bf1640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc110e20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f82ec006a70 tx=0x7f82ec008040 comp rx=0 tx=0).stop 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.236+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 shutdown_connections 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.236+0000 7f8300bf1640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f82e4039380 0x7f82e403b830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.236+0000 7f8300bf1640 1 --2- 172.21.15.110:0/4271825084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82fc102110 0x7f82fc110e20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.236+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 >> 172.21.15.110:0/4271825084 conn(0x7f82fc0fd8b0 msgr2=0x7f82fc0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.236+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 shutdown_connections 2024-09-16T01:57:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:06.236+0000 7f8300bf1640 1 -- 172.21.15.110:0/4271825084 wait complete. 2024-09-16T01:57:07.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:07 smithi110 ceph-mon[27634]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:07.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:07 smithi110 ceph-mon[27634]: mgrmap e8: smithi110.hfirap(active, since 2s) 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.226+0000 7f2dcdde6640 1 Processor -- start 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.226+0000 7f2dcdde6640 1 -- start start 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.227+0000 7f2dcdde6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc81023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.227+0000 7f2dcdde6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81028e0 con 0x7f2dc8101f90 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.227+0000 7f2dc77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc81023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.227+0000 7f2dc77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc81023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44198/0 (socket says 172.21.15.110:44198) 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.227+0000 7f2dc77fe640 1 -- 172.21.15.110:0/679298089 learned_addr learned my addr 172.21.15.110:0/679298089 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.227+0000 7f2dc77fe640 1 -- 172.21.15.110:0/679298089 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc8102a20 con 0x7f2dc8101f90 2024-09-16T01:57:08.034 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.228+0000 7f2dc77fe640 1 --2- 172.21.15.110:0/679298089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc81023a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009840 tx=0x7f2db80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7892a105e2ca61a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.228+0000 7f2dc67fc640 1 -- 172.21.15.110:0/679298089 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2db8032440 con 0x7f2dc8101f90 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.228+0000 7f2dc67fc640 1 -- 172.21.15.110:0/679298089 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2db8032a00 con 0x7f2dc8101f90 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.228+0000 7f2dc67fc640 1 -- 172.21.15.110:0/679298089 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2db80319e0 con 0x7f2dc8101f90 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.228+0000 7f2dcdde6640 1 -- 172.21.15.110:0/679298089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 msgr2=0x7f2dc81023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.228+0000 7f2dcdde6640 1 --2- 172.21.15.110:0/679298089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc81023a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009840 tx=0x7f2db80091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 -- 172.21.15.110:0/679298089 shutdown_connections 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 --2- 172.21.15.110:0/679298089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc81023a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 -- 172.21.15.110:0/679298089 >> 172.21.15.110:0/679298089 conn(0x7f2dc80fd710 msgr2=0x7f2dc80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 -- 172.21.15.110:0/679298089 shutdown_connections 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 -- 172.21.15.110:0/679298089 wait complete. 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 Processor -- start 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 -- start start 2024-09-16T01:57:08.035 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc8110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.229+0000 7f2dcdde6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc8111220 con 0x7f2dc8101f90 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dc77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc8110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dc77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc8110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44206/0 (socket says 172.21.15.110:44206) 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dc77fe640 1 -- 172.21.15.110:0/1775627202 learned_addr learned my addr 172.21.15.110:0/1775627202 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dc77fe640 1 -- 172.21.15.110:0/1775627202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8009450 con 0x7f2dc8101f90 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dc77fe640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc8110ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2db80098a0 tx=0x7f2db8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2db8032880 con 0x7f2dc8101f90 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2db803d8b0 con 0x7f2dc8101f90 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc8111420 con 0x7f2dc8101f90 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2db803b910 con 0x7f2dc8101f90 2024-09-16T01:57:08.036 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.230+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc8111890 con 0x7f2dc8101f90 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.231+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2db8039070 con 0x7f2dc8101f90 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.231+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc804b720 con 0x7f2dc8101f90 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.231+0000 7f2daffff640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f2db00394e0 0x7f2db003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.231+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2db806d0f0 con 0x7f2dc8101f90 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.231+0000 7f2dc6ffd640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f2db00394e0 0x7f2db003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.232+0000 7f2dc6ffd640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f2db00394e0 0x7f2db003b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00ad90 tx=0x7f2dbc009410 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.236+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2db804eda0 con 0x7f2dc8101f90 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.395+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc8111890 con 0x7f2db00394e0 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.396+0000 7f2daffff640 1 -- 172.21.15.110:0/1775627202 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f2dc8111890 con 0x7f2db00394e0 2024-09-16T01:57:08.037 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f2db00394e0 msgr2=0x7f2db003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f2db00394e0 0x7f2db003b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00ad90 tx=0x7f2dbc009410 comp rx=0 tx=0).stop 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 msgr2=0x7f2dc8110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc8110ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2db80098a0 tx=0x7f2db8008040 comp rx=0 tx=0).stop 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 shutdown_connections 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f2db00394e0 0x7f2db003b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 --2- 172.21.15.110:0/1775627202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc8101f90 0x7f2dc8110ce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 >> 172.21.15.110:0/1775627202 conn(0x7f2dc80fd710 msgr2=0x7f2dc80fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 shutdown_connections 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:07.398+0000 7f2dcdde6640 1 -- 172.21.15.110:0/1775627202 wait complete. 2024-09-16T01:57:08.038 INFO:teuthology.orchestra.run.smithi110.stdout:Generating ssh key... 2024-09-16T01:57:08.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:08 smithi110 ceph-mon[27634]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.432+0000 7f35ba144640 1 Processor -- start 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35ba144640 1 -- start start 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35ba144640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b41013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35ba144640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b41018e0 con 0x7f35b4100f90 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35b37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b41013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35b37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b41013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44212/0 (socket says 172.21.15.110:44212) 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35b37fe640 1 -- 172.21.15.110:0/3271950448 learned_addr learned my addr 172.21.15.110:0/3271950448 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.433+0000 7f35b37fe640 1 -- 172.21.15.110:0/3271950448 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4101a20 con 0x7f35b4100f90 2024-09-16T01:57:09.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.434+0000 7f35b37fe640 1 --2- 172.21.15.110:0/3271950448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b41013a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009840 tx=0x7f35a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0c7e1c80287bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.434+0000 7f35b2ffd640 1 -- 172.21.15.110:0/3271950448 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35a4032440 con 0x7f35b4100f90 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.434+0000 7f35b2ffd640 1 -- 172.21.15.110:0/3271950448 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f35a4032a00 con 0x7f35b4100f90 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.434+0000 7f35b2ffd640 1 -- 172.21.15.110:0/3271950448 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35a4031a10 con 0x7f35b4100f90 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 -- 172.21.15.110:0/3271950448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 msgr2=0x7f35b41013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 --2- 172.21.15.110:0/3271950448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b41013a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009840 tx=0x7f35a40091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 -- 172.21.15.110:0/3271950448 shutdown_connections 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 --2- 172.21.15.110:0/3271950448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b41013a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 -- 172.21.15.110:0/3271950448 >> 172.21.15.110:0/3271950448 conn(0x7f35b40fc790 msgr2=0x7f35b40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 -- 172.21.15.110:0/3271950448 shutdown_connections 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 -- 172.21.15.110:0/3271950448 wait complete. 2024-09-16T01:57:09.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 Processor -- start 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.435+0000 7f35ba144640 1 -- start start 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35ba144640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35ba144640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4110190 con 0x7f35b4100f90 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44228/0 (socket says 172.21.15.110:44228) 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b37fe640 1 -- 172.21.15.110:0/430371509 learned_addr learned my addr 172.21.15.110:0/430371509 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b37fe640 1 -- 172.21.15.110:0/430371509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009450 con 0x7f35b4100f90 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b37fe640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b410fc50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35a40098a0 tx=0x7f35a402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35a40327b0 con 0x7f35b4100f90 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f35a403b870 con 0x7f35b4100f90 2024-09-16T01:57:09.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b4110390 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35a403a550 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.436+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b4110800 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.437+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f35a4039040 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.437+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b404b720 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.437+0000 7f35b0ff9640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f35a0039490 0x7f35a003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.437+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f35a406c8c0 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.438+0000 7f35aaffd640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f35a0039490 0x7f35a003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.438+0000 7f35aaffd640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f35a0039490 0x7f35a003b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f359c006fd0 tx=0x7f359c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.442+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f35a404b530 con 0x7f35b4100f90 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.597+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f35b4110800 con 0x7f35a0039490 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.748+0000 7f35b0ff9640 1 -- 172.21.15.110:0/430371509 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f35b4110800 con 0x7f35a0039490 2024-09-16T01:57:09.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f35a0039490 msgr2=0x7f35a003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f35a0039490 0x7f35a003b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f359c006fd0 tx=0x7f359c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 msgr2=0x7f35b410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b410fc50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35a40098a0 tx=0x7f35a402c040 comp rx=0 tx=0).stop 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 shutdown_connections 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f35a0039490 0x7f35a003b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 --2- 172.21.15.110:0/430371509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35b4100f90 0x7f35b410fc50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 >> 172.21.15.110:0/430371509 conn(0x7f35b40fc790 msgr2=0x7f35b40fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 shutdown_connections 2024-09-16T01:57:09.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:08.750+0000 7f35ba144640 1 -- 172.21.15.110:0/430371509 wait complete. 2024-09-16T01:57:09.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:09 smithi110 ceph-mon[27634]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:09.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:09 smithi110 ceph-mon[27634]: Generating ssh key... 2024-09-16T01:57:09.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:09 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:09.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:09 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyDVOdkKqYVQntn1j7R9bCqiBhEQd3qQyN63WZneBdVJ2BTbJF4dYyrlPjCa2Vp+TRksreDKrcts3RIv7ut+lOSmM7l558Sv1OpSgDazR/MWUjerhDDnA4rKCWXJEQu7GEY4BcMHOE3p4RJ6hQRmKdwz7k1hW7tK5LcN2avP1Hnb+d3bs4Xpwo3KtzvPJQGPWr/3kKbsCeskwLpOQkLuVAA/VVsO86No/MRhQCxlKg/d0YAx9QuAPysnumRYywQM/0AUBGKty/p85gHoU2MXDHks67kj79JsmJKIIOxY32tDJ4Aw1kH39agSHR0FTl9Bp/O2hV6t/F744Fj/m4xUeQC7oefVWeOIbXjRitchN4qGkNrtmEDU4DYCqvTShQk2SJR9rKKR6axWtKCfxBbG4jKsAPRvZj+QwwRrOCcAWjlHyssV6jPDYM13WYge0Z5OyeMCjyVwh5l5EB7dKiDGUYjZExqu6hfPDL0M99WXj/Fg9bz4TRaTcp9mPhU0SyGxc= ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3299725640 1 Processor -- start 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3299725640 1 -- start start 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3299725640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f32941039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3299725640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294070e30 con 0x7f32941035c0 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3292ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f32941039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3292ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f32941039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44234/0 (socket says 172.21.15.110:44234) 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3292ffd640 1 -- 172.21.15.110:0/856613639 learned_addr learned my addr 172.21.15.110:0/856613639 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.697+0000 7f3292ffd640 1 -- 172.21.15.110:0/856613639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294103f10 con 0x7f32941035c0 2024-09-16T01:57:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.698+0000 7f3292ffd640 1 --2- 172.21.15.110:0/856613639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f32941039d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3284009840 tx=0x7f32840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de9a5559526e853 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.698+0000 7f3291ffb640 1 -- 172.21.15.110:0/856613639 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3284032440 con 0x7f32941035c0 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.698+0000 7f3291ffb640 1 -- 172.21.15.110:0/856613639 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3284032a00 con 0x7f32941035c0 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.698+0000 7f3291ffb640 1 -- 172.21.15.110:0/856613639 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32840319e0 con 0x7f32941035c0 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.698+0000 7f3299725640 1 -- 172.21.15.110:0/856613639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 msgr2=0x7f32941039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.698+0000 7f3299725640 1 --2- 172.21.15.110:0/856613639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f32941039d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3284009840 tx=0x7f32840091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 -- 172.21.15.110:0/856613639 shutdown_connections 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 --2- 172.21.15.110:0/856613639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f32941039d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 -- 172.21.15.110:0/856613639 >> 172.21.15.110:0/856613639 conn(0x7f32940fbdc0 msgr2=0x7f32940fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 -- 172.21.15.110:0/856613639 shutdown_connections 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 -- 172.21.15.110:0/856613639 wait complete. 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 Processor -- start 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 -- start start 2024-09-16T01:57:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f3294110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3299725640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294111340 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3292ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f3294110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3292ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f3294110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44246/0 (socket says 172.21.15.110:44246) 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.699+0000 7f3292ffd640 1 -- 172.21.15.110:0/294638319 learned_addr learned my addr 172.21.15.110:0/294638319 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f3292ffd640 1 -- 172.21.15.110:0/294638319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009450 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f3292ffd640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f3294110e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3284000c00 tx=0x7f3284008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f328403d450 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f328403da10 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294111540 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f328403b8a0 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.700+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3294111f90 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.701+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3284039070 con 0x7f32941035c0 2024-09-16T01:57:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.701+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32940ffa60 con 0x7f32941035c0 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.701+0000 7f328b7fe640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f3280039490 0x7f328003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.701+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f328406d3c0 con 0x7f32941035c0 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.701+0000 7f32927fc640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f3280039490 0x7f328003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.702+0000 7f32927fc640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f3280039490 0x7f328003b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f327c006fd0 tx=0x7f327c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.706+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f328403d5b0 con 0x7f32941035c0 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.862+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f32940fd050 con 0x7f3280039490 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.863+0000 7f328b7fe640 1 -- 172.21.15.110:0/294638319 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f32940fd050 con 0x7f3280039490 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f3280039490 msgr2=0x7f328003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f3280039490 0x7f328003b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f327c006fd0 tx=0x7f327c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 msgr2=0x7f3294110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f3294110e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3284000c00 tx=0x7f3284008040 comp rx=0 tx=0).stop 2024-09-16T01:57:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 shutdown_connections 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f3280039490 0x7f328003b940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 --2- 172.21.15.110:0/294638319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32941035c0 0x7f3294110e00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 >> 172.21.15.110:0/294638319 conn(0x7f32940fbdc0 msgr2=0x7f32940fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 shutdown_connections 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:09.865+0000 7f3299725640 1 -- 172.21.15.110:0/294638319 wait complete. 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:57:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T01:57:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:Adding host smithi110... 2024-09-16T01:57:11.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:10 smithi110 ceph-mon[27634]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:12.002 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:11 smithi110 ceph-mon[27634]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "addr": "172.21.15.110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:12.944 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:12 smithi110 ceph-mon[27634]: Deploying cephadm binary to smithi110 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Added host 'smithi110' with addr '172.21.15.110' 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39ac924640 1 Processor -- start 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39ac924640 1 -- start start 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39ac924640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39ac924640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8101880 con 0x7f39a8100f30 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39a659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39a659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46358/0 (socket says 172.21.15.110:46358) 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.048+0000 7f39a659c640 1 -- 172.21.15.110:0/1231702119 learned_addr learned my addr 172.21.15.110:0/1231702119 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.049+0000 7f39a659c640 1 -- 172.21.15.110:0/1231702119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a81019c0 con 0x7f39a8100f30 2024-09-16T01:57:14.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.049+0000 7f39a659c640 1 --2- 172.21.15.110:0/1231702119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8101340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3998009840 tx=0x7f39980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90397d5a9bc5eb24 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.049+0000 7f39a559a640 1 -- 172.21.15.110:0/1231702119 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3998032440 con 0x7f39a8100f30 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39a559a640 1 -- 172.21.15.110:0/1231702119 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3998032a00 con 0x7f39a8100f30 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39a559a640 1 -- 172.21.15.110:0/1231702119 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39980319e0 con 0x7f39a8100f30 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 -- 172.21.15.110:0/1231702119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 msgr2=0x7f39a8101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 --2- 172.21.15.110:0/1231702119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8101340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3998009840 tx=0x7f39980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 -- 172.21.15.110:0/1231702119 shutdown_connections 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 --2- 172.21.15.110:0/1231702119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8101340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 -- 172.21.15.110:0/1231702119 >> 172.21.15.110:0/1231702119 conn(0x7f39a80fc730 msgr2=0x7f39a80feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 -- 172.21.15.110:0/1231702119 shutdown_connections 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.050+0000 7f39ac924640 1 -- 172.21.15.110:0/1231702119 wait complete. 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39ac924640 1 Processor -- start 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39ac924640 1 -- start start 2024-09-16T01:57:14.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39ac924640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39ac924640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8113aa0 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39a659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39a659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46360/0 (socket says 172.21.15.110:46360) 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39a659c640 1 -- 172.21.15.110:0/3644867200 learned_addr learned my addr 172.21.15.110:0/3644867200 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.051+0000 7f39a659c640 1 -- 172.21.15.110:0/3644867200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998009450 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.052+0000 7f39a659c640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8076ae0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39980098a0 tx=0x7f3998008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.052+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3998032880 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.052+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f399803d8b0 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.052+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a8113be0 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.052+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f399803b910 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.052+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a8113ff0 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.053+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3998039070 con 0x7f39a8100f30 2024-09-16T01:57:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.053+0000 7f3996ffd640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f39900394e0 0x7f399003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.053+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f399806d2d0 con 0x7f39a8100f30 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.053+0000 7f39a5d9b640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f39900394e0 0x7f399003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.053+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a804b720 con 0x7f39a8100f30 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.053+0000 7f39a5d9b640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f39900394e0 0x7f399003b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f399c006fd0 tx=0x7f399c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.057+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3998041080 con 0x7f39a8100f30 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:11.217+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi110", "addr": "172.21.15.110", "target": ["mon-mgr", ""]}) v1 -- 0x7f39a80fdae0 con 0x7f39900394e0 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.900+0000 7f3996ffd640 1 -- 172.21.15.110:0/3644867200 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f39a80fdae0 con 0x7f39900394e0 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f39900394e0 msgr2=0x7f399003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f39900394e0 0x7f399003b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f399c006fd0 tx=0x7f399c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 msgr2=0x7f39a8076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:14.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8076ae0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39980098a0 tx=0x7f3998008040 comp rx=0 tx=0).stop 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 shutdown_connections 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f39900394e0 0x7f399003b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 --2- 172.21.15.110:0/3644867200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a8100f30 0x7f39a8076ae0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 >> 172.21.15.110:0/3644867200 conn(0x7f39a80fc730 msgr2=0x7f39a80fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.903+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 shutdown_connections 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:13.904+0000 7f39ac924640 1 -- 172.21.15.110:0/3644867200 wait complete. 2024-09-16T01:57:14.501 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying mon service with default placement... 2024-09-16T01:57:15.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:14 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:15.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:14 smithi110 ceph-mon[27634]: Added host smithi110 2024-09-16T01:57:15.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:14 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:57:16.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:16 smithi110 ceph-mon[27634]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:16.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:16 smithi110 ceph-mon[27634]: Saving service mon spec with placement count:5 2024-09-16T01:57:16.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:16 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.095+0000 7fcb2785a640 1 Processor -- start 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.095+0000 7fcb2785a640 1 -- start start 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.096+0000 7fcb2785a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20102360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.096+0000 7fcb2785a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb201028a0 con 0x7fcb20101f50 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.096+0000 7fcb255f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:16.746 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.096+0000 7fcb255f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20102360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46366/0 (socket says 172.21.15.110:46366) 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.096+0000 7fcb255f6640 1 -- 172.21.15.110:0/1137268750 learned_addr learned my addr 172.21.15.110:0/1137268750 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.096+0000 7fcb255f6640 1 -- 172.21.15.110:0/1137268750 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb201029e0 con 0x7fcb20101f50 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.097+0000 7fcb255f6640 1 --2- 172.21.15.110:0/1137268750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20102360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009840 tx=0x7fcb100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3566816b63dc25a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.097+0000 7fcb1ffff640 1 -- 172.21.15.110:0/1137268750 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb10032440 con 0x7fcb20101f50 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.097+0000 7fcb1ffff640 1 -- 172.21.15.110:0/1137268750 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcb10032a00 con 0x7fcb20101f50 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.097+0000 7fcb1ffff640 1 -- 172.21.15.110:0/1137268750 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb100319e0 con 0x7fcb20101f50 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 -- 172.21.15.110:0/1137268750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 msgr2=0x7fcb20102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 --2- 172.21.15.110:0/1137268750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20102360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009840 tx=0x7fcb100091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 -- 172.21.15.110:0/1137268750 shutdown_connections 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 --2- 172.21.15.110:0/1137268750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20102360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 -- 172.21.15.110:0/1137268750 >> 172.21.15.110:0/1137268750 conn(0x7fcb200fd770 msgr2=0x7fcb200ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 -- 172.21.15.110:0/1137268750 shutdown_connections 2024-09-16T01:57:16.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.098+0000 7fcb2785a640 1 -- 172.21.15.110:0/1137268750 wait complete. 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb2785a640 1 Processor -- start 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb2785a640 1 -- start start 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb2785a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb2785a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20111350 con 0x7fcb20101f50 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb255f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb255f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46382/0 (socket says 172.21.15.110:46382) 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb255f6640 1 -- 172.21.15.110:0/3013607329 learned_addr learned my addr 172.21.15.110:0/3013607329 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb255f6640 1 -- 172.21.15.110:0/3013607329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009450 con 0x7fcb20101f50 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb255f6640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20110e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb10000c00 tx=0x7fcb10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb1003d450 con 0x7fcb20101f50 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcb1003da10 con 0x7fcb20101f50 2024-09-16T01:57:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb20111550 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.099+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb1003b880 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.100+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb20111fa0 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.101+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fcb10039070 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.101+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb201013b0 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.101+0000 7fcb1dffb640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fcb080394e0 0x7fcb0803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.101+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcb1006d570 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.101+0000 7fcb24df5640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fcb080394e0 0x7fcb0803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.101+0000 7fcb24df5640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fcb080394e0 0x7fcb0803b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400ad90 tx=0x7fcb14009410 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.106+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcb1003ad00 con 0x7fcb20101f50 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.279+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb200feb30 con 0x7fcb080394e0 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.284+0000 7fcb1dffb640 1 -- 172.21.15.110:0/3013607329 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcb200feb30 con 0x7fcb080394e0 2024-09-16T01:57:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.285+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fcb080394e0 msgr2=0x7fcb0803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.285+0000 7fcb2785a640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fcb080394e0 0x7fcb0803b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400ad90 tx=0x7fcb14009410 comp rx=0 tx=0).stop 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.285+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 msgr2=0x7fcb20110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.285+0000 7fcb2785a640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20110e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb10000c00 tx=0x7fcb10008040 comp rx=0 tx=0).stop 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.286+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 shutdown_connections 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.286+0000 7fcb2785a640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fcb080394e0 0x7fcb0803b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.286+0000 7fcb2785a640 1 --2- 172.21.15.110:0/3013607329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb20101f50 0x7fcb20110e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.286+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 >> 172.21.15.110:0/3013607329 conn(0x7fcb200fd770 msgr2=0x7fcb200fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.286+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 shutdown_connections 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:15.286+0000 7fcb2785a640 1 -- 172.21.15.110:0/3013607329 wait complete. 2024-09-16T01:57:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying mgr service with default placement... 2024-09-16T01:57:17.694 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:17 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:17.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:17 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.190+0000 7fa1a2cf8640 1 Processor -- start 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.190+0000 7fa1a2cf8640 1 -- start start 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.191+0000 7fa1a2cf8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.191+0000 7fa1a2cf8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1017e0 con 0x7fa19c100e90 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.191+0000 7fa1a0a94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:18.541 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.191+0000 7fa1a0a94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46398/0 (socket says 172.21.15.110:46398) 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.191+0000 7fa1a0a94640 1 -- 172.21.15.110:0/210612522 learned_addr learned my addr 172.21.15.110:0/210612522 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.191+0000 7fa1a0a94640 1 -- 172.21.15.110:0/210612522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c101920 con 0x7fa19c100e90 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.192+0000 7fa1a0a94640 1 --2- 172.21.15.110:0/210612522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c1012a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa198009840 tx=0x7fa1980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1df190e946cd72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.192+0000 7fa1937fe640 1 -- 172.21.15.110:0/210612522 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa198032440 con 0x7fa19c100e90 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.192+0000 7fa1937fe640 1 -- 172.21.15.110:0/210612522 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa198032a40 con 0x7fa19c100e90 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.192+0000 7fa1937fe640 1 -- 172.21.15.110:0/210612522 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa198031aa0 con 0x7fa19c100e90 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.192+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/210612522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 msgr2=0x7fa19c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.192+0000 7fa1a2cf8640 1 --2- 172.21.15.110:0/210612522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c1012a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa198009840 tx=0x7fa1980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:18.542 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/210612522 shutdown_connections 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 --2- 172.21.15.110:0/210612522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c1012a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/210612522 >> 172.21.15.110:0/210612522 conn(0x7fa19c0fc6d0 msgr2=0x7fa19c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/210612522 shutdown_connections 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/210612522 wait complete. 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 Processor -- start 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 -- start start 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a2cf8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c113a90 con 0x7fa19c100e90 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.193+0000 7fa1a0a94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1a0a94640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46412/0 (socket says 172.21.15.110:46412) 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1a0a94640 1 -- 172.21.15.110:0/3696354811 learned_addr learned my addr 172.21.15.110:0/3696354811 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1a0a94640 1 -- 172.21.15.110:0/3696354811 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198009450 con 0x7fa19c100e90 2024-09-16T01:57:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1a0a94640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c076ae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa198009810 tx=0x7fa1980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1980327b0 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa19803b8d0 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa19803a6f0 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c113bd0 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.194+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c113fe0 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.195+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa198039040 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.195+0000 7fa1917fa640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fa1840394e0 0x7fa18403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.195+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa19806cba0 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.195+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c04b720 con 0x7fa19c100e90 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.195+0000 7fa193fff640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fa1840394e0 0x7fa18403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:18.544 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.196+0000 7fa193fff640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fa1840394e0 0x7fa18403b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa18c006fd0 tx=0x7fa18c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:18.545 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.200+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa198037080 con 0x7fa19c100e90 2024-09-16T01:57:18.545 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.386+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fa19c0fd950 con 0x7fa1840394e0 2024-09-16T01:57:18.545 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.391+0000 7fa1917fa640 1 -- 172.21.15.110:0/3696354811 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa19c0fd950 con 0x7fa1840394e0 2024-09-16T01:57:18.545 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fa1840394e0 msgr2=0x7fa18403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:18.545 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fa1840394e0 0x7fa18403b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa18c006fd0 tx=0x7fa18c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:18.545 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 msgr2=0x7fa19c076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c076ae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa198009810 tx=0x7fa1980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 shutdown_connections 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fa1840394e0 0x7fa18403b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 --2- 172.21.15.110:0/3696354811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa19c100e90 0x7fa19c076ae0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.393+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 >> 172.21.15.110:0/3696354811 conn(0x7fa19c0fc6d0 msgr2=0x7fa19c0fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.394+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 shutdown_connections 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:17.394+0000 7fa1a2cf8640 1 -- 172.21.15.110:0/3696354811 wait complete. 2024-09-16T01:57:18.546 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying crash service with default placement... 2024-09-16T01:57:18.650 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:18 smithi110 ceph-mon[27634]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:18.651 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:18 smithi110 ceph-mon[27634]: Saving service mgr spec with placement count:2 2024-09-16T01:57:18.651 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:18 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:18.651 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:18 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:19.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-16T01:57:19.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8add62640 1 Processor -- start 2024-09-16T01:57:19.747 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8add62640 1 -- start start 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8add62640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a81007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8add62640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8100d00 con 0x7fe8a81003b0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a81007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a81007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46418/0 (socket says 172.21.15.110:46418) 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.949+0000 7fe8a77fe640 1 -- 172.21.15.110:0/2010492892 learned_addr learned my addr 172.21.15.110:0/2010492892 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.950+0000 7fe8a77fe640 1 -- 172.21.15.110:0/2010492892 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8100e40 con 0x7fe8a81003b0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.950+0000 7fe8a77fe640 1 --2- 172.21.15.110:0/2010492892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a81007c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe898009840 tx=0x7fe8980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45426cab82d079b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8a67fc640 1 -- 172.21.15.110:0/2010492892 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe898032440 con 0x7fe8a81003b0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8a67fc640 1 -- 172.21.15.110:0/2010492892 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe898032a40 con 0x7fe8a81003b0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8a67fc640 1 -- 172.21.15.110:0/2010492892 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe898031a70 con 0x7fe8a81003b0 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 -- 172.21.15.110:0/2010492892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 msgr2=0x7fe8a81007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:19.748 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 --2- 172.21.15.110:0/2010492892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a81007c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe898009840 tx=0x7fe8980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 -- 172.21.15.110:0/2010492892 shutdown_connections 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 --2- 172.21.15.110:0/2010492892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a81007c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 -- 172.21.15.110:0/2010492892 >> 172.21.15.110:0/2010492892 conn(0x7fe8a80fbdd0 msgr2=0x7fe8a80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 -- 172.21.15.110:0/2010492892 shutdown_connections 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.951+0000 7fe8add62640 1 -- 172.21.15.110:0/2010492892 wait complete. 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8add62640 1 Processor -- start 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8add62640 1 -- start start 2024-09-16T01:57:19.749 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8add62640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a8110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:19.750 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8add62640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8111310 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a8110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a8110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46426/0 (socket says 172.21.15.110:46426) 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.952+0000 7fe8a77fe640 1 -- 172.21.15.110:0/3977160406 learned_addr learned my addr 172.21.15.110:0/3977160406 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe8a77fe640 1 -- 172.21.15.110:0/3977160406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009450 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe8a77fe640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a8110dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe898009810 tx=0x7fe8980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe89803c400 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe89803ca00 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe89803a870 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a8111510 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.953+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a8111f60 con 0x7fe8a81003b0 2024-09-16T01:57:19.751 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.954+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe89803aae0 con 0x7fe8a81003b0 2024-09-16T01:57:19.752 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.954+0000 7fe88ffff640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe8900394e0 0x7fe89003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:19.752 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.954+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe89806ce80 con 0x7fe8a81003b0 2024-09-16T01:57:19.752 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.954+0000 7fe8a6ffd640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe8900394e0 0x7fe89003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:19.752 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.954+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a80ffa70 con 0x7fe8a81003b0 2024-09-16T01:57:19.752 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.955+0000 7fe8a6ffd640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe8900394e0 0x7fe89003b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe89c006fd0 tx=0x7fe89c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:19.752 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:18.959+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe898037030 con 0x7fe8a81003b0 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.121+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8a80fd0f0 con 0x7fe8900394e0 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.125+0000 7fe88ffff640 1 -- 172.21.15.110:0/3977160406 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fe8a80fd0f0 con 0x7fe8900394e0 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe8900394e0 msgr2=0x7fe89003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe8900394e0 0x7fe89003b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe89c006fd0 tx=0x7fe89c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 msgr2=0x7fe8a8110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a8110dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe898009810 tx=0x7fe8980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 shutdown_connections 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe8900394e0 0x7fe89003b990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 --2- 172.21.15.110:0/3977160406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8a81003b0 0x7fe8a8110dd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.127+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 >> 172.21.15.110:0/3977160406 conn(0x7fe8a80fbdd0 msgr2=0x7fe8a80fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.128+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 shutdown_connections 2024-09-16T01:57:19.753 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:19.128+0000 7fe8add62640 1 -- 172.21.15.110:0/3977160406 wait complete. 2024-09-16T01:57:19.754 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying prometheus service with default placement... 2024-09-16T01:57:20.389 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:20 smithi110 ceph-mon[27634]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:20.389 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:20 smithi110 ceph-mon[27634]: Saving service crash spec with placement * 2024-09-16T01:57:20.389 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:20 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:20.389 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:20 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:21.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:21 smithi110 ceph-mon[27634]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:21.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:21 smithi110 ceph-mon[27634]: Saving service prometheus spec with placement count:1 2024-09-16T01:57:21.587 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:21 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:21.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-16T01:57:21.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.143+0000 7ff304c26640 1 Processor -- start 2024-09-16T01:57:21.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff304c26640 1 -- start start 2024-09-16T01:57:21.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff304c26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300102420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:21.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff304c26640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300102960 con 0x7ff300102010 2024-09-16T01:57:21.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46434/0 (socket says 172.21.15.110:46434) 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff2fe59c640 1 -- 172.21.15.110:0/2468148730 learned_addr learned my addr 172.21.15.110:0/2468148730 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.144+0000 7ff2fe59c640 1 -- 172.21.15.110:0/2468148730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300102aa0 con 0x7ff300102010 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.145+0000 7ff2fe59c640 1 --2- 172.21.15.110:0/2468148730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300102420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009840 tx=0x7ff2f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04432823991d129 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.145+0000 7ff2fd59a640 1 -- 172.21.15.110:0/2468148730 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2f0032440 con 0x7ff300102010 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.145+0000 7ff2fd59a640 1 -- 172.21.15.110:0/2468148730 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2f0032a40 con 0x7ff300102010 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.145+0000 7ff2fd59a640 1 -- 172.21.15.110:0/2468148730 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2f0031a70 con 0x7ff300102010 2024-09-16T01:57:21.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 -- 172.21.15.110:0/2468148730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 msgr2=0x7ff300102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 --2- 172.21.15.110:0/2468148730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300102420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009840 tx=0x7ff2f00091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 -- 172.21.15.110:0/2468148730 shutdown_connections 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 --2- 172.21.15.110:0/2468148730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300102420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 -- 172.21.15.110:0/2468148730 >> 172.21.15.110:0/2468148730 conn(0x7ff3000fd790 msgr2=0x7ff3000ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 -- 172.21.15.110:0/2468148730 shutdown_connections 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.146+0000 7ff304c26640 1 -- 172.21.15.110:0/2468148730 wait complete. 2024-09-16T01:57:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff304c26640 1 Processor -- start 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff304c26640 1 -- start start 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff304c26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff304c26640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300111370 con 0x7ff300102010 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46436/0 (socket says 172.21.15.110:46436) 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff2fe59c640 1 -- 172.21.15.110:0/2734573472 learned_addr learned my addr 172.21.15.110:0/2734573472 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:21.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff2fe59c640 1 -- 172.21.15.110:0/2734573472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0009450 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.147+0000 7ff2fe59c640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300110e30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009810 tx=0x7ff2f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.148+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2f003c400 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.148+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2f003ca00 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.148+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2f003a870 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.148+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff300111570 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.148+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff300111fc0 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.148+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff2f003aae0 con 0x7ff300102010 2024-09-16T01:57:21.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.149+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff300101470 con 0x7ff300102010 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.149+0000 7ff2eeffd640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff2e80394e0 0x7ff2e803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.149+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff2f006cfc0 con 0x7ff300102010 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.149+0000 7ff2fdd9b640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff2e80394e0 0x7ff2e803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.149+0000 7ff2fdd9b640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff2e80394e0 0x7ff2e803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4006fd0 tx=0x7ff2f4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.153+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff2f00394f0 con 0x7ff300102010 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.331+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3000feac0 con 0x7ff2e80394e0 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.335+0000 7ff2eeffd640 1 -- 172.21.15.110:0/2734573472 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7ff3000feac0 con 0x7ff2e80394e0 2024-09-16T01:57:21.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff2e80394e0 msgr2=0x7ff2e803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff2e80394e0 0x7ff2e803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4006fd0 tx=0x7ff2f4006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 msgr2=0x7ff300110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300110e30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009810 tx=0x7ff2f00091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 shutdown_connections 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff2e80394e0 0x7ff2e803b990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 --2- 172.21.15.110:0/2734573472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff300102010 0x7ff300110e30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 >> 172.21.15.110:0/2734573472 conn(0x7ff3000fd790 msgr2=0x7ff3000fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 shutdown_connections 2024-09-16T01:57:21.880 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:20.337+0000 7ff304c26640 1 -- 172.21.15.110:0/2734573472 wait complete. 2024-09-16T01:57:21.880 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying grafana service with default placement... 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.286+0000 7fe49941a640 1 Processor -- start 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.286+0000 7fe49941a640 1 -- start start 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.286+0000 7fe49941a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.286+0000 7fe49941a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494076f20 con 0x7fe494076b10 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.287+0000 7fe492ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.287+0000 7fe492ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38732/0 (socket says 172.21.15.110:38732) 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.287+0000 7fe492ffd640 1 -- 172.21.15.110:0/669484186 learned_addr learned my addr 172.21.15.110:0/669484186 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:23.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.287+0000 7fe492ffd640 1 -- 172.21.15.110:0/669484186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494105120 con 0x7fe494076b10 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.288+0000 7fe492ffd640 1 --2- 172.21.15.110:0/669484186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494104be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe484009e50 tx=0x7fe484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988a3f5ad6650e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.288+0000 7fe491ffb640 1 -- 172.21.15.110:0/669484186 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484031560 con 0x7fe494076b10 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.288+0000 7fe491ffb640 1 -- 172.21.15.110:0/669484186 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe48402d050 con 0x7fe494076b10 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.288+0000 7fe491ffb640 1 -- 172.21.15.110:0/669484186 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484007a60 con 0x7fe494076b10 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 -- 172.21.15.110:0/669484186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 msgr2=0x7fe494104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 --2- 172.21.15.110:0/669484186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494104be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe484009e50 tx=0x7fe484009840 comp rx=0 tx=0).stop 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 -- 172.21.15.110:0/669484186 shutdown_connections 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 --2- 172.21.15.110:0/669484186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494104be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 -- 172.21.15.110:0/669484186 >> 172.21.15.110:0/669484186 conn(0x7fe4940fc6d0 msgr2=0x7fe4940feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 -- 172.21.15.110:0/669484186 shutdown_connections 2024-09-16T01:57:23.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.289+0000 7fe49941a640 1 -- 172.21.15.110:0/669484186 wait complete. 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe49941a640 1 Processor -- start 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe49941a640 1 -- start start 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe49941a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe49941a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494102a50 con 0x7fe494076b10 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe492ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe492ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38740/0 (socket says 172.21.15.110:38740) 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe492ffd640 1 -- 172.21.15.110:0/1097270372 learned_addr learned my addr 172.21.15.110:0/1097270372 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe492ffd640 1 -- 172.21.15.110:0/1097270372 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009ae0 con 0x7fe494076b10 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.290+0000 7fe492ffd640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494102510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe48402ac70 tx=0x7fe484009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.291+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484031bc0 con 0x7fe494076b10 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.291+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe484031d20 con 0x7fe494076b10 2024-09-16T01:57:23.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.291+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe494100ae0 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.291+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484045570 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.291+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe494100f50 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.291+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe484038050 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.292+0000 7fe47b7fe640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe47c0394e0 0x7fe47c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.292+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49404b720 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.292+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe48406cdb0 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.292+0000 7fe4927fc640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe47c0394e0 0x7fe47c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.292+0000 7fe4927fc640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe47c0394e0 0x7fe47c03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe488006fd0 tx=0x7fe488006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.296+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe484036070 con 0x7fe494076b10 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.461+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4941015d0 con 0x7fe47c0394e0 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.466+0000 7fe47b7fe640 1 -- 172.21.15.110:0/1097270372 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fe4941015d0 con 0x7fe47c0394e0 2024-09-16T01:57:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe47c0394e0 msgr2=0x7fe47c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe47c0394e0 0x7fe47c03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe488006fd0 tx=0x7fe488006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 msgr2=0x7fe494102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494102510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe48402ac70 tx=0x7fe484009840 comp rx=0 tx=0).stop 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 shutdown_connections 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fe47c0394e0 0x7fe47c03b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 --2- 172.21.15.110:0/1097270372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe494076b10 0x7fe494102510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 >> 172.21.15.110:0/1097270372 conn(0x7fe4940fc6d0 msgr2=0x7fe4940fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 shutdown_connections 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:22.468+0000 7fe49941a640 1 -- 172.21.15.110:0/1097270372 wait complete. 2024-09-16T01:57:23.030 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying node-exporter service with default placement... 2024-09-16T01:57:23.607 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:23 smithi110 ceph-mon[27634]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:23.607 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:23 smithi110 ceph-mon[27634]: Saving service grafana spec with placement count:1 2024-09-16T01:57:23.607 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:23 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:24.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.427+0000 7fd6b8a6f640 1 Processor -- start 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.427+0000 7fd6b8a6f640 1 -- start start 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.428+0000 7fd6b8a6f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b41012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.428+0000 7fd6b8a6f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41017e0 con 0x7fd6b4100e90 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.428+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b41012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.428+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b41012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38742/0 (socket says 172.21.15.110:38742) 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.428+0000 7fd6b259c640 1 -- 172.21.15.110:0/2526658629 learned_addr learned my addr 172.21.15.110:0/2526658629 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:24.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.428+0000 7fd6b259c640 1 -- 172.21.15.110:0/2526658629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4101920 con 0x7fd6b4100e90 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.429+0000 7fd6b259c640 1 --2- 172.21.15.110:0/2526658629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b41012a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009840 tx=0x7fd6a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16dd2d45ca461c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.429+0000 7fd6b159a640 1 -- 172.21.15.110:0/2526658629 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a4032440 con 0x7fd6b4100e90 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.429+0000 7fd6b159a640 1 -- 172.21.15.110:0/2526658629 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6a4032a40 con 0x7fd6b4100e90 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.429+0000 7fd6b159a640 1 -- 172.21.15.110:0/2526658629 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a4031aa0 con 0x7fd6b4100e90 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/2526658629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 msgr2=0x7fd6b41012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 --2- 172.21.15.110:0/2526658629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b41012a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009840 tx=0x7fd6a40091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/2526658629 shutdown_connections 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 --2- 172.21.15.110:0/2526658629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b41012a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/2526658629 >> 172.21.15.110:0/2526658629 conn(0x7fd6b40fc6d0 msgr2=0x7fd6b40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/2526658629 shutdown_connections 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/2526658629 wait complete. 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 Processor -- start 2024-09-16T01:57:24.276 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- start start 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.430+0000 7fd6b8a6f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4110190 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38746/0 (socket says 172.21.15.110:38746) 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b259c640 1 -- 172.21.15.110:0/4002762234 learned_addr learned my addr 172.21.15.110:0/4002762234 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b259c640 1 -- 172.21.15.110:0/4002762234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009450 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b259c640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b410fc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4006a70 tx=0x7fd6a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a4031d20 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6a4031e80 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4110390 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a403a750 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.431+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b4110800 con 0x7fd6b4100e90 2024-09-16T01:57:24.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.432+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd6a4039040 con 0x7fd6b4100e90 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.432+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b404b720 con 0x7fd6b4100e90 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.432+0000 7fd6aaffd640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fd6a00394e0 0x7fd6a003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.432+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd6a406c950 con 0x7fd6b4100e90 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.432+0000 7fd6b1d9b640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fd6a00394e0 0x7fd6a003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.433+0000 7fd6b1d9b640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fd6a00394e0 0x7fd6a003b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd69c006fd0 tx=0x7fd69c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.436+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd6a4030b20 con 0x7fd6b4100e90 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.601+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6b4110800 con 0x7fd6a00394e0 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.605+0000 7fd6aaffd640 1 -- 172.21.15.110:0/4002762234 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd6b4110800 con 0x7fd6a00394e0 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fd6a00394e0 msgr2=0x7fd6a003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fd6a00394e0 0x7fd6a003b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd69c006fd0 tx=0x7fd69c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 msgr2=0x7fd6b410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b410fc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4006a70 tx=0x7fd6a40091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:24.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 shutdown_connections 2024-09-16T01:57:24.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fd6a00394e0 0x7fd6a003b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:24.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 --2- 172.21.15.110:0/4002762234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b4100e90 0x7fd6b410fc50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:24.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.607+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 >> 172.21.15.110:0/4002762234 conn(0x7fd6b40fc6d0 msgr2=0x7fd6b40fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:24.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.608+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 shutdown_connections 2024-09-16T01:57:24.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:23.608+0000 7fd6b8a6f640 1 -- 172.21.15.110:0/4002762234 wait complete. 2024-09-16T01:57:24.279 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying alertmanager service with default placement... 2024-09-16T01:57:24.853 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:24 smithi110 ceph-mon[27634]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:24.853 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:24 smithi110 ceph-mon[27634]: Saving service node-exporter spec with placement * 2024-09-16T01:57:24.853 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:24 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.677+0000 7f9128e99640 1 Processor -- start 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.677+0000 7f9128e99640 1 -- start start 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.677+0000 7f9128e99640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f91241023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.677+0000 7f9128e99640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91241028e0 con 0x7f9124101f90 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.678+0000 7f912259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f91241023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:25.440 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.678+0000 7f912259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f91241023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38762/0 (socket says 172.21.15.110:38762) 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.678+0000 7f912259c640 1 -- 172.21.15.110:0/3396299676 learned_addr learned my addr 172.21.15.110:0/3396299676 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.678+0000 7f912259c640 1 -- 172.21.15.110:0/3396299676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124102a20 con 0x7f9124101f90 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.678+0000 7f912259c640 1 --2- 172.21.15.110:0/3396299676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f91241023a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9114009840 tx=0x7f91140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd03446deef97494 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f912159a640 1 -- 172.21.15.110:0/3396299676 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9114032440 con 0x7f9124101f90 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f912159a640 1 -- 172.21.15.110:0/3396299676 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9114032a40 con 0x7f9124101f90 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f912159a640 1 -- 172.21.15.110:0/3396299676 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9114031a70 con 0x7f9124101f90 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 -- 172.21.15.110:0/3396299676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 msgr2=0x7f91241023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 --2- 172.21.15.110:0/3396299676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f91241023a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9114009840 tx=0x7f91140091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 -- 172.21.15.110:0/3396299676 shutdown_connections 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 --2- 172.21.15.110:0/3396299676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f91241023a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 -- 172.21.15.110:0/3396299676 >> 172.21.15.110:0/3396299676 conn(0x7f91240fd710 msgr2=0x7f91240ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:25.441 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 -- 172.21.15.110:0/3396299676 shutdown_connections 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.679+0000 7f9128e99640 1 -- 172.21.15.110:0/3396299676 wait complete. 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f9128e99640 1 Processor -- start 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f9128e99640 1 -- start start 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f9128e99640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f9124110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f9128e99640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124111260 con 0x7f9124101f90 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f912259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f9124110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f912259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f9124110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38770/0 (socket says 172.21.15.110:38770) 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f912259c640 1 -- 172.21.15.110:0/3576912565 learned_addr learned my addr 172.21.15.110:0/3576912565 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f912259c640 1 -- 172.21.15.110:0/3576912565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009450 con 0x7f9124101f90 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.680+0000 7f912259c640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f9124110d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9114009810 tx=0x7f91140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.681+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f911403c400 con 0x7f9124101f90 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.681+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9124111460 con 0x7f9124101f90 2024-09-16T01:57:25.442 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.681+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f911403ca00 con 0x7f9124101f90 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.681+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f911403a870 con 0x7f9124101f90 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.681+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91241118d0 con 0x7f9124101f90 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.682+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f911403ab30 con 0x7f9124101f90 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.682+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912404b720 con 0x7f9124101f90 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.682+0000 7f9112ffd640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f910c039490 0x7f910c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.682+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f911406ce60 con 0x7f9124101f90 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.682+0000 7f9121d9b640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f910c039490 0x7f910c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.682+0000 7f9121d9b640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f910c039490 0x7f910c03b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9118006fd0 tx=0x7f9118006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.686+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9114030570 con 0x7f9124101f90 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.852+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f91241118d0 con 0x7f910c039490 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.856+0000 7f9112ffd640 1 -- 172.21.15.110:0/3576912565 <== mgr.14116 v2:172.21.15.110:6800/3914114363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f91241118d0 con 0x7f910c039490 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f910c039490 msgr2=0x7f910c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f910c039490 0x7f910c03b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9118006fd0 tx=0x7f9118006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 msgr2=0x7f9124110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f9124110d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9114009810 tx=0x7f91140091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 shutdown_connections 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f910c039490 0x7f910c03b940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 --2- 172.21.15.110:0/3576912565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9124101f90 0x7f9124110d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 >> 172.21.15.110:0/3576912565 conn(0x7f91240fd710 msgr2=0x7f91240fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 shutdown_connections 2024-09-16T01:57:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:24.858+0000 7f9128e99640 1 -- 172.21.15.110:0/3576912565 wait complete. 2024-09-16T01:57:25.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:25 smithi110 ceph-mon[27634]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:57:25.818 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:25 smithi110 ceph-mon[27634]: from='mgr.14116 172.21.15.110:0/3062877007' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:26.679 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc05ba3c640 1 Processor -- start 2024-09-16T01:57:26.679 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc05ba3c640 1 -- start start 2024-09-16T01:57:26.679 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc05ba3c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc05ba3c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054076ef0 con 0x7fc054076ae0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc0597d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc0597d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38782/0 (socket says 172.21.15.110:38782) 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.824+0000 7fc0597d8640 1 -- 172.21.15.110:0/4058875918 learned_addr learned my addr 172.21.15.110:0/4058875918 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.825+0000 7fc0597d8640 1 -- 172.21.15.110:0/4058875918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0541051c0 con 0x7fc054076ae0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.825+0000 7fc0597d8640 1 --2- 172.21.15.110:0/4058875918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054104c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009840 tx=0x7fc04c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ca98bec4bbf54b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.825+0000 7fc053fff640 1 -- 172.21.15.110:0/4058875918 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc04c032440 con 0x7fc054076ae0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc053fff640 1 -- 172.21.15.110:0/4058875918 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc04c032a40 con 0x7fc054076ae0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc053fff640 1 -- 172.21.15.110:0/4058875918 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc04c031a70 con 0x7fc054076ae0 2024-09-16T01:57:26.680 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4058875918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 msgr2=0x7fc054104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:26.681 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 --2- 172.21.15.110:0/4058875918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054104c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009840 tx=0x7fc04c0091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:26.681 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4058875918 shutdown_connections 2024-09-16T01:57:26.681 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 --2- 172.21.15.110:0/4058875918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054104c80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:26.681 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4058875918 >> 172.21.15.110:0/4058875918 conn(0x7fc0540fc730 msgr2=0x7fc0540feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:26.681 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4058875918 shutdown_connections 2024-09-16T01:57:26.681 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.826+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4058875918 wait complete. 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc05ba3c640 1 Processor -- start 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc05ba3c640 1 -- start start 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc05ba3c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc05ba3c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054111380 con 0x7fc054076ae0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc0597d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc0597d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38798/0 (socket says 172.21.15.110:38798) 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc0597d8640 1 -- 172.21.15.110:0/4233125524 learned_addr learned my addr 172.21.15.110:0/4233125524 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.827+0000 7fc0597d8640 1 -- 172.21.15.110:0/4233125524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009450 con 0x7fc054076ae0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.828+0000 7fc0597d8640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054110e40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc04c031750 tx=0x7fc04c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.828+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc04c03c400 con 0x7fc054076ae0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.828+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc04c03ca00 con 0x7fc054076ae0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.828+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc054111580 con 0x7fc054076ae0 2024-09-16T01:57:26.682 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.828+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc04c03a880 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.828+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc054111fd0 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.829+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc04c03a9e0 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.829+0000 7fc051ffb640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fc03c0394e0 0x7fc03c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.829+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc054100390 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.829+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc04c06ce50 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.829+0000 7fc058fd7640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fc03c0394e0 0x7fc03c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.830+0000 7fc058fd7640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fc03c0394e0 0x7fc03c03b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc048006fd0 tx=0x7fc048006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.834+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc04c037070 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.987+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc05404b720 con 0x7fc054076ae0 2024-09-16T01:57:26.683 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.990+0000 7fc051ffb640 1 -- 172.21.15.110:0/4233125524 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc04c030570 con 0x7fc054076ae0 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fc03c0394e0 msgr2=0x7fc03c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fc03c0394e0 0x7fc03c03b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc048006fd0 tx=0x7fc048006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 msgr2=0x7fc054110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054110e40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc04c031750 tx=0x7fc04c0091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 shutdown_connections 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7fc03c0394e0 0x7fc03c03b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 --2- 172.21.15.110:0/4233125524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc054076ae0 0x7fc054110e40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 >> 172.21.15.110:0/4233125524 conn(0x7fc0540fc730 msgr2=0x7fc0540fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 shutdown_connections 2024-09-16T01:57:26.684 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:25.992+0000 7fc05ba3c640 1 -- 172.21.15.110:0/4233125524 wait complete. 2024-09-16T01:57:26.916 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:26 smithi110 ceph-mon[27634]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:26.916 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:26 smithi110 ceph-mon[27634]: Saving service alertmanager spec with placement count:1 2024-09-16T01:57:26.916 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:26 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/4233125524' entity='client.admin' 2024-09-16T01:57:27.862 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:27 smithi110 ceph-mon[27634]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:57:27.862 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:27 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/4182132326' entity='client.admin' 2024-09-16T01:57:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.083+0000 7f7043246640 1 Processor -- start 2024-09-16T01:57:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.083+0000 7f7043246640 1 -- start start 2024-09-16T01:57:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.083+0000 7f7043246640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.083+0000 7f7043246640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c1050c0 con 0x7f703c076b70 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.084+0000 7f7040fe2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.084+0000 7f7040fe2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38814/0 (socket says 172.21.15.110:38814) 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.084+0000 7f7040fe2640 1 -- 172.21.15.110:0/4279052859 learned_addr learned my addr 172.21.15.110:0/4279052859 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.084+0000 7f7040fe2640 1 -- 172.21.15.110:0/4279052859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c105200 con 0x7f703c076b70 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7040fe2640 1 --2- 172.21.15.110:0/4279052859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c104b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f702c009e50 tx=0x7f702c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49315eeeebdb0fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f703b7fe640 1 -- 172.21.15.110:0/4279052859 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f702c031560 con 0x7f703c076b70 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f703b7fe640 1 -- 172.21.15.110:0/4279052859 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f702c02d050 con 0x7f703c076b70 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f703b7fe640 1 -- 172.21.15.110:0/4279052859 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f702c007a60 con 0x7f703c076b70 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 -- 172.21.15.110:0/4279052859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 msgr2=0x7f703c104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 --2- 172.21.15.110:0/4279052859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c104b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f702c009e50 tx=0x7f702c009840 comp rx=0 tx=0).stop 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 -- 172.21.15.110:0/4279052859 shutdown_connections 2024-09-16T01:57:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 --2- 172.21.15.110:0/4279052859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c104b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 -- 172.21.15.110:0/4279052859 >> 172.21.15.110:0/4279052859 conn(0x7f703c0fc6d0 msgr2=0x7f703c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 -- 172.21.15.110:0/4279052859 shutdown_connections 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.085+0000 7f7043246640 1 -- 172.21.15.110:0/4279052859 wait complete. 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7043246640 1 Processor -- start 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7043246640 1 -- start start 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7043246640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7043246640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c111380 con 0x7f703c076b70 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7040fe2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7040fe2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38826/0 (socket says 172.21.15.110:38826) 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.086+0000 7f7040fe2640 1 -- 172.21.15.110:0/4182132326 learned_addr learned my addr 172.21.15.110:0/4182132326 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f7040fe2640 1 -- 172.21.15.110:0/4182132326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009ae0 con 0x7f703c076b70 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f7040fe2640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c110e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f702c02ac70 tx=0x7f702c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f702c031bc0 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f702c031d20 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c111580 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f702c045570 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.087+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c111fd0 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.088+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f702c038050 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.088+0000 7f70397fa640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7028039490 0x7f702803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.088+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f702c06ccb0 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.088+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c1002f0 con 0x7f703c076b70 2024-09-16T01:57:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.088+0000 7f703bfff640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7028039490 0x7f702803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.088+0000 7f703bfff640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7028039490 0x7f702803b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7024006fd0 tx=0x7f7024006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.092+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f702c041020 con 0x7f703c076b70 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.248+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f703c04b720 con 0x7f703c076b70 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.251+0000 7f70397fa640 1 -- 172.21.15.110:0/4182132326 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f702c036070 con 0x7f703c076b70 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7028039490 msgr2=0x7f702803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7028039490 0x7f702803b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7024006fd0 tx=0x7f7024006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 msgr2=0x7f703c110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c110e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f702c02ac70 tx=0x7f702c009840 comp rx=0 tx=0).stop 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 shutdown_connections 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f7028039490 0x7f702803b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 --2- 172.21.15.110:0/4182132326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f703c076b70 0x7f703c110e40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.253+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 >> 172.21.15.110:0/4182132326 conn(0x7f703c0fc6d0 msgr2=0x7f703c0fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.254+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 shutdown_connections 2024-09-16T01:57:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:27.254+0000 7f7043246640 1 -- 172.21.15.110:0/4182132326 wait complete. 2024-09-16T01:57:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling the dashboard module... 2024-09-16T01:57:28.616 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:28 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2855025801' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T01:57:29.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.307+0000 7ffa14f84640 1 Processor -- start 2024-09-16T01:57:29.277 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.307+0000 7ffa14f84640 1 -- start start 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.307+0000 7ffa14f84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.307+0000 7ffa14f84640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10076f20 con 0x7ffa10076b10 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.308+0000 7ffa0e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.308+0000 7ffa0e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38828/0 (socket says 172.21.15.110:38828) 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.308+0000 7ffa0e59c640 1 -- 172.21.15.110:0/267406199 learned_addr learned my addr 172.21.15.110:0/267406199 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.308+0000 7ffa0e59c640 1 -- 172.21.15.110:0/267406199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10105130 con 0x7ffa10076b10 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa0e59c640 1 --2- 172.21.15.110:0/267406199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10104bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009840 tx=0x7ffa000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73821804f618bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa0d59a640 1 -- 172.21.15.110:0/267406199 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa00032440 con 0x7ffa10076b10 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa0d59a640 1 -- 172.21.15.110:0/267406199 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa00032a40 con 0x7ffa10076b10 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa0d59a640 1 -- 172.21.15.110:0/267406199 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa00031aa0 con 0x7ffa10076b10 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa14f84640 1 -- 172.21.15.110:0/267406199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 msgr2=0x7ffa10104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:29.278 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa14f84640 1 --2- 172.21.15.110:0/267406199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10104bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009840 tx=0x7ffa000091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa14f84640 1 -- 172.21.15.110:0/267406199 shutdown_connections 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa14f84640 1 --2- 172.21.15.110:0/267406199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10104bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.309+0000 7ffa14f84640 1 -- 172.21.15.110:0/267406199 >> 172.21.15.110:0/267406199 conn(0x7ffa100fc700 msgr2=0x7ffa100feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa14f84640 1 -- 172.21.15.110:0/267406199 shutdown_connections 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa14f84640 1 -- 172.21.15.110:0/267406199 wait complete. 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa14f84640 1 Processor -- start 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa14f84640 1 -- start start 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa14f84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10110ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa14f84640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa101113e0 con 0x7ffa10076b10 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa0e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10110ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa0e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10110ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38844/0 (socket says 172.21.15.110:38844) 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa0e59c640 1 -- 172.21.15.110:0/2855025801 learned_addr learned my addr 172.21.15.110:0/2855025801 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:29.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.310+0000 7ffa0e59c640 1 -- 172.21.15.110:0/2855025801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00009450 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.311+0000 7ffa0e59c640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10110ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa000316a0 tx=0x7ffa000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.311+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa000327b0 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.311+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa0003b8d0 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.311+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa101115e0 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.311+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa0003a780 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.311+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa10112070 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.312+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ffa00039040 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.312+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10100300 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.312+0000 7ffa06ffd640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff9fc039490 0x7ff9fc03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.312+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffa0006cae0 con 0x7ffa10076b10 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.312+0000 7ffa0dd9b640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff9fc039490 0x7ff9fc03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.312+0000 7ffa0dd9b640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff9fc039490 0x7ff9fc03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8006fd0 tx=0x7ff9f8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.316+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffa0004b300 con 0x7ffa10076b10 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.520+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ffa1004b720 con 0x7ffa10076b10 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.610+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7ffa0003b490 con 0x7ffa10076b10 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.611+0000 7ffa06ffd640 1 -- 172.21.15.110:0/2855025801 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ffa00007c40 con 0x7ffa10076b10 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.614+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff9fc039490 msgr2=0x7ff9fc03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff9fc039490 0x7ff9fc03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8006fd0 tx=0x7ff9f8006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 msgr2=0x7ffa10110ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10110ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa000316a0 tx=0x7ffa000091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 shutdown_connections 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7ff9fc039490 0x7ff9fc03b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 --2- 172.21.15.110:0/2855025801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa10076b10 0x7ffa10110ea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 >> 172.21.15.110:0/2855025801 conn(0x7ffa100fc700 msgr2=0x7ffa100fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 shutdown_connections 2024-09-16T01:57:29.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:28.615+0000 7ffa14f84640 1 -- 172.21.15.110:0/2855025801 wait complete. 2024-09-16T01:57:29.655 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:29 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2855025801' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T01:57:29.655 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:29 smithi110 ceph-mon[27634]: mgrmap e9: smithi110.hfirap(active, since 24s) 2024-09-16T01:57:30.509 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:57:30.509 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T01:57:30.509 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T01:57:30.509 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "active_name": "smithi110.hfirap", 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.690+0000 7f272fabb640 1 Processor -- start 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.690+0000 7f272fabb640 1 -- start start 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.690+0000 7f272fabb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728102490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.690+0000 7f272fabb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728102a60 con 0x7f2728102080 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.691+0000 7f272d857640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.691+0000 7f272d857640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38868/0 (socket says 172.21.15.110:38868) 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.691+0000 7f272d857640 1 -- 172.21.15.110:0/1815143331 learned_addr learned my addr 172.21.15.110:0/1815143331 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.691+0000 7f272d857640 1 -- 172.21.15.110:0/1815143331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728102ba0 con 0x7f2728102080 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.692+0000 7f272d857640 1 --2- 172.21.15.110:0/1815143331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728102490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2724009840 tx=0x7f27240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ebddb9bea49ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.692+0000 7f272c855640 1 -- 172.21.15.110:0/1815143331 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2724032440 con 0x7f2728102080 2024-09-16T01:57:30.510 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.692+0000 7f272c855640 1 -- 172.21.15.110:0/1815143331 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2724032a40 con 0x7f2728102080 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.692+0000 7f272c855640 1 -- 172.21.15.110:0/1815143331 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2724031a70 con 0x7f2728102080 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.692+0000 7f272fabb640 1 -- 172.21.15.110:0/1815143331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 msgr2=0x7f2728102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.692+0000 7f272fabb640 1 --2- 172.21.15.110:0/1815143331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728102490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2724009840 tx=0x7f27240091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 -- 172.21.15.110:0/1815143331 shutdown_connections 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 --2- 172.21.15.110:0/1815143331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728102490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 -- 172.21.15.110:0/1815143331 >> 172.21.15.110:0/1815143331 conn(0x7f27280fd880 msgr2=0x7f27280ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 -- 172.21.15.110:0/1815143331 shutdown_connections 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 -- 172.21.15.110:0/1815143331 wait complete. 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 Processor -- start 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 -- start start 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272fabb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728111390 con 0x7f2728102080 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272d857640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:30.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.693+0000 7f272d857640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38880/0 (socket says 172.21.15.110:38880) 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f272d857640 1 -- 172.21.15.110:0/394288480 learned_addr learned my addr 172.21.15.110:0/394288480 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f272d857640 1 -- 172.21.15.110:0/394288480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009450 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f272d857640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728110e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2724009420 tx=0x7f27240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f272403b470 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f272403ba70 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2728111590 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f272403a930 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.694+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728112070 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.695+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f272403bbe0 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.695+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27281014e0 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.695+0000 7f271e7fc640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 0x7f271403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.695+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f272406d100 con 0x7f2728102080 2024-09-16T01:57:30.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.695+0000 7f272d056640 1 -- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 msgr2=0x7f271403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3914114363 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.695+0000 7f272d056640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 0x7f271403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.704+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f272404b300 con 0x7f2728102080 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.896+0000 7f272d056640 1 -- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 msgr2=0x7f271403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3914114363 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.896+0000 7f272d056640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 0x7f271403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.907+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2728112410 con 0x7f2728102080 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.907+0000 7f271e7fc640 1 -- 172.21.15.110:0/394288480 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f2724037070 con 0x7f2728102080 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 msgr2=0x7f271403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 0x7f271403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 msgr2=0x7f2728110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728110e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2724009420 tx=0x7f27240091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 shutdown_connections 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f27140394e0 0x7f271403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:30.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 --2- 172.21.15.110:0/394288480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2728102080 0x7f2728110e50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:30.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 >> 172.21.15.110:0/394288480 conn(0x7f27280fd880 msgr2=0x7f27280fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:30.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 shutdown_connections 2024-09-16T01:57:30.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:29.909+0000 7f272fabb640 1 -- 172.21.15.110:0/394288480 wait complete. 2024-09-16T01:57:30.514 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for the mgr to restart... 2024-09-16T01:57:30.514 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr epoch 9... 2024-09-16T01:57:30.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:30 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/394288480' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T01:57:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: Active manager daemon smithi110.hfirap restarted 2024-09-16T01:57:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: Activating manager daemon smithi110.hfirap 2024-09-16T01:57:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: osdmap e3: 0 total, 0 up, 0 in 2024-09-16T01:57:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: mgrmap e10: smithi110.hfirap(active, starting, since 0.00304695s) 2024-09-16T01:57:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: Manager daemon smithi110.hfirap is now available 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:57:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:33 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T01:57:34.889 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:57:34.889 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T01:57:34.889 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T01:57:34.889 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.929+0000 7f34fc27c640 1 Processor -- start 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.929+0000 7f34fc27c640 1 -- start start 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.930+0000 7f34fc27c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f41012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.930+0000 7f34fc27c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41017e0 con 0x7f34f4100e90 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.930+0000 7f34fa018640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f41012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.930+0000 7f34fa018640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f41012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45320/0 (socket says 172.21.15.110:45320) 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.930+0000 7f34fa018640 1 -- 172.21.15.110:0/4252913314 learned_addr learned my addr 172.21.15.110:0/4252913314 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.930+0000 7f34fa018640 1 -- 172.21.15.110:0/4252913314 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4101920 con 0x7f34f4100e90 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.931+0000 7f34fa018640 1 --2- 172.21.15.110:0/4252913314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f41012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009840 tx=0x7f34f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29ee706f22b2807 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:34.890 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.931+0000 7f34f9016640 1 -- 172.21.15.110:0/4252913314 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f0032440 con 0x7f34f4100e90 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.931+0000 7f34f9016640 1 -- 172.21.15.110:0/4252913314 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34f0032a40 con 0x7f34f4100e90 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.931+0000 7f34f9016640 1 -- 172.21.15.110:0/4252913314 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f0031aa0 con 0x7f34f4100e90 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 -- 172.21.15.110:0/4252913314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 msgr2=0x7f34f41012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 --2- 172.21.15.110:0/4252913314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f41012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009840 tx=0x7f34f00091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 -- 172.21.15.110:0/4252913314 shutdown_connections 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 --2- 172.21.15.110:0/4252913314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f41012a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 -- 172.21.15.110:0/4252913314 >> 172.21.15.110:0/4252913314 conn(0x7f34f40fc6d0 msgr2=0x7f34f40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 -- 172.21.15.110:0/4252913314 shutdown_connections 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 -- 172.21.15.110:0/4252913314 wait complete. 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 Processor -- start 2024-09-16T01:57:34.891 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.932+0000 7f34fc27c640 1 -- start start 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fc27c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f4076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fc27c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4113a90 con 0x7f34f4100e90 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fa018640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f4076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fa018640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f4076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45328/0 (socket says 172.21.15.110:45328) 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fa018640 1 -- 172.21.15.110:0/1124943693 learned_addr learned my addr 172.21.15.110:0/1124943693 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fa018640 1 -- 172.21.15.110:0/1124943693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009450 con 0x7f34f4100e90 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fa018640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f4076ae0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006a70 tx=0x7f34f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f0031d20 con 0x7f34f4100e90 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34f0031e80 con 0x7f34f4100e90 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f003a750 con 0x7f34f4100e90 2024-09-16T01:57:34.892 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f4113bd0 con 0x7f34f4100e90 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.933+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f4113fe0 con 0x7f34f4100e90 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.934+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f34f0039040 con 0x7f34f4100e90 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.934+0000 7f34eaffd640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.934+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 --> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34e003c0a0 con 0x7f34e00394e0 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.934+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f34f006cd20 con 0x7f34f4100e90 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.934+0000 7f34f9817640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 msgr2=0x7f34e003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3914114363 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:30.935+0000 7f34f9817640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:31.136+0000 7f34f9817640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 msgr2=0x7f34e003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3914114363 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:31.136+0000 7f34f9817640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:57:34.893 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:31.537+0000 7f34f9817640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 msgr2=0x7f34e003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3914114363 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:31.537+0000 7f34f9817640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:32.338+0000 7f34f9817640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 msgr2=0x7f34e003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3914114363 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:32.338+0000 7f34f9817640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:33.046+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f34f003bc80 con 0x7f34f4100e90 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:33.046+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 msgr2=0x7f34e003b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:33.046+0000 7f34eaffd640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.047+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f34f004bce0 con 0x7f34f4100e90 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.047+0000 7f34eaffd640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f34e003cf80 0x7f34e003f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.047+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34e003c0a0 con 0x7f34e003cf80 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.048+0000 7f34f9817640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f34e003cf80 0x7f34e003f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:34.894 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.048+0000 7f34f9817640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f34e003cf80 0x7f34e003f360 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f34e4003940 tx=0x7f34e4009350 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.049+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f34e003c0a0 con 0x7f34e003cf80 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.054+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f34f404b720 con 0x7f34e003cf80 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.054+0000 7f34eaffd640 1 -- 172.21.15.110:0/1124943693 <== mgr.14158 v2:172.21.15.110:6800/2073782143 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f34f404b720 con 0x7f34e003cf80 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f34e003cf80 msgr2=0x7f34e003f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f34e003cf80 0x7f34e003f360 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f34e4003940 tx=0x7f34e4009350 comp rx=0 tx=0).stop 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 msgr2=0x7f34f4076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f4076ae0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34f0006a70 tx=0x7f34f00091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 shutdown_connections 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f34e003cf80 0x7f34e003f360 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:6800/3914114363,v1:172.21.15.110:6801/3914114363] conn(0x7f34e00394e0 0x7f34e003b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.895 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 --2- 172.21.15.110:0/1124943693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34f4100e90 0x7f34f4076ae0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:34.896 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 >> 172.21.15.110:0/1124943693 conn(0x7f34f40fc6d0 msgr2=0x7f34f40fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:34.896 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 shutdown_connections 2024-09-16T01:57:34.896 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:34.055+0000 7f34fc27c640 1 -- 172.21.15.110:0/1124943693 wait complete. 2024-09-16T01:57:34.896 INFO:teuthology.orchestra.run.smithi110.stdout:mgr epoch 9 is available 2024-09-16T01:57:34.896 INFO:teuthology.orchestra.run.smithi110.stdout:Generating a dashboard self-signed certificate... 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: mgrmap e11: smithi110.hfirap(active, since 1.00551s) 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:34] ENGINE Bus STARTING 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:34] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:34] ENGINE Bus STARTED 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:57:34] ENGINE Error in HTTPServer.serve 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Traceback (most recent call last): 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:57:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._run(expiration_interval) 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s = self.context.wrap_socket( 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: return self.sslsocket_class._create( 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self.do_handshake() 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._sslobj.do_handshake() 2024-09-16T01:57:35.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:57:35.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:35 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc546d4640 1 Processor -- start 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc546d4640 1 -- start start 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc546d4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc546d4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c078f50 con 0x7efc4c078ab0 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc52470640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc52470640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45416/0 (socket says 172.21.15.110:45416) 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.285+0000 7efc52470640 1 -- 172.21.15.110:0/102933690 learned_addr learned my addr 172.21.15.110:0/102933690 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.286+0000 7efc52470640 1 -- 172.21.15.110:0/102933690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c079090 con 0x7efc4c078ab0 2024-09-16T01:57:36.210 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.286+0000 7efc52470640 1 --2- 172.21.15.110:0/102933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c077210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc48009840 tx=0x7efc480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b5adb5f46bc349 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc5146e640 1 -- 172.21.15.110:0/102933690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc48032440 con 0x7efc4c078ab0 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc5146e640 1 -- 172.21.15.110:0/102933690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc48032a40 con 0x7efc4c078ab0 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc5146e640 1 -- 172.21.15.110:0/102933690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc48031a70 con 0x7efc4c078ab0 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 -- 172.21.15.110:0/102933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 msgr2=0x7efc4c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 --2- 172.21.15.110:0/102933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c077210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc48009840 tx=0x7efc480091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 -- 172.21.15.110:0/102933690 shutdown_connections 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 --2- 172.21.15.110:0/102933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c077210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 -- 172.21.15.110:0/102933690 >> 172.21.15.110:0/102933690 conn(0x7efc4c0fd8b0 msgr2=0x7efc4c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 -- 172.21.15.110:0/102933690 shutdown_connections 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.287+0000 7efc546d4640 1 -- 172.21.15.110:0/102933690 wait complete. 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc546d4640 1 Processor -- start 2024-09-16T01:57:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc546d4640 1 -- start start 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc546d4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc546d4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c113500 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc52470640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc52470640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45426/0 (socket says 172.21.15.110:45426) 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc52470640 1 -- 172.21.15.110:0/3719369834 learned_addr learned my addr 172.21.15.110:0/3719369834 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.288+0000 7efc52470640 1 -- 172.21.15.110:0/3719369834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009450 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.289+0000 7efc52470640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c112fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc48009420 tx=0x7efc480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.289+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc4803b470 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.289+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc4803ba70 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.289+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c113700 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.289+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc4803a930 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.289+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c113b70 con 0x7efc4c078ab0 2024-09-16T01:57:36.212 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.290+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7efc4803aba0 con 0x7efc4c078ab0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.290+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c04b720 con 0x7efc4c078ab0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.290+0000 7efc42ffd640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efc38039420 0x7efc3803b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.290+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efc4806ce00 con 0x7efc4c078ab0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.290+0000 7efc51c6f640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efc38039420 0x7efc3803b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.290+0000 7efc51c6f640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efc38039420 0x7efc3803b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006fd0 tx=0x7efc3c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.295+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efc4804b300 con 0x7efc4c078ab0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.460+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7efc4c113b70 con 0x7efc38039420 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.537+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7efc4c113b70 con 0x7efc38039420 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc42ffd640 1 -- 172.21.15.110:0/3719369834 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7efc4804ad40 con 0x7efc4c078ab0 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efc38039420 msgr2=0x7efc3803b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efc38039420 0x7efc3803b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006fd0 tx=0x7efc3c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:36.213 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 msgr2=0x7efc4c112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c112fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc48009420 tx=0x7efc480091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 shutdown_connections 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efc38039420 0x7efc3803b8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 --2- 172.21.15.110:0/3719369834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc4c078ab0 0x7efc4c112fc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 >> 172.21.15.110:0/3719369834 conn(0x7efc4c0fd8b0 msgr2=0x7efc4c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 shutdown_connections 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:35.539+0000 7efc546d4640 1 -- 172.21.15.110:0/3719369834 wait complete. 2024-09-16T01:57:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial admin user... 2024-09-16T01:57:36.605 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:36 smithi110 ceph-mon[27634]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:36.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:36 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:36.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:36 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:36.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:36 smithi110 ceph-mon[27634]: mgrmap e12: smithi110.hfirap(active, since 2s) 2024-09-16T01:57:36.606 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:36 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:37.862 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$mKvvCgHM17oTWgeUz4eiFO.jQWIGmritQdEI.MwfqqboE2SMKDxqG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726451857, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.615+0000 7fe0ae0df640 1 Processor -- start 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.615+0000 7fe0ae0df640 1 -- start start 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.616+0000 7fe0ae0df640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a81018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.616+0000 7fe0ae0df640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8101df0 con 0x7fe0a81014a0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.616+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a81018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.616+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a81018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45440/0 (socket says 172.21.15.110:45440) 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.616+0000 7fe0a77fe640 1 -- 172.21.15.110:0/1626124328 learned_addr learned my addr 172.21.15.110:0/1626124328 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.616+0000 7fe0a77fe640 1 -- 172.21.15.110:0/1626124328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8101f30 con 0x7fe0a81014a0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.617+0000 7fe0a77fe640 1 --2- 172.21.15.110:0/1626124328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a81018b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe098009840 tx=0x7fe0980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14337b31aeec472e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.617+0000 7fe0a67fc640 1 -- 172.21.15.110:0/1626124328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe098032440 con 0x7fe0a81014a0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.617+0000 7fe0a67fc640 1 -- 172.21.15.110:0/1626124328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe098032a40 con 0x7fe0a81014a0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.617+0000 7fe0a67fc640 1 -- 172.21.15.110:0/1626124328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe098031aa0 con 0x7fe0a81014a0 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 -- 172.21.15.110:0/1626124328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 msgr2=0x7fe0a81018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:37.863 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 --2- 172.21.15.110:0/1626124328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a81018b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe098009840 tx=0x7fe0980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 -- 172.21.15.110:0/1626124328 shutdown_connections 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 --2- 172.21.15.110:0/1626124328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a81018b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 -- 172.21.15.110:0/1626124328 >> 172.21.15.110:0/1626124328 conn(0x7fe0a80fbd90 msgr2=0x7fe0a80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 -- 172.21.15.110:0/1626124328 shutdown_connections 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 -- 172.21.15.110:0/1626124328 wait complete. 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.618+0000 7fe0ae0df640 1 Processor -- start 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0ae0df640 1 -- start start 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0ae0df640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a8110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0ae0df640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8111370 con 0x7fe0a81014a0 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a8110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0a77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a8110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45444/0 (socket says 172.21.15.110:45444) 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0a77fe640 1 -- 172.21.15.110:0/2832484604 learned_addr learned my addr 172.21.15.110:0/2832484604 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:37.864 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0a77fe640 1 -- 172.21.15.110:0/2832484604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009450 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe0a77fe640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a8110e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe098009810 tx=0x7fe0980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.619+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0980327b0 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.620+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a8111570 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.620+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe09803b8d0 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.620+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe09803a6f0 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.620+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8111fc0 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.621+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fe098039040 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.621+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a80ffa10 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.621+0000 7fe08ffff640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe0900394e0 0x7fe09003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.621+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe09806cc10 con 0x7fe0a81014a0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.621+0000 7fe0a6ffd640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe0900394e0 0x7fe09003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.622+0000 7fe0a6ffd640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe0900394e0 0x7fe09003b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe09c006fd0 tx=0x7fe09c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.626+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe098030990 con 0x7fe0a81014a0 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:36.797+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe0a805eb60 con 0x7fe0900394e0 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.023+0000 7fe08ffff640 1 -- 172.21.15.110:0/2832484604 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe0a805eb60 con 0x7fe0900394e0 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe0900394e0 msgr2=0x7fe09003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe0900394e0 0x7fe09003b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe09c006fd0 tx=0x7fe09c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 msgr2=0x7fe0a8110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a8110e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe098009810 tx=0x7fe0980091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 shutdown_connections 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe0900394e0 0x7fe09003b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 --2- 172.21.15.110:0/2832484604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81014a0 0x7fe0a8110e30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 >> 172.21.15.110:0/2832484604 conn(0x7fe0a80fbd90 msgr2=0x7fe0a80fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 shutdown_connections 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:37.026+0000 7fe0ae0df640 1 -- 172.21.15.110:0/2832484604 wait complete. 2024-09-16T01:57:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:Fetching dashboard port number... 2024-09-16T01:57:38.124 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:38 smithi110 ceph-mon[27634]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:38.124 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:38 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:39.436 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:39 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1544246925' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T01:57:39.547 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T01:57:39.547 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e7ae5b640 1 Processor -- start 2024-09-16T01:57:39.547 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e7ae5b640 1 -- start start 2024-09-16T01:57:39.547 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e7ae5b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74102460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:39.547 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e7ae5b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741029a0 con 0x7f3e74102050 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e78bf7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e78bf7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74102460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45454/0 (socket says 172.21.15.110:45454) 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.753+0000 7f3e78bf7640 1 -- 172.21.15.110:0/2435354031 learned_addr learned my addr 172.21.15.110:0/2435354031 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.754+0000 7f3e78bf7640 1 -- 172.21.15.110:0/2435354031 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74102ae0 con 0x7f3e74102050 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.754+0000 7f3e78bf7640 1 --2- 172.21.15.110:0/2435354031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74102460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009840 tx=0x7f3e700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c5ce4c57c297e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.754+0000 7f3e6b7fe640 1 -- 172.21.15.110:0/2435354031 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e70032440 con 0x7f3e74102050 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.754+0000 7f3e6b7fe640 1 -- 172.21.15.110:0/2435354031 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e70032a40 con 0x7f3e74102050 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.754+0000 7f3e6b7fe640 1 -- 172.21.15.110:0/2435354031 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e70031a70 con 0x7f3e74102050 2024-09-16T01:57:39.548 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/2435354031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 msgr2=0x7f3e74102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 --2- 172.21.15.110:0/2435354031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74102460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009840 tx=0x7f3e700091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/2435354031 shutdown_connections 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 --2- 172.21.15.110:0/2435354031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74102460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/2435354031 >> 172.21.15.110:0/2435354031 conn(0x7f3e740fd7f0 msgr2=0x7f3e740ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/2435354031 shutdown_connections 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.755+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/2435354031 wait complete. 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e7ae5b640 1 Processor -- start 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e7ae5b640 1 -- start start 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e7ae5b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e7ae5b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74111360 con 0x7f3e74102050 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e78bf7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e78bf7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45466/0 (socket says 172.21.15.110:45466) 2024-09-16T01:57:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e78bf7640 1 -- 172.21.15.110:0/1544246925 learned_addr learned my addr 172.21.15.110:0/1544246925 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e78bf7640 1 -- 172.21.15.110:0/1544246925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70009450 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.756+0000 7f3e78bf7640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74110e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009810 tx=0x7f3e700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.757+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e7003c400 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.757+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e7003ca00 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.757+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e74111560 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.757+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e7003a870 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.757+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e74111fb0 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.757+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f3e7003aae0 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.758+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e741014b0 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.758+0000 7f3e697fa640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f3e5c039530 0x7f3e5c03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.758+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3e7006cf80 con 0x7f3e74102050 2024-09-16T01:57:39.550 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.758+0000 7f3e6bfff640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f3e5c039530 0x7f3e5c03b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.758+0000 7f3e6bfff640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f3e5c039530 0x7f3e5c03b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006fd0 tx=0x7f3e64006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.762+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3e70030570 con 0x7f3e74102050 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.918+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f3e7404b720 con 0x7f3e74102050 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.919+0000 7f3e697fa640 1 -- 172.21.15.110:0/1544246925 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f3e70037020 con 0x7f3e74102050 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f3e5c039530 msgr2=0x7f3e5c03b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f3e5c039530 0x7f3e5c03b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e64006fd0 tx=0x7f3e64006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 msgr2=0x7f3e74110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74110e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009810 tx=0x7f3e700091d0 comp rx=0 tx=0).stop 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 shutdown_connections 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f3e5c039530 0x7f3e5c03b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 --2- 172.21.15.110:0/1544246925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e74102050 0x7f3e74110e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 >> 172.21.15.110:0/1544246925 conn(0x7f3e740fd7f0 msgr2=0x7f3e740fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:39.551 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 shutdown_connections 2024-09-16T01:57:39.552 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:38.921+0000 7f3e7ae5b640 1 -- 172.21.15.110:0/1544246925 wait complete. 2024-09-16T01:57:39.554 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:57:39.554 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-16T01:57:39.561 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:57:39.562 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-16T01:57:39.562 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-16T01:57:39.562 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T01:57:39.563 INFO:teuthology.orchestra.run.smithi110.stdout:Ceph Dashboard is now available at: 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout: URL: https://smithi110.front.sepia.ceph.com:8443/ 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout: User: admin 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout: Password: 459u8kwo0n 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout:Saving cluster configuration to /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config directory 2024-09-16T01:57:39.564 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling autotune for osd_memory_target 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9c5ea3640 1 Processor -- start 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9c5ea3640 1 -- start start 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9c5ea3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c0101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9c5ea3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0101880 con 0x7ff9c0100f30 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9bf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c0101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9bf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c0101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45476/0 (socket says 172.21.15.110:45476) 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9bf7fe640 1 -- 172.21.15.110:0/1141942363 learned_addr learned my addr 172.21.15.110:0/1141942363 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:40.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.994+0000 7ff9bf7fe640 1 -- 172.21.15.110:0/1141942363 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c01019c0 con 0x7ff9c0100f30 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.995+0000 7ff9bf7fe640 1 --2- 172.21.15.110:0/1141942363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c0101340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000baf0 tx=0x7ff9b000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad44a571b683a63a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.995+0000 7ff9be7fc640 1 -- 172.21.15.110:0/1141942363 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b00327a0 con 0x7ff9c0100f30 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.995+0000 7ff9be7fc640 1 -- 172.21.15.110:0/1141942363 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9b0032da0 con 0x7ff9c0100f30 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.995+0000 7ff9be7fc640 1 -- 172.21.15.110:0/1141942363 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0031e60 con 0x7ff9c0100f30 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/1141942363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 msgr2=0x7ff9c0101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 --2- 172.21.15.110:0/1141942363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c0101340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000baf0 tx=0x7ff9b000b460 comp rx=0 tx=0).stop 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/1141942363 shutdown_connections 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 --2- 172.21.15.110:0/1141942363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c0101340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/1141942363 >> 172.21.15.110:0/1141942363 conn(0x7ff9c00fc730 msgr2=0x7ff9c00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/1141942363 shutdown_connections 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/1141942363 wait complete. 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.996+0000 7ff9c5ea3640 1 Processor -- start 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9c5ea3640 1 -- start start 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9c5ea3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c010eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9c5ea3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c010f0b0 con 0x7ff9c0100f30 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9bf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c010eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9bf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c010eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45490/0 (socket says 172.21.15.110:45490) 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9bf7fe640 1 -- 172.21.15.110:0/2791521308 learned_addr learned my addr 172.21.15.110:0/2791521308 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9bf7fe640 1 -- 172.21.15.110:0/2791521308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b000b700 con 0x7ff9c0100f30 2024-09-16T01:57:40.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9bf7fe640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c010eb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b2c0 tx=0x7ff9b003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b00329b0 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9b0032b10 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0045640 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c010f2b0 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.997+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c010f720 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.998+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7ff9b0045840 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.998+0000 7ff9a7fff640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80394e0 0x7ff9a803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.998+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c004b720 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.999+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff9b006ff40 con 0x7ff9c0100f30 2024-09-16T01:57:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.999+0000 7ff9beffd640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80394e0 0x7ff9a803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:40.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:39.999+0000 7ff9beffd640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80394e0 0x7ff9a803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4006fd0 tx=0x7ff9b4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:40.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.003+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff9b004f020 con 0x7ff9c0100f30 2024-09-16T01:57:40.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.025+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7ff9b004d360 con 0x7ff9c0100f30 2024-09-16T01:57:40.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.159+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff9c010f720 con 0x7ff9c0100f30 2024-09-16T01:57:40.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.160+0000 7ff9a7fff640 1 -- 172.21.15.110:0/2791521308 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff9b0036020 con 0x7ff9c0100f30 2024-09-16T01:57:40.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.161+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80394e0 msgr2=0x7ff9a803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.161+0000 7ff9c5ea3640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80394e0 0x7ff9a803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4006fd0 tx=0x7ff9b4006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 msgr2=0x7ff9c010eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c010eb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b2c0 tx=0x7ff9b003d040 comp rx=0 tx=0).stop 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 shutdown_connections 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80394e0 0x7ff9a803b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 --2- 172.21.15.110:0/2791521308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c0100f30 0x7ff9c010eb70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 >> 172.21.15.110:0/2791521308 conn(0x7ff9c00fc730 msgr2=0x7ff9c01053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 shutdown_connections 2024-09-16T01:57:40.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:40.162+0000 7ff9c5ea3640 1 -- 172.21.15.110:0/2791521308 wait complete. 2024-09-16T01:57:41.116 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:41 smithi110 ceph-mon[27634]: mgrmap e13: smithi110.hfirap(active, since 6s) 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.190+0000 7fa224603640 1 Processor -- start 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.190+0000 7fa224603640 1 -- start start 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.190+0000 7fa224603640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c102520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.190+0000 7fa224603640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c102af0 con 0x7fa21c102110 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.191+0000 7fa22239f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c102520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.191+0000 7fa22239f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c102520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36574/0 (socket says 172.21.15.110:36574) 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.191+0000 7fa22239f640 1 -- 172.21.15.110:0/3033864863 learned_addr learned my addr 172.21.15.110:0/3033864863 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:42.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.191+0000 7fa22239f640 1 -- 172.21.15.110:0/3033864863 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c102c30 con 0x7fa21c102110 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.191+0000 7fa22239f640 1 --2- 172.21.15.110:0/3033864863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c102520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009e50 tx=0x7fa20c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b9dd1b83e2ba3a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa22139d640 1 -- 172.21.15.110:0/3033864863 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa20c031560 con 0x7fa21c102110 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa22139d640 1 -- 172.21.15.110:0/3033864863 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa20c02d050 con 0x7fa21c102110 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa22139d640 1 -- 172.21.15.110:0/3033864863 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa20c007a60 con 0x7fa21c102110 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 -- 172.21.15.110:0/3033864863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 msgr2=0x7fa21c102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 --2- 172.21.15.110:0/3033864863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c102520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009e50 tx=0x7fa20c009840 comp rx=0 tx=0).stop 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 -- 172.21.15.110:0/3033864863 shutdown_connections 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 --2- 172.21.15.110:0/3033864863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c102520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 -- 172.21.15.110:0/3033864863 >> 172.21.15.110:0/3033864863 conn(0x7fa21c0fd8b0 msgr2=0x7fa21c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 -- 172.21.15.110:0/3033864863 shutdown_connections 2024-09-16T01:57:42.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.192+0000 7fa224603640 1 -- 172.21.15.110:0/3033864863 wait complete. 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa224603640 1 Processor -- start 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa224603640 1 -- start start 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa224603640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa224603640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c111390 con 0x7fa21c102110 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa22239f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa22239f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36578/0 (socket says 172.21.15.110:36578) 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa22239f640 1 -- 172.21.15.110:0/1701010410 learned_addr learned my addr 172.21.15.110:0/1701010410 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.193+0000 7fa22239f640 1 -- 172.21.15.110:0/1701010410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c009ae0 con 0x7fa21c102110 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.194+0000 7fa22239f640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c110e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009560 tx=0x7fa20c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.194+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa20c03a400 con 0x7fa21c102110 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.194+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa20c03aa00 con 0x7fa21c102110 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.194+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c111590 con 0x7fa21c102110 2024-09-16T01:57:42.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.194+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa20c044740 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.194+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c111fe0 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.195+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fa20c038040 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.195+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208005240 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.195+0000 7fa21affd640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa204039580 0x7fa20403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.195+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa20c040030 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.195+0000 7fa221b9e640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa204039580 0x7fa20403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.195+0000 7fa221b9e640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa204039580 0x7fa20403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa210006fd0 tx=0x7fa210006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.199+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa20c042940 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.435+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fa208005a70 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.438+0000 7fa21affd640 1 -- 172.21.15.110:0/1701010410 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa20c036030 con 0x7fa21c102110 2024-09-16T01:57:42.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.439+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa204039580 msgr2=0x7fa20403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.439+0000 7fa224603640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa204039580 0x7fa20403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa210006fd0 tx=0x7fa210006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 msgr2=0x7fa21c110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c110e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009560 tx=0x7fa20c009840 comp rx=0 tx=0).stop 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 shutdown_connections 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa204039580 0x7fa20403ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 --2- 172.21.15.110:0/1701010410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa21c102110 0x7fa21c110e50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 >> 172.21.15.110:0/1701010410 conn(0x7fa21c0fd8b0 msgr2=0x7fa21c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 shutdown_connections 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-16T01:57:41.440+0000 7fa224603640 1 -- 172.21.15.110:0/1701010410 wait complete. 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: ceph telemetry on 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout:For more information see: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-16T01:57:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:42.084 INFO:teuthology.orchestra.run.smithi110.stdout:Bootstrap complete. 2024-09-16T01:57:42.111 INFO:tasks.cephadm:Fetching config... 2024-09-16T01:57:42.111 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:57:42.112 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T01:57:42.128 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T01:57:42.128 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:57:42.128 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T01:57:42.185 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T01:57:42.185 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:57:42.185 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/keyring of=/dev/stdout 2024-09-16T01:57:42.249 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T01:57:42.249 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:57:42.250 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T01:57:42.308 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T01:57:42.308 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyDVOdkKqYVQntn1j7R9bCqiBhEQd3qQyN63WZneBdVJ2BTbJF4dYyrlPjCa2Vp+TRksreDKrcts3RIv7ut+lOSmM7l558Sv1OpSgDazR/MWUjerhDDnA4rKCWXJEQu7GEY4BcMHOE3p4RJ6hQRmKdwz7k1hW7tK5LcN2avP1Hnb+d3bs4Xpwo3KtzvPJQGPWr/3kKbsCeskwLpOQkLuVAA/VVsO86No/MRhQCxlKg/d0YAx9QuAPysnumRYywQM/0AUBGKty/p85gHoU2MXDHks67kj79JsmJKIIOxY32tDJ4Aw1kH39agSHR0FTl9Bp/O2hV6t/F744Fj/m4xUeQC7oefVWeOIbXjRitchN4qGkNrtmEDU4DYCqvTShQk2SJR9rKKR6axWtKCfxBbG4jKsAPRvZj+QwwRrOCcAWjlHyssV6jPDYM13WYge0Z5OyeMCjyVwh5l5EB7dKiDGUYjZExqu6hfPDL0M99WXj/Fg9bz4TRaTcp9mPhU0SyGxc= ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T01:57:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyDVOdkKqYVQntn1j7R9bCqiBhEQd3qQyN63WZneBdVJ2BTbJF4dYyrlPjCa2Vp+TRksreDKrcts3RIv7ut+lOSmM7l558Sv1OpSgDazR/MWUjerhDDnA4rKCWXJEQu7GEY4BcMHOE3p4RJ6hQRmKdwz7k1hW7tK5LcN2avP1Hnb+d3bs4Xpwo3KtzvPJQGPWr/3kKbsCeskwLpOQkLuVAA/VVsO86No/MRhQCxlKg/d0YAx9QuAPysnumRYywQM/0AUBGKty/p85gHoU2MXDHks67kj79JsmJKIIOxY32tDJ4Aw1kH39agSHR0FTl9Bp/O2hV6t/F744Fj/m4xUeQC7oefVWeOIbXjRitchN4qGkNrtmEDU4DYCqvTShQk2SJR9rKKR6axWtKCfxBbG4jKsAPRvZj+QwwRrOCcAWjlHyssV6jPDYM13WYge0Z5OyeMCjyVwh5l5EB7dKiDGUYjZExqu6hfPDL0M99WXj/Fg9bz4TRaTcp9mPhU0SyGxc= ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:57:42.392 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyDVOdkKqYVQntn1j7R9bCqiBhEQd3qQyN63WZneBdVJ2BTbJF4dYyrlPjCa2Vp+TRksreDKrcts3RIv7ut+lOSmM7l558Sv1OpSgDazR/MWUjerhDDnA4rKCWXJEQu7GEY4BcMHOE3p4RJ6hQRmKdwz7k1hW7tK5LcN2avP1Hnb+d3bs4Xpwo3KtzvPJQGPWr/3kKbsCeskwLpOQkLuVAA/VVsO86No/MRhQCxlKg/d0YAx9QuAPysnumRYywQM/0AUBGKty/p85gHoU2MXDHks67kj79JsmJKIIOxY32tDJ4Aw1kH39agSHR0FTl9Bp/O2hV6t/F744Fj/m4xUeQC7oefVWeOIbXjRitchN4qGkNrtmEDU4DYCqvTShQk2SJR9rKKR6axWtKCfxBbG4jKsAPRvZj+QwwRrOCcAWjlHyssV6jPDYM13WYge0Z5OyeMCjyVwh5l5EB7dKiDGUYjZExqu6hfPDL0M99WXj/Fg9bz4TRaTcp9mPhU0SyGxc= ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T01:57:42.512 INFO:teuthology.orchestra.run.smithi165.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyDVOdkKqYVQntn1j7R9bCqiBhEQd3qQyN63WZneBdVJ2BTbJF4dYyrlPjCa2Vp+TRksreDKrcts3RIv7ut+lOSmM7l558Sv1OpSgDazR/MWUjerhDDnA4rKCWXJEQu7GEY4BcMHOE3p4RJ6hQRmKdwz7k1hW7tK5LcN2avP1Hnb+d3bs4Xpwo3KtzvPJQGPWr/3kKbsCeskwLpOQkLuVAA/VVsO86No/MRhQCxlKg/d0YAx9QuAPysnumRYywQM/0AUBGKty/p85gHoU2MXDHks67kj79JsmJKIIOxY32tDJ4Aw1kH39agSHR0FTl9Bp/O2hV6t/F744Fj/m4xUeQC7oefVWeOIbXjRitchN4qGkNrtmEDU4DYCqvTShQk2SJR9rKKR6axWtKCfxBbG4jKsAPRvZj+QwwRrOCcAWjlHyssV6jPDYM13WYge0Z5OyeMCjyVwh5l5EB7dKiDGUYjZExqu6hfPDL0M99WXj/Fg9bz4TRaTcp9mPhU0SyGxc= ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:57:42.525 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T01:57:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:42 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1701010410' entity='client.admin' 2024-09-16T01:57:42.768 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:57:45.184 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:45.184 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:45.184 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:57:45.184 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:45.184 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T01:57:45.184 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T01:57:45.185 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:57:45.185 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:45 smithi110 ceph-mon[27634]: Deploying daemon crash.smithi110 on smithi110 2024-09-16T01:57:45.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 -- 172.21.15.110:0/2453907000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 msgr2=0x7f02700fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:45.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 --2- 172.21.15.110:0/2453907000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f02700fc5c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0260004850 tx=0x7f0260009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:45.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 -- 172.21.15.110:0/2453907000 shutdown_connections 2024-09-16T01:57:45.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 --2- 172.21.15.110:0/2453907000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f02700fc5c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 -- 172.21.15.110:0/2453907000 >> 172.21.15.110:0/2453907000 conn(0x7f02700f7990 msgr2=0x7f02700f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 -- 172.21.15.110:0/2453907000 shutdown_connections 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.386+0000 7f027517c640 1 -- 172.21.15.110:0/2453907000 wait complete. 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f027517c640 1 Processor -- start 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f027517c640 1 -- start start 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f027517c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f027010c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f027517c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027010cc30 con 0x7f02700fc1b0 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f026ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f027010c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f026ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f027010c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36596/0 (socket says 172.21.15.110:36596) 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f026ed9d640 1 -- 172.21.15.110:0/701808021 learned_addr learned my addr 172.21.15.110:0/701808021 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f026ed9d640 1 -- 172.21.15.110:0/701808021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260005040 con 0x7f02700fc1b0 2024-09-16T01:57:45.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f026ed9d640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f027010c6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0260009920 tx=0x7f0260009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0260033630 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.387+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0260033c30 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.388+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027010ce30 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.388+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f026003dc40 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.388+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027010d2a0 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.388+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f0260030020 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.389+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027005ed70 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.389+0000 7f02677fe640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f025c0395d0 0x7f025c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.389+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f026006c7c0 con 0x7f02700fc1b0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.389+0000 7f0267fff640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f025c0395d0 0x7f025c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:45.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.389+0000 7f0267fff640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f025c0395d0 0x7f025c03ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fd0 tx=0x7f0258006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:45.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.393+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0260033790 con 0x7f02700fc1b0 2024-09-16T01:57:45.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.554+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f027010d2a0 con 0x7f02700fc1b0 2024-09-16T01:57:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.557+0000 7f02677fe640 1 -- 172.21.15.110:0/701808021 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0260045800 con 0x7f02700fc1b0 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f025c0395d0 msgr2=0x7f025c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f025c0395d0 0x7f025c03ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fd0 tx=0x7f0258006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 msgr2=0x7f027010c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f027010c6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0260009920 tx=0x7f0260009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 shutdown_connections 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f025c0395d0 0x7f025c03ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:45.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 --2- 172.21.15.110:0/701808021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02700fc1b0 0x7f027010c6f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 >> 172.21.15.110:0/701808021 conn(0x7f02700f7990 msgr2=0x7f02700f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 shutdown_connections 2024-09-16T01:57:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:45.559+0000 7f027517c640 1 -- 172.21.15.110:0/701808021 wait complete. 2024-09-16T01:57:46.229 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T01:57:46.229 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T01:57:46.734 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:46 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/701808021' entity='client.admin' 2024-09-16T01:57:46.803 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:57:49.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4102929126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 msgr2=0x7f08d40fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:49.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 --2- 172.21.15.110:0/4102929126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d40fee50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f08d0004850 tx=0x7f08d0009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:49.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4102929126 shutdown_connections 2024-09-16T01:57:49.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 --2- 172.21.15.110:0/4102929126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d40fee50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:49.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4102929126 >> 172.21.15.110:0/4102929126 conn(0x7f08d40f6880 msgr2=0x7f08d40f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:49.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4102929126 shutdown_connections 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4102929126 wait complete. 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 Processor -- start 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.424+0000 7f08dbbf2640 1 -- start start 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08dbbf2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d410c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08dbbf2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d410cca0 con 0x7f08d4065e60 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08d998e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d410c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08d998e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d410c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36622/0 (socket says 172.21.15.110:36622) 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08d998e640 1 -- 172.21.15.110:0/4043620529 learned_addr learned my addr 172.21.15.110:0/4043620529 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08d998e640 1 -- 172.21.15.110:0/4043620529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0005040 con 0x7f08d4065e60 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08d998e640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d410c760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08d002a6d0 tx=0x7f08d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:49.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08d0033630 con 0x7f08d4065e60 2024-09-16T01:57:49.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f08d0033c30 con 0x7f08d4065e60 2024-09-16T01:57:49.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d410cea0 con 0x7f08d4065e60 2024-09-16T01:57:49.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08d003dc30 con 0x7f08d4065e60 2024-09-16T01:57:49.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.425+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d410d310 con 0x7f08d4065e60 2024-09-16T01:57:49.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.426+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f08d0030020 con 0x7f08d4065e60 2024-09-16T01:57:49.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.426+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d405ed70 con 0x7f08d4065e60 2024-09-16T01:57:49.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.426+0000 7f08c67fc640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f08c00395d0 0x7f08c003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:49.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.426+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f08d006c8b0 con 0x7f08d4065e60 2024-09-16T01:57:49.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.426+0000 7f08d918d640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f08c00395d0 0x7f08c003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:49.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.427+0000 7f08d918d640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f08c00395d0 0x7f08c003ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08c8006fd0 tx=0x7f08c8006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:49.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.431+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f08d0045800 con 0x7f08d4065e60 2024-09-16T01:57:49.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.598+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f08d410d310 con 0x7f08c00395d0 2024-09-16T01:57:49.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.601+0000 7f08c67fc640 1 -- 172.21.15.110:0/4043620529 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f08d410d310 con 0x7f08c00395d0 2024-09-16T01:57:49.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f08c00395d0 msgr2=0x7f08c003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f08c00395d0 0x7f08c003ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08c8006fd0 tx=0x7f08c8006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 msgr2=0x7f08d410c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d410c760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08d002a6d0 tx=0x7f08d0009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 shutdown_connections 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f08c00395d0 0x7f08c003ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 --2- 172.21.15.110:0/4043620529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d4065e60 0x7f08d410c760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 >> 172.21.15.110:0/4043620529 conn(0x7f08d40f6880 msgr2=0x7f08d40f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 shutdown_connections 2024-09-16T01:57:49.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:49.603+0000 7f08dbbf2640 1 -- 172.21.15.110:0/4043620529 wait complete. 2024-09-16T01:57:50.338 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi165 2024-09-16T01:57:50.338 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:57:50.338 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.conf 2024-09-16T01:57:50.358 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:57:50.359 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:57:50.417 INFO:tasks.cephadm:Adding host smithi165 to orchestrator... 2024-09-16T01:57:50.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch host add smithi165 2024-09-16T01:57:50.669 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:57:50.924 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:50 smithi110 ceph-mon[27634]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:50.924 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:50 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:51.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:51 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:51.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:51 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:51.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:51 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:51.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:51 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:51.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:51 smithi110 ceph-mon[27634]: Deploying daemon node-exporter.smithi110 on smithi110 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 -- 172.21.15.110:0/3252755737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 msgr2=0x7fecb00fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 --2- 172.21.15.110:0/3252755737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb00fb6f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feca4004850 tx=0x7feca4009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 -- 172.21.15.110:0/3252755737 shutdown_connections 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 --2- 172.21.15.110:0/3252755737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb00fb6f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 -- 172.21.15.110:0/3252755737 >> 172.21.15.110:0/3252755737 conn(0x7fecb00f6ac0 msgr2=0x7fecb00f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 -- 172.21.15.110:0/3252755737 shutdown_connections 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.134+0000 7fecb6dfe640 1 -- 172.21.15.110:0/3252755737 wait complete. 2024-09-16T01:57:52.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.135+0000 7fecb6dfe640 1 Processor -- start 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.135+0000 7fecb6dfe640 1 -- start start 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.135+0000 7fecb6dfe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb0065530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.135+0000 7fecb6dfe640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb010f600 con 0x7fecb00fb2e0 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.135+0000 7fecb4b9a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb0065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.135+0000 7fecb4b9a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb0065530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38516/0 (socket says 172.21.15.110:38516) 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecb4b9a640 1 -- 172.21.15.110:0/309228696 learned_addr learned my addr 172.21.15.110:0/309228696 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecb4b9a640 1 -- 172.21.15.110:0/309228696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4005040 con 0x7fecb00fb2e0 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecb4b9a640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb0065530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feca4009920 tx=0x7feca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feca4033630 con 0x7fecb00fb2e0 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb010f740 con 0x7fecb00fb2e0 2024-09-16T01:57:52.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feca4033c30 con 0x7fecb00fb2e0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feca403dc40 con 0x7fecb00fb2e0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.136+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb010fbb0 con 0x7fecb00fb2e0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.137+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7feca4030020 con 0x7fecb00fb2e0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.137+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb005ed70 con 0x7fecb00fb2e0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.137+0000 7fecad7fa640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7feca0039580 0x7feca003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.137+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feca406cac0 con 0x7fecb00fb2e0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.138+0000 7fecaffff640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7feca0039580 0x7feca003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.138+0000 7fecaffff640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7feca0039580 0x7feca003ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec9c006fd0 tx=0x7fec9c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:52.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.142+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feca403bd90 con 0x7fecb00fb2e0 2024-09-16T01:57:52.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:52.319+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}) v1 -- 0x7fecb0101010 con 0x7feca0039580 2024-09-16T01:57:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:52 smithi110 ceph-mon[27634]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:57:54.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:54 smithi110 ceph-mon[27634]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:57:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:54 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:54 smithi110 ceph-mon[27634]: Deploying cephadm binary to smithi165 2024-09-16T01:57:55.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.168+0000 7fecad7fa640 1 -- 172.21.15.110:0/309228696 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fecb0101010 con 0x7feca0039580 2024-09-16T01:57:55.171 INFO:teuthology.orchestra.run.smithi110.stdout:Added host 'smithi165' with addr '172.21.15.165' 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.170+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7feca0039580 msgr2=0x7feca003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.170+0000 7fecb6dfe640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7feca0039580 0x7feca003ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fec9c006fd0 tx=0x7fec9c006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.170+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 msgr2=0x7fecb0065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.170+0000 7fecb6dfe640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb0065530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feca4009920 tx=0x7feca4009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.171+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 shutdown_connections 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.171+0000 7fecb6dfe640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7feca0039580 0x7feca003ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.171+0000 7fecb6dfe640 1 --2- 172.21.15.110:0/309228696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb00fb2e0 0x7fecb0065530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.171+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 >> 172.21.15.110:0/309228696 conn(0x7fecb00f6ac0 msgr2=0x7fecb00f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.171+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 shutdown_connections 2024-09-16T01:57:55.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:55.171+0000 7fecb6dfe640 1 -- 172.21.15.110:0/309228696 wait complete. 2024-09-16T01:57:56.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T01:57:56.311 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:57:56.431 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: Added host smithi165 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:56.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:56 smithi110 ceph-mon[27634]: Deploying daemon alertmanager.smithi110 on smithi110 2024-09-16T01:57:58.248 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:58 smithi110 ceph-mon[27634]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:57:58.248 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:58 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 -- 172.21.15.110:0/1365578296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 msgr2=0x7f72000fc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 --2- 172.21.15.110:0/1365578296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f72000fc600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71f4004850 tx=0x7f71f4009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 -- 172.21.15.110:0/1365578296 shutdown_connections 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 --2- 172.21.15.110:0/1365578296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f72000fc600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 -- 172.21.15.110:0/1365578296 >> 172.21.15.110:0/1365578296 conn(0x7f72000f79b0 msgr2=0x7f72000f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 -- 172.21.15.110:0/1365578296 shutdown_connections 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 -- 172.21.15.110:0/1365578296 wait complete. 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 Processor -- start 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.479+0000 7f7206d30640 1 -- start start 2024-09-16T01:57:58.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7206d30640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f720010c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7206d30640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720010cc50 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7204acc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f720010c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7204acc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f720010c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38540/0 (socket says 172.21.15.110:38540) 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7204acc640 1 -- 172.21.15.110:0/3644645382 learned_addr learned my addr 172.21.15.110:0/3644645382 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7204acc640 1 -- 172.21.15.110:0/3644645382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f4005040 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7204acc640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f720010c710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71f402a6d0 tx=0x7f71f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71f4033630 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.480+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720010ce50 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.481+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71f4033c30 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.481+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71f403dc00 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.481+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720010d2c0 con 0x7f72000fc1f0 2024-09-16T01:57:58.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.482+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f71f4030020 con 0x7f72000fc1f0 2024-09-16T01:57:58.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.482+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720005ed70 con 0x7f72000fc1f0 2024-09-16T01:57:58.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.482+0000 7f71fd7fa640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f71f00395d0 0x7f71f003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:57:58.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.482+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f71f406c9c0 con 0x7f72000fc1f0 2024-09-16T01:57:58.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.482+0000 7f71fffff640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f71f00395d0 0x7f71f003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:57:58.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.482+0000 7f71fffff640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f71f00395d0 0x7f71f003ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f71ec006fd0 tx=0x7f71ec006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:57:58.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.486+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f71f403bb50 con 0x7f72000fc1f0 2024-09-16T01:57:58.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.658+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f720010d2c0 con 0x7f71f00395d0 2024-09-16T01:57:58.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.660+0000 7f71fd7fa640 1 -- 172.21.15.110:0/3644645382 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f720010d2c0 con 0x7f71f00395d0 2024-09-16T01:57:58.662 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:57:58.662 INFO:teuthology.orchestra.run.smithi110.stdout:[{"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}, {"addr": "172.21.15.165", "hostname": "smithi165", "labels": [], "status": ""}] 2024-09-16T01:57:58.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.661+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f71f00395d0 msgr2=0x7f71f003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.661+0000 7f7206d30640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f71f00395d0 0x7f71f003ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f71ec006fd0 tx=0x7f71ec006db0 comp rx=0 tx=0).stop 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.661+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 msgr2=0x7f720010c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.661+0000 7f7206d30640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f720010c710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71f402a6d0 tx=0x7f71f4009da0 comp rx=0 tx=0).stop 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.662+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 shutdown_connections 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.662+0000 7f7206d30640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f71f00395d0 0x7f71f003ba80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.662+0000 7f7206d30640 1 --2- 172.21.15.110:0/3644645382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72000fc1f0 0x7f720010c710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.662+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 >> 172.21.15.110:0/3644645382 conn(0x7f72000f79b0 msgr2=0x7f72000f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.662+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 shutdown_connections 2024-09-16T01:57:58.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:57:58.662+0000 7f7206d30640 1 -- 172.21.15.110:0/3644645382 wait complete. 2024-09-16T01:57:59.298 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:57:59 smithi110 ceph-mon[27634]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:57:59.807 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T01:57:59.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T01:58:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:58:00.429 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:00 smithi110 ceph-mon[27634]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:02.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:02 smithi110 ceph-mon[27634]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 -- 172.21.15.110:0/3021096465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 msgr2=0x7fe9f80fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 --2- 172.21.15.110:0/3021096465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f80fb4d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8004850 tx=0x7fe9e8009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 -- 172.21.15.110:0/3021096465 shutdown_connections 2024-09-16T01:58:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 --2- 172.21.15.110:0/3021096465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f80fb4d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 -- 172.21.15.110:0/3021096465 >> 172.21.15.110:0/3021096465 conn(0x7fe9f80f6880 msgr2=0x7fe9f80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 -- 172.21.15.110:0/3021096465 shutdown_connections 2024-09-16T01:58:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 -- 172.21.15.110:0/3021096465 wait complete. 2024-09-16T01:58:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.068+0000 7fe9fe68f640 1 Processor -- start 2024-09-16T01:58:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9fe68f640 1 -- start start 2024-09-16T01:58:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9fe68f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f810b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9fe68f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f810bb90 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f810b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f810b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37366/0 (socket says 172.21.15.110:37366) 2024-09-16T01:58:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f7fff640 1 -- 172.21.15.110:0/1040501129 learned_addr learned my addr 172.21.15.110:0/1040501129 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f7fff640 1 -- 172.21.15.110:0/1040501129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8005040 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f7fff640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f810b650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9e8033630 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9e8033c30 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.069+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f810bd90 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.070+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9e803fbc0 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.070+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f810c200 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.070+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe9e8030020 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.070+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f805ed70 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.071+0000 7fe9f4ff9640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe9e0039580 0x7fe9e003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.071+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe9e806e810 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.071+0000 7fe9f77fe640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe9e0039580 0x7fe9e003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.071+0000 7fe9f77fe640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe9e0039580 0x7fe9e003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006fd0 tx=0x7fe9ec006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.075+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe9e803db50 con 0x7fe9f80fb0c0 2024-09-16T01:58:03.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:03.237+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe9f804b720 con 0x7fe9f80fb0c0 2024-09-16T01:58:04.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.177+0000 7fe9f4ff9640 1 -- 172.21.15.110:0/1040501129 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe9e803d370 con 0x7fe9f80fb0c0 2024-09-16T01:58:04.180 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe9e0039580 msgr2=0x7fe9e003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe9e0039580 0x7fe9e003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006fd0 tx=0x7fe9ec006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 msgr2=0x7fe9f810b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f810b650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 shutdown_connections 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fe9e0039580 0x7fe9e003ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 --2- 172.21.15.110:0/1040501129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9f80fb0c0 0x7fe9f810b650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.179+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 >> 172.21.15.110:0/1040501129 conn(0x7fe9f80f6880 msgr2=0x7fe9f80f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.180+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 shutdown_connections 2024-09-16T01:58:04.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:58:04.180+0000 7fe9fe68f640 1 -- 172.21.15.110:0/1040501129 wait complete. 2024-09-16T01:58:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:04 smithi110 ceph-mon[27634]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:04.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:04 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1040501129' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T01:58:04.848 INFO:tasks.cephadm:Adding mon.smithi110 on smithi110 2024-09-16T01:58:04.848 INFO:tasks.cephadm:Adding mon.smithi165 on smithi165 2024-09-16T01:58:04.848 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi110:172.21.15.110=smithi110;smithi165:172.21.15.165=smithi165' 2024-09-16T01:58:05.174 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:05.219 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:05.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:05 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1040501129' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T01:58:05.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:05 smithi110 ceph-mon[27634]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:58:06.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:06 smithi110 ceph-mon[27634]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:06.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.642+0000 7fc85087d640 1 -- 172.21.15.165:0/1444542647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 msgr2=0x7fc84c0fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:06.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.642+0000 7fc85087d640 1 --2- 172.21.15.165:0/1444542647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fdc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc83c004850 tx=0x7fc83c009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:06.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 -- 172.21.15.165:0/1444542647 shutdown_connections 2024-09-16T01:58:06.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 --2- 172.21.15.165:0/1444542647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fdc20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:06.646 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 -- 172.21.15.165:0/1444542647 >> 172.21.15.165:0/1444542647 conn(0x7fc84c0f6010 msgr2=0x7fc84c0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 -- 172.21.15.165:0/1444542647 shutdown_connections 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 -- 172.21.15.165:0/1444542647 wait complete. 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 Processor -- start 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 -- start start 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc85087d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0fd460 con 0x7fc84c0fd810 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.643+0000 7fc84a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc84a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:44732/0 (socket says 172.21.15.165:44732) 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc84a59c640 1 -- 172.21.15.165:0/3601908218 learned_addr learned my addr 172.21.15.165:0/3601908218 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc84a59c640 1 -- 172.21.15.165:0/3601908218 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c005040 con 0x7fc84c0fd810 2024-09-16T01:58:06.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc84a59c640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fcf20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc83c02a6d0 tx=0x7fc83c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc83c033630 con 0x7fc84c0fd810 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc83c033c30 con 0x7fc84c0fd810 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c0fb4f0 con 0x7fc84c0fd810 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc83c03dc30 con 0x7fc84c0fd810 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.644+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c0fb960 con 0x7fc84c0fd810 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.645+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fc83c030020 con 0x7fc84c0fd810 2024-09-16T01:58:06.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.645+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c1025f0 con 0x7fc84c0fd810 2024-09-16T01:58:06.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.645+0000 7fc83affd640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fc834039580 0x7fc83403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:06.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.645+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc83c06ca00 con 0x7fc84c0fd810 2024-09-16T01:58:06.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.646+0000 7fc849d9b640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fc834039580 0x7fc83403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:06.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.646+0000 7fc849d9b640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fc834039580 0x7fc83403ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc840006fd0 tx=0x7fc840006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:06.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.651+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc83c045800 con 0x7fc84c0fd810 2024-09-16T01:58:06.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.813+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 --> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi110:172.21.15.110=smithi110;smithi165:172.21.15.165=smithi165", "target": ["mon-mgr", ""]}) v1 -- 0x7fc84c0fbc50 con 0x7fc834039580 2024-09-16T01:58:06.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.820+0000 7fc83affd640 1 -- 172.21.15.165:0/3601908218 <== mgr.14158 v2:172.21.15.110:6800/2073782143 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc84c0fbc50 con 0x7fc834039580 2024-09-16T01:58:06.821 INFO:teuthology.orchestra.run.smithi165.stdout:Scheduled mon update... 2024-09-16T01:58:06.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fc834039580 msgr2=0x7fc83403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fc834039580 0x7fc83403ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc840006fd0 tx=0x7fc840006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 msgr2=0x7fc84c0fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fcf20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc83c02a6d0 tx=0x7fc83c009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 shutdown_connections 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fc834039580 0x7fc83403ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 --2- 172.21.15.165:0/3601908218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc84c0fd810 0x7fc84c0fcf20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 >> 172.21.15.165:0/3601908218 conn(0x7fc84c0f6010 msgr2=0x7fc84c0f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 shutdown_connections 2024-09-16T01:58:06.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:06.821+0000 7fc85087d640 1 -- 172.21.15.165:0/3601908218 wait complete. 2024-09-16T01:58:07.403 DEBUG:teuthology.orchestra.run.smithi165:mon.smithi165> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165.service 2024-09-16T01:58:07.406 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:07.407 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:07.676 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T01:58:07.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T01:58:07.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: Deploying daemon grafana.smithi110 on smithi110 2024-09-16T01:58:07.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:07 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:07.721 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:08.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:08 smithi110 ceph-mon[27634]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi110:172.21.15.110=smithi110;smithi165:172.21.15.165=smithi165", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:58:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:08 smithi110 ceph-mon[27634]: Saving service mon spec with placement smithi110:172.21.15.110=smithi110;smithi165:172.21.15.165=smithi165;count:2 2024-09-16T01:58:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:08 smithi110 ceph-mon[27634]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:08 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 -- 172.21.15.165:0/705511642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 msgr2=0x7efde00fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 --2- 172.21.15.165:0/705511642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde00fb4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efdd0004850 tx=0x7efdd0009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 -- 172.21.15.165:0/705511642 shutdown_connections 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 --2- 172.21.15.165:0/705511642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde00fb4c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 -- 172.21.15.165:0/705511642 >> 172.21.15.165:0/705511642 conn(0x7efde00f6850 msgr2=0x7efde00f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 -- 172.21.15.165:0/705511642 shutdown_connections 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 -- 172.21.15.165:0/705511642 wait complete. 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 Processor -- start 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.111+0000 7efde5122640 1 -- start start 2024-09-16T01:58:09.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efde5122640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde010c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:09.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efde5122640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde010cc40 con 0x7efde00fb0b0 2024-09-16T01:58:09.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdded9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde010c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:09.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdded9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde010c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:44746/0 (socket says 172.21.15.165:44746) 2024-09-16T01:58:09.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdded9d640 1 -- 172.21.15.165:0/117137275 learned_addr learned my addr 172.21.15.165:0/117137275 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:09.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdded9d640 1 -- 172.21.15.165:0/117137275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0005040 con 0x7efde00fb0b0 2024-09-16T01:58:09.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdded9d640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde010c700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efdd002a6d0 tx=0x7efdd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:09.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdd0033630 con 0x7efde00fb0b0 2024-09-16T01:58:09.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde010ce40 con 0x7efde00fb0b0 2024-09-16T01:58:09.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdd0033c30 con 0x7efde00fb0b0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdd003dc00 con 0x7efde00fb0b0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.112+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde010d2b0 con 0x7efde00fb0b0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.113+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7efdd0030020 con 0x7efde00fb0b0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.113+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde005ed70 con 0x7efde00fb0b0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.114+0000 7efdd77fe640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efdcc039580 0x7efdcc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.114+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efdd006ca30 con 0x7efde00fb0b0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.114+0000 7efdd7fff640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efdcc039580 0x7efdcc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:09.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.114+0000 7efdd7fff640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efdcc039580 0x7efdcc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efdc8006fd0 tx=0x7efdc8006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:09.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.120+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efdd0045b80 con 0x7efde00fb0b0 2024-09-16T01:58:09.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.331+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efde004b720 con 0x7efde00fb0b0 2024-09-16T01:58:09.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.331+0000 7efdd77fe640 1 -- 172.21.15.165:0/117137275 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7efdd0045b80 con 0x7efde00fb0b0 2024-09-16T01:58:09.333 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:09.333 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:09.333 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efdcc039580 msgr2=0x7efdcc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efdcc039580 0x7efdcc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efdc8006fd0 tx=0x7efdc8006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:09.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 msgr2=0x7efde010c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde010c700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efdd002a6d0 tx=0x7efdd0009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 shutdown_connections 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7efdcc039580 0x7efdcc03ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 --2- 172.21.15.165:0/117137275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efde00fb0b0 0x7efde010c700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 >> 172.21.15.165:0/117137275 conn(0x7efde00f6850 msgr2=0x7efde0065560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 shutdown_connections 2024-09-16T01:58:09.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:09.333+0000 7efde5122640 1 -- 172.21.15.165:0/117137275 wait complete. 2024-09-16T01:58:09.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:09 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/117137275' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:10 smithi110 ceph-mon[27634]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:10.974 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:10.974 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:11.217 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:11.262 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:12.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:12 smithi110 ceph-mon[27634]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.673+0000 7f5a4f6da640 1 -- 172.21.15.165:0/4102302451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 msgr2=0x7f5a480fa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.673+0000 7f5a4f6da640 1 --2- 172.21.15.165:0/4102302451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480fa850 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a40004850 tx=0x7f5a40009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.673+0000 7f5a4f6da640 1 -- 172.21.15.165:0/4102302451 shutdown_connections 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.673+0000 7f5a4f6da640 1 --2- 172.21.15.165:0/4102302451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480fa850 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.673+0000 7f5a4f6da640 1 -- 172.21.15.165:0/4102302451 >> 172.21.15.165:0/4102302451 conn(0x7f5a480f6010 msgr2=0x7f5a480f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.673+0000 7f5a4f6da640 1 -- 172.21.15.165:0/4102302451 shutdown_connections 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4f6da640 1 -- 172.21.15.165:0/4102302451 wait complete. 2024-09-16T01:58:12.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4f6da640 1 Processor -- start 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4f6da640 1 -- start start 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4f6da640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4f6da640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480f84c0 con 0x7f5a48064c70 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4d476640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4d476640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480f7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:44772/0 (socket says 172.21.15.165:44772) 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.674+0000 7f5a4d476640 1 -- 172.21.15.165:0/3406559311 learned_addr learned my addr 172.21.15.165:0/3406559311 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a4d476640 1 -- 172.21.15.165:0/3406559311 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40005040 con 0x7f5a48064c70 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a4d476640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480f7f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002a6d0 tx=0x7f5a40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a40033630 con 0x7f5a48064c70 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a40033c30 con 0x7f5a48064c70 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480f6550 con 0x7f5a48064c70 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a4003dc30 con 0x7f5a48064c70 2024-09-16T01:58:12.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.675+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480f69c0 con 0x7f5a48064c70 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.676+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4805ed70 con 0x7f5a48064c70 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.676+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f5a40030020 con 0x7f5a48064c70 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.676+0000 7f5a45ffb640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f5a30039580 0x7f5a3003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.676+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5a4006ca10 con 0x7f5a48064c70 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.677+0000 7f5a4cc75640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f5a30039580 0x7f5a3003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.677+0000 7f5a4cc75640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f5a30039580 0x7f5a3003ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c006fd0 tx=0x7f5a3c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:12.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.685+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5a40033da0 con 0x7f5a48064c70 2024-09-16T01:58:12.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.899+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5a4804b720 con 0x7f5a48064c70 2024-09-16T01:58:12.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.900+0000 7f5a45ffb640 1 -- 172.21.15.165:0/3406559311 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f5a40045800 con 0x7f5a48064c70 2024-09-16T01:58:12.901 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:12.901 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:12.901 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f5a30039580 msgr2=0x7f5a3003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f5a30039580 0x7f5a3003ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c006fd0 tx=0x7f5a3c006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 msgr2=0x7f5a480f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480f7f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a4002a6d0 tx=0x7f5a40009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 shutdown_connections 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f5a30039580 0x7f5a3003ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 --2- 172.21.15.165:0/3406559311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a48064c70 0x7f5a480f7f80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 >> 172.21.15.165:0/3406559311 conn(0x7f5a480f6010 msgr2=0x7f5a480fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 shutdown_connections 2024-09-16T01:58:12.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:12.902+0000 7f5a4f6da640 1 -- 172.21.15.165:0/3406559311 wait complete. 2024-09-16T01:58:13.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:13 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/3406559311' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:14.391 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:14.392 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:14.635 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:14.677 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:14.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:14 smithi110 ceph-mon[27634]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:16.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.104+0000 7fa6db96c640 1 -- 172.21.15.165:0/1946389794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 msgr2=0x7fa6d40fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:16.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.104+0000 7fa6db96c640 1 --2- 172.21.15.165:0/1946389794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d40fb4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4004850 tx=0x7fa6c4009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:16.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.104+0000 7fa6db96c640 1 -- 172.21.15.165:0/1946389794 shutdown_connections 2024-09-16T01:58:16.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.104+0000 7fa6db96c640 1 --2- 172.21.15.165:0/1946389794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d40fb4d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:16.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.104+0000 7fa6db96c640 1 -- 172.21.15.165:0/1946389794 >> 172.21.15.165:0/1946389794 conn(0x7fa6d40f6880 msgr2=0x7fa6d40f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:16.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.105+0000 7fa6db96c640 1 -- 172.21.15.165:0/1946389794 shutdown_connections 2024-09-16T01:58:16.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.105+0000 7fa6db96c640 1 -- 172.21.15.165:0/1946389794 wait complete. 2024-09-16T01:58:16.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.105+0000 7fa6db96c640 1 Processor -- start 2024-09-16T01:58:16.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.105+0000 7fa6db96c640 1 -- start start 2024-09-16T01:58:16.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.105+0000 7fa6db96c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d410c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:16.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.105+0000 7fa6db96c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d410cc00 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6d9708640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d410c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:16.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6d9708640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d410c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:44782/0 (socket says 172.21.15.165:44782) 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6d9708640 1 -- 172.21.15.165:0/1314359747 learned_addr learned my addr 172.21.15.165:0/1314359747 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6d9708640 1 -- 172.21.15.165:0/1314359747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4005040 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6d9708640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d410c6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6c402a6d0 tx=0x7fa6c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6c4033630 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d410ce00 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa6c4033c30 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.112 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.106+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6c403dc00 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.107+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d410d270 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.107+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d405ed70 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.108+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fa6c4030020 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.108+0000 7fa6c9ffb640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa6c0039580 0x7fa6c003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.108+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa6c406c960 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.108+0000 7fa6d8f07640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa6c0039580 0x7fa6c003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:16.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.109+0000 7fa6d8f07640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa6c0039580 0x7fa6c003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0006fd0 tx=0x7fa6d0006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:16.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.113+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa6c4033790 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.329+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa6d404b720 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.330+0000 7fa6c9ffb640 1 -- 172.21.15.165:0/1314359747 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa6c4045800 con 0x7fa6d40fb0c0 2024-09-16T01:58:16.331 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:16.332 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:16.332 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa6c0039580 msgr2=0x7fa6c003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa6c0039580 0x7fa6c003ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0006fd0 tx=0x7fa6d0006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 msgr2=0x7fa6d410c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d410c6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6c402a6d0 tx=0x7fa6c4009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 shutdown_connections 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fa6c0039580 0x7fa6c003ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 --2- 172.21.15.165:0/1314359747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6d40fb0c0 0x7fa6d410c6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:16.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 >> 172.21.15.165:0/1314359747 conn(0x7fa6d40f6880 msgr2=0x7fa6d4065500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:16.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 shutdown_connections 2024-09-16T01:58:16.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:16.332+0000 7fa6db96c640 1 -- 172.21.15.165:0/1314359747 wait complete. 2024-09-16T01:58:16.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:16 smithi110 ceph-mon[27634]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:16.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:16 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1314359747' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:17.920 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:17.921 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:18.164 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:18.209 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:18.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: Deploying daemon prometheus.smithi110 on smithi110 2024-09-16T01:58:18.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:18 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.651+0000 7f275ba2f640 1 -- 172.21.15.165:0/2694338234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 msgr2=0x7f275406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.651+0000 7f275ba2f640 1 --2- 172.21.15.165:0/2694338234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f275406fb00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2750004850 tx=0x7f2750009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.651+0000 7f275ba2f640 1 -- 172.21.15.165:0/2694338234 shutdown_connections 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.651+0000 7f275ba2f640 1 --2- 172.21.15.165:0/2694338234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f275406fb00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.651+0000 7f275ba2f640 1 -- 172.21.15.165:0/2694338234 >> 172.21.15.165:0/2694338234 conn(0x7f27540f79b0 msgr2=0x7f27540f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.652+0000 7f275ba2f640 1 -- 172.21.15.165:0/2694338234 shutdown_connections 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.652+0000 7f275ba2f640 1 -- 172.21.15.165:0/2694338234 wait complete. 2024-09-16T01:58:19.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.652+0000 7f275ba2f640 1 Processor -- start 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.652+0000 7f275ba2f640 1 -- start start 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.652+0000 7f275ba2f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f2754112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.652+0000 7f275ba2f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754113250 con 0x7f27540715d0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f27597cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f2754112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f27597cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f2754112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:34722/0 (socket says 172.21.15.165:34722) 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f27597cb640 1 -- 172.21.15.165:0/1772731263 learned_addr learned my addr 172.21.15.165:0/1772731263 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f27597cb640 1 -- 172.21.15.165:0/1772731263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750005040 con 0x7f27540715d0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f27597cb640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f2754112d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f275002a6d0 tx=0x7f2750009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2750033630 con 0x7f27540715d0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2750033c30 con 0x7f27540715d0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2754113450 con 0x7f27540715d0 2024-09-16T01:58:19.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f275003dc30 con 0x7f27540715d0 2024-09-16T01:58:19.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.653+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27541138c0 con 0x7f27540715d0 2024-09-16T01:58:19.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.654+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f2750030020 con 0x7f27540715d0 2024-09-16T01:58:19.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.654+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275405ed70 con 0x7f27540715d0 2024-09-16T01:58:19.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.654+0000 7f2749ffb640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f2740039580 0x7f274003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:19.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.655+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f275006c9d0 con 0x7f27540715d0 2024-09-16T01:58:19.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.655+0000 7f2758fca640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f2740039580 0x7f274003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:19.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.655+0000 7f2758fca640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f2740039580 0x7f274003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2744006fd0 tx=0x7f2744006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:19.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.660+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f275003bb50 con 0x7f27540715d0 2024-09-16T01:58:19.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.875+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f275404b720 con 0x7f27540715d0 2024-09-16T01:58:19.876 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.875+0000 7f2749ffb640 1 -- 172.21.15.165:0/1772731263 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2750042210 con 0x7f27540715d0 2024-09-16T01:58:19.877 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:19.877 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:19.877 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:19.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f2740039580 msgr2=0x7f274003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:19.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f2740039580 0x7f274003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2744006fd0 tx=0x7f2744006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 msgr2=0x7f2754112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f2754112d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f275002a6d0 tx=0x7f2750009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 shutdown_connections 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7f2740039580 0x7f274003ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 --2- 172.21.15.165:0/1772731263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27540715d0 0x7f2754112d10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 >> 172.21.15.165:0/1772731263 conn(0x7f27540f79b0 msgr2=0x7f27540f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 shutdown_connections 2024-09-16T01:58:19.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:19.877+0000 7f275ba2f640 1 -- 172.21.15.165:0/1772731263 wait complete. 2024-09-16T01:58:20.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:20 smithi110 ceph-mon[27634]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:20.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:20 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1772731263' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:21.381 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:21.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:21.615 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:21.659 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:22.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:22 smithi110 ceph-mon[27634]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:23.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 -- 172.21.15.165:0/2089606664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 msgr2=0x7fce780fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:23.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 --2- 172.21.15.165:0/2089606664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780fb6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce68009bd0 tx=0x7fce68004d10 comp rx=0 tx=0).stop 2024-09-16T01:58:23.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 -- 172.21.15.165:0/2089606664 shutdown_connections 2024-09-16T01:58:23.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 --2- 172.21.15.165:0/2089606664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780fb6f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:23.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 -- 172.21.15.165:0/2089606664 >> 172.21.15.165:0/2089606664 conn(0x7fce780f6ac0 msgr2=0x7fce780f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 -- 172.21.15.165:0/2089606664 shutdown_connections 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 -- 172.21.15.165:0/2089606664 wait complete. 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.165+0000 7fce7f1ac640 1 Processor -- start 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7f1ac640 1 -- start start 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7f1ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7f1ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7810f660 con 0x7fce780fb2e0 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7cf48640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7cf48640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:34738/0 (socket says 172.21.15.165:34738) 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7cf48640 1 -- 172.21.15.165:0/73302273 learned_addr learned my addr 172.21.15.165:0/73302273 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.166+0000 7fce7cf48640 1 -- 172.21.15.165:0/73302273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680098b0 con 0x7fce780fb2e0 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.167+0000 7fce7cf48640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780654d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce68003400 tx=0x7fce68004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.167+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce68032910 con 0x7fce780fb2e0 2024-09-16T01:58:23.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.167+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce6803d420 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.167+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7810f7a0 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.167+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce68031590 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.167+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7810fc10 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.168+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fce6802f030 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.168+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7805ed70 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.168+0000 7fce757fa640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fce64039580 0x7fce6403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.168+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fce6806d800 con 0x7fce780fb2e0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.168+0000 7fce77fff640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fce64039580 0x7fce6403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.169+0000 7fce77fff640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fce64039580 0x7fce6403ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce60006fd0 tx=0x7fce60006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:23.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.173+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fce68032a70 con 0x7fce780fb2e0 2024-09-16T01:58:23.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.387+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fce7804b720 con 0x7fce780fb2e0 2024-09-16T01:58:23.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.387+0000 7fce757fa640 1 -- 172.21.15.165:0/73302273 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fce68041030 con 0x7fce780fb2e0 2024-09-16T01:58:23.389 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:23.389 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:23.389 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:23.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fce64039580 msgr2=0x7fce6403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:23.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fce64039580 0x7fce6403ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce60006fd0 tx=0x7fce60006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:23.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 msgr2=0x7fce780654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:23.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780654d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce68003400 tx=0x7fce68004d10 comp rx=0 tx=0).stop 2024-09-16T01:58:23.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 shutdown_connections 2024-09-16T01:58:23.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7fce64039580 0x7fce6403ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:23.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 --2- 172.21.15.165:0/73302273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce780fb2e0 0x7fce780654d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:23.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 >> 172.21.15.165:0/73302273 conn(0x7fce780f6ac0 msgr2=0x7fce780f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:23.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 shutdown_connections 2024-09-16T01:58:23.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:23.390+0000 7fce7f1ac640 1 -- 172.21.15.165:0/73302273 wait complete. 2024-09-16T01:58:24.365 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:24 smithi110 ceph-mon[27634]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:24.365 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:24 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/73302273' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:24.984 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:24.985 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:25.218 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:25.263 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:26.449 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:26 smithi110 ceph-mon[27634]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:26.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 -- 172.21.15.165:0/1008776408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 msgr2=0x7ff6d80fa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:26.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 --2- 172.21.15.165:0/1008776408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d80fa970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0004850 tx=0x7ff6d0009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:26.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 -- 172.21.15.165:0/1008776408 shutdown_connections 2024-09-16T01:58:26.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 --2- 172.21.15.165:0/1008776408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d80fa970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:26.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 -- 172.21.15.165:0/1008776408 >> 172.21.15.165:0/1008776408 conn(0x7ff6d80f5fa0 msgr2=0x7ff6d80f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 -- 172.21.15.165:0/1008776408 shutdown_connections 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 -- 172.21.15.165:0/1008776408 wait complete. 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.752+0000 7ff6dec46640 1 Processor -- start 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dec46640 1 -- start start 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dec46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d810c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dec46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d810cdf0 con 0x7ff6d80fa560 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dc9e2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d810c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dc9e2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d810c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:54082/0 (socket says 172.21.15.165:54082) 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dc9e2640 1 -- 172.21.15.165:0/2697145758 learned_addr learned my addr 172.21.15.165:0/2697145758 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.753+0000 7ff6dc9e2640 1 -- 172.21.15.165:0/2697145758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0005040 con 0x7ff6d80fa560 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.754+0000 7ff6dc9e2640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d810c8b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6d002a6d0 tx=0x7ff6d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.754+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6d0033630 con 0x7ff6d80fa560 2024-09-16T01:58:26.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.754+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6d0033c30 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.754+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d810cff0 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.754+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6d003dc00 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.754+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d810d460 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.755+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7ff6d0030020 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.755+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d805ed70 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.755+0000 7ff6d57fa640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff6c40395d0 0x7ff6c403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.755+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff6d006cbf0 con 0x7ff6d80fa560 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.755+0000 7ff6d7fff640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff6c40395d0 0x7ff6c403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.755+0000 7ff6d7fff640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff6c40395d0 0x7ff6c403ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800ad90 tx=0x7ff6c8009410 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:26.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.760+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff6d003bb50 con 0x7ff6d80fa560 2024-09-16T01:58:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.976+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff6d804b720 con 0x7ff6d80fa560 2024-09-16T01:58:26.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.976+0000 7ff6d57fa640 1 -- 172.21.15.165:0/2697145758 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff6d003b370 con 0x7ff6d80fa560 2024-09-16T01:58:26.977 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:26.978 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:26.978 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:26.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff6c40395d0 msgr2=0x7ff6c403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:26.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff6c40395d0 0x7ff6c403ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800ad90 tx=0x7ff6c8009410 comp rx=0 tx=0).stop 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 msgr2=0x7ff6d810c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d810c8b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6d002a6d0 tx=0x7ff6d0009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 shutdown_connections 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff6c40395d0 0x7ff6c403ba80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 --2- 172.21.15.165:0/2697145758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6d80fa560 0x7ff6d810c8b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 >> 172.21.15.165:0/2697145758 conn(0x7ff6d80f5fa0 msgr2=0x7ff6d80f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.978+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 shutdown_connections 2024-09-16T01:58:26.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:26.979+0000 7ff6dec46640 1 -- 172.21.15.165:0/2697145758 wait complete. 2024-09-16T01:58:27.373 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:27 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/2697145758' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:28.572 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:28.657 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:28.725 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:28 smithi110 ceph-mon[27634]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:28.725 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:28 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:28.725 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:28 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:28.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:28 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:28.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:28 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-16T01:58:28.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:28 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:28.898 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:28.952 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:29.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:29 smithi110 ceph-mon[27634]: from='mgr.14158 172.21.15.110:0/2197269251' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-16T01:58:29.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:29 smithi110 ceph-mon[27634]: mgrmap e14: smithi110.hfirap(active, since 55s) 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 -- 172.21.15.165:0/4086380606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 msgr2=0x7ff9c00fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 --2- 172.21.15.165:0/4086380606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c00fdc20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0004850 tx=0x7ff9b0009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 -- 172.21.15.165:0/4086380606 shutdown_connections 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 --2- 172.21.15.165:0/4086380606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c00fdc20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 -- 172.21.15.165:0/4086380606 >> 172.21.15.165:0/4086380606 conn(0x7ff9c00f6010 msgr2=0x7ff9c00f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 -- 172.21.15.165:0/4086380606 shutdown_connections 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 -- 172.21.15.165:0/4086380606 wait complete. 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 Processor -- start 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.399+0000 7ff9c7032640 1 -- start start 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.400+0000 7ff9c7032640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c010c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:30.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.400+0000 7ff9c7032640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c010ccc0 con 0x7ff9c00fd810 2024-09-16T01:58:30.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.400+0000 7ff9c4dce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c010c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:30.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.400+0000 7ff9c4dce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c010c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:54096/0 (socket says 172.21.15.165:54096) 2024-09-16T01:58:30.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.400+0000 7ff9c4dce640 1 -- 172.21.15.165:0/2402879319 learned_addr learned my addr 172.21.15.165:0/2402879319 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:30.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.400+0000 7ff9c4dce640 1 -- 172.21.15.165:0/2402879319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0005040 con 0x7ff9c00fd810 2024-09-16T01:58:30.403 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.401+0000 7ff9c4dce640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c010c780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9b002a6d0 tx=0x7ff9b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.401+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0033630 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.401+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c010cec0 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.401+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9b0033c30 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.401+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b003dc30 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.401+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c010d330 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.402+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7ff9b0030020 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.402+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c005ed70 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.402+0000 7ff9bd7fa640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 0x7ff9a803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.402+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff9b006c850 con 0x7ff9c00fd810 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.402+0000 7ff9bffff640 1 -- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 msgr2=0x7ff9a803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2073782143 2024-09-16T01:58:30.404 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.402+0000 7ff9bffff640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 0x7ff9a803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:58:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.407+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff9b003bb50 con 0x7ff9c00fd810 2024-09-16T01:58:30.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.603+0000 7ff9bffff640 1 -- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 msgr2=0x7ff9a803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2073782143 2024-09-16T01:58:30.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.603+0000 7ff9bffff640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 0x7ff9a803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:58:30.624 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.623+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9c004b720 con 0x7ff9c00fd810 2024-09-16T01:58:30.624 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.623+0000 7ff9bd7fa640 1 -- 172.21.15.165:0/2402879319 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff9b0042210 con 0x7ff9c00fd810 2024-09-16T01:58:30.625 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:30.625 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:30.625 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:30.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 msgr2=0x7ff9a803ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:58:30.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 0x7ff9a803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 msgr2=0x7ff9c010c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c010c780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9b002a6d0 tx=0x7ff9b0009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 shutdown_connections 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:6800/2073782143,v1:172.21.15.110:6801/2073782143] conn(0x7ff9a80395d0 0x7ff9a803ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 --2- 172.21.15.165:0/2402879319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c00fd810 0x7ff9c010c780 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 >> 172.21.15.165:0/2402879319 conn(0x7ff9c00f6010 msgr2=0x7ff9c00f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 shutdown_connections 2024-09-16T01:58:30.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:30.625+0000 7ff9c7032640 1 -- 172.21.15.165:0/2402879319 wait complete. 2024-09-16T01:58:30.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:30 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/2402879319' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:32.235 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:32.235 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:32.479 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:32.523 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: Active manager daemon smithi110.hfirap restarted 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: Activating manager daemon smithi110.hfirap 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: mgrmap e15: smithi110.hfirap(active, starting, since 0.00316046s) 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T01:58:33.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: Manager daemon smithi110.hfirap is now available 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:58:33.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:58:33.916 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T01:58:33.917 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:33.917 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:33 smithi110 ceph-mon[27634]: mgrmap e16: smithi110.hfirap(active, since 1.00538s) 2024-09-16T01:58:34.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 -- 172.21.15.165:0/645244941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 msgr2=0x7f03980ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:34.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 --2- 172.21.15.165:0/645244941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f03980ff0b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0388004850 tx=0x7f0388009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:34.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 -- 172.21.15.165:0/645244941 shutdown_connections 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 --2- 172.21.15.165:0/645244941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f03980ff0b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 -- 172.21.15.165:0/645244941 >> 172.21.15.165:0/645244941 conn(0x7f03980f6ac0 msgr2=0x7f03980f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 -- 172.21.15.165:0/645244941 shutdown_connections 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 -- 172.21.15.165:0/645244941 wait complete. 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.002+0000 7f039de7f640 1 Processor -- start 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f039de7f640 1 -- start start 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f039de7f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f039810c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f039de7f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039810cee0 con 0x7f0398065590 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f03977fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f039810c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f03977fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f039810c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:54114/0 (socket says 172.21.15.165:54114) 2024-09-16T01:58:34.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f03977fe640 1 -- 172.21.15.165:0/1537922612 learned_addr learned my addr 172.21.15.165:0/1537922612 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.003+0000 7f03977fe640 1 -- 172.21.15.165:0/1537922612 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0388005040 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.004+0000 7f03977fe640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f039810c9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f038802a6d0 tx=0x7f0388009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.004+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0388033630 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.004+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039810d0e0 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.004+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0388033c30 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.004+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038803dc30 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.004+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039810d550 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.005+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7f0388030020 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.005+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039805ed70 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.005+0000 7f0394ff9640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0384039420 0x7f038403b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.005+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f038806c720 con 0x7f0398065590 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.005+0000 7f038effd640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0384039420 0x7f038403b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.005+0000 7f038effd640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0384039420 0x7f038403b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0380006fd0 tx=0x7f0380006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:34.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.013+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0388045800 con 0x7f0398065590 2024-09-16T01:58:34.247 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.246+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f039804b720 con 0x7f0398065590 2024-09-16T01:58:34.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.247+0000 7f0394ff9640 1 -- 172.21.15.165:0/1537922612 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0388045800 con 0x7f0398065590 2024-09-16T01:58:34.248 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:34.248 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:34.249 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:34.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0384039420 msgr2=0x7f038403b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0384039420 0x7f038403b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0380006fd0 tx=0x7f0380006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 msgr2=0x7f039810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f039810c9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f038802a6d0 tx=0x7f0388009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 shutdown_connections 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0384039420 0x7f038403b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 --2- 172.21.15.165:0/1537922612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0398065590 0x7f039810c9a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 >> 172.21.15.165:0/1537922612 conn(0x7f03980f6ac0 msgr2=0x7f03980f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.249+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 shutdown_connections 2024-09-16T01:58:34.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:34.250+0000 7f039de7f640 1 -- 172.21.15.165:0/1537922612 wait complete. 2024-09-16T01:58:35.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:58:34] ENGINE Bus STARTING 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:58:34] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:58:34] ENGINE Bus STARTED 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: [16/Sep/2024:01:58:34] ENGINE Error in HTTPServer.serve 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Traceback (most recent call last): 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._run(expiration_interval) 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:58:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s = self.context.wrap_socket( 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: return self.sslsocket_class._create( 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self.do_handshake() 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._sslobj.do_handshake() 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1537922612' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:35.851 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:35.852 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:36.427 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:36 smithi110 ceph-mon[27634]: mgrmap e17: smithi110.hfirap(active, since 2s) 2024-09-16T01:58:36.577 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:36.642 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:58:38.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:37 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:38.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:37 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:38.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:37 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:38.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:37 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:38.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:37 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 -- 172.21.15.165:0/1716270877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 msgr2=0x7f7f440fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 --2- 172.21.15.165:0/1716270877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f440fb300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c004850 tx=0x7f7f2c009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 -- 172.21.15.165:0/1716270877 shutdown_connections 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 --2- 172.21.15.165:0/1716270877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f440fb300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 -- 172.21.15.165:0/1716270877 >> 172.21.15.165:0/1716270877 conn(0x7f7f440f66b0 msgr2=0x7f7f440f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 -- 172.21.15.165:0/1716270877 shutdown_connections 2024-09-16T01:58:38.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 -- 172.21.15.165:0/1716270877 wait complete. 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.564+0000 7f7f489a2640 1 Processor -- start 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f489a2640 1 -- start start 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f489a2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f4410c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f489a2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4410ca90 con 0x7f7f440faef0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f437fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f4410c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f437fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f4410c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:60792/0 (socket says 172.21.15.165:60792) 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f437fe640 1 -- 172.21.15.165:0/882750495 learned_addr learned my addr 172.21.15.165:0/882750495 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.565+0000 7f7f437fe640 1 -- 172.21.15.165:0/882750495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c005040 con 0x7f7f440faef0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.566+0000 7f7f437fe640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f4410c550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009920 tx=0x7f7f2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.566+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2c033630 con 0x7f7f440faef0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.566+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4410cc90 con 0x7f7f440faef0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.566+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f2c033c30 con 0x7f7f440faef0 2024-09-16T01:58:38.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.566+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2c03dc40 con 0x7f7f440faef0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.566+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4410d100 con 0x7f7f440faef0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.567+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f7f2c030020 con 0x7f7f440faef0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.567+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4405ed70 con 0x7f7f440faef0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.567+0000 7f7f3bfff640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7f30039670 0x7f7f3003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.567+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7f2c06cd50 con 0x7f7f440faef0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.567+0000 7f7f42ffd640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7f30039670 0x7f7f3003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.568+0000 7f7f42ffd640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7f30039670 0x7f7f3003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f34006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:38.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.571+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7f2c03bb50 con 0x7f7f440faef0 2024-09-16T01:58:38.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.798+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7f4404b720 con 0x7f7f440faef0 2024-09-16T01:58:38.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.798+0000 7f7f3bfff640 1 -- 172.21.15.165:0/882750495 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7f2c03b370 con 0x7f7f440faef0 2024-09-16T01:58:38.800 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:38.800 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:38.801 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:38.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7f30039670 msgr2=0x7f7f3003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:38.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7f30039670 0x7f7f3003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f34006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:38.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 msgr2=0x7f7f4410c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:38.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f4410c550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009920 tx=0x7f7f2c009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:38.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 shutdown_connections 2024-09-16T01:58:38.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7f30039670 0x7f7f3003bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:38.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 --2- 172.21.15.165:0/882750495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f440faef0 0x7f7f4410c550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:38.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 >> 172.21.15.165:0/882750495 conn(0x7f7f440f66b0 msgr2=0x7f7f440648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:38.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 shutdown_connections 2024-09-16T01:58:38.803 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:38.800+0000 7f7f489a2640 1 -- 172.21.15.165:0/882750495 wait complete. 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd/host:smithi165", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:58:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/882750495' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T01:58:39.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:39 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:58:40.504 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:40.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:40.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:58:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:58:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:58:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:58:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:58:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:58:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:40 smithi110 ceph-mon[27634]: Deploying daemon crash.smithi165 on smithi165 2024-09-16T01:58:40.775 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.944+0000 7f971d7d6640 1 -- 172.21.15.165:0/4072147426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 msgr2=0x7f97180fd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.944+0000 7f971d7d6640 1 --2- 172.21.15.165:0/4072147426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f97180fd4d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9710009bd0 tx=0x7f9710004d10 comp rx=0 tx=0).stop 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 -- 172.21.15.165:0/4072147426 shutdown_connections 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 --2- 172.21.15.165:0/4072147426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f97180fd4d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 -- 172.21.15.165:0/4072147426 >> 172.21.15.165:0/4072147426 conn(0x7f97180717c0 msgr2=0x7f9718071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 -- 172.21.15.165:0/4072147426 shutdown_connections 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 -- 172.21.15.165:0/4072147426 wait complete. 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 Processor -- start 2024-09-16T01:58:42.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.945+0000 7f971d7d6640 1 -- start start 2024-09-16T01:58:42.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f971d7d6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f9718114980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:42.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f971d7d6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718114ec0 con 0x7f97180fd100 2024-09-16T01:58:42.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f9716ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f9718114980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:42.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f9716ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f9718114980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:60830/0 (socket says 172.21.15.165:60830) 2024-09-16T01:58:42.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f9716ffd640 1 -- 172.21.15.165:0/3776822598 learned_addr learned my addr 172.21.15.165:0/3776822598 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:42.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f9716ffd640 1 -- 172.21.15.165:0/3776822598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100098b0 con 0x7f97180fd100 2024-09-16T01:58:42.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.946+0000 7f9716ffd640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f9718114980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9710009ba0 tx=0x7f9710004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:42.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.947+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97100327a0 con 0x7f97180fd100 2024-09-16T01:58:42.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.947+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97181150c0 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.947+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9718115590 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.947+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9710032da0 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.947+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f971003dd30 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.948+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f971002f030 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.948+0000 7f96ff7fe640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9700039670 0x7f970003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.948+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f971006d090 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.948+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9704005210 con 0x7f97180fd100 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.948+0000 7f97167fc640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9700039670 0x7f970003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:42.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.949+0000 7f97167fc640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9700039670 0x7f970003bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f970c006fd0 tx=0x7f970c006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:42.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:42.953+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9710041020 con 0x7f97180fd100 2024-09-16T01:58:43.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.195+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f97040054c0 con 0x7f97180fd100 2024-09-16T01:58:43.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.196+0000 7f96ff7fe640 1 -- 172.21.15.165:0/3776822598 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f971003b2e0 con 0x7f97180fd100 2024-09-16T01:58:43.198 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:43.198 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:43.198 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9700039670 msgr2=0x7f970003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9700039670 0x7f970003bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f970c006fd0 tx=0x7f970c006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 msgr2=0x7f9718114980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f9718114980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9710009ba0 tx=0x7f9710004d10 comp rx=0 tx=0).stop 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 shutdown_connections 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9700039670 0x7f970003bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 --2- 172.21.15.165:0/3776822598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97180fd100 0x7f9718114980 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 >> 172.21.15.165:0/3776822598 conn(0x7f97180717c0 msgr2=0x7f9718103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:43.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 shutdown_connections 2024-09-16T01:58:43.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:43.198+0000 7f971d7d6640 1 -- 172.21.15.165:0/3776822598 wait complete. 2024-09-16T01:58:43.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:43.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:43.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:43.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:43.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: Deploying daemon node-exporter.smithi165 on smithi165 2024-09-16T01:58:43.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:43.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:43 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/3776822598' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:44.794 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:44.794 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:45.584 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:58:47.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 -- 172.21.15.165:0/3392405569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 msgr2=0x7fbf8c1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:47.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 --2- 172.21.15.165:0/3392405569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c1014b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c004850 tx=0x7fbf7c009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:47.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 -- 172.21.15.165:0/3392405569 shutdown_connections 2024-09-16T01:58:47.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 --2- 172.21.15.165:0/3392405569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c1014b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 -- 172.21.15.165:0/3392405569 >> 172.21.15.165:0/3392405569 conn(0x7fbf8c0710b0 msgr2=0x7fbf8c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 -- 172.21.15.165:0/3392405569 shutdown_connections 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.780+0000 7fbf912a8640 1 -- 172.21.15.165:0/3392405569 wait complete. 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf912a8640 1 Processor -- start 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf912a8640 1 -- start start 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf912a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c0fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf912a8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0fd2c0 con 0x7fbf8c1010e0 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf8affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c0fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf8affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c0fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:60384/0 (socket says 172.21.15.165:60384) 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.781+0000 7fbf8affd640 1 -- 172.21.15.165:0/1961095305 learned_addr learned my addr 172.21.15.165:0/1961095305 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf8affd640 1 -- 172.21.15.165:0/1961095305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c005040 con 0x7fbf8c1010e0 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf8affd640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c0fcd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c02a6d0 tx=0x7fbf7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:47.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf7c02cf10 con 0x7fbf8c1010e0 2024-09-16T01:58:47.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0fd4c0 con 0x7fbf8c1010e0 2024-09-16T01:58:47.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf7c033ad0 con 0x7fbf8c1010e0 2024-09-16T01:58:47.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf7c03ebb0 con 0x7fbf8c1010e0 2024-09-16T01:58:47.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.782+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c0fd990 con 0x7fbf8c1010e0 2024-09-16T01:58:47.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.783+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c0f94a0 con 0x7fbf8c1010e0 2024-09-16T01:58:47.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.783+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fbf7c030020 con 0x7fbf8c1010e0 2024-09-16T01:58:47.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.783+0000 7fbf837fe640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbf78039670 0x7fbf7803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:47.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.783+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fbf7c06c790 con 0x7fbf8c1010e0 2024-09-16T01:58:47.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.784+0000 7fbf8a7fc640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbf78039670 0x7fbf7803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:47.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.784+0000 7fbf8a7fc640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbf78039670 0x7fbf7803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf74006fd0 tx=0x7fbf74006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:47.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:47.788+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbf7c03cb10 con 0x7fbf8c1010e0 2024-09-16T01:58:48.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.014+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbf8c0fc850 con 0x7fbf8c1010e0 2024-09-16T01:58:48.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.014+0000 7fbf837fe640 1 -- 172.21.15.165:0/1961095305 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fbf7c03c330 con 0x7fbf8c1010e0 2024-09-16T01:58:48.016 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:48.017 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:48.017 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:48.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbf78039670 msgr2=0x7fbf7803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbf78039670 0x7fbf7803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf74006fd0 tx=0x7fbf74006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 msgr2=0x7fbf8c0fcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c0fcd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c02a6d0 tx=0x7fbf7c009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 shutdown_connections 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbf78039670 0x7fbf7803bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 --2- 172.21.15.165:0/1961095305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf8c1010e0 0x7fbf8c0fcd80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 >> 172.21.15.165:0/1961095305 conn(0x7fbf8c0710b0 msgr2=0x7fbf8c064ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 shutdown_connections 2024-09-16T01:58:48.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:48.016+0000 7fbf912a8640 1 -- 172.21.15.165:0/1961095305 wait complete. 2024-09-16T01:58:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: Deploying daemon mgr.smithi165.afwhot on smithi165 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:58:48.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:48 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1961095305' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:49.538 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:49.538 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:49.906 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 -- 172.21.15.165:0/768554954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 msgr2=0x7f281c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 --2- 172.21.15.165:0/768554954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c1025b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2814009bd0 tx=0x7f2814004d10 comp rx=0 tx=0).stop 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 -- 172.21.15.165:0/768554954 shutdown_connections 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 --2- 172.21.15.165:0/768554954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c1025b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 -- 172.21.15.165:0/768554954 >> 172.21.15.165:0/768554954 conn(0x7f281c0f7d90 msgr2=0x7f281c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 -- 172.21.15.165:0/768554954 shutdown_connections 2024-09-16T01:58:51.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 -- 172.21.15.165:0/768554954 wait complete. 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 Processor -- start 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.523+0000 7f2822aee640 1 -- start start 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.524+0000 7f2822aee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.524+0000 7f2822aee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c112cc0 con 0x7f281c1021e0 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.524+0000 7f282088a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.524+0000 7f282088a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:60406/0 (socket says 172.21.15.165:60406) 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.524+0000 7f282088a640 1 -- 172.21.15.165:0/3906036014 learned_addr learned my addr 172.21.15.165:0/3906036014 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.524+0000 7f282088a640 1 -- 172.21.15.165:0/3906036014 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140098b0 con 0x7f281c1021e0 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.525+0000 7f282088a640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c112780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2814009ba0 tx=0x7f2814004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.525+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28140327a0 con 0x7f281c1021e0 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.525+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c112ec0 con 0x7f281c1021e0 2024-09-16T01:58:51.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.525+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2814032da0 con 0x7f281c1021e0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.525+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c113390 con 0x7f281c1021e0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.525+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f281403dd70 con 0x7f281c1021e0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.526+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f281402f030 con 0x7f281c1021e0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.526+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c0fd950 con 0x7f281c1021e0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.526+0000 7f28197fa640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2808039670 0x7f280803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.526+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f281406d820 con 0x7f281c1021e0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.526+0000 7f281bfff640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2808039670 0x7f280803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.527+0000 7f281bfff640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2808039670 0x7f280803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f280c006fd0 tx=0x7f280c006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:51.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.531+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f281404ed80 con 0x7f281c1021e0 2024-09-16T01:58:51.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.746+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f281c113390 con 0x7f281c1021e0 2024-09-16T01:58:51.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.747+0000 7f28197fa640 1 -- 172.21.15.165:0/3906036014 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f281c113390 con 0x7f281c1021e0 2024-09-16T01:58:51.750 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:58:51.750 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:56:33.980045Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:58:51.750 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2808039670 msgr2=0x7f280803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2808039670 0x7f280803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f280c006fd0 tx=0x7f280c006db0 comp rx=0 tx=0).stop 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 msgr2=0x7f281c112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c112780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2814009ba0 tx=0x7f2814004d10 comp rx=0 tx=0).stop 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 shutdown_connections 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2808039670 0x7f280803bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 --2- 172.21.15.165:0/3906036014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f281c1021e0 0x7f281c112780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 >> 172.21.15.165:0/3906036014 conn(0x7f281c0f7d90 msgr2=0x7f281c0f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:51.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 shutdown_connections 2024-09-16T01:58:51.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:51.750+0000 7f2822aee640 1 -- 172.21.15.165:0/3906036014 wait complete. 2024-09-16T01:58:52.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:51 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/3906036014' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: Deploying daemon mon.smithi165 on smithi165 2024-09-16T01:58:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:58:53.363 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T01:58:53.364 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:58:54.166 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:58:54.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:53 smithi110 ceph-mon[27634]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:56.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:58:55 smithi110 ceph-mon[27634]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:58:56.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 -- 172.21.15.165:0/3614628507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 msgr2=0x7fa0581025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:58:56.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 --2- 172.21.15.165:0/3614628507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa0581025b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa054004850 tx=0x7fa054009da0 comp rx=0 tx=0).stop 2024-09-16T01:58:56.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 -- 172.21.15.165:0/3614628507 shutdown_connections 2024-09-16T01:58:56.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 --2- 172.21.15.165:0/3614628507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa0581025b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 -- 172.21.15.165:0/3614628507 >> 172.21.15.165:0/3614628507 conn(0x7fa0580710b0 msgr2=0x7fa0580714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 -- 172.21.15.165:0/3614628507 shutdown_connections 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 -- 172.21.15.165:0/3614628507 wait complete. 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 Processor -- start 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 -- start start 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.314+0000 7fa05f338640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa058112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05f338640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058112cd0 con 0x7fa0581021e0 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05d0d4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa058112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05d0d4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa058112790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:58172/0 (socket says 172.21.15.165:58172) 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05d0d4640 1 -- 172.21.15.165:0/2867810595 learned_addr learned my addr 172.21.15.165:0/2867810595 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05d0d4640 1 -- 172.21.15.165:0/2867810595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054005040 con 0x7fa0581021e0 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05d0d4640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa058112790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa05402a6d0 tx=0x7fa054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:56.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa05402cf10 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa058112ed0 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa054033ad0 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.315+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa05403ebb0 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.316+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0581133a0 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.317+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fa054030020 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.317+0000 7fa04dffb640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa044039670 0x7fa04403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.317+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa05406c6c0 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.317+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0581133a0 con 0x7fa0581021e0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.317+0000 7fa05c8d3640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa044039670 0x7fa04403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.317+0000 7fa05c8d3640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa044039670 0x7fa04403bb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa048006fd0 tx=0x7fa048006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:58:56.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.322+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa0581133a0 con 0x7fa0581021e0 2024-09-16T01:58:56.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.482+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0540323d0 con 0x7fa0581021e0 2024-09-16T01:58:56.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:58:56.551+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa0581133a0 con 0x7fa0581021e0 2024-09-16T01:59:01.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.495+0000 7fa04dffb640 1 -- 172.21.15.165:0/2867810595 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7fa0581133a0 con 0x7fa0581021e0 2024-09-16T01:59:01.497 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T01:59:01.497 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":2,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","modified":"2024-09-16T01:58:56.483407Z","created":"2024-09-16T01:56:33.980045Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi110","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi165","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T01:59:01.498 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 2 2024-09-16T01:59:01.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa044039670 msgr2=0x7fa04403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa044039670 0x7fa04403bb20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa048006fd0 tx=0x7fa048006db0 comp rx=0 tx=0).stop 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 msgr2=0x7fa058112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa058112790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa05402a6d0 tx=0x7fa054009da0 comp rx=0 tx=0).stop 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 shutdown_connections 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa044039670 0x7fa04403bb20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 --2- 172.21.15.165:0/2867810595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0581021e0 0x7fa058112790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 >> 172.21.15.165:0/2867810595 conn(0x7fa0580710b0 msgr2=0x7fa0580f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 shutdown_connections 2024-09-16T01:59:01.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T01:59:01.498+0000 7fa05f338640 1 -- 172.21.15.165:0/2867810595 wait complete. 2024-09-16T01:59:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T01:59:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: mon.smithi110 calling monitor election 2024-09-16T01:59:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/2867810595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: mon.smithi165 calling monitor election 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: mon.smithi110 is new leader, mons smithi110,smithi165 in quorum (ranks 0,1) 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: monmap e2: 2 mons at {smithi110=[v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0],smithi165=[v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: fsmap 2024-09-16T01:59:01.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: mgrmap e17: smithi110.hfirap(active, since 28s) 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: overall HEALTH_OK 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: Standby manager daemon smithi165.afwhot started 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:01.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:02.154 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T01:59:02.155 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T01:59:02.407 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:59:02.780 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:02 smithi110 ceph-mon[27634]: mgrmap e18: smithi110.hfirap(active, since 28s), standbys: smithi165.afwhot 2024-09-16T01:59:02.780 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T01:59:02.780 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:59:02.780 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T01:59:03.869 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:03 smithi110 ceph-mon[27634]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:03.869 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:03 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:03.869 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:03 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:03.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:03 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/1163158170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 msgr2=0x7f4df81025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/1163158170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df81025b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004850 tx=0x7f4de8009da0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/1163158170 shutdown_connections 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/1163158170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df81025b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/1163158170 >> 172.21.15.110:0/1163158170 conn(0x7f4df80f7d90 msgr2=0x7f4df80fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/1163158170 shutdown_connections 2024-09-16T01:59:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/1163158170 wait complete. 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 Processor -- start 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.088+0000 7f4dfe9d2640 1 -- start start 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4dfe9d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4dfe9d2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df806ff50 0x7f4df80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4dfe9d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8118bd0 con 0x7f4df81021e0 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4dfe9d2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8118d10 con 0x7f4df806ff50 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45662/0 (socket says 172.21.15.110:45662) 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 -- 172.21.15.110:0/2144745111 learned_addr learned my addr 172.21.15.110:0/2144745111 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df77fe640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df806ff50 0x7f4df80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 -- 172.21.15.110:0/2144745111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df806ff50 msgr2=0x7f4df80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df806ff50 0x7f4df80703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 -- 172.21.15.110:0/2144745111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8005040 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df77fe640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df806ff50 0x7f4df80703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df7fff640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df806fa10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4de802d040 tx=0x7f4de8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de8038070 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4de8032b50 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df8118eb0 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.089+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de803ec80 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.090+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df81192a0 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.090+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df80fd950 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.091+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f4de803b020 con 0x7f4df81021e0 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.092+0000 7f4df4ff9640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4de006ee10 0x7f4de00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.092+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4de80ad3d0 con 0x7f4df81021e0 2024-09-16T01:59:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.092+0000 7f4df77fe640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4de006ee10 0x7f4de00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.092+0000 7f4df77fe640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4de006ee10 0x7f4de00712c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0079f0 tx=0x7f4dec008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:59:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.096+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4de807b650 con 0x7f4df81021e0 2024-09-16T01:59:04.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.261+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4df805ed70 con 0x7f4df81021e0 2024-09-16T01:59:04.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.261+0000 7f4df4ff9640 1 -- 172.21.15.110:0/2144745111 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f4de80acb80 con 0x7f4df81021e0 2024-09-16T01:59:04.264 INFO:teuthology.orchestra.run.smithi110.stdout:# minimal ceph.conf for c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:59:04.264 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-09-16T01:59:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T01:59:04.264 INFO:teuthology.orchestra.run.smithi110.stdout: mon_host = [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4de006ee10 msgr2=0x7f4de00712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4de006ee10 0x7f4de00712c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0079f0 tx=0x7f4dec008040 comp rx=0 tx=0).stop 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 msgr2=0x7f4df806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df806fa10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4de802d040 tx=0x7f4de8009da0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 shutdown_connections 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4de006ee10 0x7f4de00712c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df806ff50 0x7f4df80703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 --2- 172.21.15.110:0/2144745111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df81021e0 0x7f4df806fa10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:04.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.264+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 >> 172.21.15.110:0/2144745111 conn(0x7f4df80f7d90 msgr2=0x7f4df80f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:59:04.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.265+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 shutdown_connections 2024-09-16T01:59:04.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:04.265+0000 7f4dfe9d2640 1 -- 172.21.15.110:0/2144745111 wait complete. 2024-09-16T01:59:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: Reconfiguring mon.smithi110 (unknown last config time)... 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:59:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: Reconfiguring daemon mon.smithi110 on smithi110 2024-09-16T01:59:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:04 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/2144745111' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: Reconfiguring mon.smithi110 (unknown last config time)... 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: Reconfiguring daemon mon.smithi110 on smithi110 2024-09-16T01:59:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:04 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2144745111' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:05.146 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T01:59:05.146 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:59:05.146 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T01:59:05.173 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:59:05.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:59:05.237 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:59:05.238 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T01:59:05.268 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:59:05.268 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:59:05.336 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T01:59:05.337 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T01:59:05.337 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:59:05.353 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:59:05.353 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-16T01:59:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:59:05.408 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:05.408 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T01:59:05.408 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:05.408 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:05.409 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 01:58:26.844483675 +0000 2024-09-16T01:59:05.409 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 01:53:09.276877738 +0000 2024-09-16T01:59:05.409 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 01:53:09.276877738 +0000 2024-09-16T01:59:05.409 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 01:53:09.276877738 +0000 2024-09-16T01:59:05.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:59:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T01:59:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T01:59:05.471 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000106311 s, 4.8 MB/s 2024-09-16T01:59:05.472 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:59:05.528 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-16T01:59:05.584 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:59:05.584 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:05.584 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-16T01:59:05.584 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:05.584 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:05.584 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 01:58:26.845483658 +0000 2024-09-16T01:59:05.585 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 01:53:09.591872642 +0000 2024-09-16T01:59:05.585 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 01:53:09.591872642 +0000 2024-09-16T01:59:05.585 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 01:53:09.591872642 +0000 2024-09-16T01:59:05.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:59:05.645 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:05 smithi110 ceph-mon[27634]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:05.647 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T01:59:05.648 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T01:59:05.648 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.1971e-05 s, 5.6 MB/s 2024-09-16T01:59:05.649 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:59:05.706 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-16T01:59:05.762 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:59:05.762 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 01:58:26.845483658 +0000 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 01:53:09.900867642 +0000 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 01:53:09.900867642 +0000 2024-09-16T01:59:05.763 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 01:53:09.900867642 +0000 2024-09-16T01:59:05.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:59:05.826 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T01:59:05.826 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T01:59:05.826 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000107827 s, 4.7 MB/s 2024-09-16T01:59:05.827 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:59:05.884 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-16T01:59:05.939 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:59:05.939 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:05.939 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T01:59:05.939 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:05.939 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:05.940 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 01:58:26.846483642 +0000 2024-09-16T01:59:05.940 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 01:53:10.211862611 +0000 2024-09-16T01:59:05.940 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 01:53:10.211862611 +0000 2024-09-16T01:59:05.940 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 01:53:10.211862611 +0000 2024-09-16T01:59:05.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:59:05.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:05 smithi165 ceph-mon[34621]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:06.003 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T01:59:06.003 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T01:59:06.003 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.00010429 s, 4.9 MB/s 2024-09-16T01:59:06.005 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:59:06.061 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T01:59:06.062 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:59:06.082 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:59:06.083 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-16T01:59:06.142 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-16 01:58:55.100723438 +0000 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-16 01:53:09.312873229 +0000 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-16 01:53:09.312873229 +0000 2024-09-16T01:59:06.143 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-16 01:53:09.312873229 +0000 2024-09-16T01:59:06.143 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:59:06.211 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-16T01:59:06.211 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-16T01:59:06.211 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000237762 s, 2.2 MB/s 2024-09-16T01:59:06.212 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:59:06.272 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-16T01:59:06.330 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:59:06.330 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:06.330 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T01:59:06.330 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:06.330 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:06.330 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-16 01:58:55.100723438 +0000 2024-09-16T01:59:06.331 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-16 01:53:09.650868350 +0000 2024-09-16T01:59:06.331 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-16 01:53:09.650868350 +0000 2024-09-16T01:59:06.331 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-16 01:53:09.650868350 +0000 2024-09-16T01:59:06.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:59:06.396 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-16T01:59:06.396 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-16T01:59:06.396 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000228038 s, 2.2 MB/s 2024-09-16T01:59:06.397 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:59:06.456 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-16T01:59:06.512 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:59:06.512 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:06.512 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T01:59:06.512 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:06.513 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:06.513 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-16 01:58:55.100723438 +0000 2024-09-16T01:59:06.513 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-16 01:53:10.003863255 +0000 2024-09-16T01:59:06.513 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-16 01:53:10.003863255 +0000 2024-09-16T01:59:06.513 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-16 01:53:10.003863255 +0000 2024-09-16T01:59:06.513 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:59:06.578 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-16T01:59:06.578 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-16T01:59:06.578 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000216777 s, 2.4 MB/s 2024-09-16T01:59:06.579 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:59:06.636 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-16 01:58:55.101723423 +0000 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-16 01:53:10.329858549 +0000 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-16 01:53:10.329858549 +0000 2024-09-16T01:59:06.693 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-16 01:53:10.329858549 +0000 2024-09-16T01:59:06.694 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:59:06.757 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-16T01:59:06.757 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-16T01:59:06.757 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000205407 s, 2.5 MB/s 2024-09-16T01:59:06.758 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:59:06.815 INFO:tasks.cephadm:Deploying osd.0 on smithi110 with /dev/vg_nvme/lv_4... 2024-09-16T01:59:06.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T01:59:07.055 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:59:07.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:07.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:07.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: Reconfiguring mgr.smithi110.hfirap (unknown last config time)... 2024-09-16T01:59:07.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:59:07.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:59:07.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:07.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:07 smithi165 ceph-mon[34621]: Reconfiguring daemon mgr.smithi110.hfirap on smithi110 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: Reconfiguring mgr.smithi110.hfirap (unknown last config time)... 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:07 smithi110 ceph-mon[27634]: Reconfiguring daemon mgr.smithi110.hfirap on smithi110 2024-09-16T01:59:08.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:08 smithi110 ceph-mon[27634]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:08.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:08.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:08.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T01:59:08.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:08 smithi165 ceph-mon[34621]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T01:59:08.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:09.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:09 smithi110 ceph-mon[27634]: Reconfiguring crash.smithi110 (monmap changed)... 2024-09-16T01:59:09.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:09 smithi110 ceph-mon[27634]: Reconfiguring daemon crash.smithi110 on smithi110 2024-09-16T01:59:09.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:09.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:09 smithi165 ceph-mon[34621]: Reconfiguring crash.smithi110 (monmap changed)... 2024-09-16T01:59:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:09 smithi165 ceph-mon[34621]: Reconfiguring daemon crash.smithi110 on smithi110 2024-09-16T01:59:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:10.753 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:10 smithi110 ceph-mon[27634]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:10.753 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:10 smithi110 ceph-mon[27634]: Reconfiguring alertmanager.smithi110 (dependencies changed)... 2024-09-16T01:59:10.753 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:10 smithi110 ceph-mon[27634]: Reconfiguring daemon alertmanager.smithi110 on smithi110 2024-09-16T01:59:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:10 smithi165 ceph-mon[34621]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:10 smithi165 ceph-mon[34621]: Reconfiguring alertmanager.smithi110 (dependencies changed)... 2024-09-16T01:59:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:10 smithi165 ceph-mon[34621]: Reconfiguring daemon alertmanager.smithi110 on smithi110 2024-09-16T01:59:12.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:12 smithi110 ceph-mon[27634]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:12.752 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:12 smithi165 ceph-mon[34621]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:14.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:14 smithi110 ceph-mon[27634]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:14 smithi165 ceph-mon[34621]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:59:15.440 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_4 2024-09-16T01:59:15.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:15 smithi110 ceph-mon[27634]: Reconfiguring grafana.smithi110 (dependencies changed)... 2024-09-16T01:59:15.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:15 smithi110 ceph-mon[27634]: Reconfiguring daemon grafana.smithi110 on smithi110 2024-09-16T01:59:15.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:15 smithi165 ceph-mon[34621]: Reconfiguring grafana.smithi110 (dependencies changed)... 2024-09-16T01:59:15.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:15 smithi165 ceph-mon[34621]: Reconfiguring daemon grafana.smithi110 on smithi110 2024-09-16T01:59:16.688 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:16 smithi110 ceph-mon[27634]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:16 smithi165 ceph-mon[34621]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:17.607 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:59:18.754 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:18 smithi110 ceph-mon[27634]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:18.754 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:18 smithi165 ceph-mon[34621]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:19.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.598+0000 7f54148dd640 1 -- 172.21.15.110:0/2712817982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 msgr2=0x7f54100fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:19.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.598+0000 7f54148dd640 1 --2- 172.21.15.110:0/2712817982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f54100fc960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f54000048d0 tx=0x7f5400009da0 comp rx=0 tx=0).stop 2024-09-16T01:59:19.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- 172.21.15.110:0/2712817982 shutdown_connections 2024-09-16T01:59:19.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 --2- 172.21.15.110:0/2712817982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54100fd820 0x7f54100fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:19.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 --2- 172.21.15.110:0/2712817982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f54100fc960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:19.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- 172.21.15.110:0/2712817982 >> 172.21.15.110:0/2712817982 conn(0x7f54100f7d30 msgr2=0x7f54100fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- 172.21.15.110:0/2712817982 shutdown_connections 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- 172.21.15.110:0/2712817982 wait complete. 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 Processor -- start 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- start start 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f5410071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54100fd820 0x7f541006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410070080 con 0x7f54100fc550 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f54148dd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54100701c0 con 0x7f54100fd820 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f540e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f5410071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f540e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f5410071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56356/0 (socket says 172.21.15.110:56356) 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.599+0000 7f540e59c640 1 -- 172.21.15.110:0/1591557810 learned_addr learned my addr 172.21.15.110:0/1591557810 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:59:19.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f540dd9b640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54100fd820 0x7f541006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f540e59c640 1 -- 172.21.15.110:0/1591557810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54100fd820 msgr2=0x7f541006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f540e59c640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54100fd820 0x7f541006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f540e59c640 1 -- 172.21.15.110:0/1591557810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400005040 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f540e59c640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f5410071570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5400003080 tx=0x7f5400009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5400038070 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f540002abd0 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410070440 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540003e670 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.600+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5410115180 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.601+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54100fb9b0 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.602+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f5400030020 con 0x7f54100fc550 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.602+0000 7f53feffd640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53f806ecc0 0x7f53f8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:19.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.602+0000 7f540dd9b640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53f806ecc0 0x7f53f8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:19.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.602+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f54000ad470 con 0x7f54100fc550 2024-09-16T01:59:19.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.603+0000 7f540dd9b640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53f806ecc0 0x7f53f8071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f540400a900 tx=0x7f5404008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:59:19.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.606+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f540007b670 con 0x7f54100fc550 2024-09-16T01:59:19.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:19.773+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5410101c80 con 0x7f53f806ecc0 2024-09-16T01:59:20.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:20 smithi110 ceph-mon[27634]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:20.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:20 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:59:20.750 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:20 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:59:20.751 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:20 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:20 smithi165 ceph-mon[34621]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:20 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:59:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:20 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:59:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:20 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:21.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:21 smithi110 ceph-mon[27634]: from='client.14234 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:59:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:21 smithi165 ceph-mon[34621]: from='client.14234 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:59:22.620 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:22 smithi110 ceph-mon[27634]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:22.620 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:22 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:22.620 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:22 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:22 smithi165 ceph-mon[34621]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:22 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:22 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:23.851 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: Reconfiguring prometheus.smithi110 (dependencies changed)... 2024-09-16T01:59:23.852 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: Reconfiguring daemon prometheus.smithi110 on smithi110 2024-09-16T01:59:23.852 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/4238087896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13903880-eaf7-4a3b-b289-e2c35e89eeb1"}]: dispatch 2024-09-16T01:59:23.852 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/4238087896' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13903880-eaf7-4a3b-b289-e2c35e89eeb1"}]': finished 2024-09-16T01:59:23.852 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T01:59:23.852 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:23.852 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:23 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2964645552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:59:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: Reconfiguring prometheus.smithi110 (dependencies changed)... 2024-09-16T01:59:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: Reconfiguring daemon prometheus.smithi110 on smithi110 2024-09-16T01:59:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/4238087896' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13903880-eaf7-4a3b-b289-e2c35e89eeb1"}]: dispatch 2024-09-16T01:59:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/4238087896' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13903880-eaf7-4a3b-b289-e2c35e89eeb1"}]': finished 2024-09-16T01:59:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T01:59:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:23 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/2964645552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:59:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:24 smithi165 ceph-mon[34621]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:24 smithi110 ceph-mon[27634]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:26 smithi110 ceph-mon[27634]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:26 smithi165 ceph-mon[34621]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:28.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:28 smithi110 ceph-mon[27634]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:28 smithi165 ceph-mon[34621]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:30.589 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:30 smithi110 ceph-mon[27634]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:30 smithi165 ceph-mon[34621]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:32.784 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:32 smithi165 ceph-mon[34621]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:32.784 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:32.784 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:32.785 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T01:59:32.785 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:32.841 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:32 smithi110 ceph-mon[27634]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:32.841 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:32.841 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:32.841 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T01:59:32.841 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:33.553 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:33 smithi110 ceph-mon[27634]: Reconfiguring crash.smithi165 (monmap changed)... 2024-09-16T01:59:33.553 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:33 smithi110 ceph-mon[27634]: Reconfiguring daemon crash.smithi165 on smithi165 2024-09-16T01:59:33.553 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:33.916 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:33 smithi165 ceph-mon[34621]: Reconfiguring crash.smithi165 (monmap changed)... 2024-09-16T01:59:33.916 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:33 smithi165 ceph-mon[34621]: Reconfiguring daemon crash.smithi165 on smithi165 2024-09-16T01:59:33.916 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:33 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:34.642 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T01:59:34.643 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:34 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:34.821 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T01:59:34.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:34 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: Reconfiguring mgr.smithi165.afwhot (monmap changed)... 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: Reconfiguring daemon mgr.smithi165.afwhot on smithi165 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: Deploying daemon osd.0 on smithi110 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:59:35.716 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:35.919 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: Reconfiguring mgr.smithi165.afwhot (monmap changed)... 2024-09-16T01:59:35.919 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: Reconfiguring daemon mgr.smithi165.afwhot on smithi165 2024-09-16T01:59:35.919 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: Deploying daemon osd.0 on smithi110 2024-09-16T01:59:35.919 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:35.920 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:35.920 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:59:35.920 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:59:35.920 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:36.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:36.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: Reconfiguring mon.smithi165 (monmap changed)... 2024-09-16T01:59:36.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: Reconfiguring daemon mon.smithi165 on smithi165 2024-09-16T01:59:36.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi110.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:36 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:59:36.813 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:36.813 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: Reconfiguring mon.smithi165 (monmap changed)... 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: Reconfiguring daemon mon.smithi165 on smithi165 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi110.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T01:59:36.814 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:36.815 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:36 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:59:37.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:37 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T01:59:37.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:37 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi110.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T01:59:37.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:37 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T01:59:37.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:37 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T01:59:37.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:37 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T01:59:37.692 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:37 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T01:59:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:37 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T01:59:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:37 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi110.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T01:59:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:37 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T01:59:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:37 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T01:59:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:37 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T01:59:37.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:37 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T01:59:38.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:38 smithi110 ceph-mon[27634]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:38.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:38 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:38.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:38 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:38 smithi165 ceph-mon[34621]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:38 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:38 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:40.607 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:40 smithi110 ceph-mon[27634]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:40.608 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:40.608 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:40 smithi165 ceph-mon[34621]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:42.841 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:42 smithi110 ceph-mon[27634]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:42 smithi165 ceph-mon[34621]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:43.832 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 0 on host 'smithi110' 2024-09-16T01:59:43.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.830+0000 7f53feffd640 1 -- 172.21.15.110:0/1591557810 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5410101c80 con 0x7f53f806ecc0 2024-09-16T01:59:43.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53f806ecc0 msgr2=0x7f53f8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:43.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53f806ecc0 0x7f53f8071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f540400a900 tx=0x7f5404008040 comp rx=0 tx=0).stop 2024-09-16T01:59:43.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 msgr2=0x7f5410071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:43.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f5410071570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5400003080 tx=0x7f5400009da0 comp rx=0 tx=0).stop 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 shutdown_connections 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53f806ecc0 0x7f53f8071170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54100fd820 0x7f541006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 --2- 172.21.15.110:0/1591557810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54100fc550 0x7f5410071570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 >> 172.21.15.110:0/1591557810 conn(0x7f54100f7d30 msgr2=0x7f54100f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 shutdown_connections 2024-09-16T01:59:43.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:43.833+0000 7f54148dd640 1 -- 172.21.15.110:0/1591557810 wait complete. 2024-09-16T01:59:44.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:44 smithi110 ceph-mon[27634]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:44.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:44 smithi110 ceph-mon[27634]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T01:59:44.500 DEBUG:teuthology.orchestra.run.smithi110:osd.0> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T01:59:44.502 INFO:tasks.cephadm:Deploying osd.1 on smithi110 with /dev/vg_nvme/lv_3... 2024-09-16T01:59:44.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T01:59:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:44 smithi165 ceph-mon[34621]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:44.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:44 smithi165 ceph-mon[34621]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T01:59:45.253 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:59:45.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-mon[27634]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-mon[27634]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T01:59:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-mon[27634]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T01:59:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-mon[27634]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T01:59:45.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[46313]: 2024-09-16T01:59:45.835+0000 7ff31b9a0640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T01:59:45.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 01:59:45 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[46313]: 2024-09-16T01:59:45.838+0000 7ff315fd6640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:59:46.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:45 smithi165 ceph-mon[34621]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:46.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:45 smithi165 ceph-mon[34621]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T01:59:46.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:45 smithi165 ceph-mon[34621]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T01:59:46.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:46.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:45 smithi165 ceph-mon[34621]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T01:59:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:46 smithi110 ceph-mon[27634]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-16T01:59:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:46 smithi110 ceph-mon[27634]: osdmap e8: 1 total, 0 up, 1 in 2024-09-16T01:59:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:47.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:46 smithi165 ceph-mon[34621]: from='osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-16T01:59:47.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:46 smithi165 ceph-mon[34621]: osdmap e8: 1 total, 0 up, 1 in 2024-09-16T01:59:47.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:46 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:47.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:46 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:47.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:46 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:47.836 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T01:59:47.859 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_3 2024-09-16T01:59:48.162 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: purged_snaps scrub starts 2024-09-16T01:59:48.162 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: purged_snaps scrub ok 2024-09-16T01:59:48.162 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:48.162 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] boot 2024-09-16T01:59:48.163 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T01:59:48.163 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:48.163 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: purged_snaps scrub starts 2024-09-16T01:59:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: purged_snaps scrub ok 2024-09-16T01:59:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:59:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: osd.0 [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] boot 2024-09-16T01:59:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T01:59:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:59:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:59:48.405 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T01:59:49.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:48 smithi165 ceph-mon[34621]: osdmap e10: 1 total, 1 up, 1 in 2024-09-16T01:59:49.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:48 smithi110 ceph-mon[27634]: osdmap e10: 1 total, 1 up, 1 in 2024-09-16T01:59:50.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:49 smithi165 ceph-mon[34621]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:50.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:49 smithi110 ceph-mon[27634]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:50.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 -- 172.21.15.110:0/2126474534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad240ff6a0 msgr2=0x7fad24101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:50.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/2126474534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad240ff6a0 0x7fad24101a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad140048d0 tx=0x7fad14009da0 comp rx=0 tx=0).stop 2024-09-16T01:59:50.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 -- 172.21.15.110:0/2126474534 shutdown_connections 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/2126474534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad240ff6a0 0x7fad24101a80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/2126474534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad24066750 0x7fad240ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 -- 172.21.15.110:0/2126474534 >> 172.21.15.110:0/2126474534 conn(0x7fad240f6c30 msgr2=0x7fad240f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 -- 172.21.15.110:0/2126474534 shutdown_connections 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.717+0000 7fad2c3eb640 1 -- 172.21.15.110:0/2126474534 wait complete. 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 Processor -- start 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 -- start start 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 0x7fad2410d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad240ff6a0 0x7fad2410d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2410e4c0 con 0x7fad24066750 2024-09-16T01:59:50.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2410e630 con 0x7fad240ff6a0 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 0x7fad2410d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 0x7fad2410d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45906/0 (socket says 172.21.15.110:45906) 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 -- 172.21.15.110:0/147152692 learned_addr learned my addr 172.21.15.110:0/147152692 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad29986640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad240ff6a0 0x7fad2410d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 -- 172.21.15.110:0/147152692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad240ff6a0 msgr2=0x7fad2410d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad240ff6a0 0x7fad2410d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 -- 172.21.15.110:0/147152692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14005040 con 0x7fad24066750 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2a187640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 0x7fad2410d1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b580 tx=0x7fad200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:59:50.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad2000f6f0 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fad2000fcf0 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.718+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2410e910 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.719+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad200103a0 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.719+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2410ee30 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.720+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad24105800 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.720+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fad200116b0 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.720+0000 7fad1affd640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fad1006ecc0 0x7fad10071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.721+0000 7fad29986640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fad1006ecc0 0x7fad10071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.721+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fad2008d110 con 0x7fad24066750 2024-09-16T01:59:50.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.721+0000 7fad29986640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fad1006ecc0 0x7fad10071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad2410cf60 tx=0x7fad14035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:59:50.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.725+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fad2005b130 con 0x7fad24066750 2024-09-16T01:59:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T01:59:50.914+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fad2410f0b0 con 0x7fad1006ecc0 2024-09-16T01:59:51.595 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi110 2024-09-16T01:59:51.595 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.595 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.595 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi110 to 12864M 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:59:51.596 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:51.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: Detected new or changed devices on smithi110 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi110 to 12864M 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:59:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:59:51.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:52.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:52 smithi110 ceph-mon[27634]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:52.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:52 smithi110 ceph-mon[27634]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:59:52.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:52.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:52 smithi165 ceph-mon[34621]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:52 smithi165 ceph-mon[34621]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:59:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:52 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:52 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:54.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:54 smithi165 ceph-mon[34621]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:54.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:54 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3326914739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "175d7810-d02d-47ed-ac31-e85cab907936"}]: dispatch 2024-09-16T01:59:54.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:54 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3326914739' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "175d7810-d02d-47ed-ac31-e85cab907936"}]': finished 2024-09-16T01:59:54.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:54 smithi165 ceph-mon[34621]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T01:59:54.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:59:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:54 smithi110 ceph-mon[27634]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:54 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3326914739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "175d7810-d02d-47ed-ac31-e85cab907936"}]: dispatch 2024-09-16T01:59:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:54 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3326914739' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "175d7810-d02d-47ed-ac31-e85cab907936"}]': finished 2024-09-16T01:59:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:54 smithi110 ceph-mon[27634]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T01:59:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:59:55.594 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:55 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/698750200' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:59:55.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:55 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/698750200' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:59:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:56 smithi165 ceph-mon[34621]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:56 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:56 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:56 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:56 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:59:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:56 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:56.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:56 smithi110 ceph-mon[27634]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:56.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:56 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:56.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:56 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:56 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:59:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:56 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:59:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:56 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T01:59:58.499 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 01:59:58 smithi110 ceph-mon[27634]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:59:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 01:59:58 smithi165 ceph-mon[34621]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:00.613 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:00 smithi110 ceph-mon[27634]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:00.613 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:00 smithi110 ceph-mon[27634]: overall HEALTH_OK 2024-09-16T02:00:00.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:00 smithi165 ceph-mon[34621]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:00.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:00 smithi165 ceph-mon[34621]: overall HEALTH_OK 2024-09-16T02:00:02.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:02 smithi110 ceph-mon[27634]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:02.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T02:00:02.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:02.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:02 smithi110 ceph-mon[27634]: Deploying daemon osd.1 on smithi110 2024-09-16T02:00:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:02 smithi165 ceph-mon[34621]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T02:00:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:02 smithi165 ceph-mon[34621]: Deploying daemon osd.1 on smithi110 2024-09-16T02:00:03.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:03 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:03 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:04.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:04 smithi110 ceph-mon[27634]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:04.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:04 smithi165 ceph-mon[34621]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:06.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:06 smithi110 ceph-mon[27634]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:06.663 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:06 smithi165 ceph-mon[34621]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:07.599 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:07.599 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:07.599 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:07.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:08.635 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:08 smithi110 ceph-mon[27634]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:08.635 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:08.635 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:08 smithi165 ceph-mon[34621]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:09.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.713+0000 7fad1affd640 1 -- 172.21.15.110:0/147152692 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad2410f0b0 con 0x7fad1006ecc0 2024-09-16T02:00:09.716 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 1 on host 'smithi110' 2024-09-16T02:00:09.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fad1006ecc0 msgr2=0x7fad10071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:09.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fad1006ecc0 0x7fad10071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad2410cf60 tx=0x7fad14035040 comp rx=0 tx=0).stop 2024-09-16T02:00:09.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 msgr2=0x7fad2410d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:09.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 0x7fad2410d1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b580 tx=0x7fad200091a0 comp rx=0 tx=0).stop 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 shutdown_connections 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fad1006ecc0 0x7fad10071170 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad240ff6a0 0x7fad2410d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 --2- 172.21.15.110:0/147152692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad24066750 0x7fad2410d1b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 >> 172.21.15.110:0/147152692 conn(0x7fad240f6c30 msgr2=0x7fad240f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 shutdown_connections 2024-09-16T02:00:09.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:09.715+0000 7fad2c3eb640 1 -- 172.21.15.110:0/147152692 wait complete. 2024-09-16T02:00:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:10 smithi165 ceph-mon[34621]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:10 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:10 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:10.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:10 smithi165 ceph-mon[34621]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T02:00:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:10 smithi110 ceph-mon[27634]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:10 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:10 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:10 smithi110 ceph-mon[27634]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T02:00:10.840 DEBUG:teuthology.orchestra.run.smithi110:osd.1> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T02:00:10.842 INFO:tasks.cephadm:Deploying osd.2 on smithi110 with /dev/vg_nvme/lv_2... 2024-09-16T02:00:10.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T02:00:11.547 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:00:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-mon[27634]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T02:00:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-mon[27634]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T02:00:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-mon[27634]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:00:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-mon[27634]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:11.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[53713]: 2024-09-16T02:00:11.719+0000 7ff0013e1640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T02:00:11.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:11 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[53713]: 2024-09-16T02:00:11.724+0000 7feffb1f4640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:00:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:11 smithi165 ceph-mon[34621]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T02:00:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:11 smithi165 ceph-mon[34621]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T02:00:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:11 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:11 smithi165 ceph-mon[34621]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:00:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:11 smithi165 ceph-mon[34621]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:12 smithi110 ceph-mon[27634]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-16T02:00:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:12 smithi110 ceph-mon[27634]: osdmap e13: 2 total, 1 up, 2 in 2024-09-16T02:00:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:12 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:12 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:13.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:12 smithi165 ceph-mon[34621]: from='osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-16T02:00:13.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:12 smithi165 ceph-mon[34621]: osdmap e13: 2 total, 1 up, 2 in 2024-09-16T02:00:13.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:12 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:13.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:12 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:13.850 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:13 smithi110 ceph-mon[27634]: purged_snaps scrub starts 2024-09-16T02:00:13.850 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:13 smithi110 ceph-mon[27634]: purged_snaps scrub ok 2024-09-16T02:00:13.850 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:13 smithi110 ceph-mon[27634]: osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] boot 2024-09-16T02:00:13.850 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:13 smithi110 ceph-mon[27634]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T02:00:13.850 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:13 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:13.850 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:13 smithi110 ceph-mon[27634]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:14.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:13 smithi165 ceph-mon[34621]: purged_snaps scrub starts 2024-09-16T02:00:14.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:13 smithi165 ceph-mon[34621]: purged_snaps scrub ok 2024-09-16T02:00:14.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:13 smithi165 ceph-mon[34621]: osd.1 [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] boot 2024-09-16T02:00:14.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:13 smithi165 ceph-mon[34621]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T02:00:14.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:13 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:00:14.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:13 smithi165 ceph-mon[34621]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-16T02:00:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:14 smithi110 ceph-mon[27634]: osdmap e15: 2 total, 2 up, 2 in 2024-09-16T02:00:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:15.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:14 smithi165 ceph-mon[34621]: osdmap e15: 2 total, 2 up, 2 in 2024-09-16T02:00:15.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:15.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:00:15.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_2 2024-09-16T02:00:16.132 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:15 smithi110 ceph-mon[27634]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:16.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:15 smithi165 ceph-mon[34621]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:16.671 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:00:18.019 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:17 smithi110 ceph-mon[27634]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:18.019 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:17 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:17 smithi165 ceph-mon[34621]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:17 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 -- 172.21.15.110:0/1735305328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa00ff680 msgr2=0x7f9fa0101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1735305328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa00ff680 0x7f9fa0101a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f940048d0 tx=0x7f9f94009da0 comp rx=0 tx=0).stop 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 -- 172.21.15.110:0/1735305328 shutdown_connections 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1735305328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa00ff680 0x7f9fa0101a60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1735305328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa0065c40 0x7f9fa00ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 -- 172.21.15.110:0/1735305328 >> 172.21.15.110:0/1735305328 conn(0x7f9fa00f6c10 msgr2=0x7f9fa00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 -- 172.21.15.110:0/1735305328 shutdown_connections 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 -- 172.21.15.110:0/1735305328 wait complete. 2024-09-16T02:00:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 Processor -- start 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.937+0000 7f9fa7619640 1 -- start start 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa7619640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 0x7f9fa010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa7619640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa00ff680 0x7f9fa010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa7619640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa010dc00 con 0x7f9fa0065c40 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa7619640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa010e420 con 0x7f9fa00ff680 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 0x7f9fa010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 0x7f9fa010d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40164/0 (socket says 172.21.15.110:40164) 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 -- 172.21.15.110:0/1862432994 learned_addr learned my addr 172.21.15.110:0/1862432994 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa4bb4640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa00ff680 0x7f9fa010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 -- 172.21.15.110:0/1862432994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa00ff680 msgr2=0x7f9fa010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa00ff680 0x7f9fa010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 -- 172.21.15.110:0/1862432994 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94005040 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa4bb4640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa00ff680 0x7f9fa010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa53b5640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 0x7f9fa010d070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c002840 tx=0x7f9f9c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c007c30 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa010e6b0 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f9c00f040 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.938+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c009510 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.939+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa010ec50 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.939+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa00fa890 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.940+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f9f9c009780 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.940+0000 7f9f91ffb640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9f8c06ecc0 0x7f9f8c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.940+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f9f9c08d400 con 0x7f9fa0065c40 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.940+0000 7f9fa4bb4640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9f8c06ecc0 0x7f9f8c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:00:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.941+0000 7f9fa4bb4640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9f8c06ecc0 0x7f9f8c071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f94007ac0 tx=0x7f9f94035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:00:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:18.945+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9f9c05b2b0 con 0x7f9fa0065c40 2024-09-16T02:00:19.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:19.116+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fa010f000 con 0x7f9f8c06ecc0 2024-09-16T02:00:19.330 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: Detected new or changed devices on smithi110 2024-09-16T02:00:19.330 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.330 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.330 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:19.330 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:19.330 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi110 to 6432M 2024-09-16T02:00:19.331 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.331 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:19.331 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:19.331 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.331 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:19.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi110 2024-09-16T02:00:19.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi110 to 6432M 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:19.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:20.132 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:20 smithi110 ceph-mon[27634]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:20.132 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:20 smithi110 ceph-mon[27634]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:00:20.132 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:20 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:00:20.132 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:20 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:00:20.132 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:20 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:20.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:20 smithi165 ceph-mon[34621]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:20.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:20 smithi165 ceph-mon[34621]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:00:20.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:20 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:00:20.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:20 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:00:20.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:20 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:22.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:22 smithi110 ceph-mon[27634]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:22.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:22 smithi165 ceph-mon[34621]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:23.159 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:23 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1193785140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0afb738b-850a-45bb-88db-28fcfce812a6"}]: dispatch 2024-09-16T02:00:23.159 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:23 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1193785140' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0afb738b-850a-45bb-88db-28fcfce812a6"}]': finished 2024-09-16T02:00:23.159 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:23 smithi110 ceph-mon[27634]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T02:00:23.159 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:23 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:23.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:23 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1193785140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0afb738b-850a-45bb-88db-28fcfce812a6"}]: dispatch 2024-09-16T02:00:23.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:23 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1193785140' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0afb738b-850a-45bb-88db-28fcfce812a6"}]': finished 2024-09-16T02:00:23.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:23 smithi165 ceph-mon[34621]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T02:00:23.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:23 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:24.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:24 smithi165 ceph-mon[34621]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:24.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:24 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3590294543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:00:24.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:24 smithi110 ceph-mon[27634]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:24.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:24 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3590294543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:00:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:25.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:25.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:26.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:26 smithi110 ceph-mon[27634]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:26 smithi165 ceph-mon[34621]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:28.534 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:28 smithi110 ceph-mon[27634]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:28 smithi165 ceph-mon[34621]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:30.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:30 smithi110 ceph-mon[27634]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:30.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T02:00:30.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:30 smithi165 ceph-mon[34621]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T02:00:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:31.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:31 smithi165 ceph-mon[34621]: Deploying daemon osd.2 on smithi110 2024-09-16T02:00:31.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:31 smithi110 ceph-mon[27634]: Deploying daemon osd.2 on smithi110 2024-09-16T02:00:32.427 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:32 smithi110 ceph-mon[27634]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:32.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:32 smithi165 ceph-mon[34621]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:33.343 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:33 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:34.539 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:34 smithi110 ceph-mon[27634]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:34.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:34 smithi165 ceph-mon[34621]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:35.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:35.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:35.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:35.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:35.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:35.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:36.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:36 smithi165 ceph-mon[34621]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:36.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:36 smithi110 ceph-mon[27634]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:38.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.177+0000 7f9f91ffb640 1 -- 172.21.15.110:0/1862432994 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9fa010f000 con 0x7f9f8c06ecc0 2024-09-16T02:00:38.179 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 2 on host 'smithi110' 2024-09-16T02:00:38.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9f8c06ecc0 msgr2=0x7f9f8c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:38.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9f8c06ecc0 0x7f9f8c071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f94007ac0 tx=0x7f9f94035040 comp rx=0 tx=0).stop 2024-09-16T02:00:38.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 msgr2=0x7f9fa010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:38.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 0x7f9fa010d070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c002840 tx=0x7f9f9c004570 comp rx=0 tx=0).stop 2024-09-16T02:00:38.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 shutdown_connections 2024-09-16T02:00:38.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9f8c06ecc0 0x7f9f8c071170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:38.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa00ff680 0x7f9fa010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:38.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 --2- 172.21.15.110:0/1862432994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9fa0065c40 0x7f9fa010d070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:38.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 >> 172.21.15.110:0/1862432994 conn(0x7f9fa00f6c10 msgr2=0x7f9fa00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:00:38.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 shutdown_connections 2024-09-16T02:00:38.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:00:38.179+0000 7f9fa7619640 1 -- 172.21.15.110:0/1862432994 wait complete. 2024-09-16T02:00:38.428 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:38 smithi110 ceph-mon[27634]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:38.428 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:38 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:38.428 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:38 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:38 smithi165 ceph-mon[34621]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:38 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:38 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:39.157 DEBUG:teuthology.orchestra.run.smithi110:osd.2> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T02:00:39.159 INFO:tasks.cephadm:Deploying osd.3 on smithi165 with /dev/vg_nvme/lv_4... 2024-09-16T02:00:39.159 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T02:00:39.414 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:00:39.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:39 smithi165 ceph-mon[34621]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T02:00:39.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:39 smithi110 ceph-mon[27634]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T02:00:40.604 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:40 smithi165 ceph-mon[34621]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:40.604 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:40 smithi165 ceph-mon[34621]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T02:00:40.605 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:40 smithi165 ceph-mon[34621]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T02:00:40.605 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:40.605 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:40 smithi165 ceph-mon[34621]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:00:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-mon[27634]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-mon[27634]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T02:00:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-mon[27634]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T02:00:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-mon[27634]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:00:40.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[60937]: 2024-09-16T02:00:40.332+0000 7fba318d6640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T02:00:40.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:40 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[60937]: 2024-09-16T02:00:40.339+0000 7fba2e711640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: osdmap e18: 3 total, 2 up, 3 in 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:41.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:41 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: from='osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: osdmap e18: 3 total, 2 up, 3 in 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:41 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:41.758 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T02:00:41.777 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_4 2024-09-16T02:00:42.025 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:00:42.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:42 smithi165 ceph-mon[34621]: purged_snaps scrub starts 2024-09-16T02:00:42.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:42 smithi165 ceph-mon[34621]: purged_snaps scrub ok 2024-09-16T02:00:42.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:42 smithi165 ceph-mon[34621]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:42.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:42 smithi165 ceph-mon[34621]: osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] boot 2024-09-16T02:00:42.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:42 smithi165 ceph-mon[34621]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T02:00:42.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:42 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:42.667 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:42 smithi110 ceph-mon[27634]: purged_snaps scrub starts 2024-09-16T02:00:42.667 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:42 smithi110 ceph-mon[27634]: purged_snaps scrub ok 2024-09-16T02:00:42.667 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:42 smithi110 ceph-mon[27634]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-16T02:00:42.667 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:42 smithi110 ceph-mon[27634]: osd.2 [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] boot 2024-09-16T02:00:42.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:42 smithi110 ceph-mon[27634]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T02:00:42.668 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:42 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:00:43.443 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:43 smithi165 ceph-mon[34621]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T02:00:43.443 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:43 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-16T02:00:43.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 -- 172.21.15.165:0/3117835967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 msgr2=0x7f4e500fcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:43.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 --2- 172.21.15.165:0/3117835967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e500fcb20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4e440048d0 tx=0x7f4e44009da0 comp rx=0 tx=0).stop 2024-09-16T02:00:43.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 -- 172.21.15.165:0/3117835967 shutdown_connections 2024-09-16T02:00:43.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 --2- 172.21.15.165:0/3117835967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e500fcb20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 --2- 172.21.15.165:0/3117835967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 0x7f4e500fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 -- 172.21.15.165:0/3117835967 >> 172.21.15.165:0/3117835967 conn(0x7f4e500f6b80 msgr2=0x7f4e500f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 -- 172.21.15.165:0/3117835967 shutdown_connections 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 -- 172.21.15.165:0/3117835967 wait complete. 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.649+0000 7f4e55d57640 1 Processor -- start 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e55d57640 1 -- start start 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e55d57640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 0x7f4e5010cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e55d57640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e5010d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e55d57640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5010db70 con 0x7f4e500fb3e0 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e55d57640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5010e390 con 0x7f4e500fc6b0 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e5010d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 0x7f4e5010cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e5010d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:36450/0 (socket says 172.21.15.165:36450) 2024-09-16T02:00:43.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 -- 172.21.15.165:0/706595390 learned_addr learned my addr 172.21.15.165:0/706595390 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 0x7f4e5010cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.165:39422/0 (socket says 172.21.15.165:39422) 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 -- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 msgr2=0x7f4e5010cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 0x7f4e5010cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 -- 172.21.15.165:0/706595390 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44005040 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.650+0000 7f4e4effd640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e5010d520 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4e440043d0 tx=0x7f4e44009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.651+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e44038070 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.651+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e4402ae90 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.651+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5010e5c0 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.651+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4403e670 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.651+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5010eb60 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.652+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5005ed70 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.652+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f4e44030020 con 0x7f4e500fc6b0 2024-09-16T02:00:43.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.652+0000 7f4e37fff640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4e3806ecd0 0x7f4e38071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:00:43.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.653+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f4e440ad8d0 con 0x7f4e500fc6b0 2024-09-16T02:00:43.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.653+0000 7f4e4f7fe640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4e3806ecd0 0x7f4e38071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:00:43.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.653+0000 7f4e4f7fe640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4e3806ecd0 0x7f4e38071180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e40007fd0 tx=0x7f4e40009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:00:43.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.657+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4e4407b4c0 con 0x7f4e500fc6b0 2024-09-16T02:00:43.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:43 smithi110 ceph-mon[27634]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T02:00:43.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:43 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-16T02:00:43.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:43.819+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e50103f50 con 0x7f4e3806ecd0 2024-09-16T02:00:44.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:44.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-16T02:00:44.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: osdmap e21: 3 total, 3 up, 3 in 2024-09-16T02:00:44.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T02:00:44.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:00:44.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:00:44.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:44 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:44.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-16T02:00:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: osdmap e21: 3 total, 3 up, 3 in 2024-09-16T02:00:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T02:00:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:00:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:00:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:44 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:45.277 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65600]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T02:00:45.277 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65600]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:45.277 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:45.277 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65600]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:45.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:00:45.415+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4e4402c3a0 con 0x7f4e500fc6b0 2024-09-16T02:00:45.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:00:45.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: osdmap e22: 3 total, 3 up, 3 in 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi110 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi110 to 4288M 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:45.539 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:45 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.562 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65619]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T02:00:45.562 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65619]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:45.562 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:45.562 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65619]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:45.562 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:00:45.562 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: osdmap e22: 3 total, 3 up, 3 in 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: Detected new or changed devices on smithi110 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi110 to 4288M 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:45.563 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:45 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:45.828 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65628]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T02:00:45.829 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65628]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:45.829 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:45.829 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65628]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:46.080 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65706]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T02:00:46.081 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65706]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:46.081 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:46.081 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:00:45 smithi110 sudo[65706]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:46.345 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T02:00:46.345 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:46.345 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:46.345 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65729]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:46.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65770]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T02:00:46.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65770]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:46.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:46.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65770]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:46.856 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65808]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T02:00:46.856 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65808]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:46.856 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:46.856 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65808]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:47.187 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65813]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65813]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 sudo[65813]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: osdmap e23: 3 total, 3 up, 3 in 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: mgrmap e19: smithi110.hfirap(active, since 2m), standbys: smithi165.afwhot 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1342068482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2285ab-b31a-4184-92f4-9c09372bf5bc"}]: dispatch 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2285ab-b31a-4184-92f4-9c09372bf5bc"}]: dispatch 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da2285ab-b31a-4184-92f4-9c09372bf5bc"}]': finished 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:00:47.188 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:46 smithi110 ceph-mon[27634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T02:00:47.389 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[37950]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T02:00:47.389 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[37950]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:47.389 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[37950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:47.389 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[37950]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:47.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[38139]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[38139]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[38139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 sudo[38139]: pam_unix(sudo:session): session closed for user root 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: osdmap e23: 3 total, 3 up, 3 in 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: mgrmap e19: smithi110.hfirap(active, since 2m), standbys: smithi165.afwhot 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/1342068482' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2285ab-b31a-4184-92f4-9c09372bf5bc"}]: dispatch 2024-09-16T02:00:47.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da2285ab-b31a-4184-92f4-9c09372bf5bc"}]: dispatch 2024-09-16T02:00:47.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da2285ab-b31a-4184-92f4-9c09372bf5bc"}]': finished 2024-09-16T02:00:47.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T02:00:47.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:00:47.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T02:00:48.159 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1197747324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:48.160 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/1197747324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:00:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T02:00:48.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:48.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:00:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:49 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:49 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:49 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:49 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:49.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:49 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:49.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:49 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:49.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:49 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:49.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:49 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:49.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:49 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:00:49.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:49 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:50.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:50 smithi165 ceph-mon[34621]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:50.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:50 smithi110 ceph-mon[27634]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:52.637 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:52 smithi165 ceph-mon[34621]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:52 smithi110 ceph-mon[27634]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:53.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:53 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T02:00:53.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:53 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:53 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T02:00:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:53 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:00:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:54 smithi165 ceph-mon[34621]: Deploying daemon osd.3 on smithi165 2024-09-16T02:00:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:54 smithi165 ceph-mon[34621]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:54 smithi110 ceph-mon[27634]: Deploying daemon osd.3 on smithi165 2024-09-16T02:00:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:54 smithi110 ceph-mon[27634]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:55.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:55 smithi165 ceph-mon[34621]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:55.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:55 smithi110 ceph-mon[27634]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:57.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:57 smithi165 ceph-mon[34621]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:57.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:57 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:57.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:57 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:57.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:57 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:58.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:57 smithi110 ceph-mon[27634]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:00:58.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:57 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:00:58.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:57 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:00:58.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:57 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:00.136 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:00:59 smithi165 ceph-mon[34621]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:00:59 smithi110 ceph-mon[27634]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:00.844 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 3 on host 'smithi165' 2024-09-16T02:01:00.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.842+0000 7f4e37fff640 1 -- 172.21.15.165:0/706595390 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4e50103f50 con 0x7f4e3806ecd0 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4e3806ecd0 msgr2=0x7f4e38071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4e3806ecd0 0x7f4e38071180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e40007fd0 tx=0x7f4e40009040 comp rx=0 tx=0).stop 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 msgr2=0x7f4e5010d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e5010d520 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4e440043d0 tx=0x7f4e44009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 shutdown_connections 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f4e3806ecd0 0x7f4e38071180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e500fc6b0 0x7f4e5010d520 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 --2- 172.21.15.165:0/706595390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e500fb3e0 0x7f4e5010cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 >> 172.21.15.165:0/706595390 conn(0x7f4e500f6b80 msgr2=0x7f4e500655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:00.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 shutdown_connections 2024-09-16T02:01:00.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:00.844+0000 7f4e55d57640 1 -- 172.21.15.165:0/706595390 wait complete. 2024-09-16T02:01:01.455 DEBUG:teuthology.orchestra.run.smithi165:osd.3> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.3.service 2024-09-16T02:01:01.458 INFO:tasks.cephadm:Deploying osd.4 on smithi165 with /dev/vg_nvme/lv_3... 2024-09-16T02:01:01.458 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T02:01:01.763 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: from='osd.3 [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:01 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: from='osd.3 [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:01 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:02 smithi110 ceph-mon[27634]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T02:01:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:02 smithi110 ceph-mon[27634]: osdmap e25: 4 total, 3 up, 4 in 2024-09-16T02:01:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:02 smithi110 ceph-mon[27634]: from='osd.3 [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:02 smithi110 ceph-mon[27634]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:03.161 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-mon[34621]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T02:01:03.161 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-mon[34621]: osdmap e25: 4 total, 3 up, 4 in 2024-09-16T02:01:03.161 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:03.161 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-mon[34621]: from='osd.3 [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:03.161 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-mon[34621]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:03.161 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:03.162 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[39926]: 2024-09-16T02:01:02.850+0000 7f508f7e4640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T02:01:03.162 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:01:02 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[39926]: 2024-09-16T02:01:02.856+0000 7f508a61b640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:01:04.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:03 smithi165 ceph-mon[34621]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:04.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:03 smithi165 ceph-mon[34621]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-16T02:01:04.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:03 smithi165 ceph-mon[34621]: osdmap e26: 4 total, 3 up, 4 in 2024-09-16T02:01:04.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:03 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:04.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:03 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:04.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:03 smithi110 ceph-mon[27634]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:04.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:03 smithi110 ceph-mon[27634]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-16T02:01:04.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:03 smithi110 ceph-mon[27634]: osdmap e26: 4 total, 3 up, 4 in 2024-09-16T02:01:04.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:03 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:04.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:03 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:04.545 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T02:01:04.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_3 2024-09-16T02:01:04.944 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:04 smithi165 ceph-mon[34621]: purged_snaps scrub starts 2024-09-16T02:01:04.944 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:04 smithi165 ceph-mon[34621]: purged_snaps scrub ok 2024-09-16T02:01:04.945 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:04 smithi165 ceph-mon[34621]: osd.3 [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] boot 2024-09-16T02:01:04.945 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:04 smithi165 ceph-mon[34621]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T02:01:04.945 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:04.945 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:04 smithi165 ceph-mon[34621]: osdmap e28: 4 total, 4 up, 4 in 2024-09-16T02:01:05.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:04 smithi110 ceph-mon[27634]: purged_snaps scrub starts 2024-09-16T02:01:05.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:04 smithi110 ceph-mon[27634]: purged_snaps scrub ok 2024-09-16T02:01:05.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:04 smithi110 ceph-mon[27634]: osd.3 [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] boot 2024-09-16T02:01:05.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:04 smithi110 ceph-mon[27634]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T02:01:05.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:01:05.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:04 smithi110 ceph-mon[27634]: osdmap e28: 4 total, 4 up, 4 in 2024-09-16T02:01:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:01:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: pgmap v92: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: osdmap e29: 4 total, 4 up, 4 in 2024-09-16T02:01:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:06 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: pgmap v92: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-16T02:01:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: osdmap e29: 4 total, 4 up, 4 in 2024-09-16T02:01:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:06.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:06.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:06.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:06.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:06 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 -- 172.21.15.165:0/560692724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 msgr2=0x7fbc1c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 --2- 172.21.15.165:0/560692724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c0fdcb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbc100048d0 tx=0x7fbc10009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 -- 172.21.15.165:0/560692724 shutdown_connections 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 --2- 172.21.15.165:0/560692724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c0fdcb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 --2- 172.21.15.165:0/560692724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc1c0fc570 0x7fbc1c0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 -- 172.21.15.165:0/560692724 >> 172.21.15.165:0/560692724 conn(0x7fbc1c0f7d30 msgr2=0x7fbc1c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:07.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 -- 172.21.15.165:0/560692724 shutdown_connections 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.284+0000 7fbc22898640 1 -- 172.21.15.165:0/560692724 wait complete. 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc22898640 1 Processor -- start 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc22898640 1 -- start start 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc22898640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc1c0fc570 0x7fbc1c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc22898640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc22898640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c10e4a0 con 0x7fbc1c0fc570 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc22898640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c10e610 con 0x7fbc1c0fd840 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.285+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:37732/0 (socket says 172.21.15.165:37732) 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1b7fe640 1 -- 172.21.15.165:0/3323363353 learned_addr learned my addr 172.21.15.165:0/3323363353 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T02:01:07.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1bfff640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc1c0fc570 0x7fbc1c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1b7fe640 1 -- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc1c0fc570 msgr2=0x7fbc1c10d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1b7fe640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc1c0fc570 0x7fbc1c10d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1b7fe640 1 -- 172.21.15.165:0/3323363353 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10005040 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc1b7fe640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c10d630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc10003080 tx=0x7fbc10009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc10038070 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c10e890 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc1002abd0 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc1003e670 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.286+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c10edb0 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.287+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c0fb9d0 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.287+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fbc10030020 con 0x7fbc1c0fd840 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.288+0000 7fbc18ff9640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbc0406ed60 0x7fbc04071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:07.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.288+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fbc100adef0 con 0x7fbc1c0fd840 2024-09-16T02:01:07.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.288+0000 7fbc1bfff640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbc0406ed60 0x7fbc04071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:07.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.289+0000 7fbc1bfff640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbc0406ed60 0x7fbc04071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006fd0 tx=0x7fbc0c008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:07.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.292+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbc1007b6b0 con 0x7fbc1c0fd840 2024-09-16T02:01:07.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:07.454+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc1c10efd0 con 0x7fbc0406ed60 2024-09-16T02:01:07.859 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi165 2024-09-16T02:01:07.859 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi165 to 15936M 2024-09-16T02:01:07.859 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:07.860 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:07.860 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:07.860 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:07.860 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:01:07.860 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:01:07.860 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: Detected new or changed devices on smithi165 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi165 to 15936M 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:01:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:01:07.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:08.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:08 smithi165 ceph-mon[34621]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:08.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:08 smithi165 ceph-mon[34621]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:01:08.935 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:08 smithi110 ceph-mon[27634]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:08.935 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:08 smithi110 ceph-mon[27634]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/3065194010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5984349f-312a-4420-acde-49ffad3292a4"}]: dispatch 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5984349f-312a-4420-acde-49ffad3292a4"}]: dispatch 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5984349f-312a-4420-acde-49ffad3292a4"}]': finished 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:10.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:10 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/1139247388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/3065194010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5984349f-312a-4420-acde-49ffad3292a4"}]: dispatch 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5984349f-312a-4420-acde-49ffad3292a4"}]: dispatch 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5984349f-312a-4420-acde-49ffad3292a4"}]': finished 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:10 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/1139247388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:01:11.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:11 smithi165 ceph-mon[34621]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-16T02:01:11.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:11 smithi110 ceph-mon[27634]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-16T02:01:13.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:13 smithi165 ceph-mon[34621]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T02:01:14.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:13 smithi110 ceph-mon[27634]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T02:01:15.872 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:15 smithi165 ceph-mon[34621]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-16T02:01:16.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:15 smithi110 ceph-mon[27634]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-16T02:01:17.066 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:16 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T02:01:17.066 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:16 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:17.066 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:16 smithi165 ceph-mon[34621]: Deploying daemon osd.4 on smithi165 2024-09-16T02:01:17.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:16 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T02:01:17.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:16 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:17.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:16 smithi110 ceph-mon[27634]: Deploying daemon osd.4 on smithi165 2024-09-16T02:01:18.060 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:17 smithi165 ceph-mon[34621]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T02:01:18.060 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:17 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:18.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:17 smithi110 ceph-mon[27634]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T02:01:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:17 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:20.071 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:19 smithi165 ceph-mon[34621]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:20.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:19 smithi110 ceph-mon[27634]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:22.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:21 smithi165 ceph-mon[34621]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:22.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:22.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:22.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:22.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:21 smithi110 ceph-mon[27634]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:22.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:22.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:22.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:24.105 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:23 smithi165 ceph-mon[34621]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:24.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:23 smithi110 ceph-mon[27634]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:25.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.098+0000 7fbc18ff9640 1 -- 172.21.15.165:0/3323363353 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbc1c10efd0 con 0x7fbc0406ed60 2024-09-16T02:01:25.101 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 4 on host 'smithi165' 2024-09-16T02:01:25.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbc0406ed60 msgr2=0x7fbc04071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:25.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbc0406ed60 0x7fbc04071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006fd0 tx=0x7fbc0c008040 comp rx=0 tx=0).stop 2024-09-16T02:01:25.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 msgr2=0x7fbc1c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:25.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c10d630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc10003080 tx=0x7fbc10009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:25.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 shutdown_connections 2024-09-16T02:01:25.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbc0406ed60 0x7fbc04071210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:25.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc1c0fd840 0x7fbc1c10d630 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:25.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 --2- 172.21.15.165:0/3323363353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc1c0fc570 0x7fbc1c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:25.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 >> 172.21.15.165:0/3323363353 conn(0x7fbc1c0f7d30 msgr2=0x7fbc1c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:25.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 shutdown_connections 2024-09-16T02:01:25.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:25.100+0000 7fbc22898640 1 -- 172.21.15.165:0/3323363353 wait complete. 2024-09-16T02:01:25.686 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.686 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.686 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:25.686 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:25.686 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.686 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='osd.4 [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:01:25.687 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:01:25.687 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:25.687 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.687 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:25 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='osd.4 [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:01:25.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:01:25.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:25.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:25 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:25.712 DEBUG:teuthology.orchestra.run.smithi165:osd.4> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.4.service 2024-09-16T02:01:25.715 INFO:tasks.cephadm:Deploying osd.5 on smithi165 with /dev/vg_nvme/lv_2... 2024-09-16T02:01:25.715 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T02:01:26.448 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:01:26.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-mon[34621]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:26.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-mon[34621]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T02:01:26.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-mon[34621]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T02:01:26.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:26.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-mon[34621]: from='osd.4 [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:26.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-mon[34621]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:26.570 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[46730]: 2024-09-16T02:01:26.454+0000 7f26df815640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T02:01:26.571 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:01:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[46730]: 2024-09-16T02:01:26.461+0000 7f26da64c640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:01:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:26 smithi110 ceph-mon[27634]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:26 smithi110 ceph-mon[27634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T02:01:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:26 smithi110 ceph-mon[27634]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T02:01:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:26 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:26 smithi110 ceph-mon[27634]: from='osd.4 [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:26 smithi110 ceph-mon[27634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:27.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:27 smithi165 ceph-mon[34621]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-16T02:01:27.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:27 smithi165 ceph-mon[34621]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T02:01:27.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:27 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:27.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:27 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:27.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:27 smithi110 ceph-mon[27634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-16T02:01:27.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:27 smithi110 ceph-mon[27634]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T02:01:27.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:27 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:27.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:27 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:28 smithi165 ceph-mon[34621]: purged_snaps scrub starts 2024-09-16T02:01:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:28 smithi165 ceph-mon[34621]: purged_snaps scrub ok 2024-09-16T02:01:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:28 smithi165 ceph-mon[34621]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:28 smithi165 ceph-mon[34621]: osd.4 [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] boot 2024-09-16T02:01:28.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:28 smithi165 ceph-mon[34621]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T02:01:28.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:28 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:28.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:28 smithi110 ceph-mon[27634]: purged_snaps scrub starts 2024-09-16T02:01:28.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:28 smithi110 ceph-mon[27634]: purged_snaps scrub ok 2024-09-16T02:01:28.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:28 smithi110 ceph-mon[27634]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-16T02:01:28.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:28 smithi110 ceph-mon[27634]: osd.4 [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] boot 2024-09-16T02:01:28.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:28 smithi110 ceph-mon[27634]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T02:01:28.882 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:28 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:01:29.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: osdmap e34: 5 total, 5 up, 5 in 2024-09-16T02:01:29.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:29.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:29.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:29.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:29.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:29 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: osdmap e34: 5 total, 5 up, 5 in 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:29.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:29.849 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:29.849 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:29 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:30.418 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-16T02:01:30.441 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_2 2024-09-16T02:01:30.690 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:01:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:30 smithi165 ceph-mon[34621]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:30 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi165 2024-09-16T02:01:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:30 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi165 to 7968M 2024-09-16T02:01:30.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:30 smithi110 ceph-mon[27634]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:30 smithi110 ceph-mon[27634]: Detected new or changed devices on smithi165 2024-09-16T02:01:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:30 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi165 to 7968M 2024-09-16T02:01:32.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 -- 172.21.15.165:0/3815740571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 msgr2=0x7f3d7006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 --2- 172.21.15.165:0/3815740571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d7006fb00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3d600048d0 tx=0x7f3d60009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 -- 172.21.15.165:0/3815740571 shutdown_connections 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 --2- 172.21.15.165:0/3815740571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d70070040 0x7f3d700704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 --2- 172.21.15.165:0/3815740571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d7006fb00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 -- 172.21.15.165:0/3815740571 >> 172.21.15.165:0/3815740571 conn(0x7f3d700f7d30 msgr2=0x7f3d700fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.166+0000 7f3d7685f640 1 -- 172.21.15.165:0/3815740571 shutdown_connections 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.167+0000 7f3d7685f640 1 -- 172.21.15.165:0/3815740571 wait complete. 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.167+0000 7f3d7685f640 1 Processor -- start 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.167+0000 7f3d7685f640 1 -- start start 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.167+0000 7f3d7685f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d70070040 0x7f3d70113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d7685f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d70113c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:32.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d7685f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70114af0 con 0x7f3d70070040 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d7685f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70114c60 con 0x7f3d700715d0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d70113c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d70113c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:50516/0 (socket says 172.21.15.165:50516) 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 -- 172.21.15.165:0/1161131041 learned_addr learned my addr 172.21.15.165:0/1161131041 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6ffff640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d70070040 0x7f3d70113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 -- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d70070040 msgr2=0x7f3d70113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d70070040 0x7f3d70113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 -- 172.21.15.165:0/1161131041 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60005040 con 0x7f3d700715d0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6f7fe640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d70113c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400b790 tx=0x7f3d640091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6400c700 con 0x7f3d700715d0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3d6400cd00 con 0x7f3d700715d0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d70114f40 con 0x7f3d700715d0 2024-09-16T02:01:32.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d64015e70 con 0x7f3d700715d0 2024-09-16T02:01:32.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.168+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d70115460 con 0x7f3d700715d0 2024-09-16T02:01:32.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.169+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d700fb9b0 con 0x7f3d700715d0 2024-09-16T02:01:32.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.170+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3d64012070 con 0x7f3d700715d0 2024-09-16T02:01:32.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.170+0000 7f3d6cff9640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3d5806ed60 0x7f3d58071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:32.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.170+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f3d6408d7e0 con 0x7f3d700715d0 2024-09-16T02:01:32.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.170+0000 7f3d6ffff640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3d5806ed60 0x7f3d58071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:32.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.171+0000 7f3d6ffff640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3d5806ed60 0x7f3d58071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d60007ac0 tx=0x7f3d60035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:32.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.174+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3d6405adf0 con 0x7f3d700715d0 2024-09-16T02:01:32.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:32.335+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d701156e0 con 0x7f3d5806ed60 2024-09-16T02:01:32.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:32 smithi165 ceph-mon[34621]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:32.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:01:32.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:01:32.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:32 smithi110 ceph-mon[27634]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T02:01:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T02:01:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:33 smithi165 ceph-mon[34621]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:01:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:33 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:33.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:33 smithi110 ceph-mon[27634]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:01:33.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:34.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:34 smithi165 ceph-mon[34621]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:34.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:34 smithi110 ceph-mon[27634]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:35.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:35 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/4149669584' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fec096e-c71e-45b3-a55f-ab0b854dc250"}]: dispatch 2024-09-16T02:01:35.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:35 smithi165 ceph-mon[34621]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fec096e-c71e-45b3-a55f-ab0b854dc250"}]: dispatch 2024-09-16T02:01:35.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:35 smithi165 ceph-mon[34621]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fec096e-c71e-45b3-a55f-ab0b854dc250"}]': finished 2024-09-16T02:01:35.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:35 smithi165 ceph-mon[34621]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T02:01:35.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:35.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:35 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/72603455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:01:35.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:35 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/4149669584' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fec096e-c71e-45b3-a55f-ab0b854dc250"}]: dispatch 2024-09-16T02:01:35.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:35 smithi110 ceph-mon[27634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fec096e-c71e-45b3-a55f-ab0b854dc250"}]: dispatch 2024-09-16T02:01:35.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:35 smithi110 ceph-mon[27634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fec096e-c71e-45b3-a55f-ab0b854dc250"}]': finished 2024-09-16T02:01:35.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:35 smithi110 ceph-mon[27634]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T02:01:35.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:35.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:35 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/72603455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T02:01:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:36 smithi165 ceph-mon[34621]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:36 smithi110 ceph-mon[27634]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:38 smithi165 ceph-mon[34621]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:38.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:38 smithi110 ceph-mon[27634]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:40 smithi165 ceph-mon[34621]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:40 smithi110 ceph-mon[27634]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:42 smithi165 ceph-mon[34621]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:42 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T02:01:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:42 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:42.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:42 smithi110 ceph-mon[27634]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:42.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:42 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T02:01:42.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:42 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:43 smithi165 ceph-mon[34621]: Deploying daemon osd.5 on smithi165 2024-09-16T02:01:43.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:43 smithi110 ceph-mon[27634]: Deploying daemon osd.5 on smithi165 2024-09-16T02:01:44.740 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:44 smithi165 ceph-mon[34621]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:44.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:44 smithi110 ceph-mon[27634]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:46.794 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:46 smithi165 ceph-mon[34621]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:46.794 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:46 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:46.794 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:46 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:46.795 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:46 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:46 smithi110 ceph-mon[27634]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:46 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:48.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:48 smithi165 ceph-mon[34621]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:48.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:48 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:48 smithi110 ceph-mon[27634]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:01:49.516 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.514+0000 7f3d6cff9640 1 -- 172.21.15.165:0/1161131041 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3d701156e0 con 0x7f3d5806ed60 2024-09-16T02:01:49.516 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 5 on host 'smithi165' 2024-09-16T02:01:49.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3d5806ed60 msgr2=0x7f3d58071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:49.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3d5806ed60 0x7f3d58071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d60007ac0 tx=0x7f3d60035040 comp rx=0 tx=0).stop 2024-09-16T02:01:49.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 msgr2=0x7f3d70113c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:49.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d70113c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400b790 tx=0x7f3d640091d0 comp rx=0 tx=0).stop 2024-09-16T02:01:49.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 shutdown_connections 2024-09-16T02:01:49.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3d5806ed60 0x7f3d58071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:49.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d700715d0 0x7f3d70113c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:49.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 --2- 172.21.15.165:0/1161131041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d70070040 0x7f3d70113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:49.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 >> 172.21.15.165:0/1161131041 conn(0x7f3d700f7d30 msgr2=0x7f3d700f9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:49.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 shutdown_connections 2024-09-16T02:01:49.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:01:49.517+0000 7f3d7685f640 1 -- 172.21.15.165:0/1161131041 wait complete. 2024-09-16T02:01:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:50 smithi165 ceph-mon[34621]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:50 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:50 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:50 smithi165 ceph-mon[34621]: from='osd.5 [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:01:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:50 smithi165 ceph-mon[34621]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:01:50.751 DEBUG:teuthology.orchestra.run.smithi165:osd.5> sudo journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.5.service 2024-09-16T02:01:50.753 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-16T02:01:50.754 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T02:01:50.783 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:50 smithi110 ceph-mon[27634]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:50.783 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:50 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:50.783 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:50 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:50.783 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:50 smithi110 ceph-mon[27634]: from='osd.5 [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:01:50.783 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:50 smithi110 ceph-mon[27634]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:01:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: from='osd.5 [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:51.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:51.852 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T02:01:51.852 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T02:01:51.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:51.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: from='osd.5 [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:51.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:01:51.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:51.853 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:51.853 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[53292]: 2024-09-16T02:01:51.535+0000 7ff9b8542640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T02:01:51.853 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:01:51 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[53292]: 2024-09-16T02:01:51.543+0000 7ff9b0351640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:01:52.614 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:52 smithi165 ceph-mon[34621]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:52.614 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:52 smithi165 ceph-mon[34621]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-16T02:01:52.614 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:52 smithi165 ceph-mon[34621]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T02:01:52.614 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:52 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:52.614 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:52 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:52.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 -- 172.21.15.110:0/136325554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 msgr2=0x7f6c100fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 --2- 172.21.15.110:0/136325554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c100fdcb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c040048d0 tx=0x7f6c04009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 -- 172.21.15.110:0/136325554 shutdown_connections 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 --2- 172.21.15.110:0/136325554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c100fdcb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 --2- 172.21.15.110:0/136325554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c100fc570 0x7f6c100fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 -- 172.21.15.110:0/136325554 >> 172.21.15.110:0/136325554 conn(0x7f6c100f7d30 msgr2=0x7f6c100fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 -- 172.21.15.110:0/136325554 shutdown_connections 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 -- 172.21.15.110:0/136325554 wait complete. 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 Processor -- start 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.648+0000 7f6c172d0640 1 -- start start 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c172d0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c100fc570 0x7f6c1010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c172d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c1010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:52.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c172d0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1010dc10 con 0x7f6c100fd840 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c172d0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1010e430 con 0x7f6c100fc570 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c1010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c1010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58692/0 (socket says 172.21.15.110:58692) 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 -- 172.21.15.110:0/3002141516 learned_addr learned my addr 172.21.15.110:0/3002141516 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1506c640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c100fc570 0x7f6c1010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 -- 172.21.15.110:0/3002141516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c100fc570 msgr2=0x7f6c1010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c100fc570 0x7f6c1010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 -- 172.21.15.110:0/3002141516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04005040 con 0x7f6c100fd840 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c1486b640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c1010d5c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c040043d0 tx=0x7f6c04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c04038070 con 0x7f6c100fd840 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c0402ae90 con 0x7f6c100fd840 2024-09-16T02:01:52.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1010e660 con 0x7f6c100fd840 2024-09-16T02:01:52.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.649+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c0403e670 con 0x7f6c100fd840 2024-09-16T02:01:52.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.650+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1010ec00 con 0x7f6c100fd840 2024-09-16T02:01:52.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.651+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c100fb9d0 con 0x7f6c100fd840 2024-09-16T02:01:52.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.651+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6c04030020 con 0x7f6c100fd840 2024-09-16T02:01:52.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.652+0000 7f6c0dffb640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6bf806ed60 0x7f6bf8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:52.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.652+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6c040ae0e0 con 0x7f6c100fd840 2024-09-16T02:01:52.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.652+0000 7f6c1506c640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6bf806ed60 0x7f6bf8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:52.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.652+0000 7f6c1506c640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6bf806ed60 0x7f6bf8071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c000049b0 tx=0x7f6c00009d30 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:52.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.656+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c0407b540 con 0x7f6c100fd840 2024-09-16T02:01:52.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.814+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6c1010eec0 con 0x7f6c100fd840 2024-09-16T02:01:52.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:52 smithi110 ceph-mon[27634]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:52.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:52 smithi110 ceph-mon[27634]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-16T02:01:52.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:52 smithi110 ceph-mon[27634]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T02:01:52.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:52.816 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:52 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:52.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.815+0000 7f6c0dffb640 1 -- 172.21.15.110:0/3002141516 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6c0407aee0 con 0x7f6c100fd840 2024-09-16T02:01:52.817 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6bf806ed60 msgr2=0x7f6bf8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6bf806ed60 0x7f6bf8071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c000049b0 tx=0x7f6c00009d30 comp rx=0 tx=0).stop 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 msgr2=0x7f6c1010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c1010d5c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c040043d0 tx=0x7f6c04009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 shutdown_connections 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6bf806ed60 0x7f6bf8071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c100fd840 0x7f6c1010d5c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 --2- 172.21.15.110:0/3002141516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c100fc570 0x7f6c1010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:52.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 >> 172.21.15.110:0/3002141516 conn(0x7f6c100f7d30 msgr2=0x7f6c100f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:52.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 shutdown_connections 2024-09-16T02:01:52.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:52.817+0000 7f6c172d0640 1 -- 172.21.15.110:0/3002141516 wait complete. 2024-09-16T02:01:53.515 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726452112,"num_in_osds":6,"osd_in_since":1726452094,"num_remapped_pgs":0} 2024-09-16T02:01:53.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T02:01:53.804 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:01:53.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:53 smithi165 ceph-mon[34621]: purged_snaps scrub starts 2024-09-16T02:01:53.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:53 smithi165 ceph-mon[34621]: purged_snaps scrub ok 2024-09-16T02:01:53.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:53 smithi165 ceph-mon[34621]: osd.5 [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] boot 2024-09-16T02:01:53.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:53 smithi165 ceph-mon[34621]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T02:01:53.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:53 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:53.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:53 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3002141516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T02:01:53.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:53 smithi110 ceph-mon[27634]: purged_snaps scrub starts 2024-09-16T02:01:53.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:53 smithi110 ceph-mon[27634]: purged_snaps scrub ok 2024-09-16T02:01:53.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:53 smithi110 ceph-mon[27634]: osd.5 [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] boot 2024-09-16T02:01:53.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:53 smithi110 ceph-mon[27634]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T02:01:53.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:53 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:01:53.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:53 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3002141516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.901 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:54.902 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:54.902 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.902 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:54 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-16T02:01:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T02:01:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:54.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:54 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:01:55.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 -- 172.21.15.110:0/189661693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 msgr2=0x7f7b58065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:55.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 --2- 172.21.15.110:0/189661693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b58065430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b400048d0 tx=0x7f7b40009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 -- 172.21.15.110:0/189661693 shutdown_connections 2024-09-16T02:01:55.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 --2- 172.21.15.110:0/189661693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b58065430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 --2- 172.21.15.110:0/189661693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 0x7f7b580fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 -- 172.21.15.110:0/189661693 >> 172.21.15.110:0/189661693 conn(0x7f7b580723b0 msgr2=0x7f7b580727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 -- 172.21.15.110:0/189661693 shutdown_connections 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 -- 172.21.15.110:0/189661693 wait complete. 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.396+0000 7f7b5e667640 1 Processor -- start 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b5e667640 1 -- start start 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b5e667640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b581131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b5e667640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 0x7f7b581136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b5e667640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58113cf0 con 0x7f7b58064fe0 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b5e667640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5810d130 con 0x7f7b580fe450 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b581131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b581131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58712/0 (socket says 172.21.15.110:58712) 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 -- 172.21.15.110:0/337134499 learned_addr learned my addr 172.21.15.110:0/337134499 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b4ffff640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 0x7f7b581136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 -- 172.21.15.110:0/337134499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 msgr2=0x7f7b581136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:55.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 0x7f7b581136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 -- 172.21.15.110:0/337134499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40005040 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b4ffff640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 0x7f7b581136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b57fff640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b581131b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b48002a50 tx=0x7f7b48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.397+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b48007c30 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.398+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5810d410 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.398+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b4800f040 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.398+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4800db50 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.398+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5810d980 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.399+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b580fdce0 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.399+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7b4800dcb0 con 0x7f7b58064fe0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.400+0000 7f7b557fa640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7b4406ed60 0x7f7b44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.400+0000 7f7b4ffff640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7b4406ed60 0x7f7b44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:55.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.400+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b4808ddc0 con 0x7f7b58064fe0 2024-09-16T02:01:55.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.400+0000 7f7b4ffff640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7b4406ed60 0x7f7b44071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b58072d20 tx=0x7f7b40035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:55.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.404+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7b4805b220 con 0x7f7b58064fe0 2024-09-16T02:01:55.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.562+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b5804b720 con 0x7f7b58064fe0 2024-09-16T02:01:55.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.563+0000 7f7b557fa640 1 -- 172.21.15.110:0/337134499 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11139 (secure 0 0 0) 0x7f7b4805abc0 con 0x7f7b58064fe0 2024-09-16T02:01:55.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:01:55.564 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":39,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","created":"2024-09-16T01:56:36.667290+0000","modified":"2024-09-16T02:01:53.539984+0000","last_up_change":"2024-09-16T02:01:52.532481+0000","last_in_change":"2024-09-16T02:01:34.619366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T02:00:43.037209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"13903880-eaf7-4a3b-b289-e2c35e89eeb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6803","nonce":3391846421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6805","nonce":3391846421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6809","nonce":3391846421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6807","nonce":3391846421}]},"public_addr":"172.21.15.110:6803/3391846421","cluster_addr":"172.21.15.110:6805/3391846421","heartbeat_back_addr":"172.21.15.110:6809/3391846421","heartbeat_front_addr":"172.21.15.110:6807/3391846421","state":["exists","up"]},{"osd":1,"uuid":"175d7810-d02d-47ed-ac31-e85cab907936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6811","nonce":4105339787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6813","nonce":4105339787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6817","nonce":4105339787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6815","nonce":4105339787}]},"public_addr":"172.21.15.110:6811/4105339787","cluster_addr":"172.21.15.110:6813/4105339787","heartbeat_back_addr":"172.21.15.110:6817/4105339787","heartbeat_front_addr":"172.21.15.110:6815/4105339787","state":["exists","up"]},{"osd":2,"uuid":"0afb738b-850a-45bb-88db-28fcfce812a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6819","nonce":2035538238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6821","nonce":2035538238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6825","nonce":2035538238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6823","nonce":2035538238}]},"public_addr":"172.21.15.110:6819/2035538238","cluster_addr":"172.21.15.110:6821/2035538238","heartbeat_back_addr":"172.21.15.110:6825/2035538238","heartbeat_front_addr":"172.21.15.110:6823/2035538238","state":["exists","up"]},{"osd":3,"uuid":"da2285ab-b31a-4184-92f4-9c09372bf5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6801","nonce":4062357428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6803","nonce":4062357428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6807","nonce":4062357428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6805","nonce":4062357428}]},"public_addr":"172.21.15.165:6801/4062357428","cluster_addr":"172.21.15.165:6803/4062357428","heartbeat_back_addr":"172.21.15.165:6807/4062357428","heartbeat_front_addr":"172.21.15.165:6805/4062357428","state":["exists","up"]},{"osd":4,"uuid":"5984349f-312a-4420-acde-49ffad3292a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6809","nonce":1452301669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6811","nonce":1452301669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6815","nonce":1452301669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6813","nonce":1452301669}]},"public_addr":"172.21.15.165:6809/1452301669","cluster_addr":"172.21.15.165:6811/1452301669","heartbeat_back_addr":"172.21.15.165:6815/1452301669","heartbeat_front_addr":"172.21.15.165:6813/1452301669","state":["exists","up"]},{"osd":5,"uuid":"4fec096e-c71e-45b3-a55f-ab0b854dc250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6817","nonce":2669879117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6819","nonce":2669879117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6823","nonce":2669879117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6821","nonce":2669879117}]},"public_addr":"172.21.15.165:6817/2669879117","cluster_addr":"172.21.15.165:6819/2669879117","heartbeat_back_addr":"172.21.15.165:6823/2669879117","heartbeat_front_addr":"172.21.15.165:6821/2669879117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:59:44.914569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:00:11.234050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:00:39.476885+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:02.223270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:25.973956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:51.298536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/728530367":"2024-09-17T01:58:32.725210+0000","172.21.15.110:0/2684868236":"2024-09-17T01:58:32.725210+0000","172.21.15.110:0/44402193":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/1760065388":"2024-09-17T01:57:33.044545+0000","172.21.15.110:0/1315429218":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/350261868":"2024-09-17T01:58:32.725210+0000","172.21.15.110:6800/750341792":"2024-09-17T01:57:04.101594+0000","172.21.15.110:6801/750341792":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/507819561":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6801/2073782143":"2024-09-17T01:58:32.725210+0000","172.21.15.110:6800/3914114363":"2024-09-17T01:57:33.044545+0000","172.21.15.110:0/841598639":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/519121796":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6801/3914114363":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6800/2073782143":"2024-09-17T01:58:32.725210+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T02:01:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.564+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7b4406ed60 msgr2=0x7f7b44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.564+0000 7f7b5e667640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7b4406ed60 0x7f7b44071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b58072d20 tx=0x7f7b40035040 comp rx=0 tx=0).stop 2024-09-16T02:01:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.564+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 msgr2=0x7f7b581131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.564+0000 7f7b5e667640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b581131b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b48002a50 tx=0x7f7b48004600 comp rx=0 tx=0).stop 2024-09-16T02:01:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 shutdown_connections 2024-09-16T02:01:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7b4406ed60 0x7f7b44071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b580fe450 0x7f7b581136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 --2- 172.21.15.110:0/337134499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b58064fe0 0x7f7b581131b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:55.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 >> 172.21.15.110:0/337134499 conn(0x7f7b580723b0 msgr2=0x7f7b58105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:55.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 shutdown_connections 2024-09-16T02:01:55.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:55.565+0000 7f7b5e667640 1 -- 172.21.15.110:0/337134499 wait complete. 2024-09-16T02:01:55.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:55 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi165 2024-09-16T02:01:55.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:55 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi165 to 5312M 2024-09-16T02:01:55.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:55 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:55.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:55 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:55.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:55 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:55.867 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:55 smithi110 ceph-mon[27634]: Detected new or changed devices on smithi165 2024-09-16T02:01:55.867 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:55 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi165 to 5312M 2024-09-16T02:01:55.867 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:55 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:01:55.867 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:55 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:01:55.867 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:55 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:01:56.225 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T02:00:43.037209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-16T02:01:56.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T02:01:56.470 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:01:56.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:56 smithi110 ceph-mon[27634]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:01:56.802 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:56 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/337134499' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T02:01:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:56 smithi165 ceph-mon[34621]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:01:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:56 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/337134499' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T02:01:58.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 -- 172.21.15.110:0/2434279551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601025f0 msgr2=0x7f69601029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:58.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 --2- 172.21.15.110:0/2434279551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601025f0 0x7f69601029c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f695c0048d0 tx=0x7f695c009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 -- 172.21.15.110:0/2434279551 shutdown_connections 2024-09-16T02:01:58.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 --2- 172.21.15.110:0/2434279551 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69600fac60 0x7f69600fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 --2- 172.21.15.110:0/2434279551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601025f0 0x7f69601029c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 -- 172.21.15.110:0/2434279551 >> 172.21.15.110:0/2434279551 conn(0x7f6960070c80 msgr2=0x7f6960071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:58.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 -- 172.21.15.110:0/2434279551 shutdown_connections 2024-09-16T02:01:58.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 -- 172.21.15.110:0/2434279551 wait complete. 2024-09-16T02:01:58.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 Processor -- start 2024-09-16T02:01:58.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.129+0000 7f6967f82640 1 -- start start 2024-09-16T02:01:58.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6967f82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 0x7f6960113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:58.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6967f82640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69601025f0 0x7f6960113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:58.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6967f82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960113d70 con 0x7f69600fac60 2024-09-16T02:01:58.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6967f82640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960113ee0 con 0x7f69601025f0 2024-09-16T02:01:58.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 0x7f6960113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:58.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 0x7f6960113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58726/0 (socket says 172.21.15.110:58726) 2024-09-16T02:01:58.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 -- 172.21.15.110:0/385086464 learned_addr learned my addr 172.21.15.110:0/385086464 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:01:58.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f696551d640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69601025f0 0x7f6960113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:58.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 -- 172.21.15.110:0/385086464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69601025f0 msgr2=0x7f6960113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69601025f0 0x7f6960113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 -- 172.21.15.110:0/385086464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c005040 con 0x7f69600fac60 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6965d1e640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 0x7f6960113230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f695c000c00 tx=0x7f695c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695c038070 con 0x7f69600fac60 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696010d300 con 0x7f69600fac60 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f695c02ade0 con 0x7f69600fac60 2024-09-16T02:01:58.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695c02c7e0 con 0x7f69600fac60 2024-09-16T02:01:58.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.130+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696010d7c0 con 0x7f69600fac60 2024-09-16T02:01:58.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.131+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6960065810 con 0x7f69600fac60 2024-09-16T02:01:58.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.132+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f695c030020 con 0x7f69600fac60 2024-09-16T02:01:58.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.132+0000 7f69527fc640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f694c06ed60 0x7f694c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:01:58.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.132+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f695c0adad0 con 0x7f69600fac60 2024-09-16T02:01:58.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.132+0000 7f696551d640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f694c06ed60 0x7f694c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:01:58.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.133+0000 7f696551d640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f694c06ed60 0x7f694c071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f696010eb30 tx=0x7f695400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:01:58.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.136+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f695c07afe0 con 0x7f69600fac60 2024-09-16T02:01:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.294+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6960074c20 con 0x7f69600fac60 2024-09-16T02:01:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.295+0000 7f69527fc640 1 -- 172.21.15.110:0/385086464 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f695c07a980 con 0x7f69600fac60 2024-09-16T02:01:58.297 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-09-16T02:01:58.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f694c06ed60 msgr2=0x7f694c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:58.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f694c06ed60 0x7f694c071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f696010eb30 tx=0x7f695400b040 comp rx=0 tx=0).stop 2024-09-16T02:01:58.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 msgr2=0x7f6960113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:01:58.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 0x7f6960113230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f695c000c00 tx=0x7f695c009da0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 shutdown_connections 2024-09-16T02:01:58.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f694c06ed60 0x7f694c071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69601025f0 0x7f6960113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 --2- 172.21.15.110:0/385086464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69600fac60 0x7f6960113230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:01:58.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 >> 172.21.15.110:0/385086464 conn(0x7f6960070c80 msgr2=0x7f69600f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:01:58.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 shutdown_connections 2024-09-16T02:01:58.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:01:58.297+0000 7f6967f82640 1 -- 172.21.15.110:0/385086464 wait complete. 2024-09-16T02:01:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:58 smithi165 ceph-mon[34621]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:01:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:58 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/385086464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T02:01:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:58 smithi110 ceph-mon[27634]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:01:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:58 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/385086464' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T02:01:59.009 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T02:01:59.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T02:01:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:01:59.633 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:01:59 smithi110 ceph-mon[27634]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:01:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:01:59 smithi165 ceph-mon[34621]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:00.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1727712148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 msgr2=0x7f9b500fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1727712148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b500fad90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9b440048d0 tx=0x7f9b44009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1727712148 shutdown_connections 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1727712148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b500fb2d0 0x7f9b500fdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1727712148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b500fad90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1727712148 >> 172.21.15.110:0/1727712148 conn(0x7f9b500f63a0 msgr2=0x7f9b500f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1727712148 shutdown_connections 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.929+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1727712148 wait complete. 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b56f9a640 1 Processor -- start 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b56f9a640 1 -- start start 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b56f9a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b5010d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:00.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b56f9a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b500fb2d0 0x7f9b5010d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b56f9a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5010dea0 con 0x7f9b500fa980 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b56f9a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5010e670 con 0x7f9b500fb2d0 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b54d36640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b5010d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b54d36640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b5010d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33256/0 (socket says 172.21.15.110:33256) 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b54d36640 1 -- 172.21.15.110:0/1586136336 learned_addr learned my addr 172.21.15.110:0/1586136336 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b4ffff640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b500fb2d0 0x7f9b5010d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b54d36640 1 -- 172.21.15.110:0/1586136336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b500fb2d0 msgr2=0x7f9b5010d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b54d36640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b500fb2d0 0x7f9b5010d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.930+0000 7f9b54d36640 1 -- 172.21.15.110:0/1586136336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44005040 con 0x7f9b500fa980 2024-09-16T02:02:00.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.931+0000 7f9b54d36640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b5010d310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b44003080 tx=0x7f9b44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:00.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.931+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b44038070 con 0x7f9b500fa980 2024-09-16T02:02:00.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.931+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5010e8a0 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.931+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b4402abd0 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.931+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4403e670 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.931+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5010ee40 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.932+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b500fa060 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.932+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9b44030020 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.933+0000 7f9b4d7fa640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9b4006ed60 0x7f9b40071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.933+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9b440ae250 con 0x7f9b500fa980 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.933+0000 7f9b4ffff640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9b4006ed60 0x7f9b40071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:00.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.933+0000 7f9b4ffff640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9b4006ed60 0x7f9b40071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b5010d0c0 tx=0x7f9b3c009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:00.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:00.937+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9b4407b6b0 con 0x7f9b500fa980 2024-09-16T02:02:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.149+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9b5004b720 con 0x7f9b500fa980 2024-09-16T02:02:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.153+0000 7f9b4d7fa640 1 -- 172.21.15.110:0/1586136336 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9b4407b050 con 0x7f9b500fa980 2024-09-16T02:02:01.156 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-09-16T02:02:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCZkedmuQINCRAAjcTjqY3nv1IXBBDZmevfoA== 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9b4006ed60 msgr2=0x7f9b40071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9b4006ed60 0x7f9b40071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b5010d0c0 tx=0x7f9b3c009040 comp rx=0 tx=0).stop 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 msgr2=0x7f9b5010d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b5010d310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b44003080 tx=0x7f9b44009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 shutdown_connections 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9b4006ed60 0x7f9b40071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b500fb2d0 0x7f9b5010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 --2- 172.21.15.110:0/1586136336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b500fa980 0x7f9b5010d310 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.155+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 >> 172.21.15.110:0/1586136336 conn(0x7f9b500f63a0 msgr2=0x7f9b500f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.156+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 shutdown_connections 2024-09-16T02:02:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:01.156+0000 7f9b56f9a640 1 -- 172.21.15.110:0/1586136336 wait complete. 2024-09-16T02:02:01.953 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T02:02:01.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-16T02:02:01.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T02:02:01.993 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T02:02:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:01 smithi165 ceph-mon[34621]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:01 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1586136336' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T02:02:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:01 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1586136336' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T02:02:02.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:01 smithi110 ceph-mon[27634]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:01 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1586136336' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T02:02:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:01 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1586136336' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T02:02:02.254 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi165/config 2024-09-16T02:02:02.917 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:02.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:03.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.653+0000 7fccbf6c3640 1 -- 172.21.15.165:0/1191462295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fc730 msgr2=0x7fccb80fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:03.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.653+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/1191462295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fc730 0x7fccb80fcba0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fccb40048d0 tx=0x7fccb4009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- 172.21.15.165:0/1191462295 shutdown_connections 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/1191462295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fc730 0x7fccb80fcba0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/1191462295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fb460 0x7fccb80fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- 172.21.15.165:0/1191462295 >> 172.21.15.165:0/1191462295 conn(0x7fccb80f6c20 msgr2=0x7fccb80f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- 172.21.15.165:0/1191462295 shutdown_connections 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- 172.21.15.165:0/1191462295 wait complete. 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 Processor -- start 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- start start 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 0x7fccb810f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fc730 0x7fccb810f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:03.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb8110680 con 0x7fccb80fc730 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbf6c3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb81107f0 con 0x7fccb80fb460 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.654+0000 7fccbd45f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 0x7fccb810f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbd45f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 0x7fccb810f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:45592/0 (socket says 172.21.15.165:45592) 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbd45f640 1 -- 172.21.15.165:0/2708346255 learned_addr learned my addr 172.21.15.165:0/2708346255 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbcc5e640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fc730 0x7fccb810f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbd45f640 1 -- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fc730 msgr2=0x7fccb810f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbd45f640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fc730 0x7fccb810f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbd45f640 1 -- 172.21.15.165:0/2708346255 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4005040 con 0x7fccb80fb460 2024-09-16T02:02:03.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbcc5e640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fc730 0x7fccb810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:02:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbd45f640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 0x7fccb810f2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcca800b790 tx=0x7fcca80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca800c700 con 0x7fccb80fb460 2024-09-16T02:02:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcca800cd00 con 0x7fccb80fb460 2024-09-16T02:02:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca8015e70 con 0x7fccb80fb460 2024-09-16T02:02:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.655+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb8110ad0 con 0x7fccb80fb460 2024-09-16T02:02:03.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.656+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb8110fa0 con 0x7fccb80fb460 2024-09-16T02:02:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.656+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb81046f0 con 0x7fccb80fb460 2024-09-16T02:02:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.657+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcca8012070 con 0x7fccb80fb460 2024-09-16T02:02:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.657+0000 7fccadffb640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcca406ed60 0x7fcca4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.657+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcca808d9b0 con 0x7fccb80fb460 2024-09-16T02:02:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.658+0000 7fccbcc5e640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcca406ed60 0x7fcca4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.658+0000 7fccbcc5e640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcca406ed60 0x7fcca4071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fccb400b020 tx=0x7fccb4009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:03.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.661+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcca805ae10 con 0x7fccb80fb460 2024-09-16T02:02:03.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.877+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fccb80fa8c0 con 0x7fccb80fb460 2024-09-16T02:02:03.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.881+0000 7fccadffb640 1 -- 172.21.15.165:0/2708346255 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcca805a7b0 con 0x7fccb80fb460 2024-09-16T02:02:03.883 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2024-09-16T02:02:03.884 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCbkedmEbFrNBAAOj7qscL/t4LwN2othPXXXw== 2024-09-16T02:02:03.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.883+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcca406ed60 msgr2=0x7fcca4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.883+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcca406ed60 0x7fcca4071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fccb400b020 tx=0x7fccb4009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.883+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 msgr2=0x7fccb810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.883+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 0x7fccb810f2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcca800b790 tx=0x7fcca80091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 shutdown_connections 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcca406ed60 0x7fcca4071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccb80fc730 0x7fccb810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 --2- 172.21.15.165:0/2708346255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb80fb460 0x7fccb810f2d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 >> 172.21.15.165:0/2708346255 conn(0x7fccb80f6c20 msgr2=0x7fccb8066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:03.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 shutdown_connections 2024-09-16T02:02:03.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:02:03.884+0000 7fccbf6c3640 1 -- 172.21.15.165:0/2708346255 wait complete. 2024-09-16T02:02:04.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:03 smithi165 ceph-mon[34621]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:04.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:03 smithi110 ceph-mon[27634]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:04.540 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T02:02:04.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-16T02:02:04.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T02:02:04.578 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T02:02:04.578 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T02:02:04.578 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T02:02:04.836 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:04 smithi110 ceph-mon[27634]: from='client.? 172.21.15.165:0/2708346255' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T02:02:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:04 smithi110 ceph-mon[27634]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T02:02:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:04 smithi110 ceph-mon[27634]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T02:02:05.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:04 smithi165 ceph-mon[34621]: from='client.? 172.21.15.165:0/2708346255' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T02:02:05.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:04 smithi165 ceph-mon[34621]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T02:02:05.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:04 smithi165 ceph-mon[34621]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T02:02:06.136 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:05 smithi110 ceph-mon[27634]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:06.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:05 smithi165 ceph-mon[34621]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:06.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 -- 172.21.15.110:0/190901613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 msgr2=0x7f0b380fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:06.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/190901613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b380fe830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009c50 tx=0x7f0b28004d10 comp rx=0 tx=0).stop 2024-09-16T02:02:06.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 -- 172.21.15.110:0/190901613 shutdown_connections 2024-09-16T02:02:06.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/190901613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b38064fc0 0x7f0b38065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/190901613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b380fe830 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 -- 172.21.15.110:0/190901613 >> 172.21.15.110:0/190901613 conn(0x7f0b380723b0 msgr2=0x7f0b380727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 -- 172.21.15.110:0/190901613 shutdown_connections 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.586+0000 7f0b3fce1640 1 -- 172.21.15.110:0/190901613 wait complete. 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3fce1640 1 Processor -- start 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3fce1640 1 -- start start 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3fce1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b38064fc0 0x7f0b38113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3fce1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b38113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3fce1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38113dd0 con 0x7f0b380fe460 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3fce1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3810d180 con 0x7f0b38064fc0 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3d27c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b38113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3d27c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b38113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33280/0 (socket says 172.21.15.110:33280) 2024-09-16T02:02:06.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3d27c640 1 -- 172.21.15.110:0/2535387730 learned_addr learned my addr 172.21.15.110:0/2535387730 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3d27c640 1 -- 172.21.15.110:0/2535387730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b38064fc0 msgr2=0x7f0b38113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3d27c640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b38064fc0 0x7f0b38113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.587+0000 7f0b3d27c640 1 -- 172.21.15.110:0/2535387730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b280098b0 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.588+0000 7f0b3d27c640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b38113740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00b790 tx=0x7f0b2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.588+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b2c00c700 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.588+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3810d460 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.588+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b2c00cd00 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.588+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b2c015e70 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.588+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3810d980 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.589+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b380fdcf0 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.589+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0b2c012070 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.590+0000 7f0b367fc640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0b2006ed60 0x7f0b20071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.590+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0b2c08d9c0 con 0x7f0b380fe460 2024-09-16T02:02:06.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.590+0000 7f0b3da7d640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0b2006ed60 0x7f0b20071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.590+0000 7f0b3da7d640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0b2006ed60 0x7f0b20071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b2802a8b0 tx=0x7f0b28004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:06.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.594+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0b2c05ae20 con 0x7f0b380fe460 2024-09-16T02:02:06.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.791+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0b38072ec0 con 0x7f0b380fe460 2024-09-16T02:02:06.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.793+0000 7f0b367fc640 1 -- 172.21.15.110:0/2535387730 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176722 (secure 0 0 0) 0x7f0b2c05a7c0 con 0x7f0b380fe460 2024-09-16T02:02:06.798 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:02:06.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0b2006ed60 msgr2=0x7f0b20071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:06.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0b2006ed60 0x7f0b20071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b2802a8b0 tx=0x7f0b28004d10 comp rx=0 tx=0).stop 2024-09-16T02:02:06.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 msgr2=0x7f0b38113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b38113740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00b790 tx=0x7f0b2c0091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 shutdown_connections 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0b2006ed60 0x7f0b20071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b380fe460 0x7f0b38113740 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 --2- 172.21.15.110:0/2535387730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b38064fc0 0x7f0b38113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 >> 172.21.15.110:0/2535387730 conn(0x7f0b380723b0 msgr2=0x7f0b38105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 shutdown_connections 2024-09-16T02:02:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:06.796+0000 7f0b3fce1640 1 -- 172.21.15.110:0/2535387730 wait complete. 2024-09-16T02:02:07.149 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:06 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2535387730' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T02:02:07.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:06 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/2535387730' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T02:02:07.528 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":19,"flags":0,"active_gid":14204,"active_name":"smithi110.hfirap","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1015288142},{"type":"v1","addr":"172.21.15.110:6801","nonce":1015288142}]},"active_addr":"172.21.15.110:6801/1015288142","active_change":"2024-09-16T01:58:32.725320+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14224,"name":"smithi165.afwhot","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.110:8443/","prometheus":"http://172.21.15.110:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":4287951481}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1388363081}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1150541288}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3244469834}]}]} 2024-09-16T02:02:07.534 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T02:02:07.534 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T02:02:07.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T02:02:07.777 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:08.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:07 smithi110 ceph-mon[27634]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:08.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:07 smithi165 ceph-mon[34621]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.478+0000 7fe6ccabf640 1 -- 172.21.15.110:0/2223837752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 msgr2=0x7fe6c80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.478+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/2223837752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c80fc5b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0048d0 tx=0x7fe6bc009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 -- 172.21.15.110:0/2223837752 shutdown_connections 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/2223837752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c80fc5b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/2223837752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6c8102550 0x7fe6c8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 -- 172.21.15.110:0/2223837752 >> 172.21.15.110:0/2223837752 conn(0x7fe6c80f80f0 msgr2=0x7fe6c80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 -- 172.21.15.110:0/2223837752 shutdown_connections 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 -- 172.21.15.110:0/2223837752 wait complete. 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 Processor -- start 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.479+0000 7fe6ccabf640 1 -- start start 2024-09-16T02:02:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6ccabf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6c8102550 0x7fe6c81135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6ccabf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c8113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6ccabf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c81141d0 con 0x7fe6c8102ef0 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6ccabf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c810d550 con 0x7fe6c8102550 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c8113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c8113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33292/0 (socket says 172.21.15.110:33292) 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 -- 172.21.15.110:0/1713219194 learned_addr learned my addr 172.21.15.110:0/1713219194 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c659c640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6c8102550 0x7fe6c81135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 -- 172.21.15.110:0/1713219194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6c8102550 msgr2=0x7fe6c81135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6c8102550 0x7fe6c81135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 -- 172.21.15.110:0/1713219194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc005040 con 0x7fe6c8102ef0 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6c5d9b640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c8113af0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc003080 tx=0x7fe6bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:09.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6bc038070 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c810d780 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6bc009760 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6bc033420 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.480+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c810dbe0 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.481+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c80fdcd0 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.482+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe6bc030020 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.482+0000 7fe6b6ffd640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe6b006ed60 0x7fe6b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.482+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe6bc0adb00 con 0x7fe6c8102ef0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.482+0000 7fe6c659c640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe6b006ed60 0x7fe6b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.483+0000 7fe6c659c640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe6b006ed60 0x7fe6b0071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8007580 tx=0x7fe6b8009780 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.486+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe6bc07af60 con 0x7fe6c8102ef0 2024-09-16T02:02:09.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.648+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6c8109670 con 0x7fe6c8102ef0 2024-09-16T02:02:09.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.649+0000 7fe6b6ffd640 1 -- 172.21.15.110:0/1713219194 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11139 (secure 0 0 0) 0x7fe6bc07a900 con 0x7fe6c8102ef0 2024-09-16T02:02:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:02:09.652 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":39,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","created":"2024-09-16T01:56:36.667290+0000","modified":"2024-09-16T02:01:53.539984+0000","last_up_change":"2024-09-16T02:01:52.532481+0000","last_in_change":"2024-09-16T02:01:34.619366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T02:00:43.037209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"13903880-eaf7-4a3b-b289-e2c35e89eeb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6803","nonce":3391846421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6805","nonce":3391846421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6809","nonce":3391846421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6807","nonce":3391846421}]},"public_addr":"172.21.15.110:6803/3391846421","cluster_addr":"172.21.15.110:6805/3391846421","heartbeat_back_addr":"172.21.15.110:6809/3391846421","heartbeat_front_addr":"172.21.15.110:6807/3391846421","state":["exists","up"]},{"osd":1,"uuid":"175d7810-d02d-47ed-ac31-e85cab907936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6811","nonce":4105339787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6813","nonce":4105339787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6817","nonce":4105339787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6815","nonce":4105339787}]},"public_addr":"172.21.15.110:6811/4105339787","cluster_addr":"172.21.15.110:6813/4105339787","heartbeat_back_addr":"172.21.15.110:6817/4105339787","heartbeat_front_addr":"172.21.15.110:6815/4105339787","state":["exists","up"]},{"osd":2,"uuid":"0afb738b-850a-45bb-88db-28fcfce812a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6819","nonce":2035538238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6821","nonce":2035538238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6825","nonce":2035538238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6823","nonce":2035538238}]},"public_addr":"172.21.15.110:6819/2035538238","cluster_addr":"172.21.15.110:6821/2035538238","heartbeat_back_addr":"172.21.15.110:6825/2035538238","heartbeat_front_addr":"172.21.15.110:6823/2035538238","state":["exists","up"]},{"osd":3,"uuid":"da2285ab-b31a-4184-92f4-9c09372bf5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6801","nonce":4062357428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6803","nonce":4062357428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6807","nonce":4062357428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6805","nonce":4062357428}]},"public_addr":"172.21.15.165:6801/4062357428","cluster_addr":"172.21.15.165:6803/4062357428","heartbeat_back_addr":"172.21.15.165:6807/4062357428","heartbeat_front_addr":"172.21.15.165:6805/4062357428","state":["exists","up"]},{"osd":4,"uuid":"5984349f-312a-4420-acde-49ffad3292a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6809","nonce":1452301669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6811","nonce":1452301669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6815","nonce":1452301669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6813","nonce":1452301669}]},"public_addr":"172.21.15.165:6809/1452301669","cluster_addr":"172.21.15.165:6811/1452301669","heartbeat_back_addr":"172.21.15.165:6815/1452301669","heartbeat_front_addr":"172.21.15.165:6813/1452301669","state":["exists","up"]},{"osd":5,"uuid":"4fec096e-c71e-45b3-a55f-ab0b854dc250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6817","nonce":2669879117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6819","nonce":2669879117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6823","nonce":2669879117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6821","nonce":2669879117}]},"public_addr":"172.21.15.165:6817/2669879117","cluster_addr":"172.21.15.165:6819/2669879117","heartbeat_back_addr":"172.21.15.165:6823/2669879117","heartbeat_front_addr":"172.21.15.165:6821/2669879117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:59:44.914569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:00:11.234050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:00:39.476885+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:02.223270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:25.973956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:51.298536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/728530367":"2024-09-17T01:58:32.725210+0000","172.21.15.110:0/2684868236":"2024-09-17T01:58:32.725210+0000","172.21.15.110:0/44402193":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/1760065388":"2024-09-17T01:57:33.044545+0000","172.21.15.110:0/1315429218":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/350261868":"2024-09-17T01:58:32.725210+0000","172.21.15.110:6800/750341792":"2024-09-17T01:57:04.101594+0000","172.21.15.110:6801/750341792":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/507819561":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6801/2073782143":"2024-09-17T01:58:32.725210+0000","172.21.15.110:6800/3914114363":"2024-09-17T01:57:33.044545+0000","172.21.15.110:0/841598639":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/519121796":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6801/3914114363":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6800/2073782143":"2024-09-17T01:58:32.725210+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T02:02:09.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe6b006ed60 msgr2=0x7fe6b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:09.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe6b006ed60 0x7fe6b0071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8007580 tx=0x7fe6b8009780 comp rx=0 tx=0).stop 2024-09-16T02:02:09.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 msgr2=0x7fe6c8113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c8113af0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc003080 tx=0x7fe6bc009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 shutdown_connections 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe6b006ed60 0x7fe6b0071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6c8102ef0 0x7fe6c8113af0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 --2- 172.21.15.110:0/1713219194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6c8102550 0x7fe6c81135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 >> 172.21.15.110:0/1713219194 conn(0x7fe6c80f80f0 msgr2=0x7fe6c80f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 shutdown_connections 2024-09-16T02:02:09.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:09.651+0000 7fe6ccabf640 1 -- 172.21.15.110:0/1713219194 wait complete. 2024-09-16T02:02:10.197 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:09 smithi110 ceph-mon[27634]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:10.197 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:09 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1713219194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T02:02:10.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:09 smithi165 ceph-mon[34621]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:10.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:09 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1713219194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T02:02:10.328 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T02:02:10.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T02:02:10.571 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 -- 172.21.15.110:0/1521673618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804064fc0 msgr2=0x7f8804065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 --2- 172.21.15.110:0/1521673618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804064fc0 0x7f8804065430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0048d0 tx=0x7f87ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 -- 172.21.15.110:0/1521673618 shutdown_connections 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 --2- 172.21.15.110:0/1521673618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8804064fc0 0x7f8804065430 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 --2- 172.21.15.110:0/1521673618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fe460 0x7f88040fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 -- 172.21.15.110:0/1521673618 >> 172.21.15.110:0/1521673618 conn(0x7f88040723b0 msgr2=0x7f88040727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 -- 172.21.15.110:0/1521673618 shutdown_connections 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 -- 172.21.15.110:0/1521673618 wait complete. 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 Processor -- start 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.069+0000 7f88093a9640 1 -- start start 2024-09-16T02:02:12.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88093a9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8804064fc0 0x7f8804113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88093a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 0x7f8804113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88093a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804113e00 con 0x7f88040fe460 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88093a9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880410d1b0 con 0x7f8804064fc0 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 0x7f8804113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 0x7f8804113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35878/0 (socket says 172.21.15.110:35878) 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 -- 172.21.15.110:0/1918478727 learned_addr learned my addr 172.21.15.110:0/1918478727 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 -- 172.21.15.110:0/1918478727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8804064fc0 msgr2=0x7f8804113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f8802ffd640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8804064fc0 0x7f8804113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8804064fc0 0x7f8804113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 -- 172.21.15.110:0/1918478727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec005040 con 0x7f88040fe460 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f8802ffd640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8804064fc0 0x7f8804113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:02:12.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f88027fc640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 0x7f8804113770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f87ec003080 tx=0x7f87ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.070+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ec038070 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.071+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880410d430 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.071+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87ec0097e0 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.071+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ec03d420 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.071+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880410d8f0 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.071+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040fdcf0 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.072+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f87ec030020 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.072+0000 7f87fb7fe640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f87f006ed60 0x7f87f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.072+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f87ec0ae470 con 0x7f88040fe460 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.072+0000 7f8802ffd640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f87f006ed60 0x7f87f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.073+0000 7f8802ffd640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f87f006ed60 0x7f87f0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87f4007fd0 tx=0x7f87f40074f0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:12.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.076+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f87ec07b8d0 con 0x7f88040fe460 2024-09-16T02:02:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:11 smithi165 ceph-mon[34621]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:12.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:11 smithi110 ceph-mon[27634]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:12.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.234+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8804072ec0 con 0x7f88040fe460 2024-09-16T02:02:12.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.234+0000 7f87fb7fe640 1 -- 172.21.15.110:0/1918478727 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11139 (secure 0 0 0) 0x7f87ec07b270 con 0x7f88040fe460 2024-09-16T02:02:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:02:12.237 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":39,"fsid":"c3aa8d62-73ce-11ef-bceb-c7b262605968","created":"2024-09-16T01:56:36.667290+0000","modified":"2024-09-16T02:01:53.539984+0000","last_up_change":"2024-09-16T02:01:52.532481+0000","last_in_change":"2024-09-16T02:01:34.619366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T02:00:43.037209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"13903880-eaf7-4a3b-b289-e2c35e89eeb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6803","nonce":3391846421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6805","nonce":3391846421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6809","nonce":3391846421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3391846421},{"type":"v1","addr":"172.21.15.110:6807","nonce":3391846421}]},"public_addr":"172.21.15.110:6803/3391846421","cluster_addr":"172.21.15.110:6805/3391846421","heartbeat_back_addr":"172.21.15.110:6809/3391846421","heartbeat_front_addr":"172.21.15.110:6807/3391846421","state":["exists","up"]},{"osd":1,"uuid":"175d7810-d02d-47ed-ac31-e85cab907936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6811","nonce":4105339787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6813","nonce":4105339787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6817","nonce":4105339787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4105339787},{"type":"v1","addr":"172.21.15.110:6815","nonce":4105339787}]},"public_addr":"172.21.15.110:6811/4105339787","cluster_addr":"172.21.15.110:6813/4105339787","heartbeat_back_addr":"172.21.15.110:6817/4105339787","heartbeat_front_addr":"172.21.15.110:6815/4105339787","state":["exists","up"]},{"osd":2,"uuid":"0afb738b-850a-45bb-88db-28fcfce812a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6819","nonce":2035538238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6821","nonce":2035538238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6825","nonce":2035538238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2035538238},{"type":"v1","addr":"172.21.15.110:6823","nonce":2035538238}]},"public_addr":"172.21.15.110:6819/2035538238","cluster_addr":"172.21.15.110:6821/2035538238","heartbeat_back_addr":"172.21.15.110:6825/2035538238","heartbeat_front_addr":"172.21.15.110:6823/2035538238","state":["exists","up"]},{"osd":3,"uuid":"da2285ab-b31a-4184-92f4-9c09372bf5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6801","nonce":4062357428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6803","nonce":4062357428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6807","nonce":4062357428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":4062357428},{"type":"v1","addr":"172.21.15.165:6805","nonce":4062357428}]},"public_addr":"172.21.15.165:6801/4062357428","cluster_addr":"172.21.15.165:6803/4062357428","heartbeat_back_addr":"172.21.15.165:6807/4062357428","heartbeat_front_addr":"172.21.15.165:6805/4062357428","state":["exists","up"]},{"osd":4,"uuid":"5984349f-312a-4420-acde-49ffad3292a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6809","nonce":1452301669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6811","nonce":1452301669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6815","nonce":1452301669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1452301669},{"type":"v1","addr":"172.21.15.165:6813","nonce":1452301669}]},"public_addr":"172.21.15.165:6809/1452301669","cluster_addr":"172.21.15.165:6811/1452301669","heartbeat_back_addr":"172.21.15.165:6815/1452301669","heartbeat_front_addr":"172.21.15.165:6813/1452301669","state":["exists","up"]},{"osd":5,"uuid":"4fec096e-c71e-45b3-a55f-ab0b854dc250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6817","nonce":2669879117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6819","nonce":2669879117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6823","nonce":2669879117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2669879117},{"type":"v1","addr":"172.21.15.165:6821","nonce":2669879117}]},"public_addr":"172.21.15.165:6817/2669879117","cluster_addr":"172.21.15.165:6819/2669879117","heartbeat_back_addr":"172.21.15.165:6823/2669879117","heartbeat_front_addr":"172.21.15.165:6821/2669879117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:59:44.914569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:00:11.234050+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:00:39.476885+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:02.223270+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:25.973956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T02:01:51.298536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/728530367":"2024-09-17T01:58:32.725210+0000","172.21.15.110:0/2684868236":"2024-09-17T01:58:32.725210+0000","172.21.15.110:0/44402193":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/1760065388":"2024-09-17T01:57:33.044545+0000","172.21.15.110:0/1315429218":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/350261868":"2024-09-17T01:58:32.725210+0000","172.21.15.110:6800/750341792":"2024-09-17T01:57:04.101594+0000","172.21.15.110:6801/750341792":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/507819561":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6801/2073782143":"2024-09-17T01:58:32.725210+0000","172.21.15.110:6800/3914114363":"2024-09-17T01:57:33.044545+0000","172.21.15.110:0/841598639":"2024-09-17T01:57:04.101594+0000","172.21.15.110:0/519121796":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6801/3914114363":"2024-09-17T01:57:33.044545+0000","172.21.15.110:6800/2073782143":"2024-09-17T01:58:32.725210+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f87f006ed60 msgr2=0x7f87f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f87f006ed60 0x7f87f0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87f4007fd0 tx=0x7f87f40074f0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 msgr2=0x7f8804113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 0x7f8804113770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f87ec003080 tx=0x7f87ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 shutdown_connections 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f87f006ed60 0x7f87f0071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fe460 0x7f8804113770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 --2- 172.21.15.110:0/1918478727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8804064fc0 0x7f8804113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.236+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 >> 172.21.15.110:0/1918478727 conn(0x7f88040723b0 msgr2=0x7f8804105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.237+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 shutdown_connections 2024-09-16T02:02:12.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:12.237+0000 7f88093a9640 1 -- 172.21.15.110:0/1918478727 wait complete. 2024-09-16T02:02:12.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T02:02:12.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T02:02:12.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T02:02:12.893 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-16T02:02:12.893 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-16T02:02:12.894 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-16T02:02:13.190 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:13.192 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:13.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:12 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1918478727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T02:02:13.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:12 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1918478727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T02:02:14.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:13 smithi165 ceph-mon[34621]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:14.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:13 smithi110 ceph-mon[27634]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:15.937 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:15 smithi110 ceph-mon[27634]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 -- 172.21.15.110:0/614097562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101480 msgr2=0x7fcfa8101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 --2- 172.21.15.110:0/614097562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101480 0x7fcfa8101850 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00048d0 tx=0x7fcfa0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 -- 172.21.15.110:0/614097562 shutdown_connections 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 --2- 172.21.15.110:0/614097562 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa8101e20 0x7fcfa80fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 --2- 172.21.15.110:0/614097562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101480 0x7fcfa8101850 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 -- 172.21.15.110:0/614097562 >> 172.21.15.110:0/614097562 conn(0x7fcfa8070c80 msgr2=0x7fcfa8071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 -- 172.21.15.110:0/614097562 shutdown_connections 2024-09-16T02:02:16.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 -- 172.21.15.110:0/614097562 wait complete. 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 Processor -- start 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.105+0000 7fcfaf205640 1 -- start start 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfaf205640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa8101480 0x7fcfa8111010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfaf205640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 0x7fcfa8111550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfaf205640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8111b50 con 0x7fcfa8101e20 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfaf205640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa810af90 con 0x7fcfa8101480 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 0x7fcfa8111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 0x7fcfa8111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35896/0 (socket says 172.21.15.110:35896) 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 -- 172.21.15.110:0/893713521 learned_addr learned my addr 172.21.15.110:0/893713521 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfacfa1640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa8101480 0x7fcfa8111010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 -- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa8101480 msgr2=0x7fcfa8111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa8101480 0x7fcfa8111010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 -- 172.21.15.110:0/893713521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0005040 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.106+0000 7fcfa7fff640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 0x7fcfa8111550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800cb10 tx=0x7fcf98007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.107+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf98004200 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.107+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf9800ac40 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.107+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa810b270 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.107+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf98003be0 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.107+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa810b810 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.107+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfa810bda0 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.108+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcf9800a7a0 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfa57fa640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcf94070f60 0x7fcf94073410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcf9808e300 con 0x7fcfa8101e20 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfacfa1640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcf94070f60 0x7fcf94073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:16.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfa57fa640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] conn(0x7fcf94076ce0 0x7fcf940790f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 --> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf940797a0 con 0x7fcf94076ce0 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf980908f0 con 0x7fcfa8101e20 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfacfa1640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcf94070f60 0x7fcf94073410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0003080 tx=0x7fcfa0009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.109+0000 7fcfad7a2640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] conn(0x7fcf94076ce0 0x7fcf940790f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.110+0000 7fcfad7a2640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] conn(0x7fcf94076ce0 0x7fcf940790f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.110+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== osd.5 v2:172.21.15.165:6816/2669879117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcf940797a0 con 0x7fcf94076ce0 2024-09-16T02:02:16.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.122+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 --> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfa81009a0 con 0x7fcf94076ce0 2024-09-16T02:02:16.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfa57fa640 1 -- 172.21.15.110:0/893713521 <== osd.5 v2:172.21.15.165:6816/2669879117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcfa81009a0 con 0x7fcf94076ce0 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] conn(0x7fcf94076ce0 msgr2=0x7fcf940790f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] conn(0x7fcf94076ce0 0x7fcf940790f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcf94070f60 msgr2=0x7fcf94073410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcf94070f60 0x7fcf94073410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0003080 tx=0x7fcfa0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 msgr2=0x7fcfa8111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.123+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 0x7fcfa8111550 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800cb10 tx=0x7fcf98007e80 comp rx=0 tx=0).stop 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 shutdown_connections 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:6816/2669879117,v1:172.21.15.165:6817/2669879117] conn(0x7fcf94076ce0 0x7fcf940790f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fcf94070f60 0x7fcf94073410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa8101e20 0x7fcfa8111550 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 --2- 172.21.15.110:0/893713521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa8101480 0x7fcfa8111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:16.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 >> 172.21.15.110:0/893713521 conn(0x7fcfa8070c80 msgr2=0x7fcfa80ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:16.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 shutdown_connections 2024-09-16T02:02:16.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:16.124+0000 7fcfaf205640 1 -- 172.21.15.110:0/893713521 wait complete. 2024-09-16T02:02:16.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:15 smithi165 ceph-mon[34621]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4069737691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102570 msgr2=0x7f9d28102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4069737691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102570 0x7f9d28102940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d180048d0 tx=0x7f9d18009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4069737691 shutdown_connections 2024-09-16T02:02:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4069737691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d28102f10 0x7f9d280fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4069737691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102570 0x7f9d28102940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4069737691 >> 172.21.15.110:0/4069737691 conn(0x7f9d28070ce0 msgr2=0x7f9d280710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4069737691 shutdown_connections 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4069737691 wait complete. 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.161+0000 7f9d2d9c0640 1 Processor -- start 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d2d9c0640 1 -- start start 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d2d9c0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d28102570 0x7f9d28113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d2d9c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 0x7f9d281137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d2d9c0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28113e60 con 0x7f9d28102f10 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d2d9c0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2810d210 con 0x7f9d28102570 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 0x7f9d281137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:17.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 0x7f9d281137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35914/0 (socket says 172.21.15.110:35914) 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 -- 172.21.15.110:0/4178288144 learned_addr learned my addr 172.21.15.110:0/4178288144 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 -- 172.21.15.110:0/4178288144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d28102570 msgr2=0x7f9d28113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d26ffd640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d28102570 0x7f9d28113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d28102570 0x7f9d28113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 -- 172.21.15.110:0/4178288144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18005040 con 0x7f9d28102f10 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.162+0000 7f9d267fc640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 0x7f9d281137d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b540 tx=0x7f9d100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.163+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1000f6f0 con 0x7f9d28102f10 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.163+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d1000fcf0 con 0x7f9d28102f10 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.163+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2810d4f0 con 0x7f9d28102f10 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.163+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d100103a0 con 0x7f9d28102f10 2024-09-16T02:02:17.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.163+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2810da10 con 0x7f9d28102f10 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.163+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d2810df50 con 0x7f9d28102f10 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.164+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9d1000f850 con 0x7f9d28102f10 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d1f7fe640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9d1406ed60 0x7f9d14071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d26ffd640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9d1406ed60 0x7f9d14071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9d1008e840 con 0x7f9d28102f10 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d1f7fe640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] conn(0x7f9d14074ae0 0x7f9d14076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 --> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d140775a0 con 0x7f9d14074ae0 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d1008ec20 con 0x7f9d28102f10 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d277fe640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] conn(0x7f9d14074ae0 0x7f9d14076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:17.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d26ffd640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9d1406ed60 0x7f9d14071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d180043d0 tx=0x7f9d18009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:17.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.165+0000 7f9d277fe640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] conn(0x7f9d14074ae0 0x7f9d14076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:17.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.166+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== osd.0 v2:172.21.15.110:6802/3391846421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9d140775a0 con 0x7f9d14074ae0 2024-09-16T02:02:17.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.178+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 --> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d28106cd0 con 0x7f9d14074ae0 2024-09-16T02:02:17.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.178+0000 7f9d1f7fe640 1 -- 172.21.15.110:0/4178288144 <== osd.0 v2:172.21.15.110:6802/3391846421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d28106cd0 con 0x7f9d14074ae0 2024-09-16T02:02:17.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] conn(0x7f9d14074ae0 msgr2=0x7f9d14076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:17.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] conn(0x7f9d14074ae0 0x7f9d14076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9d1406ed60 msgr2=0x7f9d14071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9d1406ed60 0x7f9d14071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d180043d0 tx=0x7f9d18009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 msgr2=0x7f9d281137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 0x7f9d281137d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b540 tx=0x7f9d100091a0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 shutdown_connections 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6802/3391846421,v1:172.21.15.110:6803/3391846421] conn(0x7f9d14074ae0 0x7f9d14076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9d1406ed60 0x7f9d14071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d28102f10 0x7f9d281137d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 --2- 172.21.15.110:0/4178288144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d28102570 0x7f9d28113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 >> 172.21.15.110:0/4178288144 conn(0x7f9d28070ce0 msgr2=0x7f9d28105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:17.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 shutdown_connections 2024-09-16T02:02:17.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:17.179+0000 7f9d2d9c0640 1 -- 172.21.15.110:0/4178288144 wait complete. 2024-09-16T02:02:17.806 INFO:teuthology.orchestra.run.smithi110.stdout:38654705696 2024-09-16T02:02:17.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T02:02:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:17 smithi165 ceph-mon[34621]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:17 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:18.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:17 smithi110 ceph-mon[27634]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:17 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:18.529 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:18.973 INFO:teuthology.orchestra.run.smithi110.stdout:163208757256 2024-09-16T02:02:18.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-16T02:02:20.113 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:19 smithi110 ceph-mon[27634]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:20.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:19 smithi165 ceph-mon[34621]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 -- 172.21.15.110:0/1388413096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102ef0 msgr2=0x7fc3000fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 --2- 172.21.15.110:0/1388413096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102ef0 0x7fc3000fc5b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80048d0 tx=0x7fc2e8009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 -- 172.21.15.110:0/1388413096 shutdown_connections 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 --2- 172.21.15.110:0/1388413096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102ef0 0x7fc3000fc5b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 --2- 172.21.15.110:0/1388413096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300102550 0x7fc300102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 -- 172.21.15.110:0/1388413096 >> 172.21.15.110:0/1388413096 conn(0x7fc3000f80f0 msgr2=0x7fc3000fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 -- 172.21.15.110:0/1388413096 shutdown_connections 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.085+0000 7fc3053c7640 1 -- 172.21.15.110:0/1388413096 wait complete. 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc3053c7640 1 Processor -- start 2024-09-16T02:02:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc3053c7640 1 -- start start 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc3053c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 0x7fc30006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc3053c7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300102ef0 0x7fc30006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc3053c7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300070520 con 0x7fc300102550 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc3053c7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300070690 con 0x7fc300102ef0 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc2feffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 0x7fc30006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc2feffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 0x7fc30006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46156/0 (socket says 172.21.15.110:46156) 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc2feffd640 1 -- 172.21.15.110:0/353065838 learned_addr learned my addr 172.21.15.110:0/353065838 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc2feffd640 1 -- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300102ef0 msgr2=0x7fc30006ff50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc2feffd640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300102ef0 0x7fc30006ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.086+0000 7fc2feffd640 1 -- 172.21.15.110:0/353065838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8005040 con 0x7fc300102550 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.087+0000 7fc2feffd640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 0x7fc30006fa10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000b790 tx=0x7fc2f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.087+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f000c700 con 0x7fc300102550 2024-09-16T02:02:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.087+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc2f000cd00 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.087+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3001198d0 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.087+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f0015e70 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.087+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc300119d10 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.088+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3000fdcd0 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.088+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc2f0012070 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f77fe640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc2ec06ed60 0x7fc2ec071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc2f008d930 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f7fff640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc2ec06ed60 0x7fc2ec071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f77fe640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] conn(0x7fc2ec074ae0 0x7fc2ec076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 --> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2ec0775a0 con 0x7fc2ec074ae0 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2f0092220 con 0x7fc300102550 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.089+0000 7fc2f7fff640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc2ec06ed60 0x7fc2ec071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000c00 tx=0x7fc2e8009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.090+0000 7fc2ff7fe640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] conn(0x7fc2ec074ae0 0x7fc2ec076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.090+0000 7fc2ff7fe640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] conn(0x7fc2ec074ae0 0x7fc2ec076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.091+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== osd.3 v2:172.21.15.165:6800/4062357428 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc2ec0775a0 con 0x7fc2ec074ae0 2024-09-16T02:02:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.103+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 --> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3000fbd50 con 0x7fc2ec074ae0 2024-09-16T02:02:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.104+0000 7fc2f77fe640 1 -- 172.21.15.110:0/353065838 <== osd.3 v2:172.21.15.165:6800/4062357428 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc3000fbd50 con 0x7fc2ec074ae0 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] conn(0x7fc2ec074ae0 msgr2=0x7fc2ec076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] conn(0x7fc2ec074ae0 0x7fc2ec076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc2ec06ed60 msgr2=0x7fc2ec071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc2ec06ed60 0x7fc2ec071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000c00 tx=0x7fc2e8009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 msgr2=0x7fc30006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 0x7fc30006fa10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000b790 tx=0x7fc2f00091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 shutdown_connections 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:6800/4062357428,v1:172.21.15.165:6801/4062357428] conn(0x7fc2ec074ae0 0x7fc2ec076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc2ec06ed60 0x7fc2ec071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300102ef0 0x7fc30006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 --2- 172.21.15.110:0/353065838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc300102550 0x7fc30006fa10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 >> 172.21.15.110:0/353065838 conn(0x7fc3000f80f0 msgr2=0x7fc3000f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 shutdown_connections 2024-09-16T02:02:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:21.105+0000 7fc3053c7640 1 -- 172.21.15.110:0/353065838 wait complete. 2024-09-16T02:02:22.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:21 smithi165 ceph-mon[34621]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:22.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:21 smithi110 ceph-mon[27634]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:23.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 -- 172.21.15.110:0/1134889354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 msgr2=0x7f41dc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:23.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 --2- 172.21.15.110:0/1134889354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc0fc5b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0048d0 tx=0x7f41cc009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 -- 172.21.15.110:0/1134889354 shutdown_connections 2024-09-16T02:02:23.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 --2- 172.21.15.110:0/1134889354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc0fc5b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 --2- 172.21.15.110:0/1134889354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41dc102550 0x7f41dc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 -- 172.21.15.110:0/1134889354 >> 172.21.15.110:0/1134889354 conn(0x7f41dc0f80f0 msgr2=0x7f41dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 -- 172.21.15.110:0/1134889354 shutdown_connections 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.082+0000 7f41e4742640 1 -- 172.21.15.110:0/1134889354 wait complete. 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e4742640 1 Processor -- start 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e4742640 1 -- start start 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e4742640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41dc102550 0x7f41dc113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e4742640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e4742640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc1140b0 con 0x7f41dc102ef0 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e4742640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc10d4c0 con 0x7f41dc102550 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e1cdd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:23.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e1cdd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46178/0 (socket says 172.21.15.110:46178) 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e1cdd640 1 -- 172.21.15.110:0/3610853188 learned_addr learned my addr 172.21.15.110:0/3610853188 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e24de640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41dc102550 0x7f41dc113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e1cdd640 1 -- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41dc102550 msgr2=0x7f41dc113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e1cdd640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41dc102550 0x7f41dc113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.083+0000 7f41e1cdd640 1 -- 172.21.15.110:0/3610853188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc005040 con 0x7f41dc102ef0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.084+0000 7f41e1cdd640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc113a60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f41cc02a530 tx=0x7f41cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.084+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41cc038070 con 0x7f41dc102ef0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.084+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f41cc02ade0 con 0x7f41dc102ef0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.084+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc10d740 con 0x7f41dc102ef0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.084+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41cc02c7a0 con 0x7f41dc102ef0 2024-09-16T02:02:23.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.084+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc10dc80 con 0x7f41dc102ef0 2024-09-16T02:02:23.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.085+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41dc0fdcd0 con 0x7f41dc102ef0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.085+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f41cc030020 con 0x7f41dc102ef0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41d2ffd640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f41c806ed60 0x7f41c8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f41cc0ae660 con 0x7f41dc102ef0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41e24de640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f41c806ed60 0x7f41c8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41d2ffd640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] conn(0x7f41c8074ae0 0x7f41c8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 --> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41c80775a0 con 0x7f41c8074ae0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41cc0aea40 con 0x7f41dc102ef0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41e24de640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f41c806ed60 0x7f41c8071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41d8004a70 tx=0x7f41d800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.086+0000 7f41e2cdf640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] conn(0x7f41c8074ae0 0x7f41c8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.087+0000 7f41e2cdf640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] conn(0x7f41c8074ae0 0x7f41c8076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:23.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.088+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== osd.4 v2:172.21.15.165:6808/1452301669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f41c80775a0 con 0x7f41c8074ae0 2024-09-16T02:02:23.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.100+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 --> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41dc10e160 con 0x7f41c8074ae0 2024-09-16T02:02:23.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.100+0000 7f41d2ffd640 1 -- 172.21.15.110:0/3610853188 <== osd.4 v2:172.21.15.165:6808/1452301669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f41dc10e160 con 0x7f41c8074ae0 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.100+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] conn(0x7f41c8074ae0 msgr2=0x7f41c8076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.100+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] conn(0x7f41c8074ae0 0x7f41c8076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f41c806ed60 msgr2=0x7f41c8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f41c806ed60 0x7f41c8071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41d8004a70 tx=0x7f41d800b040 comp rx=0 tx=0).stop 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 msgr2=0x7f41dc113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc113a60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f41cc02a530 tx=0x7f41cc009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 shutdown_connections 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:6808/1452301669,v1:172.21.15.165:6809/1452301669] conn(0x7f41c8074ae0 0x7f41c8076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f41c806ed60 0x7f41c8071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41dc102ef0 0x7f41dc113a60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 --2- 172.21.15.110:0/3610853188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41dc102550 0x7f41dc113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 >> 172.21.15.110:0/3610853188 conn(0x7f41dc0f80f0 msgr2=0x7f41dc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 shutdown_connections 2024-09-16T02:02:23.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.101+0000 7f41e4742640 1 -- 172.21.15.110:0/3610853188 wait complete. 2024-09-16T02:02:23.935 INFO:teuthology.orchestra.run.smithi110.stdout:141733920782 2024-09-16T02:02:23.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 -- 172.21.15.110:0/3249728998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fcf80 msgr2=0x7f61280fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 --2- 172.21.15.110:0/3249728998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fcf80 0x7f61280fd3d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f61180048d0 tx=0x7f6118009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 -- 172.21.15.110:0/3249728998 shutdown_connections 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 --2- 172.21.15.110:0/3249728998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fcf80 0x7f61280fd3d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 --2- 172.21.15.110:0/3249728998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61280fb810 0x7f61280fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 -- 172.21.15.110:0/3249728998 >> 172.21.15.110:0/3249728998 conn(0x7f61280723b0 msgr2=0x7f61280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 -- 172.21.15.110:0/3249728998 shutdown_connections 2024-09-16T02:02:24.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.495+0000 7f612d1a3640 1 -- 172.21.15.110:0/3249728998 wait complete. 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612d1a3640 1 Processor -- start 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612d1a3640 1 -- start start 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612d1a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 0x7f61281120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612d1a3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61280fcf80 0x7f6128112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612d1a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128112c10 con 0x7f61280fb810 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612d1a3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612810c050 con 0x7f61280fcf80 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f6126d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 0x7f61281120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f6126d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 0x7f61281120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46206/0 (socket says 172.21.15.110:46206) 2024-09-16T02:02:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f6126d9d640 1 -- 172.21.15.110:0/1053657143 learned_addr learned my addr 172.21.15.110:0/1053657143 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f612659c640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61280fcf80 0x7f6128112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f6126d9d640 1 -- 172.21.15.110:0/1053657143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61280fcf80 msgr2=0x7f6128112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f6126d9d640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61280fcf80 0x7f6128112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.496+0000 7f6126d9d640 1 -- 172.21.15.110:0/1053657143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118005040 con 0x7f61280fb810 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.497+0000 7f6126d9d640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 0x7f61281120d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f611000eb70 tx=0x7f611000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.497+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6110007c30 con 0x7f61280fb810 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.497+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612810c2d0 con 0x7f61280fb810 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.497+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f611000f040 con 0x7f61280fb810 2024-09-16T02:02:24.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.497+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61100094e0 con 0x7f61280fb810 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.497+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612810c840 con 0x7f61280fb810 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.498+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f612810cd70 con 0x7f61280fb810 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.498+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6110009640 con 0x7f61280fb810 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f611f7fe640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f611406ed60 0x7f6114071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f612659c640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f611406ed60 0x7f6114071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f611008db70 con 0x7f61280fb810 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f611f7fe640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] conn(0x7f6114074ae0 0x7f6114076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 --> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61140775a0 con 0x7f6114074ae0 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6110092220 con 0x7f61280fb810 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f612759e640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] conn(0x7f6114074ae0 0x7f6114076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f612659c640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f611406ed60 0x7f6114071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61280fe4b0 tx=0x7f6118035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:24.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.499+0000 7f612759e640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] conn(0x7f6114074ae0 0x7f6114076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.500+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== osd.2 v2:172.21.15.110:6818/2035538238 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f61140775a0 con 0x7f6114074ae0 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.512+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 --> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f612810cee0 con 0x7f6114074ae0 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f611f7fe640 1 -- 172.21.15.110:0/1053657143 <== osd.2 v2:172.21.15.110:6818/2035538238 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f612000ae50 con 0x7f6114074ae0 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] conn(0x7f6114074ae0 msgr2=0x7f6114076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] conn(0x7f6114074ae0 0x7f6114076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f611406ed60 msgr2=0x7f6114071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f611406ed60 0x7f6114071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61280fe4b0 tx=0x7f6118035040 comp rx=0 tx=0).stop 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 msgr2=0x7f61281120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 0x7f61281120d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f611000eb70 tx=0x7f611000b040 comp rx=0 tx=0).stop 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 shutdown_connections 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6818/2035538238,v1:172.21.15.110:6819/2035538238] conn(0x7f6114074ae0 0x7f6114076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f611406ed60 0x7f6114071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61280fcf80 0x7f6128112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 --2- 172.21.15.110:0/1053657143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280fb810 0x7f61281120d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:24.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 >> 172.21.15.110:0/1053657143 conn(0x7f61280723b0 msgr2=0x7f61280fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:24.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 shutdown_connections 2024-09-16T02:02:24.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:23.513+0000 7f612d1a3640 1 -- 172.21.15.110:0/1053657143 wait complete. 2024-09-16T02:02:24.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:23 smithi165 ceph-mon[34621]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:24.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:23 smithi110 ceph-mon[27634]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:25.125 INFO:teuthology.orchestra.run.smithi110.stdout:81604378648 2024-09-16T02:02:25.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T02:02:25.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 -- 172.21.15.110:0/667769762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 msgr2=0x7f2ba40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:25.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/667769762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba40fc5b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0048d0 tx=0x7f2b8c009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 -- 172.21.15.110:0/667769762 shutdown_connections 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/667769762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba40fc5b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/667769762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ba4102550 0x7f2ba4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 -- 172.21.15.110:0/667769762 >> 172.21.15.110:0/667769762 conn(0x7f2ba40f80f0 msgr2=0x7f2ba40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 -- 172.21.15.110:0/667769762 shutdown_connections 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 -- 172.21.15.110:0/667769762 wait complete. 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 Processor -- start 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.590+0000 7f2baa4c1640 1 -- start start 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2baa4c1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ba4102550 0x7f2ba406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2baa4c1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2baa4c1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4070490 con 0x7f2ba4102ef0 2024-09-16T02:02:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2baa4c1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4070600 con 0x7f2ba4102550 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46220/0 (socket says 172.21.15.110:46220) 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 -- 172.21.15.110:0/2985182766 learned_addr learned my addr 172.21.15.110:0/2985182766 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 -- 172.21.15.110:0/2985182766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ba4102550 msgr2=0x7f2ba406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ba4102550 0x7f2ba406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 -- 172.21.15.110:0/2985182766 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c005040 con 0x7f2ba4102ef0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2b9bfff640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba406ff50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0043d0 tx=0x7f2b8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8c038070 con 0x7f2ba4102ef0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b8c0096e0 con 0x7f2ba4102ef0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8c02c8a0 con 0x7f2ba4102ef0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba4070830 con 0x7f2ba4102ef0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.591+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba4119bd0 con 0x7f2ba4102ef0 2024-09-16T02:02:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.592+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ba40fdcd0 con 0x7f2ba4102ef0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.593+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2b8c030020 con 0x7f2ba4102ef0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.593+0000 7f2ba17fa640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2b9006ed60 0x7f2b90071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.593+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2b8c0adbe0 con 0x7f2ba4102ef0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.593+0000 7f2ba3fff640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2b9006ed60 0x7f2b90071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.594+0000 7f2ba17fa640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] conn(0x7f2b90074970 0x7f2b90076d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.594+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 --> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b90077430 con 0x7f2b90074970 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.594+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b8c0b31e0 con 0x7f2ba4102ef0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.594+0000 7f2ba8a5e640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] conn(0x7f2b90074970 0x7f2b90076d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.594+0000 7f2ba3fff640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2b9006ed60 0x7f2b90071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b94004c80 tx=0x7f2b94009c50 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.594+0000 7f2ba8a5e640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] conn(0x7f2b90074970 0x7f2b90076d80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.595+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== osd.1 v2:172.21.15.110:6810/4105339787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2b90077430 con 0x7f2b90074970 2024-09-16T02:02:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.609+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 --> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ba40f9ad0 con 0x7f2b90074970 2024-09-16T02:02:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.609+0000 7f2ba17fa640 1 -- 172.21.15.110:0/2985182766 <== osd.1 v2:172.21.15.110:6810/4105339787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ba40f9ad0 con 0x7f2b90074970 2024-09-16T02:02:25.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] conn(0x7f2b90074970 msgr2=0x7f2b90076d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:25.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] conn(0x7f2b90074970 0x7f2b90076d80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2b9006ed60 msgr2=0x7f2b90071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2b9006ed60 0x7f2b90071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b94004c80 tx=0x7f2b94009c50 comp rx=0 tx=0).stop 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 msgr2=0x7f2ba406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba406ff50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0043d0 tx=0x7f2b8c009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 shutdown_connections 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6810/4105339787,v1:172.21.15.110:6811/4105339787] conn(0x7f2b90074970 0x7f2b90076d80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f2b9006ed60 0x7f2b90071210 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b94004c80 tx=0x7f2b94009c50 comp rx=0 tx=0).stop 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ba4102ef0 0x7f2ba406ff50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 --2- 172.21.15.110:0/2985182766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ba4102550 0x7f2ba406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 >> 172.21.15.110:0/2985182766 conn(0x7f2ba40f80f0 msgr2=0x7f2ba40f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.610+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 shutdown_connections 2024-09-16T02:02:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:25.611+0000 7f2baa4c1640 1 -- 172.21.15.110:0/2985182766 wait complete. 2024-09-16T02:02:26.038 INFO:teuthology.orchestra.run.smithi110.stdout:115964117010 2024-09-16T02:02:26.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-16T02:02:26.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:25 smithi165 ceph-mon[34621]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:26.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:25 smithi110 ceph-mon[27634]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:26.270 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:26.736 INFO:teuthology.orchestra.run.smithi110.stdout:60129542174 2024-09-16T02:02:26.736 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T02:02:28.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:27 smithi165 ceph-mon[34621]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:28.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:27 smithi110 ceph-mon[27634]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:29.301 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:29.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 -- 172.21.15.110:0/413557082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86101014b0 msgr2=0x7f8610101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 --2- 172.21.15.110:0/413557082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86101014b0 0x7f8610101880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86000048d0 tx=0x7f8600009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 -- 172.21.15.110:0/413557082 shutdown_connections 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 --2- 172.21.15.110:0/413557082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86100fb470 0x7f86100fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 --2- 172.21.15.110:0/413557082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86101014b0 0x7f8610101880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 -- 172.21.15.110:0/413557082 >> 172.21.15.110:0/413557082 conn(0x7f86100f7030 msgr2=0x7f86100f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 -- 172.21.15.110:0/413557082 shutdown_connections 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 -- 172.21.15.110:0/413557082 wait complete. 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 Processor -- start 2024-09-16T02:02:29.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.804+0000 7f8616db1640 1 -- start start 2024-09-16T02:02:29.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8616db1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 0x7f86101153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:29.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8616db1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86101014b0 0x7f8610115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:29.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8616db1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610115f10 con 0x7f86100fb470 2024-09-16T02:02:29.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8616db1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861010f350 con 0x7f86101014b0 2024-09-16T02:02:29.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 0x7f86101153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:29.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 0x7f86101153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46236/0 (socket says 172.21.15.110:46236) 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 -- 172.21.15.110:0/3462115736 learned_addr learned my addr 172.21.15.110:0/3462115736 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f860ffff640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86101014b0 0x7f8610115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 -- 172.21.15.110:0/3462115736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86101014b0 msgr2=0x7f8610115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86101014b0 0x7f8610115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 -- 172.21.15.110:0/3462115736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600005040 con 0x7f86100fb470 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8614b4d640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 0x7f86101153d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8600003080 tx=0x7f8600009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8600038070 con 0x7f86100fb470 2024-09-16T02:02:29.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86000097e0 con 0x7f86100fb470 2024-09-16T02:02:29.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861010f5d0 con 0x7f86100fb470 2024-09-16T02:02:29.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.805+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f860003d420 con 0x7f86100fb470 2024-09-16T02:02:29.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.806+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861010fb10 con 0x7f86100fb470 2024-09-16T02:02:29.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.806+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100fcbb0 con 0x7f86100fb470 2024-09-16T02:02:29.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.807+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8600030020 con 0x7f86100fb470 2024-09-16T02:02:29.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.807+0000 7f860d7fa640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f85f806ed60 0x7f85f8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:29.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.808+0000 7f860ffff640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f85f806ed60 0x7f85f8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:29.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.808+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f86000ae370 con 0x7f86100fb470 2024-09-16T02:02:29.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.808+0000 7f860ffff640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f85f806ed60 0x7f85f8071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8610110c90 tx=0x7f8604009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:29.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.812+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f860007b850 con 0x7f86100fb470 2024-09-16T02:02:29.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.974+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f861004b720 con 0x7f86100fb470 2024-09-16T02:02:29.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.974+0000 7f860d7fa640 1 -- 172.21.15.110:0/3462115736 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f860007b1f0 con 0x7f86100fb470 2024-09-16T02:02:29.976 INFO:teuthology.orchestra.run.smithi110.stdout:141733920783 2024-09-16T02:02:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f85f806ed60 msgr2=0x7f85f8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f85f806ed60 0x7f85f8071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8610110c90 tx=0x7f8604009040 comp rx=0 tx=0).stop 2024-09-16T02:02:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 msgr2=0x7f86101153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:29.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 0x7f86101153d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8600003080 tx=0x7f8600009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.978 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:29 smithi110 ceph-mon[27634]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 shutdown_connections 2024-09-16T02:02:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f85f806ed60 0x7f85f8071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86101014b0 0x7f8610115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 --2- 172.21.15.110:0/3462115736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86100fb470 0x7f86101153d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 >> 172.21.15.110:0/3462115736 conn(0x7f86100f7030 msgr2=0x7f86100fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 shutdown_connections 2024-09-16T02:02:29.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:29.976+0000 7f8616db1640 1 -- 172.21.15.110:0/3462115736 wait complete. 2024-09-16T02:02:30.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:29 smithi165 ceph-mon[34621]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:31.180 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:30 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3462115736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T02:02:31.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:30 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3462115736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T02:02:32.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 -- 172.21.15.110:0/1675458614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fdf10 msgr2=0x7f75a4106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:32.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1675458614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fdf10 0x7f75a4106550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75980048d0 tx=0x7f7598009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 -- 172.21.15.110:0/1675458614 shutdown_connections 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1675458614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fdf10 0x7f75a4106550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1675458614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a40fd570 0x7f75a40fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 -- 172.21.15.110:0/1675458614 >> 172.21.15.110:0/1675458614 conn(0x7f75a40f7000 msgr2=0x7f75a40f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 -- 172.21.15.110:0/1675458614 shutdown_connections 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.027+0000 7f75a9d16640 1 -- 172.21.15.110:0/1675458614 wait complete. 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a9d16640 1 Processor -- start 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a9d16640 1 -- start start 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a9d16640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 0x7f75a4113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a9d16640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a40fdf10 0x7f75a4113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a9d16640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4113ed0 con 0x7f75a40fd570 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a9d16640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a410d2c0 con 0x7f75a40fdf10 2024-09-16T02:02:32.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 0x7f75a4113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 0x7f75a4113300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51138/0 (socket says 172.21.15.110:51138) 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a37fe640 1 -- 172.21.15.110:0/1168779290 learned_addr learned my addr 172.21.15.110:0/1168779290 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.028+0000 7f75a2ffd640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a40fdf10 0x7f75a4113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f75a37fe640 1 -- 172.21.15.110:0/1168779290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a40fdf10 msgr2=0x7f75a4113840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f75a37fe640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a40fdf10 0x7f75a4113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f75a37fe640 1 -- 172.21.15.110:0/1168779290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598005040 con 0x7f75a40fd570 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f75a37fe640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 0x7f75a4113300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f759400b790 tx=0x7f75940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f759400c700 con 0x7f75a40fd570 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f759400cd00 con 0x7f75a40fd570 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a410d5a0 con 0x7f75a40fd570 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7594015e70 con 0x7f75a40fd570 2024-09-16T02:02:32.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.029+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a410dac0 con 0x7f75a40fd570 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.030+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4066330 con 0x7f75a40fd570 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.030+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7594012070 con 0x7f75a40fd570 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.031+0000 7f758bfff640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f758c06ed60 0x7f758c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.031+0000 7f75a2ffd640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f758c06ed60 0x7f758c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.031+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f759408d930 con 0x7f75a40fd570 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.031+0000 7f75a2ffd640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f758c06ed60 0x7f758c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75980043d0 tx=0x7f7598009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:32.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.035+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f759405ae10 con 0x7f75a40fd570 2024-09-16T02:02:32.178 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:31 smithi110 ceph-mon[27634]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:32.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.196+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75a40fac40 con 0x7f75a40fd570 2024-09-16T02:02:32.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.196+0000 7f758bfff640 1 -- 172.21.15.110:0/1168779290 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f759405a7b0 con 0x7f75a40fd570 2024-09-16T02:02:32.197 INFO:teuthology.orchestra.run.smithi110.stdout:38654705699 2024-09-16T02:02:32.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f758c06ed60 msgr2=0x7f758c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:32.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f758c06ed60 0x7f758c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75980043d0 tx=0x7f7598009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 msgr2=0x7f75a4113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:32.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 0x7f75a4113300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f759400b790 tx=0x7f75940091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 shutdown_connections 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f758c06ed60 0x7f758c071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a40fdf10 0x7f75a4113840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 --2- 172.21.15.110:0/1168779290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75a40fd570 0x7f75a4113300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 >> 172.21.15.110:0/1168779290 conn(0x7f75a40f7000 msgr2=0x7f75a40f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 shutdown_connections 2024-09-16T02:02:32.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:32.198+0000 7f75a9d16640 1 -- 172.21.15.110:0/1168779290 wait complete. 2024-09-16T02:02:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:31 smithi165 ceph-mon[34621]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:32.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920782 got 141733920783 for osd.4 2024-09-16T02:02:32.931 DEBUG:teuthology.parallel:result is None 2024-09-16T02:02:33.115 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:32 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1168779290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T02:02:33.115 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:33.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:32 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1168779290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T02:02:33.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:33.750 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:33.773 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705696 got 38654705699 for osd.0 2024-09-16T02:02:33.773 DEBUG:teuthology.parallel:result is None 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 -- 172.21.15.110:0/2669194514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102550 msgr2=0x7ffb0c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 --2- 172.21.15.110:0/2669194514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102550 0x7ffb0c102920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0048d0 tx=0x7ffafc009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 -- 172.21.15.110:0/2669194514 shutdown_connections 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 --2- 172.21.15.110:0/2669194514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 --2- 172.21.15.110:0/2669194514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102550 0x7ffb0c102920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 -- 172.21.15.110:0/2669194514 >> 172.21.15.110:0/2669194514 conn(0x7ffb0c0f80f0 msgr2=0x7ffb0c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 -- 172.21.15.110:0/2669194514 shutdown_connections 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 -- 172.21.15.110:0/2669194514 wait complete. 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.934+0000 7ffb1217b640 1 Processor -- start 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 -- start start 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb0c102550 0x7ffb0c113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1140d0 con 0x7ffb0c102ef0 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c10d4e0 con 0x7ffb0c102550 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51170/0 (socket says 172.21.15.110:51170) 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 -- 172.21.15.110:0/897874298 learned_addr learned my addr 172.21.15.110:0/897874298 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb0b7fe640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb0c102550 0x7ffb0c113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 -- 172.21.15.110:0/897874298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb0c102550 msgr2=0x7ffb0c113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb0c102550 0x7ffb0c113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 -- 172.21.15.110:0/897874298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc005040 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb03fff640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c113a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c790 tx=0x7ffaf40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf400a7a0 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c10d7c0 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffaf400ada0 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf4011380 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.935+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c10dd60 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.937+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c0fdcd0 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.937+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ffaf4012420 con 0x7ffb0c102ef0 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.938+0000 7ffb08ff9640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ffaf806ed50 0x7ffaf8071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.938+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffaf408ea40 con 0x7ffb0c102ef0 2024-09-16T02:02:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.938+0000 7ffb0b7fe640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ffaf806ed50 0x7ffaf8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.939+0000 7ffb0b7fe640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ffaf806ed50 0x7ffaf8071200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009ac0 tx=0x7ffafc035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:33.941+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffaf405bfe0 con 0x7ffb0c102ef0 2024-09-16T02:02:33.987 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:34.083 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:33 smithi110 ceph-mon[27634]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:34.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.107+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb0c0fbd50 con 0x7ffb0c102ef0 2024-09-16T02:02:34.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.108+0000 7ffb08ff9640 1 -- 172.21.15.110:0/897874298 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaf4016090 con 0x7ffb0c102ef0 2024-09-16T02:02:34.109 INFO:teuthology.orchestra.run.smithi110.stdout:81604378650 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ffaf806ed50 msgr2=0x7ffaf8071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ffaf806ed50 0x7ffaf8071200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009ac0 tx=0x7ffafc035040 comp rx=0 tx=0).stop 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 msgr2=0x7ffb0c113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c113a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c790 tx=0x7ffaf40043c0 comp rx=0 tx=0).stop 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 shutdown_connections 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ffaf806ed50 0x7ffaf8071200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb0c102ef0 0x7ffb0c113a80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 --2- 172.21.15.110:0/897874298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb0c102550 0x7ffb0c113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 >> 172.21.15.110:0/897874298 conn(0x7ffb0c0f80f0 msgr2=0x7ffb0c0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:34.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 shutdown_connections 2024-09-16T02:02:34.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:34.110+0000 7ffb1217b640 1 -- 172.21.15.110:0/897874298 wait complete. 2024-09-16T02:02:34.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:33 smithi165 ceph-mon[34621]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:34.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:34 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/897874298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T02:02:35.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:34 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/897874298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T02:02:35.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-16T02:02:35.631 DEBUG:teuthology.parallel:result is None 2024-09-16T02:02:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:35 smithi165 ceph-mon[34621]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:36.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:35 smithi110 ceph-mon[27634]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:36.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 -- 172.21.15.110:0/4264261711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fcf80 msgr2=0x7fda540fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 --2- 172.21.15.110:0/4264261711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fcf80 0x7fda540fd3d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fda480048d0 tx=0x7fda48009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 -- 172.21.15.110:0/4264261711 shutdown_connections 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 --2- 172.21.15.110:0/4264261711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fcf80 0x7fda540fd3d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 --2- 172.21.15.110:0/4264261711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda540fb810 0x7fda540fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 -- 172.21.15.110:0/4264261711 >> 172.21.15.110:0/4264261711 conn(0x7fda540723b0 msgr2=0x7fda540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 -- 172.21.15.110:0/4264261711 shutdown_connections 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 -- 172.21.15.110:0/4264261711 wait complete. 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 Processor -- start 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 -- start start 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.430+0000 7fda5c31d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 0x7fda54113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:36.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5c31d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda540fcf80 0x7fda54113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5c31d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda54113d70 con 0x7fda540fb810 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5c31d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5410d1b0 con 0x7fda540fcf80 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 0x7fda54113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 0x7fda54113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51184/0 (socket says 172.21.15.110:51184) 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 -- 172.21.15.110:0/3811485864 learned_addr learned my addr 172.21.15.110:0/3811485864 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 -- 172.21.15.110:0/3811485864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda540fcf80 msgr2=0x7fda54113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda540fcf80 0x7fda54113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 -- 172.21.15.110:0/3811485864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48005040 con 0x7fda540fb810 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5a0b9640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 0x7fda54113230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda4400cb10 tx=0x7fda44007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda44004200 con 0x7fda540fb810 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda4400acc0 con 0x7fda540fb810 2024-09-16T02:02:36.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5410d490 con 0x7fda540fb810 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda44003cd0 con 0x7fda540fb810 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.431+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5410d9b0 con 0x7fda540fb810 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.432+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda540fcbc0 con 0x7fda540fb810 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.433+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fda4400a820 con 0x7fda540fb810 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.433+0000 7fda52ffd640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fda3c06ed60 0x7fda3c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.433+0000 7fda598b8640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fda3c06ed60 0x7fda3c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.433+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fda4408e560 con 0x7fda540fb810 2024-09-16T02:02:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.434+0000 7fda598b8640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fda3c06ed60 0x7fda3c071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda4802a530 tx=0x7fda48009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:36.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.438+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda4405b9c0 con 0x7fda540fb810 2024-09-16T02:02:36.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.601+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fda5410e8d0 con 0x7fda540fb810 2024-09-16T02:02:36.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.601+0000 7fda52ffd640 1 -- 172.21.15.110:0/3811485864 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda4405b360 con 0x7fda540fb810 2024-09-16T02:02:36.603 INFO:teuthology.orchestra.run.smithi110.stdout:163208757260 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fda3c06ed60 msgr2=0x7fda3c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fda3c06ed60 0x7fda3c071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda4802a530 tx=0x7fda48009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 msgr2=0x7fda54113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 0x7fda54113230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fda4400cb10 tx=0x7fda44007ee0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 shutdown_connections 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fda3c06ed60 0x7fda3c071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda540fcf80 0x7fda54113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 --2- 172.21.15.110:0/3811485864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda540fb810 0x7fda54113230 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 >> 172.21.15.110:0/3811485864 conn(0x7fda540723b0 msgr2=0x7fda540fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 shutdown_connections 2024-09-16T02:02:36.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:36.603+0000 7fda5c31d640 1 -- 172.21.15.110:0/3811485864 wait complete. 2024-09-16T02:02:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:36 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3811485864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T02:02:37.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:36 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3811485864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T02:02:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:37 smithi165 ceph-mon[34621]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:38.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:37 smithi110 ceph-mon[27634]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:38.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.361+0000 7fea1904a640 1 -- 172.21.15.110:0/14869276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102ef0 msgr2=0x7fea140fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.361+0000 7fea1904a640 1 --2- 172.21.15.110:0/14869276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102ef0 0x7fea140fc5b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea080048d0 tx=0x7fea08009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- 172.21.15.110:0/14869276 shutdown_connections 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 --2- 172.21.15.110:0/14869276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102ef0 0x7fea140fc5b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 --2- 172.21.15.110:0/14869276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea14102550 0x7fea14102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- 172.21.15.110:0/14869276 >> 172.21.15.110:0/14869276 conn(0x7fea140f80f0 msgr2=0x7fea140fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- 172.21.15.110:0/14869276 shutdown_connections 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- 172.21.15.110:0/14869276 wait complete. 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 Processor -- start 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- start start 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 0x7fea141135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea14102ef0 0x7fea14113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:38.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea141141d0 con 0x7fea14102550 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.362+0000 7fea1904a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1410d550 con 0x7fea14102ef0 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 0x7fea141135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 0x7fea141135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51208/0 (socket says 172.21.15.110:51208) 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 -- 172.21.15.110:0/1131151908 learned_addr learned my addr 172.21.15.110:0/1131151908 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 -- 172.21.15.110:0/1131151908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea14102ef0 msgr2=0x7fea14113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea14102ef0 0x7fea14113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 -- 172.21.15.110:0/1131151908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08005040 con 0x7fea14102550 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea12d9d640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 0x7fea141135b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea0400b790 tx=0x7fea040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0400c700 con 0x7fea14102550 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea0400cd00 con 0x7fea14102550 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1410d7e0 con 0x7fea14102550 2024-09-16T02:02:38.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea04015e70 con 0x7fea14102550 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.363+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1410dd00 con 0x7fea14102550 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.364+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140fdcd0 con 0x7fea14102550 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.365+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fea04012070 con 0x7fea14102550 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.365+0000 7fe9fb7fe640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe9fc06ed50 0x7fe9fc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.365+0000 7fea1259c640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe9fc06ed50 0x7fe9fc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.365+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fea0408d9b0 con 0x7fea14102550 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.366+0000 7fea1259c640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe9fc06ed50 0x7fe9fc071200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea08009ac0 tx=0x7fea08009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:38.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.369+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea0405ae10 con 0x7fea14102550 2024-09-16T02:02:38.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.528+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea1404b720 con 0x7fea14102550 2024-09-16T02:02:38.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.528+0000 7fe9fb7fe640 1 -- 172.21.15.110:0/1131151908 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea0405a7b0 con 0x7fea14102550 2024-09-16T02:02:38.530 INFO:teuthology.orchestra.run.smithi110.stdout:60129542176 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe9fc06ed50 msgr2=0x7fe9fc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe9fc06ed50 0x7fe9fc071200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea08009ac0 tx=0x7fea08009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 msgr2=0x7fea141135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 0x7fea141135b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea0400b790 tx=0x7fea040091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 shutdown_connections 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fe9fc06ed50 0x7fe9fc071200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea14102ef0 0x7fea14113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 --2- 172.21.15.110:0/1131151908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea14102550 0x7fea141135b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 >> 172.21.15.110:0/1131151908 conn(0x7fea140f80f0 msgr2=0x7fea140f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:38.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 shutdown_connections 2024-09-16T02:02:38.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.530+0000 7fea1904a640 1 -- 172.21.15.110:0/1131151908 wait complete. 2024-09-16T02:02:38.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 -- 172.21.15.110:0/715240943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 msgr2=0x7fd8dc0fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 --2- 172.21.15.110:0/715240943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc0fb050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00048d0 tx=0x7fd8d0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 -- 172.21.15.110:0/715240943 shutdown_connections 2024-09-16T02:02:38.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 --2- 172.21.15.110:0/715240943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc0fb050 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 --2- 172.21.15.110:0/715240943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 0x7fd8dc0fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 -- 172.21.15.110:0/715240943 >> 172.21.15.110:0/715240943 conn(0x7fd8dc071b00 msgr2=0x7fd8dc071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 -- 172.21.15.110:0/715240943 shutdown_connections 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 -- 172.21.15.110:0/715240943 wait complete. 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 Processor -- start 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.554+0000 7fd8e425a640 1 -- start start 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e425a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc1153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e425a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 0x7fd8dc115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e425a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc115fc0 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e425a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc10f3b0 con 0x7fd8dc0fd510 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc1153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc1153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51228/0 (socket says 172.21.15.110:51228) 2024-09-16T02:02:38.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 -- 172.21.15.110:0/2621326599 learned_addr learned my addr 172.21.15.110:0/2621326599 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:38.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e17f5640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 0x7fd8dc115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:38.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 -- 172.21.15.110:0/2621326599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 msgr2=0x7fd8dc115930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 0x7fd8dc115930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 -- 172.21.15.110:0/2621326599 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0005040 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e17f5640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 0x7fd8dc115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:02:38.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.555+0000 7fd8e1ff6640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc1153f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800b580 tx=0x7fd8d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:38.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.556+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d800f570 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.556+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc10f690 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.556+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd8d800fb70 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.556+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d8010d40 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.556+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc10fc30 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.557+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0fbbf0 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.557+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd8d800fce0 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.558+0000 7fd8ce7fc640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8c806ee20 0x7fd8c80712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:38.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.558+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd8d808dd00 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.558+0000 7fd8e17f5640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8c806ee20 0x7fd8c80712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:38.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.559+0000 7fd8e17f5640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8c806ee20 0x7fd8c80712d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009ac0 tx=0x7fd8d0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:38.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.563+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd8d805b1c0 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.720+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8dc04b720 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.721+0000 7fd8ce7fc640 1 -- 172.21.15.110:0/2621326599 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8d805ab60 con 0x7fd8dc0fabe0 2024-09-16T02:02:38.722 INFO:teuthology.orchestra.run.smithi110.stdout:115964117013 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.722+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8c806ee20 msgr2=0x7fd8c80712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.722+0000 7fd8e425a640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8c806ee20 0x7fd8c80712d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009ac0 tx=0x7fd8d0035040 comp rx=0 tx=0).stop 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.722+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 msgr2=0x7fd8dc1153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.722+0000 7fd8e425a640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc1153f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800b580 tx=0x7fd8d80091a0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 shutdown_connections 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8c806ee20 0x7fd8c80712d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8dc0fd510 0x7fd8dc115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 --2- 172.21.15.110:0/2621326599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8dc0fabe0 0x7fd8dc1153f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:38.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 >> 172.21.15.110:0/2621326599 conn(0x7fd8dc071b00 msgr2=0x7fd8dc0f8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:38.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 shutdown_connections 2024-09-16T02:02:38.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:38.723+0000 7fd8e425a640 1 -- 172.21.15.110:0/2621326599 wait complete. 2024-09-16T02:02:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:38 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1131151908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T02:02:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:38 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/2621326599' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T02:02:39.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:38 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1131151908' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T02:02:39.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:38 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2621326599' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T02:02:39.447 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757256 got 163208757260 for osd.5 2024-09-16T02:02:39.447 DEBUG:teuthology.parallel:result is None 2024-09-16T02:02:39.916 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-09-16T02:02:39.916 DEBUG:teuthology.parallel:result is None 2024-09-16T02:02:40.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:39 smithi165 ceph-mon[34621]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:40.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:39 smithi110 ceph-mon[27634]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:40.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117010 got 115964117013 for osd.3 2024-09-16T02:02:40.362 DEBUG:teuthology.parallel:result is None 2024-09-16T02:02:40.363 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T02:02:40.363 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T02:02:40.604 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:42.004 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:41 smithi110 ceph-mon[27634]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:42.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 -- 172.21.15.110:0/2061894208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102ef0 msgr2=0x7f53f80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/2061894208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102ef0 0x7f53f80fc5b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53f40048d0 tx=0x7f53f4009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 -- 172.21.15.110:0/2061894208 shutdown_connections 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/2061894208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102ef0 0x7f53f80fc5b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/2061894208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f8102550 0x7f53f8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 -- 172.21.15.110:0/2061894208 >> 172.21.15.110:0/2061894208 conn(0x7f53f80f80f0 msgr2=0x7f53f80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 -- 172.21.15.110:0/2061894208 shutdown_connections 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.314+0000 7f53ffaa2640 1 -- 172.21.15.110:0/2061894208 wait complete. 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53ffaa2640 1 Processor -- start 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53ffaa2640 1 -- start start 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53ffaa2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 0x7f53f81135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:42.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53ffaa2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f8102ef0 0x7f53f8113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53ffaa2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81141d0 con 0x7f53f8102550 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53ffaa2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f810d550 con 0x7f53f8102ef0 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53fd83e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 0x7f53f81135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53fd83e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 0x7f53f81135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47654/0 (socket says 172.21.15.110:47654) 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.315+0000 7f53fd83e640 1 -- 172.21.15.110:0/1743455306 learned_addr learned my addr 172.21.15.110:0/1743455306 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53fd83e640 1 -- 172.21.15.110:0/1743455306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f8102ef0 msgr2=0x7f53f8113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53fd83e640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f8102ef0 0x7f53f8113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53fd83e640 1 -- 172.21.15.110:0/1743455306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4005040 con 0x7f53f8102550 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53fd83e640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 0x7f53f81135b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f53e800b790 tx=0x7f53e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53e800c700 con 0x7f53f8102550 2024-09-16T02:02:42.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53e800cd00 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53e8015e70 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f810d7e0 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.316+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f810dd00 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.317+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f80fdcd0 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.318+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f53e8012070 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.318+0000 7f53ee7fc640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53e406ed50 0x7f53e4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.318+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f53e808d930 con 0x7f53f8102550 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.318+0000 7f53fd03d640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53e406ed50 0x7f53e4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:42.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.319+0000 7f53fd03d640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53e406ed50 0x7f53e4071200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009ac0 tx=0x7f53f4009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:42.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.323+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f53e805ae10 con 0x7f53f8102550 2024-09-16T02:02:42.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:41 smithi165 ceph-mon[34621]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.474+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53f804b720 con 0x7f53e406ed50 2024-09-16T02:02:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.475+0000 7f53ee7fc640 1 -- 172.21.15.110:0/1743455306 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27919 (secure 0 0 0) 0x7f53f804b720 con 0x7f53e406ed50 2024-09-16T02:02:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:02:42.477 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53e406ed50 msgr2=0x7f53e4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53e406ed50 0x7f53e4071200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009ac0 tx=0x7f53f4009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 msgr2=0x7f53f81135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 0x7f53f81135b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f53e800b790 tx=0x7f53e80091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 shutdown_connections 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f53e406ed50 0x7f53e4071200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f8102ef0 0x7f53f8113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 --2- 172.21.15.110:0/1743455306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f8102550 0x7f53f81135b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.477+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 >> 172.21.15.110:0/1743455306 conn(0x7f53f80f80f0 msgr2=0x7f53f80f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.478+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 shutdown_connections 2024-09-16T02:02:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:42.478+0000 7f53ffaa2640 1 -- 172.21.15.110:0/1743455306 wait complete. 2024-09-16T02:02:43.133 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-16T02:02:40.769026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787996,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682916,"statfs":{"total":575970213888,"available":574139305984,"internally_reserved":0,"allocated":3919872,"data_stored":2576304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001868"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T02:01:53.420135+0000","last_change":"2024-09-16T02:01:27.450922+0000","last_active":"2024-09-16T02:01:53.420135+0000","last_peered":"2024-09-16T02:01:53.420135+0000","last_clean":"2024-09-16T02:01:53.420135+0000","last_became_active":"2024-09-16T02:01:27.450636+0000","last_became_peered":"2024-09-16T02:01:27.450636+0000","last_unstale":"2024-09-16T02:01:53.420135+0000","last_undegraded":"2024-09-16T02:01:53.420135+0000","last_fullsized":"2024-09-16T02:01:53.420135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T02:00:43.343317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T02:00:43.343317+0000","last_clean_scrub_stamp":"2024-09-16T02:00:43.343317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:28.127729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":4,"up_from":33,"seq":141733920785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39200000000000002}]},{"osd":2,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":1.117}]},{"osd":3,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Sep 16 02:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.1909999999999998,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Sep 16 02:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Sep 16 02:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.245},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.26800000000000002}]},{"osd":1,"last update":"Mon Sep 16 02:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.218}]},{"osd":3,"last update":"Mon Sep 16 02:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Sep 16 02:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.318,"15min":0.316},"min":{"1min":0.20399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Sep 16 02:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.314},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.255}]},{"osd":3,"last update":"Mon Sep 16 02:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Mon Sep 16 02:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 02:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.318},"min":{"1min":0.23599999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.37},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.223,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38200000000000001}]},{"osd":2,"last update":"Mon Sep 16 02:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Sep 16 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.4629999999999992,"5min":8.4629999999999992,"15min":8.4629999999999992},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Sep 16 02:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":1.246},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T02:02:43.134 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T02:02:43.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:42 smithi110 ceph-mon[27634]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T02:02:43.351 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:42 smithi165 ceph-mon[34621]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T02:02:43.374 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:44.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:43 smithi110 ceph-mon[27634]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:44.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:43 smithi165 ceph-mon[34621]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 -- 172.21.15.110:0/1542129508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102ed0 msgr2=0x7fadb80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 --2- 172.21.15.110:0/1542129508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102ed0 0x7fadb80fc590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fada00048d0 tx=0x7fada0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 -- 172.21.15.110:0/1542129508 shutdown_connections 2024-09-16T02:02:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 --2- 172.21.15.110:0/1542129508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102ed0 0x7fadb80fc590 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 --2- 172.21.15.110:0/1542129508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102530 0x7fadb8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 -- 172.21.15.110:0/1542129508 >> 172.21.15.110:0/1542129508 conn(0x7fadb80f8110 msgr2=0x7fadb80fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 -- 172.21.15.110:0/1542129508 shutdown_connections 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.144+0000 7fadbd769640 1 -- 172.21.15.110:0/1542129508 wait complete. 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadbd769640 1 Processor -- start 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadbd769640 1 -- start start 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadbd769640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 0x7fadb8113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadbd769640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102ed0 0x7fadb81137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadbd769640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8113e40 con 0x7fadb8102530 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadbd769640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb810d1f0 con 0x7fadb8102ed0 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadb6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 0x7fadb8113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadb6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 0x7fadb8113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47682/0 (socket says 172.21.15.110:47682) 2024-09-16T02:02:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadb6ffd640 1 -- 172.21.15.110:0/2385094136 learned_addr learned my addr 172.21.15.110:0/2385094136 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadaffff640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102ed0 0x7fadb81137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadb6ffd640 1 -- 172.21.15.110:0/2385094136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102ed0 msgr2=0x7fadb81137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadb6ffd640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102ed0 0x7fadb81137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadb6ffd640 1 -- 172.21.15.110:0/2385094136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0005040 con 0x7fadb8102530 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.145+0000 7fadaffff640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102ed0 0x7fadb81137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.146+0000 7fadb6ffd640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 0x7fadb8113270 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fada800b790 tx=0x7fada80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.146+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada800c700 con 0x7fadb8102530 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.146+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fada800cd00 con 0x7fadb8102530 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.146+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada8015e70 con 0x7fadb8102530 2024-09-16T02:02:45.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.146+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb810d4d0 con 0x7fadb8102530 2024-09-16T02:02:45.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.146+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb810d9f0 con 0x7fadb8102530 2024-09-16T02:02:45.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.147+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb80fdcb0 con 0x7fadb8102530 2024-09-16T02:02:45.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.147+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fada8012070 con 0x7fadb8102530 2024-09-16T02:02:45.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.148+0000 7fadaf7fe640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fada406ed60 0x7fada4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:45.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.148+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fada808d790 con 0x7fadb8102530 2024-09-16T02:02:45.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.148+0000 7fadaffff640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fada406ed60 0x7fada4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:45.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.148+0000 7fadaffff640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fada406ed60 0x7fada4071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fadb810eb30 tx=0x7fada0009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:45.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.152+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fada805abf0 con 0x7fadb8102530 2024-09-16T02:02:45.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.305+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fadb804b7b0 con 0x7fada406ed60 2024-09-16T02:02:45.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.306+0000 7fadaf7fe640 1 -- 172.21.15.110:0/2385094136 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27977 (secure 0 0 0) 0x7fadb804b7b0 con 0x7fada406ed60 2024-09-16T02:02:45.307 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:02:45.308 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-09-16T02:02:45.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fada406ed60 msgr2=0x7fada4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:45.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fada406ed60 0x7fada4071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fadb810eb30 tx=0x7fada0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 msgr2=0x7fadb8113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 0x7fadb8113270 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fada800b790 tx=0x7fada80091d0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 shutdown_connections 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fada406ed60 0x7fada4071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb8102ed0 0x7fadb81137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 --2- 172.21.15.110:0/2385094136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadb8102530 0x7fadb8113270 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 >> 172.21.15.110:0/2385094136 conn(0x7fadb80f8110 msgr2=0x7fadb80f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 shutdown_connections 2024-09-16T02:02:45.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:45.308+0000 7fadbd769640 1 -- 172.21.15.110:0/2385094136 wait complete. 2024-09-16T02:02:46.057 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-16T02:02:44.769756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787996,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682916,"statfs":{"total":575970213888,"available":574139305984,"internally_reserved":0,"allocated":3919872,"data_stored":2576304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002023"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T02:01:53.420135+0000","last_change":"2024-09-16T02:01:27.450922+0000","last_active":"2024-09-16T02:01:53.420135+0000","last_peered":"2024-09-16T02:01:53.420135+0000","last_clean":"2024-09-16T02:01:53.420135+0000","last_became_active":"2024-09-16T02:01:27.450636+0000","last_became_peered":"2024-09-16T02:01:27.450636+0000","last_unstale":"2024-09-16T02:01:53.420135+0000","last_undegraded":"2024-09-16T02:01:53.420135+0000","last_fullsized":"2024-09-16T02:01:53.420135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T02:00:43.343317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T02:00:43.343317+0000","last_clean_scrub_stamp":"2024-09-16T02:00:43.343317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:28.127729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Sep 16 02:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Sep 16 02:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.1909999999999998,"5min":6.1909999999999998,"15min":6.1909999999999998},"last":0.57899999999999996}]},{"osd":2,"last update":"Mon Sep 16 02:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Mon Sep 16 02:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.34499999999999997}]},{"osd":1,"last update":"Mon Sep 16 02:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.29599999999999999}]},{"osd":3,"last update":"Mon Sep 16 02:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.501}]},{"osd":4,"last update":"Mon Sep 16 02:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 02:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.318,"15min":0.316},"min":{"1min":0.20399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Sep 16 02:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.36099999999999999,"15min":0.36399999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.35199999999999998,"15min":0.35799999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.49099999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.28100000000000003}]},{"osd":3,"last update":"Mon Sep 16 02:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Sep 16 02:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 02:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.32200000000000001,"15min":0.318},"min":{"1min":0.23599999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.223,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Sep 16 02:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.442}]},{"osd":3,"last update":"Mon Sep 16 02:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.4629999999999992,"5min":8.4629999999999992,"15min":8.4629999999999992},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Sep 16 02:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T02:02:46.058 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T02:02:46.058 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T02:02:46.059 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T02:02:46.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T02:02:46.300 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:46.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:45 smithi110 ceph-mon[27634]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:46.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:45 smithi110 ceph-mon[27634]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T02:02:46.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:45 smithi165 ceph-mon[34621]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:46.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:45 smithi165 ceph-mon[34621]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T02:02:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 -- 172.21.15.110:0/3296025694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f200fabd0 msgr2=0x7f3f200fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 --2- 172.21.15.110:0/3296025694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f200fabd0 0x7f3f200fb040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f140048d0 tx=0x7f3f14009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 -- 172.21.15.110:0/3296025694 shutdown_connections 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 --2- 172.21.15.110:0/3296025694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f200fabd0 0x7f3f200fb040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 --2- 172.21.15.110:0/3296025694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f20102680 0x7f3f20102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 -- 172.21.15.110:0/3296025694 >> 172.21.15.110:0/3296025694 conn(0x7f3f20071ac0 msgr2=0x7f3f20071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 -- 172.21.15.110:0/3296025694 shutdown_connections 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 -- 172.21.15.110:0/3296025694 wait complete. 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 Processor -- start 2024-09-16T02:02:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.981+0000 7f3f252eb640 1 -- start start 2024-09-16T02:02:47.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f252eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f200fabd0 0x7f3f200fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f252eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 0x7f3f200fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f252eb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200fc830 con 0x7f3f20102680 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f252eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200fc9a0 con 0x7f3f200fabd0 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 0x7f3f200fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 0x7f3f200fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47710/0 (socket says 172.21.15.110:47710) 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 -- 172.21.15.110:0/2504651957 learned_addr learned my addr 172.21.15.110:0/2504651957 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1effd640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f200fabd0 0x7f3f200fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 -- 172.21.15.110:0/2504651957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f200fabd0 msgr2=0x7f3f200fbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f200fabd0 0x7f3f200fbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 -- 172.21.15.110:0/2504651957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14005040 con 0x7f3f20102680 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f1e7fc640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 0x7f3f200fc2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f14000c00 tx=0x7f3f14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f14038070 con 0x7f3f20102680 2024-09-16T02:02:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3f1402ade0 con 0x7f3f20102680 2024-09-16T02:02:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f200fcbd0 con 0x7f3f20102680 2024-09-16T02:02:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1402c7b0 con 0x7f3f20102680 2024-09-16T02:02:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.982+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f201198e0 con 0x7f3f20102680 2024-09-16T02:02:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.983+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f200725d0 con 0x7f3f20102680 2024-09-16T02:02:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.984+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3f14030020 con 0x7f3f20102680 2024-09-16T02:02:47.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.985+0000 7f3f077fe640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3f0806ed60 0x7f3f08071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:47.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.985+0000 7f3f1effd640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3f0806ed60 0x7f3f08071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:47.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.985+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3f140ae240 con 0x7f3f20102680 2024-09-16T02:02:47.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.985+0000 7f3f1effd640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3f0806ed60 0x7f3f08071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f10004fd0 tx=0x7f3f1000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:47.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:47.989+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3f1407b6a0 con 0x7f3f20102680 2024-09-16T02:02:48.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.174+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3f2004b720 con 0x7f3f20102680 2024-09-16T02:02:48.176 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:47 smithi110 ceph-mon[27634]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:48.176 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:47 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:48.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.175+0000 7f3f077fe640 1 -- 172.21.15.110:0/2504651957 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3f1407b040 con 0x7f3f20102680 2024-09-16T02:02:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:02:48.177 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T02:02:48.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3f0806ed60 msgr2=0x7f3f08071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3f0806ed60 0x7f3f08071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f10004fd0 tx=0x7f3f1000b040 comp rx=0 tx=0).stop 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 msgr2=0x7f3f200fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 0x7f3f200fc2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f14000c00 tx=0x7f3f14009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 shutdown_connections 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3f0806ed60 0x7f3f08071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f20102680 0x7f3f200fc2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 --2- 172.21.15.110:0/2504651957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f200fabd0 0x7f3f200fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 >> 172.21.15.110:0/2504651957 conn(0x7f3f20071ac0 msgr2=0x7f3f20105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 shutdown_connections 2024-09-16T02:02:48.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:48.177+0000 7f3f252eb640 1 -- 172.21.15.110:0/2504651957 wait complete. 2024-09-16T02:02:48.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:47 smithi165 ceph-mon[34621]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:48.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:47 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:02:48.801 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T02:02:48.802 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T02:02:48.802 INFO:teuthology.run_tasks:Running task print... 2024-09-16T02:02:48.809 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-16T02:02:48.809 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:02:48.870 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:02:48.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-16T02:02:49.119 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:49.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:48 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2504651957' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T02:02:49.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:48 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/2504651957' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T02:02:50.267 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:49 smithi110 ceph-mon[27634]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:50.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:49 smithi165 ceph-mon[34621]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:50.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 -- 172.21.15.110:0/4149942832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fdb70 msgr2=0x7fc01c0fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:50.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 --2- 172.21.15.110:0/4149942832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fdb70 0x7fc01c0fdf80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0048d0 tx=0x7fc00c009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 -- 172.21.15.110:0/4149942832 shutdown_connections 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 --2- 172.21.15.110:0/4149942832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 --2- 172.21.15.110:0/4149942832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fdb70 0x7fc01c0fdf80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 -- 172.21.15.110:0/4149942832 >> 172.21.15.110:0/4149942832 conn(0x7fc01c0f6390 msgr2=0x7fc01c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 -- 172.21.15.110:0/4149942832 shutdown_connections 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.743+0000 7fc0212b1640 1 -- 172.21.15.110:0/4149942832 wait complete. 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0212b1640 1 Processor -- start 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0212b1640 1 -- start start 2024-09-16T02:02:50.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0212b1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01c0fdb70 0x7fc01c0fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:50.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0212b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:50.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0212b1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0fbde0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0212b1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0fbf20 con 0x7fc01c0fdb70 2024-09-16T02:02:50.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0127fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:50.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0127fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56424/0 (socket says 172.21.15.110:56424) 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.744+0000 7fc0127fc640 1 -- 172.21.15.110:0/1234037513 learned_addr learned my addr 172.21.15.110:0/1234037513 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc01affd640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01c0fdb70 0x7fc01c0fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc0127fc640 1 -- 172.21.15.110:0/1234037513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01c0fdb70 msgr2=0x7fc01c0fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc0127fc640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01c0fdb70 0x7fc01c0fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc0127fc640 1 -- 172.21.15.110:0/1234037513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c005040 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc0127fc640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fb850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c800 tx=0x7fc004004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:50.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00400a7a0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c0fc200 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc00400ada0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0040113a0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.745+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c1150c0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.746+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c0fa010 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.747+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc004011610 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.747+0000 7fc013fff640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc00806ed60 0x7fc008071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:50.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.747+0000 7fc01affd640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc00806ed60 0x7fc008071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:50.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.747+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc00408dfb0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.748+0000 7fc01affd640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc00806ed60 0x7fc008071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc00c000c00 tx=0x7fc00c035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:50.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.751+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc00405b490 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.908+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fc01c1152b0 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.912+0000 7fc013fff640 1 -- 172.21.15.110:0/1234037513 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fc00405ae30 con 0x7fc01c0fe4c0 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc00806ed60 msgr2=0x7fc008071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc00806ed60 0x7fc008071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc00c000c00 tx=0x7fc00c035040 comp rx=0 tx=0).stop 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 msgr2=0x7fc01c0fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fb850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc00400c800 tx=0x7fc004004430 comp rx=0 tx=0).stop 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 shutdown_connections 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc00806ed60 0x7fc008071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc01c0fe4c0 0x7fc01c0fb850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 --2- 172.21.15.110:0/1234037513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc01c0fdb70 0x7fc01c0fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 >> 172.21.15.110:0/1234037513 conn(0x7fc01c0f6390 msgr2=0x7fc01c0f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 shutdown_connections 2024-09-16T02:02:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:50.915+0000 7fc0212b1640 1 -- 172.21.15.110:0/1234037513 wait complete. 2024-09-16T02:02:51.592 INFO:teuthology.run_tasks:Running task print... 2024-09-16T02:02:51.602 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-16T02:02:51.602 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:02:51.662 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:02:51.662 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-16T02:02:51.906 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:52.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:51 smithi110 ceph-mon[27634]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:52.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:51 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1234037513' entity='client.admin' 2024-09-16T02:02:52.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:02:52.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:02:52.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:02:52.172 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:51 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:02:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:51 smithi165 ceph-mon[34621]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:51 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1234037513' entity='client.admin' 2024-09-16T02:02:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:02:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:02:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:02:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:51 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:02:53.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- 172.21.15.110:0/501670283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 msgr2=0x7f83f00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 --2- 172.21.15.110:0/501670283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f00fc960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f83e00048d0 tx=0x7f83e0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- 172.21.15.110:0/501670283 shutdown_connections 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 --2- 172.21.15.110:0/501670283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83f00fd820 0x7f83f00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 --2- 172.21.15.110:0/501670283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f00fc960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- 172.21.15.110:0/501670283 >> 172.21.15.110:0/501670283 conn(0x7f83f00f7d30 msgr2=0x7f83f00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- 172.21.15.110:0/501670283 shutdown_connections 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- 172.21.15.110:0/501670283 wait complete. 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 Processor -- start 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- start start 2024-09-16T02:02:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83f00fd820 0x7f83f010d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f010e4b0 con 0x7f83f00fc550 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.534+0000 7f83f5701640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f010e620 con 0x7f83f00fd820 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f010d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56444/0 (socket says 172.21.15.110:56444) 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 -- 172.21.15.110:0/2241676351 learned_addr learned my addr 172.21.15.110:0/2241676351 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83e7fff640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83f00fd820 0x7f83f010d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 -- 172.21.15.110:0/2241676351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83f00fd820 msgr2=0x7f83f010d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83f00fd820 0x7f83f010d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 -- 172.21.15.110:0/2241676351 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0005040 con 0x7f83f00fc550 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83eeffd640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f010d100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f83e0003080 tx=0x7f83e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:53.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83e0038070 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f010e8a0 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83e002abd0 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83e003e670 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.535+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f010edc0 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.536+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f01057e0 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.537+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f83e0030020 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.537+0000 7f83e77fe640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f83dc06ed60 0x7f83dc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.537+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f83e00ae250 con 0x7f83f00fc550 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.537+0000 7f83e7fff640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f83dc06ed60 0x7f83dc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:53.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.538+0000 7f83e7fff640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f83dc06ed60 0x7f83dc071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83d8006fd0 tx=0x7f83d8008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:53.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.541+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f83e007b6b0 con 0x7f83f00fc550 2024-09-16T02:02:53.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.709+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83f010efe0 con 0x7f83dc06ed60 2024-09-16T02:02:53.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.710+0000 7f83e77fe640 1 -- 172.21.15.110:0/2241676351 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f83f010efe0 con 0x7f83dc06ed60 2024-09-16T02:02:53.711 INFO:teuthology.orchestra.run.smithi110.stdout:Backend: cephadm 2024-09-16T02:02:53.711 INFO:teuthology.orchestra.run.smithi110.stdout:Available: Yes 2024-09-16T02:02:53.711 INFO:teuthology.orchestra.run.smithi110.stdout:Paused: No 2024-09-16T02:02:53.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f83dc06ed60 msgr2=0x7f83dc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:53.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f83dc06ed60 0x7f83dc071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83d8006fd0 tx=0x7f83d8008040 comp rx=0 tx=0).stop 2024-09-16T02:02:53.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 msgr2=0x7f83f010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:53.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f010d100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f83e0003080 tx=0x7f83e0009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 shutdown_connections 2024-09-16T02:02:53.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f83dc06ed60 0x7f83dc071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83f00fd820 0x7f83f010d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 --2- 172.21.15.110:0/2241676351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83f00fc550 0x7f83f010d100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:53.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 >> 172.21.15.110:0/2241676351 conn(0x7f83f00f7d30 msgr2=0x7f83f00f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:53.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 shutdown_connections 2024-09-16T02:02:53.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:53.712+0000 7f83f5701640 1 -- 172.21.15.110:0/2241676351 wait complete. 2024-09-16T02:02:54.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:53 smithi165 ceph-mon[34621]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:54.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:53 smithi110 ceph-mon[27634]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:54.334 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-16T02:02:54.588 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:54 smithi165 ceph-mon[34621]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:02:55.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:54 smithi110 ceph-mon[27634]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:02:56.040 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:55 smithi110 ceph-mon[27634]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:56.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:55 smithi165 ceph-mon[34621]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 -- 172.21.15.110:0/4010017806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fdbb0 msgr2=0x7efcf40fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 --2- 172.21.15.110:0/4010017806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fdbb0 0x7efcf40fdfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efce40048d0 tx=0x7efce4009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 -- 172.21.15.110:0/4010017806 shutdown_connections 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 --2- 172.21.15.110:0/4010017806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf40fe500 0x7efcf40fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 --2- 172.21.15.110:0/4010017806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fdbb0 0x7efcf40fdfc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 -- 172.21.15.110:0/4010017806 >> 172.21.15.110:0/4010017806 conn(0x7efcf40f63b0 msgr2=0x7efcf40f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.232+0000 7efcf989b640 1 -- 172.21.15.110:0/4010017806 shutdown_connections 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 -- 172.21.15.110:0/4010017806 wait complete. 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 Processor -- start 2024-09-16T02:02:56.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 -- start start 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf40fdbb0 0x7efcf410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 0x7efcf410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf410dc70 con 0x7efcf40fe500 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf989b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf410e440 con 0x7efcf40fdbb0 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcebfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 0x7efcf410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcebfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 0x7efcf410d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56474/0 (socket says 172.21.15.110:56474) 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcebfff640 1 -- 172.21.15.110:0/1040926931 learned_addr learned my addr 172.21.15.110:0/1040926931 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcf2ffd640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf40fdbb0 0x7efcf410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcebfff640 1 -- 172.21.15.110:0/1040926931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf40fdbb0 msgr2=0x7efcf410d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcebfff640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf40fdbb0 0x7efcf410d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.233+0000 7efcebfff640 1 -- 172.21.15.110:0/1040926931 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4005040 con 0x7efcf40fe500 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.234+0000 7efcebfff640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 0x7efcf410d620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c800 tx=0x7efcdc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:56.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.234+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcdc00a820 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.234+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efcdc00ae20 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.234+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf410e6d0 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.234+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcdc0113a0 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.234+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf410ec70 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.235+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40fa050 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.235+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7efcdc012400 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.236+0000 7efceb7fe640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efce006ed60 0x7efce0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.236+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efcdc08e030 con 0x7efcf40fe500 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.236+0000 7efcf2ffd640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efce006ed60 0x7efce0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.236+0000 7efcf2ffd640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efce006ed60 0x7efce0071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efce4007ac0 tx=0x7efce4035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:56.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.240+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efcdc05b090 con 0x7efcf40fe500 2024-09-16T02:02:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.399+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efcf410ef90 con 0x7efce006ed60 2024-09-16T02:02:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.407+0000 7efceb7fe640 1 -- 172.21.15.110:0/1040926931 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2826 (secure 0 0 0) 0x7efcf410ef90 con 0x7efce006ed60 2024-09-16T02:02:56.408 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (3m) 2m ago 4m 26.1M - 0.25.0 c8568f914cd2 d98e35b955ee 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (5m) 2m ago 5m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (4m) 65s ago 4m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (3m) 2m ago 4m 79.7M - 9.4.7 954c08fa6188 02b51104ba52 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:9283,8765,8443 running (6m) 2m ago 6m 437M - 17.2.7-1633-g6d025bc2 33ed8dba3996 093819b4fc7f 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (4m) 65s ago 4m 402M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15164ccb0b8c 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (6m) 2m ago 6m 43.1M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (4m) 65s ago 3m 37.9M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 69c375f8a058 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (4m) 65s ago 4m 16.1M - 1.5.0 0da6a335fe13 60a3c227d383 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (3m) 2m ago 3m 38.8M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (2m) 2m ago 2m 36.7M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:02:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (2m) 2m ago 2m 38.6M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:02:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (119s) 65s ago 119s 40.3M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:02:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (95s) 65s ago 95s 37.6M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:02:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (70s) 65s ago 70s 11.0M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:02:56.410 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (3m) 2m ago 4m 40.3M - 2.43.0 a07b618ecd1d 63397dfd0974 2024-09-16T02:02:56.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efce006ed60 msgr2=0x7efce0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efce006ed60 0x7efce0071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efce4007ac0 tx=0x7efce4035040 comp rx=0 tx=0).stop 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 msgr2=0x7efcf410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 0x7efcf410d620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c800 tx=0x7efcdc004430 comp rx=0 tx=0).stop 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 shutdown_connections 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efce006ed60 0x7efce0071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf40fe500 0x7efcf410d620 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 --2- 172.21.15.110:0/1040926931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf40fdbb0 0x7efcf410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 >> 172.21.15.110:0/1040926931 conn(0x7efcf40f63b0 msgr2=0x7efcf40f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 shutdown_connections 2024-09-16T02:02:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:56.409+0000 7efcf989b640 1 -- 172.21.15.110:0/1040926931 wait complete. 2024-09-16T02:02:57.144 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:56 smithi110 ceph-mon[27634]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:02:57.171 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-16T02:02:57.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:56 smithi165 ceph-mon[34621]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:02:57.416 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:02:58.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:57 smithi165 ceph-mon[34621]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:58.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:57 smithi110 ceph-mon[27634]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 -- 172.21.15.110:0/316929601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fc720 msgr2=0x7fa5940fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 --2- 172.21.15.110:0/316929601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fc720 0x7fa5940fcb90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0048d0 tx=0x7fa57c009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 -- 172.21.15.110:0/316929601 shutdown_connections 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 --2- 172.21.15.110:0/316929601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fc720 0x7fa5940fcb90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 --2- 172.21.15.110:0/316929601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5940fb450 0x7fa5940fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 -- 172.21.15.110:0/316929601 >> 172.21.15.110:0/316929601 conn(0x7fa5940f6c10 msgr2=0x7fa5940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 -- 172.21.15.110:0/316929601 shutdown_connections 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 -- 172.21.15.110:0/316929601 wait complete. 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.082+0000 7fa598a80640 1 Processor -- start 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 -- start start 2024-09-16T02:02:59.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 0x7fa59410fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5940fc720 0x7fa5941122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594066770 con 0x7fa5940fb450 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5940668e0 con 0x7fa5940fc720 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 0x7fa59410fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 0x7fa59410fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56494/0 (socket says 172.21.15.110:56494) 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 -- 172.21.15.110:0/3695164606 learned_addr learned my addr 172.21.15.110:0/3695164606 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 -- 172.21.15.110:0/3695164606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5940fc720 msgr2=0x7fa5941122e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5940fc720 0x7fa5941122e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 -- 172.21.15.110:0/3695164606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c005040 con 0x7fa5940fb450 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa59259c640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 0x7fa59410fd90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa584002a50 tx=0x7fa584004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa584007c30 con 0x7fa5940fb450 2024-09-16T02:02:59.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa594112880 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa58400f040 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa58400da90 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.083+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa594112e20 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.085+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5940fa8b0 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.085+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa58400dd00 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.086+0000 7fa58affd640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa58006ed60 0x7fa580071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.086+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa58408d700 con 0x7fa5940fb450 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.086+0000 7fa58bfff640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa58006ed60 0x7fa580071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:02:59.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.087+0000 7fa58bfff640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa58006ed60 0x7fa580071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa57c02a530 tx=0x7fa57c009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:02:59.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.090+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa58404d2a0 con 0x7fa5940fb450 2024-09-16T02:02:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.254+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa594100ac0 con 0x7fa58006ed60 2024-09-16T02:02:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.258+0000 7fa58affd640 1 -- 172.21.15.110:0/3695164606 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fa594100ac0 con 0x7fa58006ed60 2024-09-16T02:02:59.260 INFO:teuthology.orchestra.run.smithi110.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-16T02:02:59.260 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-16T02:02:59.260 INFO:teuthology.orchestra.run.smithi110.stdout:crash 2/2 2m ago 5m * 2024-09-16T02:02:59.261 INFO:teuthology.orchestra.run.smithi110.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-16T02:02:59.261 INFO:teuthology.orchestra.run.smithi110.stdout:mgr 2/2 2m ago 5m count:2 2024-09-16T02:02:59.261 INFO:teuthology.orchestra.run.smithi110.stdout:mon 2/2 2m ago 4m smithi110:172.21.15.110=smithi110;smithi165:172.21.15.165=smithi165;count:2 2024-09-16T02:02:59.261 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-16T02:02:59.261 INFO:teuthology.orchestra.run.smithi110.stdout:osd 6 2m ago - 2024-09-16T02:02:59.261 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-16T02:02:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa58006ed60 msgr2=0x7fa580071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa58006ed60 0x7fa580071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa57c02a530 tx=0x7fa57c009da0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 msgr2=0x7fa59410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:02:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 0x7fa59410fd90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa584002a50 tx=0x7fa584004600 comp rx=0 tx=0).stop 2024-09-16T02:02:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 shutdown_connections 2024-09-16T02:02:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa58006ed60 0x7fa580071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5940fc720 0x7fa5941122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 --2- 172.21.15.110:0/3695164606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5940fb450 0x7fa59410fd90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:02:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 >> 172.21.15.110:0/3695164606 conn(0x7fa5940f6c10 msgr2=0x7fa5940f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:02:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 shutdown_connections 2024-09-16T02:02:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:02:59.260+0000 7fa598a80640 1 -- 172.21.15.110:0/3695164606 wait complete. 2024-09-16T02:02:59.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-16T02:03:00.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:59 smithi165 ceph-mon[34621]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:00.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:02:59 smithi165 ceph-mon[34621]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:00.201 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:00.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:59 smithi110 ceph-mon[27634]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:00.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:02:59 smithi110 ceph-mon[27634]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- 172.21.15.110:0/289512815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 msgr2=0x7f5fd00fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/289512815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd00fc940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009c50 tx=0x7f5fc0004d10 comp rx=0 tx=0).stop 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- 172.21.15.110:0/289512815 shutdown_connections 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/289512815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 0x7f5fd00fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/289512815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd00fc940 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- 172.21.15.110:0/289512815 >> 172.21.15.110:0/289512815 conn(0x7f5fd00f7d10 msgr2=0x7f5fd00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- 172.21.15.110:0/289512815 shutdown_connections 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- 172.21.15.110:0/289512815 wait complete. 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 Processor -- start 2024-09-16T02:03:01.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- start start 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 0x7f5fd006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd006fff0 con 0x7f5fd00fc530 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.922+0000 7f5fd82e2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0070130 con 0x7f5fd00fd800 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd0071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51650/0 (socket says 172.21.15.110:51650) 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 -- 172.21.15.110:0/599559267 learned_addr learned my addr 172.21.15.110:0/599559267 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 -- 172.21.15.110:0/599559267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 msgr2=0x7f5fd006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd587d640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 0x7f5fd006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 0x7f5fd006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 -- 172.21.15.110:0/599559267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00098b0 con 0x7f5fd00fc530 2024-09-16T02:03:01.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd587d640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 0x7f5fd006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd607e640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd0071570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0004a30 tx=0x7f5fc0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fc0032850 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5fc0009710 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd00703b0 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fc003dc20 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.923+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd01150e0 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.924+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd00fb990 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.925+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5fc002f030 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.925+0000 7f5fceffd640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f5fb806ed60 0x7f5fb8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.925+0000 7f5fd587d640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f5fb806ed60 0x7f5fb8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.925+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5fc00af550 con 0x7f5fd00fc530 2024-09-16T02:03:01.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.926+0000 7f5fd587d640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f5fb806ed60 0x7f5fb8071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40041d0 tx=0x7f5fc4009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:01.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:01.930+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5fc007c9b0 con 0x7f5fd00fc530 2024-09-16T02:03:02.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.087+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fd0101c20 con 0x7f5fb806ed60 2024-09-16T02:03:02.090 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:01 smithi110 ceph-mon[27634]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:02.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.088+0000 7f5fceffd640 1 -- 172.21.15.110:0/599559267 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f5fd0101c20 con 0x7f5fb806ed60 2024-09-16T02:03:02.091 INFO:teuthology.orchestra.run.smithi110.stdout:HOST ADDR LABELS STATUS 2024-09-16T02:03:02.091 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 172.21.15.110 2024-09-16T02:03:02.091 INFO:teuthology.orchestra.run.smithi110.stdout:smithi165 172.21.15.165 2024-09-16T02:03:02.091 INFO:teuthology.orchestra.run.smithi110.stdout:2 hosts in cluster 2024-09-16T02:03:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.090+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f5fb806ed60 msgr2=0x7f5fb8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.090+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f5fb806ed60 0x7f5fb8071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40041d0 tx=0x7f5fc4009040 comp rx=0 tx=0).stop 2024-09-16T02:03:02.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.090+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 msgr2=0x7f5fd0071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.090+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd0071570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0004a30 tx=0x7f5fc0004d10 comp rx=0 tx=0).stop 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 shutdown_connections 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f5fb806ed60 0x7f5fb8071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd00fd800 0x7f5fd006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 --2- 172.21.15.110:0/599559267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fd00fc530 0x7f5fd0071570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 >> 172.21.15.110:0/599559267 conn(0x7f5fd00f7d10 msgr2=0x7f5fd00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 shutdown_connections 2024-09-16T02:03:02.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:02.091+0000 7f5fd82e2640 1 -- 172.21.15.110:0/599559267 wait complete. 2024-09-16T02:03:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:01 smithi165 ceph-mon[34621]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:02.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-16T02:03:03.063 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:03.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:02 smithi110 ceph-mon[27634]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:03.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:03.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:02 smithi165 ceph-mon[34621]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:03.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:04.131 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:03 smithi110 ceph-mon[27634]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:04.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:03 smithi165 ceph-mon[34621]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:04.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 -- 172.21.15.110:0/2033725459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 msgr2=0x7fc46c0fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:04.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2033725459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fa650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0048d0 tx=0x7fc45c009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 -- 172.21.15.110:0/2033725459 shutdown_connections 2024-09-16T02:03:04.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2033725459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fa650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2033725459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc46c0fdba0 0x7fc46c0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 -- 172.21.15.110:0/2033725459 >> 172.21.15.110:0/2033725459 conn(0x7fc46c0f63a0 msgr2=0x7fc46c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 -- 172.21.15.110:0/2033725459 shutdown_connections 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 -- 172.21.15.110:0/2033725459 wait complete. 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.569+0000 7fc471dd6640 1 Processor -- start 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc471dd6640 1 -- start start 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc471dd6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc46c0fdba0 0x7fc46c0fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc471dd6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc471dd6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0fbdc0 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc471dd6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0fbf00 con 0x7fc46c0fdba0 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51668/0 (socket says 172.21.15.110:51668) 2024-09-16T02:03:04.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 -- 172.21.15.110:0/2416911945 learned_addr learned my addr 172.21.15.110:0/2416911945 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46b7fe640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc46c0fdba0 0x7fc46c0fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 -- 172.21.15.110:0/2416911945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc46c0fdba0 msgr2=0x7fc46c0fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc46c0fdba0 0x7fc46c0fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 -- 172.21.15.110:0/2416911945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c005040 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.570+0000 7fc46affd640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fb880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0048a0 tx=0x7fc45c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.571+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45c038070 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.571+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc45c02abd0 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.571+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c0fc180 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.571+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45c033640 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.571+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c115130 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.572+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c0fa040 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.572+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc45c030020 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.573+0000 7fc453fff640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc45406ed60 0x7fc454071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:04.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.573+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc45c0ae100 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.573+0000 7fc46b7fe640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc45406ed60 0x7fc454071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:04.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.573+0000 7fc46b7fe640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc45406ed60 0x7fc454071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4600041d0 tx=0x7fc460004330 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:04.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.577+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc45c07b610 con 0x7fc46c0fe4f0 2024-09-16T02:03:04.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.739+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc46c101d80 con 0x7fc45406ed60 2024-09-16T02:03:04.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.741+0000 7fc453fff640 1 -- 172.21.15.110:0/2416911945 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fc46c101d80 con 0x7fc45406ed60 2024-09-16T02:03:04.743 INFO:teuthology.orchestra.run.smithi110.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-16T02:03:04.743 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002T480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-16T02:03:04.743 INFO:teuthology.orchestra.run.smithi110.stdout:smithi165 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CE400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc45406ed60 msgr2=0x7fc454071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc45406ed60 0x7fc454071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4600041d0 tx=0x7fc460004330 comp rx=0 tx=0).stop 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 msgr2=0x7fc46c0fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fb880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0048a0 tx=0x7fc45c009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 shutdown_connections 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fc45406ed60 0x7fc454071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc46c0fe4f0 0x7fc46c0fb880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 --2- 172.21.15.110:0/2416911945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc46c0fdba0 0x7fc46c0fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:04.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 >> 172.21.15.110:0/2416911945 conn(0x7fc46c0f63a0 msgr2=0x7fc46c0f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:04.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 shutdown_connections 2024-09-16T02:03:04.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:04.743+0000 7fc471dd6640 1 -- 172.21.15.110:0/2416911945 wait complete. 2024-09-16T02:03:05.523 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:03:05.532 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:03:05.532 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-16T02:03:05.776 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:06.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:05 smithi110 ceph-mon[27634]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:06.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:05 smithi110 ceph-mon[27634]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:06.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:05 smithi165 ceph-mon[34621]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:06.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:05 smithi165 ceph-mon[34621]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:07.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 -- 172.21.15.110:0/3194144479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 msgr2=0x7f63a40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:07.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 --2- 172.21.15.110:0/3194144479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a40fdc60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f638c0048d0 tx=0x7f638c009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:07.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 -- 172.21.15.110:0/3194144479 shutdown_connections 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 --2- 172.21.15.110:0/3194144479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a40fdc60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 --2- 172.21.15.110:0/3194144479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 0x7f63a40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 -- 172.21.15.110:0/3194144479 >> 172.21.15.110:0/3194144479 conn(0x7f63a40f7ce0 msgr2=0x7f63a40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 -- 172.21.15.110:0/3194144479 shutdown_connections 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 -- 172.21.15.110:0/3194144479 wait complete. 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.347+0000 7f63a9931640 1 Processor -- start 2024-09-16T02:03:07.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a9931640 1 -- start start 2024-09-16T02:03:07.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a9931640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 0x7f63a410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:07.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a9931640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a410d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:07.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a9931640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a410dbf0 con 0x7f63a40fd7f0 2024-09-16T02:03:07.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a9931640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a410e410 con 0x7f63a40fc520 2024-09-16T02:03:07.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a410d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:07.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a410d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51692/0 (socket says 172.21.15.110:51692) 2024-09-16T02:03:07.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 -- 172.21.15.110:0/3990457802 learned_addr learned my addr 172.21.15.110:0/3990457802 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:07.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a2ffd640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 0x7f63a410d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:07.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 -- 172.21.15.110:0/3990457802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 msgr2=0x7f63a410d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:07.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 0x7f63a410d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:07.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 -- 172.21.15.110:0/3990457802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c005040 con 0x7f63a40fd7f0 2024-09-16T02:03:07.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f63a2ffd640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 0x7f63a410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:03:07.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639a7fc640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a410d5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f638c003080 tx=0x7f638c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:07.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.348+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f638c038070 con 0x7f63a40fd7f0 2024-09-16T02:03:07.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.349+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a410e640 con 0x7f63a40fd7f0 2024-09-16T02:03:07.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.349+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f638c02abd0 con 0x7f63a40fd7f0 2024-09-16T02:03:07.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.349+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f638c03e670 con 0x7f63a40fd7f0 2024-09-16T02:03:07.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.349+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a410ebe0 con 0x7f63a40fd7f0 2024-09-16T02:03:07.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.349+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a40fb980 con 0x7f63a40fd7f0 2024-09-16T02:03:07.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.350+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f638c030020 con 0x7f63a40fd7f0 2024-09-16T02:03:07.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.351+0000 7f639bfff640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f639006ed60 0x7f6390071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:07.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.351+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f638c0ae250 con 0x7f63a40fd7f0 2024-09-16T02:03:07.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.351+0000 7f63a2ffd640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f639006ed60 0x7f6390071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:07.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.351+0000 7f63a2ffd640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f639006ed60 0x7f6390071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6394004c80 tx=0x7f6394009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:07.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.355+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f638c07b6b0 con 0x7f63a40fd7f0 2024-09-16T02:03:07.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:07.532+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f63a410eef0 con 0x7f639006ed60 2024-09-16T02:03:08.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:07 smithi165 ceph-mon[34621]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:08.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:07 smithi165 ceph-mon[34621]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:08.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:07 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-16T02:03:08.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:07 smithi110 ceph-mon[27634]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:08.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:07 smithi110 ceph-mon[27634]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:03:08.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:07 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-16T02:03:08.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.980+0000 7f639bfff640 1 -- 172.21.15.110:0/3990457802 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f63a410eef0 con 0x7f639006ed60 2024-09-16T02:03:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.982+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f639006ed60 msgr2=0x7f6390071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.982+0000 7f63a9931640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f639006ed60 0x7f6390071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6394004c80 tx=0x7f6394009040 comp rx=0 tx=0).stop 2024-09-16T02:03:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.982+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 msgr2=0x7f63a410d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.982+0000 7f63a9931640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a410d5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f638c003080 tx=0x7f638c009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 shutdown_connections 2024-09-16T02:03:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f639006ed60 0x7f6390071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:08.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63a40fd7f0 0x7f63a410d5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:08.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 --2- 172.21.15.110:0/3990457802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a40fc520 0x7f63a410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:08.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 >> 172.21.15.110:0/3990457802 conn(0x7f63a40f7ce0 msgr2=0x7f63a40f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:08.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 shutdown_connections 2024-09-16T02:03:08.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:08.983+0000 7f63a9931640 1 -- 172.21.15.110:0/3990457802 wait complete. 2024-09-16T02:03:09.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-16T02:03:09.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:08 smithi110 ceph-mon[27634]: osdmap e40: 6 total, 6 up, 6 in 2024-09-16T02:03:09.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-16T02:03:09.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:08 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[27629]: 2024-09-16T02:03:08.958+0000 7fc832212640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:03:09.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-16T02:03:09.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:08 smithi165 ceph-mon[34621]: osdmap e40: 6 total, 6 up, 6 in 2024-09-16T02:03:09.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-16T02:03:09.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T02:03:10.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: pgmap v166: 33 pgs: 12 creating+peering, 20 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:10.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T02:03:10.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: osdmap e41: 6 total, 6 up, 6 in 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: osdmap e42: 6 total, 6 up, 6 in 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: fsmap cephfs:0 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: Saving service mds.cephfs spec with placement count:4 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:10.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:03:10.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:10.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:10.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:10.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:10.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:09 smithi110 ceph-mon[27634]: Deploying daemon mds.cephfs.smithi110.yaugxw on smithi110 2024-09-16T02:03:10.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: pgmap v166: 33 pgs: 12 creating+peering, 20 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: osdmap e41: 6 total, 6 up, 6 in 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: osdmap e42: 6 total, 6 up, 6 in 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: fsmap cephfs:0 2024-09-16T02:03:10.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: Saving service mds.cephfs spec with placement count:4 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:10.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:10.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:09 smithi165 ceph-mon[34621]: Deploying daemon mds.cephfs.smithi110.yaugxw on smithi110 2024-09-16T02:03:10.957 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:11.078 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:10 smithi110 ceph-mon[27634]: osdmap e43: 6 total, 6 up, 6 in 2024-09-16T02:03:11.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:10 smithi165 ceph-mon[34621]: osdmap e43: 6 total, 6 up, 6 in 2024-09-16T02:03:12.110 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:11 smithi110 ceph-mon[27634]: pgmap v170: 65 pgs: 10 active+clean, 18 creating+peering, 37 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:12.110 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:11 smithi110 ceph-mon[27634]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-16T02:03:12.110 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:11 smithi110 ceph-mon[27634]: osdmap e44: 6 total, 6 up, 6 in 2024-09-16T02:03:12.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:11 smithi165 ceph-mon[34621]: pgmap v170: 65 pgs: 10 active+clean, 18 creating+peering, 37 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:12.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:11 smithi165 ceph-mon[34621]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-16T02:03:12.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:11 smithi165 ceph-mon[34621]: osdmap e44: 6 total, 6 up, 6 in 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 -- 172.21.15.110:0/1726581202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 msgr2=0x7fa4a80fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 --2- 172.21.15.110:0/1726581202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a80fb860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4980048d0 tx=0x7fa498009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 -- 172.21.15.110:0/1726581202 shutdown_connections 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 --2- 172.21.15.110:0/1726581202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a80fc720 0x7fa4a80fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 --2- 172.21.15.110:0/1726581202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a80fb860 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 -- 172.21.15.110:0/1726581202 >> 172.21.15.110:0/1726581202 conn(0x7fa4a80f6c10 msgr2=0x7fa4a80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 -- 172.21.15.110:0/1726581202 shutdown_connections 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.579+0000 7fa4ae525640 1 -- 172.21.15.110:0/1726581202 wait complete. 2024-09-16T02:03:12.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4ae525640 1 Processor -- start 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4ae525640 1 -- start start 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4ae525640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a810d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4ae525640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a80fc720 0x7fa4a810d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4ae525640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a810e550 con 0x7fa4a80fb450 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4ae525640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a810e6c0 con 0x7fa4a80fc720 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a810d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a810d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46160/0 (socket says 172.21.15.110:46160) 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 -- 172.21.15.110:0/357087407 learned_addr learned my addr 172.21.15.110:0/357087407 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 -- 172.21.15.110:0/357087407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a80fc720 msgr2=0x7fa4a810d730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a80fc720 0x7fa4a810d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 -- 172.21.15.110:0/357087407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498005040 con 0x7fa4a80fb450 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.580+0000 7fa4a7fff640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a810d1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa498009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:12.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.581+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa498038070 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.581+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa49802ae90 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.581+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a810e940 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.581+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49803d440 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.581+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a810ee00 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.582+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a80fa8b0 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.582+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa498030020 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.583+0000 7fa4a4ff9640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa49006ed50 0x7fa490071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.583+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa4980ae860 con 0x7fa4a80fb450 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.583+0000 7fa4a77fe640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa49006ed50 0x7fa490071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:12.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.583+0000 7fa4a77fe640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa49006ed50 0x7fa490071200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4a810cfa0 tx=0x7fa49c006ca0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:12.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.587+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa49807ba40 con 0x7fa4a80fb450 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.782+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4a8103ed0 con 0x7fa4a80fb450 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.782+0000 7fa4a4ff9640 1 -- 172.21.15.110:0/357087407 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fa49807b3e0 con 0x7fa4a80fb450 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stdout:e2 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:12.785 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 2 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:08.960123+0000 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:03:12.786 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:in 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:up {} 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data disabled 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 0 2024-09-16T02:03:12.787 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:12.788 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:12.788 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 2 2024-09-16T02:03:12.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa49006ed50 msgr2=0x7fa490071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:12.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa49006ed50 0x7fa490071200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4a810cfa0 tx=0x7fa49c006ca0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 msgr2=0x7fa4a810d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a810d1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa498000c00 tx=0x7fa498009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 shutdown_connections 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa49006ed50 0x7fa490071200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a80fc720 0x7fa4a810d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 --2- 172.21.15.110:0/357087407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4a80fb450 0x7fa4a810d1f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.784+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 >> 172.21.15.110:0/357087407 conn(0x7fa4a80f6c10 msgr2=0x7fa4a8066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.785+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 shutdown_connections 2024-09-16T02:03:12.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:12.785+0000 7fa4ae525640 1 -- 172.21.15.110:0/357087407 wait complete. 2024-09-16T02:03:13.259 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:12 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/357087407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:03:13.351 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:12 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/357087407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:03:13.796 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:03:13.806 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:03:13.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-16T02:03:14.061 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:14.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: pgmap v172: 65 pgs: 25 active+clean, 18 creating+peering, 22 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:14.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:14.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:14.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:14.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:14.432 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: Deploying daemon mds.cephfs.smithi165.hskfht on smithi165 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] up:boot 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: daemon mds.cephfs.smithi110.yaugxw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: Cluster is now healthy 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: fsmap cephfs:0 1 up:standby 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:creating} 2024-09-16T02:03:14.433 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:14 smithi110 ceph-mon[27634]: daemon mds.cephfs.smithi110.yaugxw is now active in filesystem cephfs as rank 0 2024-09-16T02:03:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: pgmap v172: 65 pgs: 25 active+clean, 18 creating+peering, 22 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: Deploying daemon mds.cephfs.smithi165.hskfht on smithi165 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] up:boot 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: daemon mds.cephfs.smithi110.yaugxw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: Cluster is now healthy 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: fsmap cephfs:0 1 up:standby 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:03:14.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:creating} 2024-09-16T02:03:14.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:14 smithi165 ceph-mon[34621]: daemon mds.cephfs.smithi110.yaugxw is now active in filesystem cephfs as rank 0 2024-09-16T02:03:15.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.642+0000 7f9c0c935640 1 -- 172.21.15.110:0/3273229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fd830 msgr2=0x7f9c080fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:15.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.642+0000 7f9c0c935640 1 --2- 172.21.15.110:0/3273229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fd830 0x7f9c080fdca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0048d0 tx=0x7f9bfc009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:15.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.642+0000 7f9c0c935640 1 -- 172.21.15.110:0/3273229907 shutdown_connections 2024-09-16T02:03:15.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.642+0000 7f9c0c935640 1 --2- 172.21.15.110:0/3273229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fd830 0x7f9c080fdca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:15.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.642+0000 7f9c0c935640 1 --2- 172.21.15.110:0/3273229907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c080fc560 0x7f9c080fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:15.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 -- 172.21.15.110:0/3273229907 >> 172.21.15.110:0/3273229907 conn(0x7f9c080f7d40 msgr2=0x7f9c080fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 -- 172.21.15.110:0/3273229907 shutdown_connections 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 -- 172.21.15.110:0/3273229907 wait complete. 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 Processor -- start 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 -- start start 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 0x7f9c0810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c080fd830 0x7f9c0810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0810dc60 con 0x7f9c080fc560 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0c935640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0810e430 con 0x7f9c080fd830 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 0x7f9c0810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:15.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 0x7f9c0810d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46196/0 (socket says 172.21.15.110:46196) 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c0659c640 1 -- 172.21.15.110:0/923181279 learned_addr learned my addr 172.21.15.110:0/923181279 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.643+0000 7f9c05d9b640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c080fd830 0x7f9c0810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9c0659c640 1 -- 172.21.15.110:0/923181279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c080fd830 msgr2=0x7f9c0810d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9c0659c640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c080fd830 0x7f9c0810d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9c0659c640 1 -- 172.21.15.110:0/923181279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc005040 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9c0659c640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 0x7f9c0810d0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8002a50 tx=0x7f9bf8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf8007c30 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0810e6c0 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9bf800f040 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf800da10 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.644+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0810ec60 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.645+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c080fb9c0 con 0x7f9c080fc560 2024-09-16T02:03:15.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.646+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9bf800dc80 con 0x7f9c080fc560 2024-09-16T02:03:15.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.646+0000 7f9bf6ffd640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9bf006ed60 0x7f9bf0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:15.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.646+0000 7f9c05d9b640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9bf006ed60 0x7f9bf0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:15.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.646+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9bf808d940 con 0x7f9c080fc560 2024-09-16T02:03:15.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.647+0000 7f9c05d9b640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9bf006ed60 0x7f9bf0071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c0810ce80 tx=0x7f9bfc035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:15.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.650+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9bf804d2a0 con 0x7f9c080fc560 2024-09-16T02:03:15.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:15.849+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f9c0810ef40 con 0x7f9c080fc560 2024-09-16T02:03:16.165 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: pgmap v173: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] up:active 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:16.166 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:15 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/923181279' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T02:03:16.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.407+0000 7f9bf6ffd640 1 -- 172.21.15.110:0/923181279 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9bf805abd0 con 0x7f9c080fc560 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.410+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9bf006ed60 msgr2=0x7f9bf0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.410+0000 7f9c0c935640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9bf006ed60 0x7f9bf0071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c0810ce80 tx=0x7f9bfc035040 comp rx=0 tx=0).stop 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.410+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 msgr2=0x7f9c0810d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.410+0000 7f9c0c935640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 0x7f9c0810d0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8002a50 tx=0x7f9bf8004600 comp rx=0 tx=0).stop 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 shutdown_connections 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9bf006ed60 0x7f9bf0071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c080fd830 0x7f9c0810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 --2- 172.21.15.110:0/923181279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c080fc560 0x7f9c0810d0d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:16.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 >> 172.21.15.110:0/923181279 conn(0x7f9c080f7d40 msgr2=0x7f9c080f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:16.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 shutdown_connections 2024-09-16T02:03:16.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:16.411+0000 7f9c0c935640 1 -- 172.21.15.110:0/923181279 wait complete. 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: pgmap v173: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] up:active 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:16.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:16.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:16.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:15 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/923181279' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T02:03:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:17 smithi110 ceph-mon[27634]: Deploying daemon mds.cephfs.smithi110.svegdg on smithi110 2024-09-16T02:03:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:17 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.165:6824/841669092,v1:172.21.15.165:6825/841669092] up:boot 2024-09-16T02:03:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:17 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/923181279' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-16T02:03:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:17 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby 2024-09-16T02:03:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:17 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:03:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:17 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby 2024-09-16T02:03:17.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:17 smithi165 ceph-mon[34621]: Deploying daemon mds.cephfs.smithi110.svegdg on smithi110 2024-09-16T02:03:17.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:17 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.165:6824/841669092,v1:172.21.15.165:6825/841669092] up:boot 2024-09-16T02:03:17.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:17 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/923181279' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-16T02:03:17.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:17 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby 2024-09-16T02:03:17.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:17 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:03:17.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:17 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby 2024-09-16T02:03:17.933 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:03:17.944 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:03:17.944 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-16T02:03:18.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:18 smithi110 ceph-mon[27634]: pgmap v174: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 393 B/s wr, 1 op/s 2024-09-16T02:03:18.421 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:18.569 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:18.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:18 smithi165 ceph-mon[34621]: pgmap v174: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 393 B/s wr, 1 op/s 2024-09-16T02:03:18.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:19.704 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:19.704 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:19.704 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:19.704 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:19.704 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:19.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:19.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: Deploying daemon mds.cephfs.smithi165.gxrypw on smithi165 2024-09-16T02:03:19.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-16T02:03:19.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] up:boot 2024-09-16T02:03:19.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2 up:standby 2024-09-16T02:03:19.705 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:19 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:03:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: Deploying daemon mds.cephfs.smithi165.gxrypw on smithi165 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] up:boot 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2 up:standby 2024-09-16T02:03:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:19 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 -- 172.21.15.110:0/2496685757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 msgr2=0x7f9ffc0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 --2- 172.21.15.110:0/2496685757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc0fb860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0048d0 tx=0x7f9fec009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 -- 172.21.15.110:0/2496685757 shutdown_connections 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 --2- 172.21.15.110:0/2496685757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 0x7f9ffc0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 --2- 172.21.15.110:0/2496685757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc0fb860 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 -- 172.21.15.110:0/2496685757 >> 172.21.15.110:0/2496685757 conn(0x7f9ffc0f6c10 msgr2=0x7f9ffc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 -- 172.21.15.110:0/2496685757 shutdown_connections 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 -- 172.21.15.110:0/2496685757 wait complete. 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 Processor -- start 2024-09-16T02:03:20.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 -- start start 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc10fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.146+0000 7fa0022d3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 0x7f9ffc112390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7fa0022d3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc066840 con 0x7f9ffc0fb450 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7fa0022d3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0669b0 con 0x7f9ffc0fc720 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc10fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc10fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46232/0 (socket says 172.21.15.110:46232) 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 -- 172.21.15.110:0/3277225180 learned_addr learned my addr 172.21.15.110:0/3277225180 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ff3fff640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 0x7f9ffc112390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 -- 172.21.15.110:0/3277225180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 msgr2=0x7f9ffc112390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 0x7f9ffc112390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 -- 172.21.15.110:0/3277225180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec005040 con 0x7f9ffc0fb450 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ff3fff640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 0x7f9ffc112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:03:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ffbfff640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc10fe40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fec003080 tx=0x7f9fec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fec038070 con 0x7f9ffc0fb450 2024-09-16T02:03:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc112990 con 0x7f9ffc0fb450 2024-09-16T02:03:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9fec02abd0 con 0x7f9ffc0fb450 2024-09-16T02:03:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fec03e670 con 0x7f9ffc0fb450 2024-09-16T02:03:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.147+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc112eb0 con 0x7f9ffc0fb450 2024-09-16T02:03:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.148+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc0fa8b0 con 0x7f9ffc0fb450 2024-09-16T02:03:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.149+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9fec030020 con 0x7f9ffc0fb450 2024-09-16T02:03:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.149+0000 7f9ff97fa640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9fe806ed60 0x7f9fe8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.150+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9fec0ae590 con 0x7f9ffc0fb450 2024-09-16T02:03:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.150+0000 7f9ff3fff640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9fe806ed60 0x7f9fe8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.150+0000 7f9ff3fff640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9fe806ed60 0x7f9fe8071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4006fd0 tx=0x7f9fe4008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:20.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.153+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9fec07b6b0 con 0x7f9ffc0fb450 2024-09-16T02:03:20.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.340+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f9ffc04b720 con 0x7f9ffc0fb450 2024-09-16T02:03:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.598+0000 7f9ff97fa640 1 -- 172.21.15.110:0/3277225180 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f9fec07b050 con 0x7f9ffc0fb450 2024-09-16T02:03:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9fe806ed60 msgr2=0x7f9fe8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9fe806ed60 0x7f9fe8071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4006fd0 tx=0x7f9fe4008040 comp rx=0 tx=0).stop 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 msgr2=0x7f9ffc10fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc10fe40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9fec003080 tx=0x7f9fec009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 shutdown_connections 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9fe806ed60 0x7f9fe8071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ffc0fc720 0x7f9ffc112390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 --2- 172.21.15.110:0/3277225180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ffc0fb450 0x7f9ffc10fe40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 >> 172.21.15.110:0/3277225180 conn(0x7f9ffc0f6c10 msgr2=0x7f9ffc0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 shutdown_connections 2024-09-16T02:03:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:20.600+0000 7fa0022d3640 1 -- 172.21.15.110:0/3277225180 wait complete. 2024-09-16T02:03:20.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:20 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3277225180' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T02:03:20.926 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:20 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3277225180' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T02:03:21.269 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:03:21.280 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:03:21.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-16T02:03:21.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3277225180' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T02:03:21.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2 up:standby 2024-09-16T02:03:21.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 1 up:standby 2024-09-16T02:03:21.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-16T02:03:21.857 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:21 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3277225180' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2 up:standby 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 1 up:standby 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:21.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:21 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:03:22.168 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:22.634 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:22 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:boot 2024-09-16T02:03:22.634 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:22 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:22.635 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:22 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:03:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:22 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:boot 2024-09-16T02:03:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:22 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:22 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:03:23.683 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] up:active 2024-09-16T02:03:23.683 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] up:standby 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: Dropping low affinity standby-replay daemon mds.cephfs.smithi165.hskfht in favor of higher affinity standby. 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 1 up:standby 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 86 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:23.684 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:23 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:23.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 -- 172.21.15.110:0/3553375631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fb430 msgr2=0x7f0c780fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:23.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 --2- 172.21.15.110:0/3553375631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fb430 0x7f0c780fb840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c740048d0 tx=0x7f0c74009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:23.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 -- 172.21.15.110:0/3553375631 shutdown_connections 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 --2- 172.21.15.110:0/3553375631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c780fc700 0x7f0c780fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 --2- 172.21.15.110:0/3553375631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fb430 0x7f0c780fb840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 -- 172.21.15.110:0/3553375631 >> 172.21.15.110:0/3553375631 conn(0x7f0c780f6c10 msgr2=0x7f0c780f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 -- 172.21.15.110:0/3553375631 shutdown_connections 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 -- 172.21.15.110:0/3553375631 wait complete. 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 Processor -- start 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.907+0000 7f0c8059e640 1 -- start start 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c8059e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c780fb430 0x7f0c7810bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c8059e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 0x7f0c7810c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c8059e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7810cb00 con 0x7f0c780fc700 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c8059e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7810d2b0 con 0x7f0c780fb430 2024-09-16T02:03:23.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 0x7f0c7810c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 0x7f0c7810c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44076/0 (socket says 172.21.15.110:44076) 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 -- 172.21.15.110:0/542233710 learned_addr learned my addr 172.21.15.110:0/542233710 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7e33a640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c780fb430 0x7f0c7810bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 -- 172.21.15.110:0/542233710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c780fb430 msgr2=0x7f0c7810bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c780fb430 0x7f0c7810bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 -- 172.21.15.110:0/542233710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74005040 con 0x7f0c780fc700 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c7db39640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 0x7f0c7810c4b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800c830 tx=0x7f0c68004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6800a850 con 0x7f0c780fc700 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c6800ae50 con 0x7f0c780fc700 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7810d540 con 0x7f0c780fc700 2024-09-16T02:03:23.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c680113a0 con 0x7f0c780fc700 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.908+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7810dae0 con 0x7f0c780fc700 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.909+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780fa890 con 0x7f0c780fc700 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.910+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0c68012400 con 0x7f0c780fc700 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.910+0000 7f0c6effd640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0c6406ed60 0x7f0c64071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.911+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0c6808e3c0 con 0x7f0c780fc700 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.911+0000 7f0c7e33a640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0c6406ed60 0x7f0c64071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:23.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.911+0000 7f0c7e33a640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0c6406ed60 0x7f0c64071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000c00 tx=0x7f0c74009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:23.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:23.915+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c6805b560 con 0x7f0c780fc700 2024-09-16T02:03:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] up:active 2024-09-16T02:03:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] up:standby 2024-09-16T02:03:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: Dropping low affinity standby-replay daemon mds.cephfs.smithi165.hskfht in favor of higher affinity standby. 2024-09-16T02:03:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 1 up:standby 2024-09-16T02:03:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 86 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-16T02:03:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:23.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:23 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:24.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.114+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c7804b720 con 0x7f0c780fc700 2024-09-16T02:03:24.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.631+0000 7f0c6effd640 1 -- 172.21.15.110:0/542233710 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v15) v1 ==== 168+0+0 (secure 0 0 0) 0x7f0c6805af00 con 0x7f0c780fc700 2024-09-16T02:03:24.633 INFO:teuthology.orchestra.run.smithi110.stderr:inline data enabled 2024-09-16T02:03:24.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0c6406ed60 msgr2=0x7f0c64071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:24.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0c6406ed60 0x7f0c64071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000c00 tx=0x7f0c74009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 msgr2=0x7f0c7810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 0x7f0c7810c4b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800c830 tx=0x7f0c68004430 comp rx=0 tx=0).stop 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 shutdown_connections 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f0c6406ed60 0x7f0c64071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c780fc700 0x7f0c7810c4b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 --2- 172.21.15.110:0/542233710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c780fb430 0x7f0c7810bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 >> 172.21.15.110:0/542233710 conn(0x7f0c780f6c10 msgr2=0x7f0c780f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.633+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 shutdown_connections 2024-09-16T02:03:24.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:24.634+0000 7f0c8059e640 1 -- 172.21.15.110:0/542233710 wait complete. 2024-09-16T02:03:24.918 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:24 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] up:boot 2024-09-16T02:03:24.918 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:24 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:24.918 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:24 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:03:24.918 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:24 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/542233710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T02:03:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:24 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] up:boot 2024-09-16T02:03:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:24 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:24 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:03:24.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:24 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/542233710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T02:03:25.357 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:03:25.367 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:03:25.367 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T02:03:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:25 smithi165 ceph-mon[34621]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-16T02:03:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:25 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/542233710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T02:03:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:25 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:25 smithi165 ceph-mon[34621]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-16T02:03:25.922 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:25 smithi110 ceph-mon[27634]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-16T02:03:25.922 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:25 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/542233710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T02:03:25.922 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:25 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:25.922 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:25 smithi110 ceph-mon[27634]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-16T02:03:26.004 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:26 smithi165 ceph-mon[34621]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:standby 2024-09-16T02:03:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:26 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:26 smithi110 ceph-mon[27634]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:standby 2024-09-16T02:03:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:26 smithi110 ceph-mon[27634]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:03:27.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:27 smithi165 ceph-mon[34621]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-16T02:03:27.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:27 smithi110 ceph-mon[27634]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-16T02:03:28.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 -- 172.21.15.110:0/3109996936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fb450 msgr2=0x7efe640fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:28.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 --2- 172.21.15.110:0/3109996936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fb450 0x7efe640fb860 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efe540048d0 tx=0x7efe54009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 -- 172.21.15.110:0/3109996936 shutdown_connections 2024-09-16T02:03:28.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 --2- 172.21.15.110:0/3109996936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe640fc720 0x7efe640fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 --2- 172.21.15.110:0/3109996936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fb450 0x7efe640fb860 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 -- 172.21.15.110:0/3109996936 >> 172.21.15.110:0/3109996936 conn(0x7efe640f6c10 msgr2=0x7efe640f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 -- 172.21.15.110:0/3109996936 shutdown_connections 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.139+0000 7efe69172640 1 -- 172.21.15.110:0/3109996936 wait complete. 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe69172640 1 Processor -- start 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe69172640 1 -- start start 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe69172640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe640fb450 0x7efe6410c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe69172640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 0x7efe6410c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:28.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe69172640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6410d3b0 con 0x7efe640fc720 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe69172640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6410d520 con 0x7efe640fb450 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe6259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 0x7efe6410c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe6259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 0x7efe6410c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44096/0 (socket says 172.21.15.110:44096) 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe6259c640 1 -- 172.21.15.110:0/1208193362 learned_addr learned my addr 172.21.15.110:0/1208193362 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe6259c640 1 -- 172.21.15.110:0/1208193362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe640fb450 msgr2=0x7efe6410c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe6259c640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe640fb450 0x7efe6410c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.140+0000 7efe6259c640 1 -- 172.21.15.110:0/1208193362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54005040 con 0x7efe640fc720 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.141+0000 7efe6259c640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 0x7efe6410c540 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efe5800b790 tx=0x7efe580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.141+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5800c700 con 0x7efe640fc720 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.141+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6410d800 con 0x7efe640fc720 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.141+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe5800cd00 con 0x7efe640fc720 2024-09-16T02:03:28.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.141+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe58015e70 con 0x7efe640fc720 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.141+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6410dd20 con 0x7efe640fc720 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.142+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe640fa8b0 con 0x7efe640fc720 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.142+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7efe58012070 con 0x7efe640fc720 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.143+0000 7efe4b7fe640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efe4c06ed60 0x7efe4c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.143+0000 7efe62d9d640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efe4c06ed60 0x7efe4c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.143+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efe5808dd00 con 0x7efe640fc720 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.143+0000 7efe62d9d640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efe4c06ed60 0x7efe4c071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe5402a530 tx=0x7efe54009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:28.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.147+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efe58091030 con 0x7efe640fc720 2024-09-16T02:03:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.350+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe6410dfa0 con 0x7efe640fc720 2024-09-16T02:03:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.350+0000 7efe4b7fe640 1 -- 172.21.15.110:0/1208193362 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1839 (secure 0 0 0) 0x7efe5805ae20 con 0x7efe640fc720 2024-09-16T02:03:28.353 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:03:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:03:28.355 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:03:28.356 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:03:28.357 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:03:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:03:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efe4c06ed60 msgr2=0x7efe4c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efe4c06ed60 0x7efe4c071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe5402a530 tx=0x7efe54009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 msgr2=0x7efe6410c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:28.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 0x7efe6410c540 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efe5800b790 tx=0x7efe580091d0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 shutdown_connections 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efe4c06ed60 0x7efe4c071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe640fc720 0x7efe6410c540 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 --2- 172.21.15.110:0/1208193362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe640fb450 0x7efe6410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 >> 172.21.15.110:0/1208193362 conn(0x7efe640f6c10 msgr2=0x7efe640f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 shutdown_connections 2024-09-16T02:03:28.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:28.354+0000 7efe69172640 1 -- 172.21.15.110:0/1208193362 wait complete. 2024-09-16T02:03:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:28 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1208193362' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:03:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:28 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1208193362' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:03:29.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-16T02:03:29.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:29 smithi110 ceph-mon[27634]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-16T02:03:29.734 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:29.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:29 smithi165 ceph-mon[34621]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-16T02:03:30.830 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:30.830 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:30.830 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:30.830 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:03:30.830 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:30.830 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:30 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:03:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:03:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:30.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:30 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:03:31.920 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:31 smithi110 ceph-mon[27634]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 -- 172.21.15.110:0/1445522775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 msgr2=0x7f46840fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 --2- 172.21.15.110:0/1445522775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f46840fc960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46740048d0 tx=0x7f4674009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 -- 172.21.15.110:0/1445522775 shutdown_connections 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 --2- 172.21.15.110:0/1445522775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46840fd820 0x7f46840fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 --2- 172.21.15.110:0/1445522775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f46840fc960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 -- 172.21.15.110:0/1445522775 >> 172.21.15.110:0/1445522775 conn(0x7f46840f7d30 msgr2=0x7f46840fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:31.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 -- 172.21.15.110:0/1445522775 shutdown_connections 2024-09-16T02:03:31.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 -- 172.21.15.110:0/1445522775 wait complete. 2024-09-16T02:03:31.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 Processor -- start 2024-09-16T02:03:31.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.921+0000 7f468bad1640 1 -- start start 2024-09-16T02:03:31.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468bad1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f468410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:31.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468bad1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46840fd820 0x7f468410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:31.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468bad1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468410dc10 con 0x7f46840fc550 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468bad1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468410e430 con 0x7f46840fd820 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f468410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f468410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42484/0 (socket says 172.21.15.110:42484) 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 -- 172.21.15.110:0/1214743479 learned_addr learned my addr 172.21.15.110:0/1214743479 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468906c640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46840fd820 0x7f468410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 -- 172.21.15.110:0/1214743479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46840fd820 msgr2=0x7f468410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46840fd820 0x7f468410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 -- 172.21.15.110:0/1214743479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674005040 con 0x7f46840fc550 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468986d640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f468410d080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46740043d0 tx=0x7f4674009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4674038070 con 0x7f46840fc550 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468410e660 con 0x7f46840fc550 2024-09-16T02:03:31.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f467402ae90 con 0x7f46840fc550 2024-09-16T02:03:31.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f467403e670 con 0x7f46840fc550 2024-09-16T02:03:31.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.922+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468410ec00 con 0x7f46840fc550 2024-09-16T02:03:31.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.923+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46840fb9b0 con 0x7f46840fc550 2024-09-16T02:03:31.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.924+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4674030020 con 0x7f46840fc550 2024-09-16T02:03:31.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.924+0000 7f467a7fc640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f467006ed60 0x7f4670071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:31.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.924+0000 7f468906c640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f467006ed60 0x7f4670071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:31.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.924+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f46740ae380 con 0x7f46840fc550 2024-09-16T02:03:31.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.925+0000 7f468906c640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f467006ed60 0x7f4670071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f468410ce30 tx=0x7f468000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:31.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:31.928+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f467407b550 con 0x7f46840fc550 2024-09-16T02:03:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:31 smithi165 ceph-mon[34621]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-16T02:03:32.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.129+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f468404b720 con 0x7f46840fc550 2024-09-16T02:03:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.129+0000 7f467a7fc640 1 -- 172.21.15.110:0/1214743479 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4703 (secure 0 0 0) 0x7f467407aef0 con 0x7f46840fc550 2024-09-16T02:03:32.131 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:03:32.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f467006ed60 msgr2=0x7f4670071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f467006ed60 0x7f4670071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f468410ce30 tx=0x7f468000b040 comp rx=0 tx=0).stop 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 msgr2=0x7f468410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f468410d080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46740043d0 tx=0x7f4674009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 shutdown_connections 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f467006ed60 0x7f4670071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46840fd820 0x7f468410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 --2- 172.21.15.110:0/1214743479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840fc550 0x7f468410d080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 >> 172.21.15.110:0/1214743479 conn(0x7f46840f7d30 msgr2=0x7f46840f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 shutdown_connections 2024-09-16T02:03:32.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:32.131+0000 7f468bad1640 1 -- 172.21.15.110:0/1214743479 wait complete. 2024-09-16T02:03:32.140 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:03:32.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-16T02:03:32.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:33.926 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:33.926 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:32 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1214743479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T02:03:33.927 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:33.927 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:33.927 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:32 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1214743479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T02:03:33.927 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:34.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:34.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:33 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:34.192 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:33 smithi110 ceph-mon[27634]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-16T02:03:34.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:33 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:34.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:33 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:34.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:33 smithi165 ceph-mon[34621]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-16T02:03:35.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:35 smithi110 ceph-mon[27634]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 -- 172.21.15.110:0/348295265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 msgr2=0x7f6c3c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 --2- 172.21.15.110:0/348295265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c0fcb70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6c300048d0 tx=0x7f6c30009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 -- 172.21.15.110:0/348295265 shutdown_connections 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 --2- 172.21.15.110:0/348295265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c0fcb70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 --2- 172.21.15.110:0/348295265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 0x7f6c3c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 -- 172.21.15.110:0/348295265 >> 172.21.15.110:0/348295265 conn(0x7f6c3c0f6c10 msgr2=0x7f6c3c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 -- 172.21.15.110:0/348295265 shutdown_connections 2024-09-16T02:03:35.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.878+0000 7f6c42870640 1 -- 172.21.15.110:0/348295265 wait complete. 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c42870640 1 Processor -- start 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c42870640 1 -- start start 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c42870640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 0x7f6c3c10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c42870640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c10c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c42870640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c10d370 con 0x7f6c3c0fc700 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c42870640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c10d4e0 con 0x7f6c3c0fb430 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c3b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c10c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c3b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c10c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42512/0 (socket says 172.21.15.110:42512) 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.879+0000 7f6c3b7fe640 1 -- 172.21.15.110:0/2376105391 learned_addr learned my addr 172.21.15.110:0/2376105391 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c3bfff640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 0x7f6c3c10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c3b7fe640 1 -- 172.21.15.110:0/2376105391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 msgr2=0x7f6c3c10bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:35.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c3b7fe640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 0x7f6c3c10bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c3b7fe640 1 -- 172.21.15.110:0/2376105391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30005040 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c3bfff640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 0x7f6c3c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c3b7fe640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c10c500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c30003080 tx=0x7f6c30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c30038070 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c3002abd0 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c10d760 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3003e670 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.880+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c10dc80 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.881+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c0fa890 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.881+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6c30030020 con 0x7f6c3c0fc700 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.882+0000 7f6c38ff9640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6c2406ed60 0x7f6c24071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.882+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c300ae590 con 0x7f6c3c0fc700 2024-09-16T02:03:35.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.882+0000 7f6c3bfff640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6c2406ed60 0x7f6c24071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:35.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.882+0000 7f6c3bfff640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6c2406ed60 0x7f6c24071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c34007fd0 tx=0x7f6c340074f0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:35.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:35.886+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c3007b6b0 con 0x7f6c3c0fc700 2024-09-16T02:03:36.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.107+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f6c3c04b720 con 0x7f6c3c0fc700 2024-09-16T02:03:36.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.108+0000 7f6c38ff9640 1 -- 172.21.15.110:0/2376105391 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+100 (secure 0 0 0) 0x7f6c3007b050 con 0x7f6c3c0fc700 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.109+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6c2406ed60 msgr2=0x7f6c24071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.109+0000 7f6c42870640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6c2406ed60 0x7f6c24071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c34007fd0 tx=0x7f6c340074f0 comp rx=0 tx=0).stop 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.109+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 msgr2=0x7f6c3c10c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c10c500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c30003080 tx=0x7f6c30009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 shutdown_connections 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f6c2406ed60 0x7f6c24071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c3c0fc700 0x7f6c3c10c500 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:36.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 --2- 172.21.15.110:0/2376105391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c3c0fb430 0x7f6c3c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:36.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 >> 172.21.15.110:0/2376105391 conn(0x7f6c3c0f6c10 msgr2=0x7f6c3c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:36.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 shutdown_connections 2024-09-16T02:03:36.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:36.110+0000 7f6c42870640 1 -- 172.21.15.110:0/2376105391 wait complete. 2024-09-16T02:03:36.119 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:03:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:35 smithi165 ceph-mon[34621]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-16T02:03:36.856 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-16T02:03:36.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T02:03:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:36 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/2376105391' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-16T02:03:37.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:36 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/2376105391' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-16T02:03:37.544 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:37 smithi110 ceph-mon[27634]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-16T02:03:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:37 smithi165 ceph-mon[34621]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-16T02:03:39.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 -- 172.21.15.110:0/3041519668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7281014b0 msgr2=0x7ff728101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/3041519668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7281014b0 0x7ff728101880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff7240048d0 tx=0x7ff724009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 -- 172.21.15.110:0/3041519668 shutdown_connections 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/3041519668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7280fb470 0x7ff7280fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/3041519668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7281014b0 0x7ff728101880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 -- 172.21.15.110:0/3041519668 >> 172.21.15.110:0/3041519668 conn(0x7ff7280f7030 msgr2=0x7ff7280f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 -- 172.21.15.110:0/3041519668 shutdown_connections 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.332+0000 7ff72f2fa640 1 -- 172.21.15.110:0/3041519668 wait complete. 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72f2fa640 1 Processor -- start 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72f2fa640 1 -- start start 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72f2fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 0x7ff72810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:39.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72f2fa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7281014b0 0x7ff72810c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72f2fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72810c9d0 con 0x7ff7280fb470 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72f2fa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72810cb10 con 0x7ff7281014b0 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72d096640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 0x7ff72810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72d096640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 0x7ff72810bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42532/0 (socket says 172.21.15.110:42532) 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72d096640 1 -- 172.21.15.110:0/1410527221 learned_addr learned my addr 172.21.15.110:0/1410527221 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72c895640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7281014b0 0x7ff72810c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72d096640 1 -- 172.21.15.110:0/1410527221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7281014b0 msgr2=0x7ff72810c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72d096640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7281014b0 0x7ff72810c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72d096640 1 -- 172.21.15.110:0/1410527221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724005040 con 0x7ff7280fb470 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.333+0000 7ff72c895640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7281014b0 0x7ff72810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.334+0000 7ff72d096640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 0x7ff72810bf50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff724003080 tx=0x7ff724009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.334+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff724038070 con 0x7ff7280fb470 2024-09-16T02:03:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.334+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff72402ade0 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.334+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72810cd90 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.334+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72402c880 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.334+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff728119830 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.335+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7280fcbb0 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.336+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff724030020 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.336+0000 7ff71dffb640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff71406ed50 0x7ff714071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.336+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff7240ae220 con 0x7ff7280fb470 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.336+0000 7ff72c895640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff71406ed50 0x7ff714071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.336+0000 7ff72c895640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff71406ed50 0x7ff714071200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7280662c0 tx=0x7ff718009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:39.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.340+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff72407b340 con 0x7ff7280fb470 2024-09-16T02:03:39.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.535+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7281084b0 con 0x7ff7280fb470 2024-09-16T02:03:39.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.535+0000 7ff71dffb640 1 -- 172.21.15.110:0/1410527221 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4703 (secure 0 0 0) 0x7ff7281084b0 con 0x7ff7280fb470 2024-09-16T02:03:39.537 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:03:39.537 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:03:24.623988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14444":{"gid":14444,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6827/3304502676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3304502676},{"type":"v1","addr":"172.21.15.110:6827","nonce":3304502676}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14454":{"gid":14454,"name":"cephfs.smithi110.svegdg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.110:6829/1889333536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1889333536},{"type":"v1","addr":"172.21.15.110:6829","nonce":1889333536}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-16T02:03:39.537 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:03:39.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff71406ed50 msgr2=0x7ff714071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff71406ed50 0x7ff714071200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7280662c0 tx=0x7ff718009040 comp rx=0 tx=0).stop 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 msgr2=0x7ff72810bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 0x7ff72810bf50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff724003080 tx=0x7ff724009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 shutdown_connections 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff71406ed50 0x7ff714071200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7281014b0 0x7ff72810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 --2- 172.21.15.110:0/1410527221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280fb470 0x7ff72810bf50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 >> 172.21.15.110:0/1410527221 conn(0x7ff7280f7030 msgr2=0x7ff7280f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 shutdown_connections 2024-09-16T02:03:39.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:39.537+0000 7ff72f2fa640 1 -- 172.21.15.110:0/1410527221 wait complete. 2024-09-16T02:03:40.205 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 50} 2024-09-16T02:03:40.206 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-16T02:03:40.234 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-16T02:03:40.234 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-16T02:03:40.234 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-16T02:03:40.234 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T02:03:40.234 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:40.234 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-16T02:03:40.235 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T02:03:40.235 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:40.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:40.235 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-09-16T02:03:40.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:40.253 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-09-16T02:03:40.323 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-09-16T02:03:40.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:03:40.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:40.324 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-16T02:03:40.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:40.344 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-16T02:03:40.420 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-16T02:03:40.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:03:40.422 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-16T02:03:40.422 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-16T02:03:40.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T02:03:40.444 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-16T02:03:40.444 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:40.445 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:40.445 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:40.445 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:03:40.445 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:40.445 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:40 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1410527221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T02:03:40.664 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-16T02:03:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:03:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:03:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:03:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:40 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1410527221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 -- 172.21.15.110:0/3742106277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 msgr2=0x7fd05c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 --2- 172.21.15.110:0/3742106277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c1018a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd0540048d0 tx=0x7fd054009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 -- 172.21.15.110:0/3742106277 shutdown_connections 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 --2- 172.21.15.110:0/3742106277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c0fb490 0x7fd05c0fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 --2- 172.21.15.110:0/3742106277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c1018a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 -- 172.21.15.110:0/3742106277 >> 172.21.15.110:0/3742106277 conn(0x7fd05c0f7010 msgr2=0x7fd05c0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 -- 172.21.15.110:0/3742106277 shutdown_connections 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 -- 172.21.15.110:0/3742106277 wait complete. 2024-09-16T02:03:42.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.321+0000 7fd063ef3640 1 Processor -- start 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 -- start start 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c0fb490 0x7fd05c10e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c10e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c10edb0 con 0x7fd05c1014d0 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c10ef20 con 0x7fd05c0fb490 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c10e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c10e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35808/0 (socket says 172.21.15.110:35808) 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 -- 172.21.15.110:0/1785426505 learned_addr learned my addr 172.21.15.110:0/1785426505 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 -- 172.21.15.110:0/1785426505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c0fb490 msgr2=0x7fd05c10e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd061c8f640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c0fb490 0x7fd05c10e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c0fb490 0x7fd05c10e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 -- 172.21.15.110:0/1785426505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054005040 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd06148e640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c10e720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd05000bbb0 tx=0x7fd050009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05000c9c0 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0500092e0 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05c1172b0 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd050007640 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.322+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c117780 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.323+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c0fcbd0 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.324+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd050012070 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.324+0000 7fd05a7fc640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd04406ed60 0x7fd044071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.324+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd05008e380 con 0x7fd05c1014d0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.324+0000 7fd061c8f640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd04406ed60 0x7fd044071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.325+0000 7fd061c8f640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd04406ed60 0x7fd044071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd054004540 tx=0x7fd054009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:42.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.328+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd05005b4a0 con 0x7fd05c1014d0 2024-09-16T02:03:42.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.518+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd05c04b720 con 0x7fd05c1014d0 2024-09-16T02:03:42.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.518+0000 7fd05a7fc640 1 -- 172.21.15.110:0/1785426505 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd05005ae40 con 0x7fd05c1014d0 2024-09-16T02:03:42.520 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-16T02:03:42.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd04406ed60 msgr2=0x7fd044071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:42.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd04406ed60 0x7fd044071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd054004540 tx=0x7fd054009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 msgr2=0x7fd05c10e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c10e720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd05000bbb0 tx=0x7fd050009840 comp rx=0 tx=0).stop 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 shutdown_connections 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd04406ed60 0x7fd044071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd05c1014d0 0x7fd05c10e720 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 --2- 172.21.15.110:0/1785426505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c0fb490 0x7fd05c10e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 >> 172.21.15.110:0/1785426505 conn(0x7fd05c0f7010 msgr2=0x7fd05c0f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 shutdown_connections 2024-09-16T02:03:42.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:42.520+0000 7fd063ef3640 1 -- 172.21.15.110:0/1785426505 wait complete. 2024-09-16T02:03:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:42 smithi165 ceph-mon[34621]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:03:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:42 smithi110 ceph-mon[27634]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T02:03:43.218 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T02:03:43.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T02:03:43.219 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T02:03:43.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:43.219 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-09-16T02:03:43.274 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T02:03:43.274 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-09-16T02:03:43.275 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42323sec preferred_lft 42323sec 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link noprefixroute 2024-09-16T02:03:43.276 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-16T02:03:43.276 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T02:03:43.277 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-16T02:03:43.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:43.445 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:43 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1785426505' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T02:03:43.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:43.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:43.477 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T02:03:43.502 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-09-16T02:03:43.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:43.504 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-09-16T02:03:43.590 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-09-16T02:03:43.591 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T02:03:43.591 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T02:03:43.591 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T02:03:43.591 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T02:03:43.591 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:43.591 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-16T02:03:43.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T02:03:43.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T02:03:43.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T02:03:43.592 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-16T02:03:43.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:43 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1785426505' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T02:03:43.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:43.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:43.853 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-09-16T02:03:43.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:43.869 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-09-16T02:03:43.924 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:43.924 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-16T02:03:43.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T02:03:43.925 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T02:03:43.925 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-16T02:03:44.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:44.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:44.041 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T02:03:44.042 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-16T02:03:44.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:44.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:44.170 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:44.170 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-16T02:03:44.170 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-09-16T02:03:44.170 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T02:03:44.170 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-16T02:03:44.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:44.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:44.247 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-16T02:03:44.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T02:03:44.247 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:44.276 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T02:03:44.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T02:03:44.276 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:44.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-09-16T02:03:44.398 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T02:03:44.454 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-09-16T02:03:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T02:03:44.456 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/64dc50e33069d3b878f669899f11b5eaa4b046f4eb154b684bdd9d40eb992bdf/merged 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/fe084bab34fc04f438f176ffd17eb8c9462a059a28a8efba7da29280cb45914e/merged 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/8e7790e479ed8c6f090bc79dc04d61e4ca72ab0dd2d0d8a34034d244cb539d36/merged 2024-09-16T02:03:44.457 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/c0532132b5bfe80325c9f5489559850283bfe24d18c1276c5998ac1574d34fe8/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/19b341152b4ab5f9bf4c3fe7a19793b728ff4d70054a63cd01f7c431724dff55/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/f2d5d202c6375afc0b00934e836eb19a54f018c3e735622d18c6c536786f3468/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1669315036e5a841af014b425cdde644496e188c30b9e41d3a598ac165facb09/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1ea6eb089152cbbfca30f74ac7e4be45e9630841665be553cac8ab2993298596/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/00b7363b1c1202c7b39fa8b707f66d9ce5af279f96536690b65e8b3a8999b0cf/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/7502edacc58a42e09488cc468e53b0f54c6e534f4d8fb6b52875084916818d16/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/162f2f88b87cfe63814a74183331d37ea8b836a9e3492ecf7cf626a29acfb32e/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/b9351ea410c48e4cbfff705d51c6c7f040cfa29933580a2a65a5c41998fe2e42/merged 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T02:03:44.458 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T02:03:44.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:44.459 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-09-16T02:03:44.510 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T02:03:44.511 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-16T02:03:44.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-09-16T02:03:44.578 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-09-16T02:03:44.634 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T02:03:44.635 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/64dc50e33069d3b878f669899f11b5eaa4b046f4eb154b684bdd9d40eb992bdf/merged 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/fe084bab34fc04f438f176ffd17eb8c9462a059a28a8efba7da29280cb45914e/merged 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/8e7790e479ed8c6f090bc79dc04d61e4ca72ab0dd2d0d8a34034d244cb539d36/merged 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/c0532132b5bfe80325c9f5489559850283bfe24d18c1276c5998ac1574d34fe8/merged 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/19b341152b4ab5f9bf4c3fe7a19793b728ff4d70054a63cd01f7c431724dff55/merged 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/f2d5d202c6375afc0b00934e836eb19a54f018c3e735622d18c6c536786f3468/merged 2024-09-16T02:03:44.636 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1669315036e5a841af014b425cdde644496e188c30b9e41d3a598ac165facb09/merged 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1ea6eb089152cbbfca30f74ac7e4be45e9630841665be553cac8ab2993298596/merged 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/00b7363b1c1202c7b39fa8b707f66d9ce5af279f96536690b65e8b3a8999b0cf/merged 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/7502edacc58a42e09488cc468e53b0f54c6e534f4d8fb6b52875084916818d16/merged 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/162f2f88b87cfe63814a74183331d37ea8b836a9e3492ecf7cf626a29acfb32e/merged 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/b9351ea410c48e4cbfff705d51c6c7f040cfa29933580a2a65a5c41998fe2e42/merged 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T02:03:44.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:44.637 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-09-16T02:03:44.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:2024-09-16T02:03:44.668+0000 7f9ee988e300 -1 init, newargv = 0x5613c6fea2e0 newargc=15 2024-09-16T02:03:44.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:ceph-fuse[74916]: starting ceph client 2024-09-16T02:03:44.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:ceph-fuse[74916]: starting fuse 2024-09-16T02:03:44.685 INFO:teuthology.orchestra.run.smithi110.stdout:153 2024-09-16T02:03:44.686 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [153] 2024-09-16T02:03:44.686 DEBUG:teuthology.orchestra.run.smithi110:> sudo stdin-killer -- python3 -c ' 2024-09-16T02:03:44.686 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2024-09-16T02:03:44.686 DEBUG:teuthology.orchestra.run.smithi110:> import re 2024-09-16T02:03:44.686 DEBUG:teuthology.orchestra.run.smithi110:> import os 2024-09-16T02:03:44.686 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2024-09-16T02:03:44.686 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T02:03:44.687 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> return f 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.0")) 2024-09-16T02:03:44.688 DEBUG:teuthology.orchestra.run.smithi110:> ' 2024-09-16T02:03:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:44 smithi165 ceph-mon[34621]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:03:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:44 smithi110 ceph-mon[27634]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:03:44.782 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.0.74916.asok 2024-09-16T02:03:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:44.793 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.74916.asok 2024-09-16T02:03:44.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:44.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.74916.asok status 2024-09-16T02:03:44.921 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "6d025bc26f3176c910707f8cb4c8d8e076640615", 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)", 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "0", 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "74916", 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2024-09-16T02:03:44.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 14492, 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 14492 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 323678790 2024-09-16T02:03:44.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 323678790 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.14492 192.168.0.1:0/323678790", 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "192.168.0.1:0/323678790", 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 15, 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 44, 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2024-09-16T02:03:44.924 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2024-09-16T02:03:44.925 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2024-09-16T02:03:44.925 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:03:44.930 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-16T02:03:44.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T02:03:45.173 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:46.592 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:46 smithi110 ceph-mon[27634]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:03:46.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:46 smithi165 ceph-mon[34621]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:03:46.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.804+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4033900939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 msgr2=0x7fd8f00fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.804+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4033900939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f00fe830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40048d0 tx=0x7fd8e4009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.804+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4033900939 shutdown_connections 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.804+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4033900939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8f00fabe0 0x7fd8f00fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.804+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4033900939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f00fe830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.804+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4033900939 >> 172.21.15.110:0/4033900939 conn(0x7fd8f0071b00 msgr2=0x7fd8f0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.805+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4033900939 shutdown_connections 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.805+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4033900939 wait complete. 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.805+0000 7fd8f6ba6640 1 Processor -- start 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.805+0000 7fd8f6ba6640 1 -- start start 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.805+0000 7fd8f6ba6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8f00fabe0 0x7fd8f0113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:46.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.805+0000 7fd8f6ba6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8f6ba6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0113e00 con 0x7fd8f00fe460 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8f6ba6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f010d1b0 con 0x7fd8f00fabe0 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f0113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35814/0 (socket says 172.21.15.110:35814) 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 -- 172.21.15.110:0/4204718902 learned_addr learned my addr 172.21.15.110:0/4204718902 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8f4942640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8f00fabe0 0x7fd8f0113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 -- 172.21.15.110:0/4204718902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8f00fabe0 msgr2=0x7fd8f0113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8f00fabe0 0x7fd8f0113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 -- 172.21.15.110:0/4204718902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4005040 con 0x7fd8f00fe460 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8effff640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f0113770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00b790 tx=0x7fd8dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:46.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8dc00c700 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd8dc00cd00 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f010d490 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8dc015e80 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.806+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f010d9b0 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.807+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f0072610 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.808+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd8dc012070 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.808+0000 7fd8ed7fa640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8e006ed60 0x7fd8e0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.808+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd8dc08da00 con 0x7fd8f00fe460 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.808+0000 7fd8f4942640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8e006ed60 0x7fd8e0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:46.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.809+0000 7fd8f4942640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8e006ed60 0x7fd8e0071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009ac0 tx=0x7fd8e4035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:46.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:46.812+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd8dc05ab20 con 0x7fd8f00fe460 2024-09-16T02:03:47.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.004+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8f004b720 con 0x7fd8f00fe460 2024-09-16T02:03:47.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.005+0000 7fd8ed7fa640 1 -- 172.21.15.110:0/4204718902 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd8dc05a4c0 con 0x7fd8f00fe460 2024-09-16T02:03:47.006 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-16T02:03:47.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8e006ed60 msgr2=0x7fd8e0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:47.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8e006ed60 0x7fd8e0071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009ac0 tx=0x7fd8e4035040 comp rx=0 tx=0).stop 2024-09-16T02:03:47.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 msgr2=0x7fd8f0113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f0113770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00b790 tx=0x7fd8dc0091d0 comp rx=0 tx=0).stop 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 shutdown_connections 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd8e006ed60 0x7fd8e0071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f00fe460 0x7fd8f0113770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 --2- 172.21.15.110:0/4204718902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8f00fabe0 0x7fd8f0113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 >> 172.21.15.110:0/4204718902 conn(0x7fd8f0071b00 msgr2=0x7fd8f00f9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 shutdown_connections 2024-09-16T02:03:47.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:47.007+0000 7fd8f6ba6640 1 -- 172.21.15.110:0/4204718902 wait complete. 2024-09-16T02:03:47.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:47 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/4204718902' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T02:03:47.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:47 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/4204718902' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T02:03:47.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T02:03:47.802 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T02:03:47.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:47.802 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-16T02:03:47.822 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T02:03:47.822 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T02:03:47.822 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T02:03:47.822 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T02:03:47.823 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:47.824 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T02:03:47.824 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T02:03:47.824 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T02:03:47.824 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42325sec preferred_lft 42325sec 2024-09-16T02:03:47.824 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-16T02:03:47.824 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-16T02:03:47.825 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add name ceph-brx type bridge 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr flush dev ceph-brx 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set ceph-brx up 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T02:03:47.825 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-16T02:03:47.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:48.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:48.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:48.041 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T02:03:48.066 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-16T02:03:48.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:48.068 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-16T02:03:48.154 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-16T02:03:48.154 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T02:03:48.154 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T02:03:48.154 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T02:03:48.155 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T02:03:48.155 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:48.155 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-16T02:03:48.155 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T02:03:48.155 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T02:03:48.155 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T02:03:48.155 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-16T02:03:48.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:48.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:48.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:48.391 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-16T02:03:48.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:48.407 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-09-16T02:03:48.463 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:48.463 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-16T02:03:48.463 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T02:03:48.463 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T02:03:48.463 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-16T02:03:48.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:48.559 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:48 smithi165 ceph-mon[34621]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T02:03:48.559 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:48 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:48.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:48.581 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T02:03:48.581 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:48.581 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-16T02:03:48.582 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T02:03:48.582 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T02:03:48.582 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T02:03:48.582 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T02:03:48.582 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T02:03:48.582 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-16T02:03:48.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:48.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:48.705 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T02:03:48.705 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-16T02:03:48.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-16T02:03:48.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T02:03:48.706 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-16T02:03:48.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:48 smithi110 ceph-mon[27634]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T02:03:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:03:48.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T02:03:48.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:48.783 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-16T02:03:48.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T02:03:48.783 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:48.798 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T02:03:48.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T02:03:48.799 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:48.854 DEBUG:teuthology.orchestra.run.smithi165:> sudo modprobe fuse 2024-09-16T02:03:48.921 DEBUG:teuthology.orchestra.run.smithi165:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/proc 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/sys 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/dev 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/security 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/shm 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/pts 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/run 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/cgroup 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/pstore 2024-09-16T02:03:48.978 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/bpf 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/ 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/selinux 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/mqueue 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/hugepages 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/debug 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/tracing 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/fuse/connections 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/config 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T02:03:48.979 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/1000 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/ceph 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/0 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/ff834b920b5916bedd8c3627e83f80649351645758c47d7278121787d16258b7/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/9422eec02e69f67ee4de3240098d7230b764cc379f19b274a52c1c1724a25e0a/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/ba53f560720ca8e06c0bbdcd2d9761903c06cb36ce8d74874aa4bc9f4e0b7932/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/0dccd3dcd9d45405b1d9f41586813e9abce903fdbb4e24f1b04445d0770cf221/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/6a402e2dd30025a5b69bab8305f948a3e19733729240aa65c319cb87174c387c/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/4126f51921abf7a15993378e027c365407501fd29d17e5da5e5c573d9adc6f32/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/d696b8bb4cfe17a06483e0da8dee8d133940769783add0fad763c2d60445a127/merged 2024-09-16T02:03:48.980 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/3a3f6e64d9d996673bda707de15ab42e775ddb5953c92d73ba1c3ab3e4f02f88/merged 2024-09-16T02:03:48.981 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/13c3cc79cbacbaa1ea20eb0a7da39de780dd81b05199da5d9c7f75532a1f8a22/merged 2024-09-16T02:03:48.981 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns 2024-09-16T02:03:48.981 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T02:03:48.981 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T02:03:48.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:48.982 DEBUG:teuthology.orchestra.run.smithi165:> ls /sys/fs/fuse/connections 2024-09-16T02:03:49.037 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T02:03:49.038 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-16T02:03:49.080 DEBUG:teuthology.orchestra.run.smithi165:> sudo modprobe fuse 2024-09-16T02:03:49.106 DEBUG:teuthology.orchestra.run.smithi165:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T02:03:49.162 INFO:teuthology.orchestra.run.smithi165.stdout:/proc 2024-09-16T02:03:49.162 INFO:teuthology.orchestra.run.smithi165.stdout:/sys 2024-09-16T02:03:49.162 INFO:teuthology.orchestra.run.smithi165.stdout:/dev 2024-09-16T02:03:49.162 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/security 2024-09-16T02:03:49.162 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/shm 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/pts 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/run 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/cgroup 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/pstore 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/bpf 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/ 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/selinux 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/mqueue 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/hugepages 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/debug 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/tracing 2024-09-16T02:03:49.163 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/fuse/connections 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/config 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/1000 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/ceph 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/0 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/ff834b920b5916bedd8c3627e83f80649351645758c47d7278121787d16258b7/merged 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/9422eec02e69f67ee4de3240098d7230b764cc379f19b274a52c1c1724a25e0a/merged 2024-09-16T02:03:49.164 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/ba53f560720ca8e06c0bbdcd2d9761903c06cb36ce8d74874aa4bc9f4e0b7932/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/0dccd3dcd9d45405b1d9f41586813e9abce903fdbb4e24f1b04445d0770cf221/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/6a402e2dd30025a5b69bab8305f948a3e19733729240aa65c319cb87174c387c/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/4126f51921abf7a15993378e027c365407501fd29d17e5da5e5c573d9adc6f32/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/d696b8bb4cfe17a06483e0da8dee8d133940769783add0fad763c2d60445a127/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/3a3f6e64d9d996673bda707de15ab42e775ddb5953c92d73ba1c3ab3e4f02f88/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/13c3cc79cbacbaa1ea20eb0a7da39de780dd81b05199da5d9c7f75532a1f8a22/merged 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T02:03:49.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:49.166 DEBUG:teuthology.orchestra.run.smithi165:> ls /sys/fs/fuse/connections 2024-09-16T02:03:49.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi165.stderr:2024-09-16T02:03:49.178+0000 7f2cd5459300 -1 init, newargv = 0x56157967e4d0 newargc=15 2024-09-16T02:03:49.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi165.stderr:ceph-fuse[59450]: starting ceph client 2024-09-16T02:03:49.183 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi165.stderr:ceph-fuse[59450]: starting fuse 2024-09-16T02:03:49.194 INFO:teuthology.orchestra.run.smithi165.stdout:117 2024-09-16T02:03:49.194 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [117] 2024-09-16T02:03:49.194 DEBUG:teuthology.orchestra.run.smithi165:> sudo stdin-killer -- python3 -c ' 2024-09-16T02:03:49.194 DEBUG:teuthology.orchestra.run.smithi165:> import glob 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> import re 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> import os 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> import subprocess 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> def _find_admin_socket(client_name): 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> files = glob.glob(asok_path) 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> # Given a non-glob path, it better be there 2024-09-16T02:03:49.195 DEBUG:teuthology.orchestra.run.smithi165:> if "*" not in asok_path: 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> assert(len(files) == 1) 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> return files[0] 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> for f in files: 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> contents = proc_f.read() 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> if mountpoint in contents: 2024-09-16T02:03:49.196 DEBUG:teuthology.orchestra.run.smithi165:> return f 2024-09-16T02:03:49.197 DEBUG:teuthology.orchestra.run.smithi165:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T02:03:49.197 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-16T02:03:49.197 DEBUG:teuthology.orchestra.run.smithi165:> print(_find_admin_socket("client.1")) 2024-09-16T02:03:49.197 DEBUG:teuthology.orchestra.run.smithi165:> ' 2024-09-16T02:03:49.312 INFO:teuthology.orchestra.run.smithi165.stdout:/var/run/ceph/ceph-client.1.59450.asok 2024-09-16T02:03:49.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-16T02:03:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T02:03:49.322 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59450.asok 2024-09-16T02:03:49.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:49.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59450.asok status 2024-09-16T02:03:49.452 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-16T02:03:49.452 INFO:teuthology.orchestra.run.smithi165.stdout: "metadata": { 2024-09-16T02:03:49.452 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_sha1": "6d025bc26f3176c910707f8cb4c8d8e076640615", 2024-09-16T02:03:49.452 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_version": "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)", 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "entity_id": "1", 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "hostname": "smithi165", 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "pid": "59450", 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "root": "/" 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "dentry_count": 0, 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "dentry_pinned_count": 0, 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "id": 24263, 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "inst": { 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "name": { 2024-09-16T02:03:49.453 INFO:teuthology.orchestra.run.smithi165.stdout: "type": "client", 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num": 24263 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": { 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "type": "v1", 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": "192.168.0.1:0", 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "nonce": 994083850 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": { 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "type": "v1", 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": "192.168.0.1:0", 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: "nonce": 994083850 2024-09-16T02:03:49.454 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "inst_str": "client.24263 192.168.0.1:0/994083850", 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "addr_str": "192.168.0.1:0/994083850", 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "inode_count": 1, 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_epoch": 15, 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_epoch": 44, 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_epoch_barrier": 0, 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "blocklisted": false, 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout: "fs_name": "cephfs" 2024-09-16T02:03:49.455 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-16T02:03:49.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:49.460 DEBUG:teuthology.orchestra.run.smithi110:> stat --file-system '--printf=%T 2024-09-16T02:03:49.460 DEBUG:teuthology.orchestra.run.smithi110:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:49.481 INFO:teuthology.orchestra.run.smithi110.stdout:fuseblk 2024-09-16T02:03:49.482 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:49.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:49.482 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:49.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:49.555 DEBUG:teuthology.orchestra.run.smithi165:> stat --file-system '--printf=%T 2024-09-16T02:03:49.555 DEBUG:teuthology.orchestra.run.smithi165:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:49.571 INFO:teuthology.orchestra.run.smithi165.stdout:fuseblk 2024-09-16T02:03:49.572 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:49.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:03:49.572 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:49.640 INFO:teuthology.run_tasks:Running task print... 2024-09-16T02:03:49.650 INFO:teuthology.task.print:**** done client 2024-09-16T02:03:49.650 INFO:teuthology.run_tasks:Running task parallel... 2024-09-16T02:03:49.738 INFO:teuthology.task.parallel:starting parallel... 2024-09-16T02:03:49.739 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-16T02:03:49.739 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T02:03:49.740 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:03:49.740 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-16T02:03:49.741 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-16T02:03:49.741 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-16T02:03:49.745 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T02:03:49.745 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T02:03:49.745 INFO:tasks.workunit:timeout=3h 2024-09-16T02:03:49.745 INFO:tasks.workunit:cleanup=True 2024-09-16T02:03:49.746 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 99h/153d Inode: 1 Links: 2 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 02:03:13.985364246 +0000 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 02:03:49.551645582 +0000 2024-09-16T02:03:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-16T02:03:49.766 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-16T02:03:49.767 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-16T02:03:49.836 DEBUG:teuthology.orchestra.run.smithi165:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:49.854 INFO:teuthology.orchestra.run.smithi165.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:49.854 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-16T02:03:49.854 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-16T02:03:49.855 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T02:03:49.855 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-16T02:03:49.855 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-16T02:03:49.855 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-16 02:03:49.831031220 +0000 2024-09-16T02:03:49.855 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-16 02:03:49.831031220 +0000 2024-09-16T02:03:49.855 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2024-09-16T02:03:49.855 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-16T02:03:49.855 DEBUG:teuthology.orchestra.run.smithi165:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-16T02:03:49.925 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T02:03:49.925 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T02:03:49.941 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T02:03:49.982 INFO:tasks.workunit.client.1.smithi165.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-16T02:03:50.011 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:50 smithi165 ceph-mon[34621]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-16T02:03:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:50 smithi110 ceph-mon[27634]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-16T02:03:51.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 -- 172.21.15.110:0/1783082188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 msgr2=0x7fd874103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:51.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 --2- 172.21.15.110:0/1783082188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd874103ec0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd8680048d0 tx=0x7fd868009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 -- 172.21.15.110:0/1783082188 shutdown_connections 2024-09-16T02:03:51.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 --2- 172.21.15.110:0/1783082188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd874103ec0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 --2- 172.21.15.110:0/1783082188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd874065be0 0x7fd8741015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 -- 172.21.15.110:0/1783082188 >> 172.21.15.110:0/1783082188 conn(0x7fd8740f6c10 msgr2=0x7fd8740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 -- 172.21.15.110:0/1783082188 shutdown_connections 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 -- 172.21.15.110:0/1783082188 wait complete. 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 Processor -- start 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 -- start start 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.627+0000 7fd878c1d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd874065be0 0x7fd87410f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd878c1d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd87410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd878c1d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87410fdf0 con 0x7fd874101ae0 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd878c1d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd874110610 con 0x7fd874065be0 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd87410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:51.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd87410f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44942/0 (socket says 172.21.15.110:44942) 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 -- 172.21.15.110:0/3929648078 learned_addr learned my addr 172.21.15.110:0/3929648078 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd87259c640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd874065be0 0x7fd87410f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 -- 172.21.15.110:0/3929648078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd874065be0 msgr2=0x7fd87410f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd874065be0 0x7fd87410f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 -- 172.21.15.110:0/3929648078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868005040 con 0x7fd874101ae0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd871d9b640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd87410f7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd8680048a0 tx=0x7fd868009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd868038070 con 0x7fd874101ae0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd868032d30 con 0x7fd874101ae0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874110840 con 0x7fd874101ae0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd86803dc80 con 0x7fd874101ae0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.628+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd874110d80 con 0x7fd874101ae0 2024-09-16T02:03:51.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.629+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8740fa890 con 0x7fd874101ae0 2024-09-16T02:03:51.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.630+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd868030020 con 0x7fd874101ae0 2024-09-16T02:03:51.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.630+0000 7fd862ffd640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd85c06ed60 0x7fd85c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:51.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.630+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd8680aeb40 con 0x7fd874101ae0 2024-09-16T02:03:51.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.630+0000 7fd87259c640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd85c06ed60 0x7fd85c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:51.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.631+0000 7fd87259c640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd85c06ed60 0x7fd85c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd864004550 tx=0x7fd864009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:51.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.634+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd86807bce0 con 0x7fd874101ae0 2024-09-16T02:03:51.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.792+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fd87404b720 con 0x7fd874101ae0 2024-09-16T02:03:51.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.793+0000 7fd862ffd640 1 -- 172.21.15.110:0/3929648078 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fd86807b680 con 0x7fd874101ae0 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd85c06ed60 msgr2=0x7fd85c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd85c06ed60 0x7fd85c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd864004550 tx=0x7fd864009040 comp rx=0 tx=0).stop 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 msgr2=0x7fd87410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd87410f7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd8680048a0 tx=0x7fd868009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 shutdown_connections 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd85c06ed60 0x7fd85c071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd874101ae0 0x7fd87410f7a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 --2- 172.21.15.110:0/3929648078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd874065be0 0x7fd87410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:51.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.794+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 >> 172.21.15.110:0/3929648078 conn(0x7fd8740f6c10 msgr2=0x7fd8740f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:51.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.795+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 shutdown_connections 2024-09-16T02:03:51.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:51.795+0000 7fd878c1d640 1 -- 172.21.15.110:0/3929648078 wait complete. 2024-09-16T02:03:52.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-16T02:03:52.667 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:52 smithi110 ceph-mon[27634]: pgmap v191: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-16T02:03:52.688 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:52 smithi165 ceph-mon[34621]: pgmap v191: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-16T02:03:54.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- 172.21.15.110:0/1037994694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fd7f0 msgr2=0x7fca340fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/1037994694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fd7f0 0x7fca340fdc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca280048d0 tx=0x7fca28009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- 172.21.15.110:0/1037994694 shutdown_connections 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/1037994694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fd7f0 0x7fca340fdc60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/1037994694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca340fc520 0x7fca340fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- 172.21.15.110:0/1037994694 >> 172.21.15.110:0/1037994694 conn(0x7fca340f7ce0 msgr2=0x7fca340fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- 172.21.15.110:0/1037994694 shutdown_connections 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- 172.21.15.110:0/1037994694 wait complete. 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 Processor -- start 2024-09-16T02:03:54.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- start start 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 0x7fca3410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca340fd7f0 0x7fca3410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3410e490 con 0x7fca340fc520 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.252+0000 7fca3b8e7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3410e600 con 0x7fca340fd7f0 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 0x7fca3410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 0x7fca3410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44962/0 (socket says 172.21.15.110:44962) 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 -- 172.21.15.110:0/850740742 learned_addr learned my addr 172.21.15.110:0/850740742 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca38e82640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca340fd7f0 0x7fca3410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 -- 172.21.15.110:0/850740742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca340fd7f0 msgr2=0x7fca3410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca340fd7f0 0x7fca3410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 -- 172.21.15.110:0/850740742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28005040 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca39683640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 0x7fca3410d0e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca2400bbb0 tx=0x7fca24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca2400c9c0 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca240092e0 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3410e8e0 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca24007640 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.253+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3410ee00 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.254+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca341057b0 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.255+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fca24012070 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.255+0000 7fca31ffb640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fca1c06ed60 0x7fca1c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.255+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fca2408e310 con 0x7fca340fc520 2024-09-16T02:03:54.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.255+0000 7fca38e82640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fca1c06ed60 0x7fca1c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:54.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.256+0000 7fca38e82640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fca1c06ed60 0x7fca1c071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca28007ac0 tx=0x7fca28035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:54.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.259+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fca2405b430 con 0x7fca340fc520 2024-09-16T02:03:54.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.416+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fca340fb980 con 0x7fca340fc520 2024-09-16T02:03:54.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.417+0000 7fca31ffb640 1 -- 172.21.15.110:0/850740742 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fca2405add0 con 0x7fca340fc520 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.418+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fca1c06ed60 msgr2=0x7fca1c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.418+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fca1c06ed60 0x7fca1c071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca28007ac0 tx=0x7fca28035040 comp rx=0 tx=0).stop 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.418+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 msgr2=0x7fca3410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.418+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 0x7fca3410d0e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca2400bbb0 tx=0x7fca24009840 comp rx=0 tx=0).stop 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 shutdown_connections 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fca1c06ed60 0x7fca1c071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca340fd7f0 0x7fca3410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 --2- 172.21.15.110:0/850740742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca340fc520 0x7fca3410d0e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:54.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 >> 172.21.15.110:0/850740742 conn(0x7fca340f7ce0 msgr2=0x7fca340f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:54.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 shutdown_connections 2024-09-16T02:03:54.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:54.419+0000 7fca3b8e7640 1 -- 172.21.15.110:0/850740742 wait complete. 2024-09-16T02:03:54.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:54 smithi165 ceph-mon[34621]: pgmap v192: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-16T02:03:54.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:54 smithi110 ceph-mon[27634]: pgmap v192: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-16T02:03:55.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-16T02:03:55.382 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:56 smithi165 ceph-mon[34621]: pgmap v193: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T02:03:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:56 smithi110 ceph-mon[27634]: pgmap v193: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 -- 172.21.15.110:0/3975087770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fc550 msgr2=0x7fa0600fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 --2- 172.21.15.110:0/3975087770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fc550 0x7fa0600fc960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa0500048d0 tx=0x7fa050009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 -- 172.21.15.110:0/3975087770 shutdown_connections 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 --2- 172.21.15.110:0/3975087770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fd820 0x7fa0600fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 --2- 172.21.15.110:0/3975087770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fc550 0x7fa0600fc960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 -- 172.21.15.110:0/3975087770 >> 172.21.15.110:0/3975087770 conn(0x7fa0600f7d30 msgr2=0x7fa0600fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 -- 172.21.15.110:0/3975087770 shutdown_connections 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.065+0000 7fa0679fd640 1 -- 172.21.15.110:0/3975087770 wait complete. 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa0679fd640 1 Processor -- start 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa0679fd640 1 -- start start 2024-09-16T02:03:57.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa0679fd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fc550 0x7fa06010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa0679fd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 0x7fa06010d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa0679fd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06010e4b0 con 0x7fa0600fd820 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa0679fd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06010e620 con 0x7fa0600fc550 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa064f98640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 0x7fa06010d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa064f98640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 0x7fa06010d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44984/0 (socket says 172.21.15.110:44984) 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa064f98640 1 -- 172.21.15.110:0/4160900269 learned_addr learned my addr 172.21.15.110:0/4160900269 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa065799640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fc550 0x7fa06010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa064f98640 1 -- 172.21.15.110:0/4160900269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fc550 msgr2=0x7fa06010d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa064f98640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fc550 0x7fa06010d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa064f98640 1 -- 172.21.15.110:0/4160900269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050005040 con 0x7fa0600fd820 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.066+0000 7fa065799640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fc550 0x7fa06010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:03:57.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.067+0000 7fa064f98640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 0x7fa06010d640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00b790 tx=0x7fa05c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.067+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa05c00c700 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.067+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa05c00cd00 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.067+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa05c015e70 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.067+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06010e900 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.067+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06010ee20 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.068+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600fb9b0 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.068+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa05c012070 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.069+0000 7fa055ffb640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa04c06ed60 0x7fa04c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.069+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa05c08dcf0 con 0x7fa0600fd820 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.069+0000 7fa065799640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa04c06ed60 0x7fa04c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.069+0000 7fa065799640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa04c06ed60 0x7fa04c071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa050004540 tx=0x7fa050035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:57.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.073+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa05c05ae10 con 0x7fa0600fd820 2024-09-16T02:03:57.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.228+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fa06004b720 con 0x7fa0600fd820 2024-09-16T02:03:57.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.228+0000 7fa055ffb640 1 -- 172.21.15.110:0/4160900269 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fa06004b720 con 0x7fa0600fd820 2024-09-16T02:03:57.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa04c06ed60 msgr2=0x7fa04c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa04c06ed60 0x7fa04c071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa050004540 tx=0x7fa050035040 comp rx=0 tx=0).stop 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 msgr2=0x7fa06010d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 0x7fa06010d640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00b790 tx=0x7fa05c0091d0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 shutdown_connections 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fa04c06ed60 0x7fa04c071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0600fd820 0x7fa06010d640 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 --2- 172.21.15.110:0/4160900269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0600fc550 0x7fa06010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 >> 172.21.15.110:0/4160900269 conn(0x7fa0600f7d30 msgr2=0x7fa0600f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 shutdown_connections 2024-09-16T02:03:57.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:57.230+0000 7fa0679fd640 1 -- 172.21.15.110:0/4160900269 wait complete. 2024-09-16T02:03:57.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-16T02:03:58.085 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:03:58.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:03:58 smithi110 ceph-mon[27634]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-16T02:03:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:03:58 smithi165 ceph-mon[34621]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 -- 172.21.15.110:0/2235448461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 msgr2=0x7f9bb40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/2235448461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb40fdc90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00048d0 tx=0x7f9ba0009da0 comp rx=0 tx=0).stop 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 -- 172.21.15.110:0/2235448461 shutdown_connections 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/2235448461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb40fdc90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/2235448461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb40fc550 0x7f9bb40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 -- 172.21.15.110:0/2235448461 >> 172.21.15.110:0/2235448461 conn(0x7f9bb40f7d30 msgr2=0x7f9bb40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 -- 172.21.15.110:0/2235448461 shutdown_connections 2024-09-16T02:03:59.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 -- 172.21.15.110:0/2235448461 wait complete. 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.656+0000 7f9bbadb9640 1 Processor -- start 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bbadb9640 1 -- start start 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bbadb9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb40fc550 0x7f9bb410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bbadb9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bbadb9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb410e4b0 con 0x7f9bb40fd820 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bbadb9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb410e620 con 0x7f9bb40fc550 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb410d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45010/0 (socket says 172.21.15.110:45010) 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 -- 172.21.15.110:0/671384190 learned_addr learned my addr 172.21.15.110:0/671384190 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb8b55640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb40fc550 0x7f9bb410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 -- 172.21.15.110:0/671384190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb40fc550 msgr2=0x7f9bb410d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:03:59.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb40fc550 0x7f9bb410d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 -- 172.21.15.110:0/671384190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0005040 con 0x7f9bb40fd820 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.657+0000 7f9bb3fff640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb410d640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0003080 tx=0x7f9ba0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.658+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ba0038070 con 0x7f9bb40fd820 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.658+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9ba002abd0 con 0x7f9bb40fd820 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.658+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb410e8a0 con 0x7f9bb40fd820 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.658+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ba003e670 con 0x7f9bb40fd820 2024-09-16T02:03:59.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.658+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb410edc0 con 0x7f9bb40fd820 2024-09-16T02:03:59.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.659+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40fb9b0 con 0x7f9bb40fd820 2024-09-16T02:03:59.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.659+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9ba0030020 con 0x7f9bb40fd820 2024-09-16T02:03:59.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.660+0000 7f9bb17fa640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9ba406ed60 0x7f9ba4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:03:59.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.660+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9ba00ae590 con 0x7f9bb40fd820 2024-09-16T02:03:59.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.660+0000 7f9bb8b55640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9ba406ed60 0x7f9ba4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:03:59.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.660+0000 7f9bb8b55640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9ba406ed60 0x7f9ba4071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800a900 tx=0x7f9ba8008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:03:59.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.664+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9ba007b6b0 con 0x7f9bb40fd820 2024-09-16T02:03:59.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:03:59.832+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bb410f0a0 con 0x7f9ba406ed60 2024-09-16T02:04:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:00 smithi165 ceph-mon[34621]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-16T02:04:00.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:00 smithi110 ceph-mon[27634]: pgmap v195: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-16T02:04:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:01 smithi165 ceph-mon[34621]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:01.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:01 smithi110 ceph-mon[27634]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:02 smithi165 ceph-mon[34621]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-16T02:04:02.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:02 smithi110 ceph-mon[27634]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-16T02:04:03.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:03 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:04.012 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:03 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:04 smithi165 ceph-mon[34621]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-16T02:04:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:04 smithi110 ceph-mon[27634]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-16T02:04:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:06 smithi165 ceph-mon[34621]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-16T02:04:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:06 smithi110 ceph-mon[27634]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-16T02:04:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:08 smithi165 ceph-mon[34621]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T02:04:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:08 smithi110 ceph-mon[27634]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T02:04:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:10 smithi165 ceph-mon[34621]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-16T02:04:10.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:10 smithi110 ceph-mon[27634]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-16T02:04:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:12 smithi165 ceph-mon[34621]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-16T02:04:12.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:12 smithi110 ceph-mon[27634]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-16T02:04:14.752 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:14 smithi165 ceph-mon[34621]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:14.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:14 smithi110 ceph-mon[27634]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:16 smithi165 ceph-mon[34621]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:16 smithi110 ceph-mon[27634]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:18 smithi165 ceph-mon[34621]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:18 smithi110 ceph-mon[27634]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:20 smithi165 ceph-mon[34621]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:20 smithi110 ceph-mon[27634]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:22 smithi165 ceph-mon[34621]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:22.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:22 smithi110 ceph-mon[27634]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:24 smithi165 ceph-mon[34621]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:24 smithi110 ceph-mon[27634]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:26 smithi165 ceph-mon[34621]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:26 smithi110 ceph-mon[27634]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:28.758 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:28 smithi110 ceph-mon[27634]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:28 smithi165 ceph-mon[34621]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:30.848 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:30 smithi110 ceph-mon[27634]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:30.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.885+0000 7f9bb17fa640 1 -- 172.21.15.110:0/671384190 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f9bb410f0a0 con 0x7f9ba406ed60 2024-09-16T02:04:30.887 INFO:teuthology.orchestra.run.smithi110.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9ba406ed60 msgr2=0x7f9ba4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9ba406ed60 0x7f9ba4071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800a900 tx=0x7f9ba8008040 comp rx=0 tx=0).stop 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 msgr2=0x7f9bb410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb410d640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0003080 tx=0x7f9ba0009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 shutdown_connections 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f9ba406ed60 0x7f9ba4071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bb40fd820 0x7f9bb410d640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 --2- 172.21.15.110:0/671384190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb40fc550 0x7f9bb410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 >> 172.21.15.110:0/671384190 conn(0x7f9bb40f7d30 msgr2=0x7f9bb40f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 shutdown_connections 2024-09-16T02:04:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:30.888+0000 7f9bbadb9640 1 -- 172.21.15.110:0/671384190 wait complete. 2024-09-16T02:04:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:30 smithi165 ceph-mon[34621]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:31.618 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-16T02:04:31.885 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:31.957 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:04:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:04:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:04:32.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:04:32.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:04:32.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:32.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:31 smithi165 ceph-mon[34621]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:32.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:31 smithi110 ceph-mon[27634]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:04:33.141 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:32 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:33.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:32 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:34.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:33 smithi165 ceph-mon[34621]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:34.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:33 smithi110 ceph-mon[27634]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:35.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.154+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/1610600513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fc700 msgr2=0x7fd1a40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.154+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/1610600513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fc700 0x7fd1a40fcb70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd1940048d0 tx=0x7fd194009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.155+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/1610600513 shutdown_connections 2024-09-16T02:04:35.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.155+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/1610600513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fc700 0x7fd1a40fcb70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.155+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/1610600513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a40fb430 0x7fd1a40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.155+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/1610600513 >> 172.21.15.110:0/1610600513 conn(0x7fd1a40f6c10 msgr2=0x7fd1a40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:35.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.155+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/1610600513 shutdown_connections 2024-09-16T02:04:35.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.155+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/1610600513 wait complete. 2024-09-16T02:04:35.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.156+0000 7fd1ab5a0640 1 Processor -- start 2024-09-16T02:04:35.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.156+0000 7fd1ab5a0640 1 -- start start 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.156+0000 7fd1ab5a0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 0x7fd1a41121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.156+0000 7fd1ab5a0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a40fc700 0x7fd1a4114710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.156+0000 7fd1ab5a0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a410dc70 con 0x7fd1a40fb430 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.156+0000 7fd1ab5a0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4065bd0 con 0x7fd1a40fc700 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 0x7fd1a41121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 0x7fd1a41121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58212/0 (socket says 172.21.15.110:58212) 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 -- 172.21.15.110:0/4239940806 learned_addr learned my addr 172.21.15.110:0/4239940806 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:04:35.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a8b3b640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a40fc700 0x7fd1a4114710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:35.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 -- 172.21.15.110:0/4239940806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a40fc700 msgr2=0x7fd1a4114710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a40fc700 0x7fd1a4114710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 -- 172.21.15.110:0/4239940806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194005040 con 0x7fd1a40fb430 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd1a933c640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 0x7fd1a41121c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000eb70 tx=0x7fd1a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.157+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a0007c30 con 0x7fd1a40fb430 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.158+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1a000f040 con 0x7fd1a40fb430 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.158+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a00094e0 con 0x7fd1a40fb430 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.158+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4065e50 con 0x7fd1a40fb430 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.158+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a4114fb0 con 0x7fd1a40fb430 2024-09-16T02:04:35.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.159+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a40fa890 con 0x7fd1a40fb430 2024-09-16T02:04:35.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.160+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd1a0009640 con 0x7fd1a40fb430 2024-09-16T02:04:35.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.164+0000 7fd199ffb640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd19006ed60 0x7fd190071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:35.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.164+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd1a008dde0 con 0x7fd1a40fb430 2024-09-16T02:04:35.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.164+0000 7fd1a8b3b640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd19006ed60 0x7fd190071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:35.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.165+0000 7fd1a8b3b640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd19006ed60 0x7fd190071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd194007ac0 tx=0x7fd194035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:35.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.167+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd1a005af80 con 0x7fd1a40fb430 2024-09-16T02:04:35.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.514+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1a4100b10 con 0x7fd19006ed60 2024-09-16T02:04:35.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.516+0000 7fd199ffb640 1 -- 172.21.15.110:0/4239940806 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd1a4100b10 con 0x7fd19006ed60 2024-09-16T02:04:35.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd19006ed60 msgr2=0x7fd190071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd19006ed60 0x7fd190071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd194007ac0 tx=0x7fd194035040 comp rx=0 tx=0).stop 2024-09-16T02:04:35.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 msgr2=0x7fd1a41121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 0x7fd1a41121c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000eb70 tx=0x7fd1a000b040 comp rx=0 tx=0).stop 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 shutdown_connections 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd19006ed60 0x7fd190071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a40fc700 0x7fd1a4114710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 --2- 172.21.15.110:0/4239940806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a40fb430 0x7fd1a41121c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 >> 172.21.15.110:0/4239940806 conn(0x7fd1a40f6c10 msgr2=0x7fd1a40f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 shutdown_connections 2024-09-16T02:04:35.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.519+0000 7fd1ab5a0640 1 -- 172.21.15.110:0/4239940806 wait complete. 2024-09-16T02:04:35.532 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:04:35.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.642+0000 7f3572790640 1 -- 172.21.15.110:0/1742929375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 msgr2=0x7f356c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.642+0000 7f3572790640 1 --2- 172.21.15.110:0/1742929375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c0fcb70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f35600048d0 tx=0x7f3560009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.643+0000 7f3572790640 1 -- 172.21.15.110:0/1742929375 shutdown_connections 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.643+0000 7f3572790640 1 --2- 172.21.15.110:0/1742929375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c0fcb70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.643+0000 7f3572790640 1 --2- 172.21.15.110:0/1742929375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.643+0000 7f3572790640 1 -- 172.21.15.110:0/1742929375 >> 172.21.15.110:0/1742929375 conn(0x7f356c0f6c10 msgr2=0x7f356c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.643+0000 7f3572790640 1 -- 172.21.15.110:0/1742929375 shutdown_connections 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.643+0000 7f3572790640 1 -- 172.21.15.110:0/1742929375 wait complete. 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.644+0000 7f3572790640 1 Processor -- start 2024-09-16T02:04:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.644+0000 7f3572790640 1 -- start start 2024-09-16T02:04:35.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f3572790640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f3572790640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f3572790640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c10cad0 con 0x7f356c0fc700 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f3572790640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c10d2f0 con 0x7f356c0fb430 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:51590/0 (socket says 172.21.15.110:51590) 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356bfff640 1 -- 172.21.15.110:0/390919943 learned_addr learned my addr 172.21.15.110:0/390919943 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356b7fe640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356bfff640 1 -- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 msgr2=0x7f356c10c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356bfff640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c10c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356bfff640 1 -- 172.21.15.110:0/390919943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560005040 con 0x7f356c0fb430 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.645+0000 7f356b7fe640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.646+0000 7f356bfff640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c10bf40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f355c002a50 tx=0x7f355c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.646+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355c007c30 con 0x7f356c0fb430 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.646+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c10d580 con 0x7f356c0fb430 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.646+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f355c00f040 con 0x7f356c0fb430 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.647+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c10da10 con 0x7f356c0fb430 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.647+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f355c00db50 con 0x7f356c0fb430 2024-09-16T02:04:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.648+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c04b720 con 0x7f356c0fb430 2024-09-16T02:04:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.649+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f355c00dcb0 con 0x7f356c0fb430 2024-09-16T02:04:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.649+0000 7f3568ff9640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3554071030 0x7f35540734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.649+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f355c08e120 con 0x7f356c0fb430 2024-09-16T02:04:35.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.649+0000 7f356b7fe640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3554071030 0x7f35540734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:35.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.650+0000 7f356b7fe640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3554071030 0x7f35540734e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3560007ac0 tx=0x7f3560035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.654+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f355c05b220 con 0x7f356c0fb430 2024-09-16T02:04:35.912 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:35.912 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:35.912 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: Upgrade: Target is version 19.1.1-326-g8921c8ef (unknown) 2024-09-16T02:04:35.912 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, digests ['quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80'] 2024-09-16T02:04:35.913 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:04:35.913 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:35.913 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: Upgrade: Need to upgrade myself (mgr.smithi110.hfirap) 2024-09-16T02:04:35.913 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 on smithi165 2024-09-16T02:04:35.913 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:35 smithi110 ceph-mon[27634]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:35.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.957+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f356c10de50 con 0x7f3554071030 2024-09-16T02:04:35.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.959+0000 7f3568ff9640 1 -- 172.21.15.110:0/390919943 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f356c10de50 con 0x7f3554071030 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.961+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3554071030 msgr2=0x7f35540734e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.961+0000 7f3572790640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3554071030 0x7f35540734e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3560007ac0 tx=0x7f3560035040 comp rx=0 tx=0).stop 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.961+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 msgr2=0x7f356c10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.961+0000 7f3572790640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c10bf40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f355c002a50 tx=0x7f355c004600 comp rx=0 tx=0).stop 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 shutdown_connections 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f3554071030 0x7f35540734e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f356c0fc700 0x7f356c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 --2- 172.21.15.110:0/390919943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f356c0fb430 0x7f356c10bf40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 >> 172.21.15.110:0/390919943 conn(0x7f356c0f6c10 msgr2=0x7f356c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:35.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 shutdown_connections 2024-09-16T02:04:35.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:35.962+0000 7f3572790640 1 -- 172.21.15.110:0/390919943 wait complete. 2024-09-16T02:04:36.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 -- 172.21.15.110:0/1011748524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 msgr2=0x7f1b680fcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 --2- 172.21.15.110:0/1011748524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 0x7f1b680fcf70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b58004900 tx=0x7f1b58009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 -- 172.21.15.110:0/1011748524 shutdown_connections 2024-09-16T02:04:36.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 --2- 172.21.15.110:0/1011748524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b68103e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 --2- 172.21.15.110:0/1011748524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 0x7f1b680fcf70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 -- 172.21.15.110:0/1011748524 >> 172.21.15.110:0/1011748524 conn(0x7f1b680f6390 msgr2=0x7f1b680f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:36.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.044+0000 7f1b6d282640 1 -- 172.21.15.110:0/1011748524 shutdown_connections 2024-09-16T02:04:36.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.045+0000 7f1b6d282640 1 -- 172.21.15.110:0/1011748524 wait complete. 2024-09-16T02:04:36.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.045+0000 7f1b6d282640 1 Processor -- start 2024-09-16T02:04:36.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.045+0000 7f1b6d282640 1 -- start start 2024-09-16T02:04:36.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b6d282640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 0x7f1b6810f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b6d282640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b6810f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b6d282640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6810fdf0 con 0x7f1b680fcb60 2024-09-16T02:04:36.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b6d282640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68110610 con 0x7f1b680fd4b0 2024-09-16T02:04:36.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b667fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b6810f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b667fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b6810f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:51620/0 (socket says 172.21.15.110:51620) 2024-09-16T02:04:36.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b667fc640 1 -- 172.21.15.110:0/768689907 learned_addr learned my addr 172.21.15.110:0/768689907 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:04:36.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b66ffd640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 0x7f1b6810f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b667fc640 1 -- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 msgr2=0x7f1b6810f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b667fc640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 0x7f1b6810f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.046+0000 7f1b667fc640 1 -- 172.21.15.110:0/768689907 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58005040 con 0x7f1b680fd4b0 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.047+0000 7f1b667fc640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b6810f7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00eb70 tx=0x7f1b5c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.047+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5c007c30 con 0x7f1b680fd4b0 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.047+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b68110840 con 0x7f1b680fd4b0 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.047+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b5c00f040 con 0x7f1b680fd4b0 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.047+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b68110ca0 con 0x7f1b680fd4b0 2024-09-16T02:04:36.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.047+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5c00c910 con 0x7f1b680fd4b0 2024-09-16T02:04:36.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.049+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b680fa010 con 0x7f1b680fd4b0 2024-09-16T02:04:36.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.049+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1b5c00ca70 con 0x7f1b680fd4b0 2024-09-16T02:04:36.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.050+0000 7f1b4f7fe640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f1b5006ed60 0x7f1b50071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.050+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1b5c08dda0 con 0x7f1b680fd4b0 2024-09-16T02:04:36.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.050+0000 7f1b66ffd640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f1b5006ed60 0x7f1b50071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.050+0000 7f1b66ffd640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f1b5006ed60 0x7f1b50071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b58003080 tx=0x7f1b58035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:36.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.056+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1b5c04e2a0 con 0x7f1b680fd4b0 2024-09-16T02:04:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: Upgrade: Target is version 19.1.1-326-g8921c8ef (unknown) 2024-09-16T02:04:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, digests ['quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80'] 2024-09-16T02:04:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:04:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:04:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: Upgrade: Need to upgrade myself (mgr.smithi110.hfirap) 2024-09-16T02:04:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 on smithi165 2024-09-16T02:04:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:35 smithi165 ceph-mon[34621]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:36.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.226+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b68111080 con 0x7f1b5006ed60 2024-09-16T02:04:36.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.236+0000 7f1b4f7fe640 1 -- 172.21.15.110:0/768689907 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1b68111080 con 0x7f1b5006ed60 2024-09-16T02:04:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:04:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (5m) 56s ago 6m 25.0M - 0.25.0 c8568f914cd2 d98e35b955ee 2024-09-16T02:04:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (6m) 56s ago 6m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (5m) 64s ago 5m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (5m) 56s ago 6m 87.1M - 9.4.7 954c08fa6188 02b51104ba52 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (78s) 56s ago 77s 13.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (83s) 56s ago 82s 15.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (75s) 64s ago 75s 14.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (80s) 64s ago 80s 10.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:9283,8765,8443 running (7m) 56s ago 7m 447M - 17.2.7-1633-g6d025bc2 33ed8dba3996 093819b4fc7f 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (5m) 64s ago 5m 403M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15164ccb0b8c 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (7m) 56s ago 7m 47.7M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (5m) 64s ago 5m 43.2M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (6m) 56s ago 6m 15.9M - 1.5.0 0da6a335fe13 69c375f8a058 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (5m) 64s ago 5m 17.0M - 1.5.0 0da6a335fe13 60a3c227d383 2024-09-16T02:04:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (4m) 56s ago 4m 47.9M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:04:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (4m) 56s ago 4m 44.4M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:04:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (4m) 56s ago 4m 45.2M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:04:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (3m) 64s ago 3m 45.6M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:04:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (3m) 64s ago 3m 42.4M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:04:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (2m) 64s ago 2m 40.9M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:04:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (5m) 56s ago 6m 64.3M - 2.43.0 a07b618ecd1d 63397dfd0974 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f1b5006ed60 msgr2=0x7f1b50071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f1b5006ed60 0x7f1b50071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b58003080 tx=0x7f1b58035040 comp rx=0 tx=0).stop 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 msgr2=0x7f1b6810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b6810f7a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00eb70 tx=0x7f1b5c00b040 comp rx=0 tx=0).stop 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 shutdown_connections 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f1b5006ed60 0x7f1b50071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b680fd4b0 0x7f1b6810f7a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 --2- 172.21.15.110:0/768689907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b680fcb60 0x7f1b6810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 >> 172.21.15.110:0/768689907 conn(0x7f1b680f6390 msgr2=0x7f1b680f6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 shutdown_connections 2024-09-16T02:04:36.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.238+0000 7f1b6d282640 1 -- 172.21.15.110:0/768689907 wait complete. 2024-09-16T02:04:36.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 -- 172.21.15.110:0/1086541627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 msgr2=0x7efc600ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 --2- 172.21.15.110:0/1086541627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc600ff140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0048d0 tx=0x7efc5c009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 -- 172.21.15.110:0/1086541627 shutdown_connections 2024-09-16T02:04:36.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 --2- 172.21.15.110:0/1086541627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc600ff680 0x7efc60101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 --2- 172.21.15.110:0/1086541627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc600ff140 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 -- 172.21.15.110:0/1086541627 >> 172.21.15.110:0/1086541627 conn(0x7efc600f6c10 msgr2=0x7efc600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:36.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 -- 172.21.15.110:0/1086541627 shutdown_connections 2024-09-16T02:04:36.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.323+0000 7efc67438640 1 -- 172.21.15.110:0/1086541627 wait complete. 2024-09-16T02:04:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc67438640 1 Processor -- start 2024-09-16T02:04:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc67438640 1 -- start start 2024-09-16T02:04:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc67438640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc6010f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc67438640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc600ff680 0x7efc6010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc67438640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6010fe20 con 0x7efc600ff680 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc67438640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc60110640 con 0x7efc60065c40 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc651d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc6010f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc651d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc6010f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:51638/0 (socket says 172.21.15.110:51638) 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.324+0000 7efc651d4640 1 -- 172.21.15.110:0/3417929374 learned_addr learned my addr 172.21.15.110:0/3417929374 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc649d3640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc600ff680 0x7efc6010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc651d4640 1 -- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc600ff680 msgr2=0x7efc6010f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc651d4640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc600ff680 0x7efc6010f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc651d4640 1 -- 172.21.15.110:0/3417929374 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c005040 con 0x7efc60065c40 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc651d4640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc6010f290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02d040 tx=0x7efc5c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc5c038070 con 0x7efc60065c40 2024-09-16T02:04:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc5c02ae90 con 0x7efc60065c40 2024-09-16T02:04:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc5c038070 con 0x7efc60065c40 2024-09-16T02:04:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.325+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc60110870 con 0x7efc60065c40 2024-09-16T02:04:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.326+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc60110d70 con 0x7efc60065c40 2024-09-16T02:04:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.327+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc600fa890 con 0x7efc60065c40 2024-09-16T02:04:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.328+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7efc5c030020 con 0x7efc60065c40 2024-09-16T02:04:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.328+0000 7efc55ffb640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efc4c06ee20 0x7efc4c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.328+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efc5c0adfd0 con 0x7efc60065c40 2024-09-16T02:04:36.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.328+0000 7efc649d3640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efc4c06ee20 0x7efc4c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.329+0000 7efc649d3640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efc4c06ee20 0x7efc4c0712d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc6010f040 tx=0x7efc5000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:36.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.336+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efc5c07b050 con 0x7efc60065c40 2024-09-16T02:04:36.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.656+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc60105070 con 0x7efc60065c40 2024-09-16T02:04:36.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.657+0000 7efc55ffb640 1 -- 172.21.15.110:0/3417929374 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7efc5c07a9f0 con 0x7efc60065c40 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:04:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:04:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:04:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:04:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:04:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 14 2024-09-16T02:04:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:04:36.660 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efc4c06ee20 msgr2=0x7efc4c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efc4c06ee20 0x7efc4c0712d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc6010f040 tx=0x7efc5000b040 comp rx=0 tx=0).stop 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 msgr2=0x7efc6010f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc6010f290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02d040 tx=0x7efc5c009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 shutdown_connections 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7efc4c06ee20 0x7efc4c0712d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc600ff680 0x7efc6010f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 --2- 172.21.15.110:0/3417929374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60065c40 0x7efc6010f290 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02d040 tx=0x7efc5c009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.660+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 >> 172.21.15.110:0/3417929374 conn(0x7efc600f6c10 msgr2=0x7efc600fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:36.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.661+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 shutdown_connections 2024-09-16T02:04:36.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.661+0000 7efc67438640 1 -- 172.21.15.110:0/3417929374 wait complete. 2024-09-16T02:04:36.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 -- 172.21.15.110:0/4014805664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fd7f0 msgr2=0x7fbed00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 --2- 172.21.15.110:0/4014805664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fd7f0 0x7fbed00fdc60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0048d0 tx=0x7fbebc009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 -- 172.21.15.110:0/4014805664 shutdown_connections 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 --2- 172.21.15.110:0/4014805664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fd7f0 0x7fbed00fdc60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 --2- 172.21.15.110:0/4014805664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fc520 0x7fbed00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 -- 172.21.15.110:0/4014805664 >> 172.21.15.110:0/4014805664 conn(0x7fbed00f7ce0 msgr2=0x7fbed00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 -- 172.21.15.110:0/4014805664 shutdown_connections 2024-09-16T02:04:36.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.757+0000 7fbed6c08640 1 -- 172.21.15.110:0/4014805664 wait complete. 2024-09-16T02:04:36.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.758+0000 7fbed6c08640 1 Processor -- start 2024-09-16T02:04:36.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.758+0000 7fbed6c08640 1 -- start start 2024-09-16T02:04:36.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbed6c08640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fc520 0x7fbed010cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbed6c08640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 0x7fbed010d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbed6c08640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed010da90 con 0x7fbed00fc520 2024-09-16T02:04:36.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbed6c08640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed010e1d0 con 0x7fbed00fd7f0 2024-09-16T02:04:36.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbecffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 0x7fbed010d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbed49a4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fc520 0x7fbed010cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbecffff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 0x7fbed010d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:51670/0 (socket says 172.21.15.110:51670) 2024-09-16T02:04:36.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbecffff640 1 -- 172.21.15.110:0/2641191100 learned_addr learned my addr 172.21.15.110:0/2641191100 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbecffff640 1 -- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fc520 msgr2=0x7fbed010cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbecffff640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fc520 0x7fbed010cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.759+0000 7fbecffff640 1 -- 172.21.15.110:0/2641191100 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc005040 con 0x7fbed00fd7f0 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.760+0000 7fbecffff640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 0x7fbed010d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097f0 tx=0x7fbebc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.760+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbebc038070 con 0x7fbed00fd7f0 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.760+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbebc02ac00 con 0x7fbed00fd7f0 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.760+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed010e400 con 0x7fbed00fd7f0 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.760+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed010e8c0 con 0x7fbed00fd7f0 2024-09-16T02:04:36.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.760+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbebc03d660 con 0x7fbed00fd7f0 2024-09-16T02:04:36.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.762+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00fb980 con 0x7fbed00fd7f0 2024-09-16T02:04:36.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.762+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fbebc030020 con 0x7fbed00fd7f0 2024-09-16T02:04:36.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.763+0000 7fbecd7fa640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbec006ed50 0x7fbec0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:04:36.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.763+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbebc0ae820 con 0x7fbed00fd7f0 2024-09-16T02:04:36.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.763+0000 7fbed49a4640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbec006ed50 0x7fbec0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:04:36.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.763+0000 7fbed49a4640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbec006ed50 0x7fbec0071200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed010cc90 tx=0x7fbec400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:04:36.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.768+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbebc07b9c0 con 0x7fbed00fd7f0 2024-09-16T02:04:36.915 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:36 smithi110 ceph-mon[27634]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:36.915 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:36 smithi110 ceph-mon[27634]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:36.915 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:36 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3417929374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:04:36.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.948+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed010ecc0 con 0x7fbec006ed50 2024-09-16T02:04:36.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.949+0000 7fbecd7fa640 1 -- 172.21.15.110:0/2641191100 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fbed010ecc0 con 0x7fbec006ed50 2024-09-16T02:04:36.950 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:04:36.950 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:04:36.950 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:04:36.951 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:04:36.951 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [], 2024-09-16T02:04:36.951 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "0/2 daemons upgraded", 2024-09-16T02:04:36.951 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 image on host smithi165", 2024-09-16T02:04:36.951 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:04:36.951 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.951+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbec006ed50 msgr2=0x7fbec0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.951+0000 7fbed6c08640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbec006ed50 0x7fbec0071200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed010cc90 tx=0x7fbec400b040 comp rx=0 tx=0).stop 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.951+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 msgr2=0x7fbed010d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.951+0000 7fbed6c08640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 0x7fbed010d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097f0 tx=0x7fbebc009da0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 shutdown_connections 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fbec006ed50 0x7fbec0071200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbed00fd7f0 0x7fbed010d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 --2- 172.21.15.110:0/2641191100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed00fc520 0x7fbed010cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:04:36.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 >> 172.21.15.110:0/2641191100 conn(0x7fbed00f7ce0 msgr2=0x7fbed00f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:04:36.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 shutdown_connections 2024-09-16T02:04:36.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:04:36.952+0000 7fbed6c08640 1 -- 172.21.15.110:0/2641191100 wait complete. 2024-09-16T02:04:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:36 smithi165 ceph-mon[34621]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:36 smithi165 ceph-mon[34621]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:36 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3417929374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:04:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:37 smithi165 ceph-mon[34621]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:37 smithi165 ceph-mon[34621]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:38.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:37 smithi110 ceph-mon[27634]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:38.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:37 smithi110 ceph-mon[27634]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:04:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:40 smithi165 ceph-mon[34621]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:40 smithi110 ceph-mon[27634]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:42 smithi165 ceph-mon[34621]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:42.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:42 smithi110 ceph-mon[27634]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:44 smithi165 ceph-mon[34621]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:44.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:44 smithi110 ceph-mon[27634]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:46 smithi165 ceph-mon[34621]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:46 smithi110 ceph-mon[27634]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:47.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:47 smithi165 ceph-mon[34621]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:47.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:47 smithi110 ceph-mon[27634]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:48 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:48 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:04:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:49 smithi165 ceph-mon[34621]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:49.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:49 smithi110 ceph-mon[27634]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:50.577 INFO:tasks.workunit.client.1.smithi165.stderr:Updating files: 89% (11529/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr: git switch -c 2024-09-16T02:04:51.394 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr:Or undo this operation with: 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr: git switch - 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-16T02:04:51.395 INFO:tasks.workunit.client.1.smithi165.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T02:04:51.399 DEBUG:teuthology.orchestra.run.smithi165:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-16T02:04:51.465 INFO:tasks.workunit.client.1.smithi165.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-09-16T02:04:51.467 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-16T02:04:51.468 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T02:04:51.472 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T02:04:51.500 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T02:04:51.502 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T02:04:51.502 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T02:04:52.157 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T02:04:52.176 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T02:04:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:51 smithi165 ceph-mon[34621]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:52.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:51 smithi110 ceph-mon[27634]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:04:52.229 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T02:04:52.242 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T02:04:52.270 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T02:04:52.272 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T02:04:52.272 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T02:04:52.286 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-16T02:04:52.288 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-16T02:04:52.288 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T02:04:52.311 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T02:04:52.315 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T02:04:52.315 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T02:04:52.330 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-16T02:04:52.334 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-16T02:04:52.334 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-16T02:04:52.371 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-16T02:04:52.373 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T02:04:52.373 DEBUG:teuthology.orchestra.run.smithi110:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-16T02:04:52.392 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-16T02:04:52.393 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T02:04:52.394 DEBUG:teuthology.orchestra.run.smithi165:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-16T02:04:52.436 INFO:tasks.workunit.client.0.smithi110.stderr:+ mkdir -p fsstress 2024-09-16T02:04:52.438 INFO:tasks.workunit.client.0.smithi110.stderr:+ pushd fsstress 2024-09-16T02:04:52.439 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T02:04:52.439 INFO:tasks.workunit.client.0.smithi110.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T02:04:52.460 INFO:tasks.workunit.client.1.smithi165.stderr:+ mkdir -p fsstress 2024-09-16T02:04:52.463 INFO:tasks.workunit.client.1.smithi165.stderr:+ pushd fsstress 2024-09-16T02:04:52.464 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T02:04:52.464 INFO:tasks.workunit.client.1.smithi165.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T02:04:53.101 INFO:tasks.workunit.client.0.smithi110.stderr:+ tar xzf ltp-full.tgz 2024-09-16T02:04:53.338 INFO:tasks.workunit.client.1.smithi165.stderr:+ tar xzf ltp-full.tgz 2024-09-16T02:04:54.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:53 smithi165 ceph-mon[34621]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:54.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:53 smithi110 ceph-mon[27634]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:04:56.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:55 smithi165 ceph-mon[34621]: pgmap v223: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1.2 MiB/s wr, 4 op/s 2024-09-16T02:04:56.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:55 smithi110 ceph-mon[27634]: pgmap v223: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1.2 MiB/s wr, 4 op/s 2024-09-16T02:04:58.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:57 smithi165 ceph-mon[34621]: pgmap v224: 65 pgs: 65 active+clean; 19 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-09-16T02:04:58.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:57 smithi110 ceph-mon[27634]: pgmap v224: 65 pgs: 65 active+clean; 19 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-09-16T02:05:00.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:04:59 smithi165 ceph-mon[34621]: pgmap v225: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 301 KiB/s rd, 2.5 MiB/s wr, 91 op/s 2024-09-16T02:05:00.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:04:59 smithi110 ceph-mon[27634]: pgmap v225: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 301 KiB/s rd, 2.5 MiB/s wr, 91 op/s 2024-09-16T02:05:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:01 smithi165 ceph-mon[34621]: pgmap v226: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 564 KiB/s rd, 2.9 MiB/s wr, 109 op/s 2024-09-16T02:05:02.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:01 smithi110 ceph-mon[27634]: pgmap v226: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 564 KiB/s rd, 2.9 MiB/s wr, 109 op/s 2024-09-16T02:05:02.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:02 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:03.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:02 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:04.311 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: pgmap v227: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 564 KiB/s rd, 3.0 MiB/s wr, 124 op/s 2024-09-16T02:05:04.311 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: Upgrade: Updating mgr.smithi165.afwhot 2024-09-16T02:05:04.312 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:04.312 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:05:04.312 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:05:04.312 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:05:04.312 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:04 smithi165 ceph-mon[34621]: Deploying daemon mgr.smithi165.afwhot on smithi165 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: pgmap v227: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 564 KiB/s rd, 3.0 MiB/s wr, 124 op/s 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: Upgrade: Updating mgr.smithi165.afwhot 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:05:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:04 smithi110 ceph-mon[27634]: Deploying daemon mgr.smithi165.afwhot on smithi165 2024-09-16T02:05:06.568 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:06 smithi165 ceph-mon[34621]: pgmap v228: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 158 op/s 2024-09-16T02:05:06.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:06 smithi110 ceph-mon[27634]: pgmap v228: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 158 op/s 2024-09-16T02:05:07.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 -- 172.21.15.110:0/473750691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 msgr2=0x7f134c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 --2- 172.21.15.110:0/473750691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c0fdcb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f133c0048d0 tx=0x7f133c009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 -- 172.21.15.110:0/473750691 shutdown_connections 2024-09-16T02:05:07.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 --2- 172.21.15.110:0/473750691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c0fdcb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 --2- 172.21.15.110:0/473750691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f134c0fc570 0x7f134c0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 -- 172.21.15.110:0/473750691 >> 172.21.15.110:0/473750691 conn(0x7f134c0f7d30 msgr2=0x7f134c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 -- 172.21.15.110:0/473750691 shutdown_connections 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.068+0000 7f13543e7640 1 -- 172.21.15.110:0/473750691 wait complete. 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f13543e7640 1 Processor -- start 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f13543e7640 1 -- start start 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f13543e7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f134c0fc570 0x7f134c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f13543e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f13543e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c10dc10 con 0x7f134c0fd840 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f13543e7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c10e430 con 0x7f134c0fc570 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f1351982640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f1351982640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53100/0 (socket says 172.21.15.110:53100) 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.069+0000 7f1351982640 1 -- 172.21.15.110:0/3585380284 learned_addr learned my addr 172.21.15.110:0/3585380284 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:07.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1351982640 1 -- 172.21.15.110:0/3585380284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f134c0fc570 msgr2=0x7f134c10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1351982640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f134c0fc570 0x7f134c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1351982640 1 -- 172.21.15.110:0/3585380284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c005040 con 0x7f134c0fd840 2024-09-16T02:05:07.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1351982640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c10d5c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f133c0048a0 tx=0x7f133c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c038070 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c10e660 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f133c004290 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c033660 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.070+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c10eb80 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.072+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c0fb9d0 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.072+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f133c030020 con 0x7f134c0fd840 2024-09-16T02:05:07.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.073+0000 7f1342ffd640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f133806ed60 0x7f1338071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.073+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f133c0ae3d0 con 0x7f134c0fd840 2024-09-16T02:05:07.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.073+0000 7f1352183640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f133806ed60 0x7f1338071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.073+0000 7f1352183640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f133806ed60 0x7f1338071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1348004cd0 tx=0x7f134800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:07.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.077+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f133c07b450 con 0x7f134c0fd840 2024-09-16T02:05:07.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.339+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f134c10eed0 con 0x7f133806ed60 2024-09-16T02:05:07.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.340+0000 7f1342ffd640 1 -- 172.21.15.110:0/3585380284 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f134c10eed0 con 0x7f133806ed60 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.342+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f133806ed60 msgr2=0x7f1338071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.342+0000 7f13543e7640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f133806ed60 0x7f1338071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1348004cd0 tx=0x7f134800b040 comp rx=0 tx=0).stop 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.342+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 msgr2=0x7f134c10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.342+0000 7f13543e7640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c10d5c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f133c0048a0 tx=0x7f133c009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 shutdown_connections 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f133806ed60 0x7f1338071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c0fd840 0x7f134c10d5c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 --2- 172.21.15.110:0/3585380284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f134c0fc570 0x7f134c10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 >> 172.21.15.110:0/3585380284 conn(0x7f134c0f7d30 msgr2=0x7f134c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:07.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 shutdown_connections 2024-09-16T02:05:07.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.343+0000 7f13543e7640 1 -- 172.21.15.110:0/3585380284 wait complete. 2024-09-16T02:05:07.354 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:05:07.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 -- 172.21.15.110:0/3126208358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b0065c40 msgr2=0x7f09b00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 --2- 172.21.15.110:0/3126208358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b0065c40 0x7f09b00ff140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09a00048d0 tx=0x7f09a0009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 -- 172.21.15.110:0/3126208358 shutdown_connections 2024-09-16T02:05:07.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 --2- 172.21.15.110:0/3126208358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b00ff680 0x7f09b0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 --2- 172.21.15.110:0/3126208358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b0065c40 0x7f09b00ff140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 -- 172.21.15.110:0/3126208358 >> 172.21.15.110:0/3126208358 conn(0x7f09b00f6c10 msgr2=0x7f09b00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:07.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 -- 172.21.15.110:0/3126208358 shutdown_connections 2024-09-16T02:05:07.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 -- 172.21.15.110:0/3126208358 wait complete. 2024-09-16T02:05:07.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.447+0000 7f09b4986640 1 Processor -- start 2024-09-16T02:05:07.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09b4986640 1 -- start start 2024-09-16T02:05:07.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09b4986640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 0x7f09b010d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09b4986640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b00ff680 0x7f09b010d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09b4986640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b010dc80 con 0x7f09b00ff680 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09b4986640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b010e450 con 0x7f09b0065c40 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09ae59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 0x7f09b010d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09ae59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 0x7f09b010d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:49836/0 (socket says 172.21.15.110:49836) 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09ae59c640 1 -- 172.21.15.110:0/4162215633 learned_addr learned my addr 172.21.15.110:0/4162215633 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09add9b640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b00ff680 0x7f09b010d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09ae59c640 1 -- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b00ff680 msgr2=0x7f09b010d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09ae59c640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b00ff680 0x7f09b010d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.448+0000 7f09ae59c640 1 -- 172.21.15.110:0/4162215633 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0005040 con 0x7f09b0065c40 2024-09-16T02:05:07.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.449+0000 7f09ae59c640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 0x7f09b010d0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09a002d040 tx=0x7f09a0009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:07.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.449+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a0038070 con 0x7f09b0065c40 2024-09-16T02:05:07.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.449+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f09a002ae90 con 0x7f09b0065c40 2024-09-16T02:05:07.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.449+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b010e680 con 0x7f09b0065c40 2024-09-16T02:05:07.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.449+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a003e670 con 0x7f09b0065c40 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.449+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b010ec20 con 0x7f09b0065c40 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.450+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b00fa890 con 0x7f09b0065c40 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.451+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f09a0030020 con 0x7f09b0065c40 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.451+0000 7f099effd640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f099806ed60 0x7f0998071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.451+0000 7f09add9b640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f099806ed60 0x7f0998071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.451+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f09a00ae270 con 0x7f09b0065c40 2024-09-16T02:05:07.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.452+0000 7f09add9b640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f099806ed60 0x7f0998071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f09b010cea0 tx=0x7f09a400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:07.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.455+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f09a007b3a0 con 0x7f09b0065c40 2024-09-16T02:05:07.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.735+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09b010efb0 con 0x7f099806ed60 2024-09-16T02:05:07.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.736+0000 7f099effd640 1 -- 172.21.15.110:0/4162215633 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f09b010efb0 con 0x7f099806ed60 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f099806ed60 msgr2=0x7f0998071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f099806ed60 0x7f0998071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f09b010cea0 tx=0x7f09a400b040 comp rx=0 tx=0).stop 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 msgr2=0x7f09b010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 0x7f09b010d0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09a002d040 tx=0x7f09a0009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 shutdown_connections 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f099806ed60 0x7f0998071210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b00ff680 0x7f09b010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 --2- 172.21.15.110:0/4162215633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09b0065c40 0x7f09b010d0f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 >> 172.21.15.110:0/4162215633 conn(0x7f09b00f6c10 msgr2=0x7f09b00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:07.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 shutdown_connections 2024-09-16T02:05:07.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.739+0000 7f09b4986640 1 -- 172.21.15.110:0/4162215633 wait complete. 2024-09-16T02:05:07.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.853+0000 7fd75fe27640 1 -- 172.21.15.110:0/1172576903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fc520 msgr2=0x7fd7580fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:07.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.853+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1172576903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fc520 0x7fd7580fc930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd7540048d0 tx=0x7fd754009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 -- 172.21.15.110:0/1172576903 shutdown_connections 2024-09-16T02:05:07.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1172576903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7580fd7f0 0x7fd7580fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1172576903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fc520 0x7fd7580fc930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 -- 172.21.15.110:0/1172576903 >> 172.21.15.110:0/1172576903 conn(0x7fd7580f7ce0 msgr2=0x7fd7580fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:07.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 -- 172.21.15.110:0/1172576903 shutdown_connections 2024-09-16T02:05:07.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 -- 172.21.15.110:0/1172576903 wait complete. 2024-09-16T02:05:07.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 Processor -- start 2024-09-16T02:05:07.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.854+0000 7fd75fe27640 1 -- start start 2024-09-16T02:05:07.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75fe27640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7580fc520 0x7fd758113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75fe27640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 0x7fd758113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75fe27640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd758114210 con 0x7fd7580fd7f0 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75fe27640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd758114a30 con 0x7fd7580fc520 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 0x7fd758113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 0x7fd758113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53140/0 (socket says 172.21.15.110:53140) 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 -- 172.21.15.110:0/1646905299 learned_addr learned my addr 172.21.15.110:0/1646905299 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 -- 172.21.15.110:0/1646905299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7580fc520 msgr2=0x7fd758113680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7580fc520 0x7fd758113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 -- 172.21.15.110:0/1646905299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754005040 con 0x7fd7580fd7f0 2024-09-16T02:05:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.855+0000 7fd75d3c2640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 0x7fd758113bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd74800eb70 tx=0x7fd74800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.856+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd748007c30 con 0x7fd7580fd7f0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.856+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd74800f040 con 0x7fd7580fd7f0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.856+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd758114c60 con 0x7fd7580fd7f0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.856+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd748009550 con 0x7fd7580fd7f0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.856+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7581151b0 con 0x7fd7580fd7f0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.857+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7580fb980 con 0x7fd7580fd7f0 2024-09-16T02:05:07.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.858+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd74800cca0 con 0x7fd7580fd7f0 2024-09-16T02:05:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.859+0000 7fd74e7fc640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd74406eda0 0x7fd744071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.859+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd74808deb0 con 0x7fd7580fd7f0 2024-09-16T02:05:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.859+0000 7fd75dbc3640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd74406eda0 0x7fd744071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:07.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.860+0000 7fd75dbc3640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd74406eda0 0x7fd744071250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7540043d0 tx=0x7fd754009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:07.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:07.865+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd74804e2a0 con 0x7fd7580fd7f0 2024-09-16T02:05:08.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.083+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd758115420 con 0x7fd74406eda0 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.094+0000 7fd74e7fc640 1 -- 172.21.15.110:0/1646905299 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fd758115420 con 0x7fd74406eda0 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (5m) 88s ago 7m 25.0M - 0.25.0 c8568f914cd2 d98e35b955ee 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (7m) 88s ago 7m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (6m) 96s ago 6m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (5m) 88s ago 6m 87.1M - 9.4.7 954c08fa6188 02b51104ba52 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (110s) 88s ago 109s 13.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:05:08.097 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (115s) 88s ago 114s 15.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (107s) 96s ago 107s 14.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (112s) 96s ago 112s 10.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:9283,8765,8443 running (8m) 88s ago 8m 447M - 17.2.7-1633-g6d025bc2 33ed8dba3996 093819b4fc7f 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 starting - - - - 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (8m) 88s ago 8m 47.7M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (6m) 96s ago 6m 43.2M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 88s ago 7m 15.9M - 1.5.0 0da6a335fe13 69c375f8a058 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 96s ago 6m 17.0M - 1.5.0 0da6a335fe13 60a3c227d383 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (5m) 88s ago 5m 47.9M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (5m) 88s ago 5m 44.4M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (4m) 88s ago 4m 45.2M 4288M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (4m) 96s ago 4m 45.6M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:05:08.098 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (3m) 96s ago 3m 42.4M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:05:08.099 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (3m) 96s ago 3m 40.9M 5312M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:05:08.099 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (5m) 88s ago 6m 64.3M - 2.43.0 a07b618ecd1d 63397dfd0974 2024-09-16T02:05:08.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd74406eda0 msgr2=0x7fd744071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd74406eda0 0x7fd744071250 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7540043d0 tx=0x7fd754009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 msgr2=0x7fd758113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 0x7fd758113bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd74800eb70 tx=0x7fd74800b040 comp rx=0 tx=0).stop 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 shutdown_connections 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7fd74406eda0 0x7fd744071250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7580fd7f0 0x7fd758113bc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 --2- 172.21.15.110:0/1646905299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7580fc520 0x7fd758113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 >> 172.21.15.110:0/1646905299 conn(0x7fd7580f7ce0 msgr2=0x7fd7580f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 shutdown_connections 2024-09-16T02:05:08.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.097+0000 7fd75fe27640 1 -- 172.21.15.110:0/1646905299 wait complete. 2024-09-16T02:05:08.112 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:08 smithi165 ceph-mon[34621]: pgmap v229: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 173 op/s 2024-09-16T02:05:08.112 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:08.112 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:08.113 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:08 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:05:08.113 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:08 smithi165 ceph-mon[34621]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.212+0000 7ff2659b5640 1 -- 172.21.15.110:0/2312384988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260065be0 msgr2=0x7ff2600ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.212+0000 7ff2659b5640 1 --2- 172.21.15.110:0/2312384988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260065be0 0x7ff2600ff1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2500048d0 tx=0x7ff250009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 -- 172.21.15.110:0/2312384988 shutdown_connections 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 --2- 172.21.15.110:0/2312384988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2600ff6e0 0x7ff260101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 --2- 172.21.15.110:0/2312384988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260065be0 0x7ff2600ff1a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 -- 172.21.15.110:0/2312384988 >> 172.21.15.110:0/2312384988 conn(0x7ff2600f6c10 msgr2=0x7ff2600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 -- 172.21.15.110:0/2312384988 shutdown_connections 2024-09-16T02:05:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 -- 172.21.15.110:0/2312384988 wait complete. 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 Processor -- start 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.213+0000 7ff2659b5640 1 -- start start 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff2659b5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff260065be0 0x7ff26010d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff2659b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 0x7ff26010d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff2659b5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26010e500 con 0x7ff2600ff6e0 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff2659b5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26010e670 con 0x7ff260065be0 2024-09-16T02:05:08.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 0x7ff26010d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 0x7ff26010d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53158/0 (socket says 172.21.15.110:53158) 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 -- 172.21.15.110:0/3451995768 learned_addr learned my addr 172.21.15.110:0/3451995768 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 -- 172.21.15.110:0/3451995768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff260065be0 msgr2=0x7ff26010d1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff260065be0 0x7ff26010d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 -- 172.21.15.110:0/3451995768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250005040 con 0x7ff2600ff6e0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.214+0000 7ff25e7fc640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 0x7ff26010d6e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b560 tx=0x7ff2540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.215+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25400f6f0 con 0x7ff2600ff6e0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.215+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26010e950 con 0x7ff2600ff6e0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.215+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff25400fcf0 con 0x7ff2600ff6e0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.215+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26010ee70 con 0x7ff2600ff6e0 2024-09-16T02:05:08.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.215+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff254011400 con 0x7ff2600ff6e0 2024-09-16T02:05:08.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.216+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2600fa890 con 0x7ff2600ff6e0 2024-09-16T02:05:08.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.217+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff25400f850 con 0x7ff2600ff6e0 2024-09-16T02:05:08.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.218+0000 7ff2477fe640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff24806ed60 0x7ff248071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:08.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.218+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff25408df00 con 0x7ff2600ff6e0 2024-09-16T02:05:08.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.218+0000 7ff25effd640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff24806ed60 0x7ff248071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:08.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.218+0000 7ff25effd640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff24806ed60 0x7ff248071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff25002a600 tx=0x7ff250009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:08.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.226+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff25405b0a0 con 0x7ff2600ff6e0 2024-09-16T02:05:08.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:08 smithi110 ceph-mon[27634]: pgmap v229: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 173 op/s 2024-09-16T02:05:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:08 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:05:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:08 smithi110 ceph-mon[27634]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.562+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff26010f0e0 con 0x7ff2600ff6e0 2024-09-16T02:05:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.562+0000 7ff2477fe640 1 -- 172.21.15.110:0/3451995768 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7ff25405aa40 con 0x7ff2600ff6e0 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:05:08.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 14 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:05:08.566 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:05:08.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff24806ed60 msgr2=0x7ff248071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff24806ed60 0x7ff248071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff25002a600 tx=0x7ff250009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 msgr2=0x7ff26010d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 0x7ff26010d6e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b560 tx=0x7ff2540090f0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 shutdown_connections 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7ff24806ed60 0x7ff248071210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2600ff6e0 0x7ff26010d6e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 --2- 172.21.15.110:0/3451995768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff260065be0 0x7ff26010d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 >> 172.21.15.110:0/3451995768 conn(0x7ff2600f6c10 msgr2=0x7ff2600f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 shutdown_connections 2024-09-16T02:05:08.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.565+0000 7ff2659b5640 1 -- 172.21.15.110:0/3451995768 wait complete. 2024-09-16T02:05:08.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 -- 172.21.15.110:0/1382605190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0fe760 msgr2=0x7f7d5c0feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1382605190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0fe760 0x7f7d5c0feb70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0048d0 tx=0x7f7d4c009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 -- 172.21.15.110:0/1382605190 shutdown_connections 2024-09-16T02:05:08.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1382605190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c0ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1382605190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0fe760 0x7f7d5c0feb70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 -- 172.21.15.110:0/1382605190 >> 172.21.15.110:0/1382605190 conn(0x7f7d5c0f9f20 msgr2=0x7f7d5c0fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:08.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 -- 172.21.15.110:0/1382605190 shutdown_connections 2024-09-16T02:05:08.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 -- 172.21.15.110:0/1382605190 wait complete. 2024-09-16T02:05:08.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.674+0000 7f7d625b5640 1 Processor -- start 2024-09-16T02:05:08.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d625b5640 1 -- start start 2024-09-16T02:05:08.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d625b5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d5c0fe760 0x7f7d5c10f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:08.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d625b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:08.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d625b5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c10fdd0 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d625b5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c1105f0 con 0x7f7d5c0fe760 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d5b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d5b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53182/0 (socket says 172.21.15.110:53182) 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d5b7fe640 1 -- 172.21.15.110:0/1555627062 learned_addr learned my addr 172.21.15.110:0/1555627062 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d5b7fe640 1 -- 172.21.15.110:0/1555627062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d5c0fe760 msgr2=0x7f7d5c10f240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d5b7fe640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d5c0fe760 0x7f7d5c10f240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.675+0000 7f7d5b7fe640 1 -- 172.21.15.110:0/1555627062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c005040 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.676+0000 7f7d5b7fe640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c10f780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000eb70 tx=0x7f7d5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.676+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d50007c30 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.676+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c110820 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.676+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c110dc0 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.676+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d5000f040 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.676+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d500094e0 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.677+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c0fdbc0 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.678+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7d50009640 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.679+0000 7f7d58ff9640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7d4406ed60 0x7f7d44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:08.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.679+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7d5008deb0 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.679+0000 7f7d5bfff640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7d4406ed60 0x7f7d44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:08.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.680+0000 7f7d5bfff640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7d4406ed60 0x7f7d44071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c02a530 tx=0x7f7d4c009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:08.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.685+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7d5005b110 con 0x7f7d5c0ffa30 2024-09-16T02:05:08.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.970+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 --> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d5c1111a0 con 0x7f7d4406ed60 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.972+0000 7f7d58ff9640 1 -- 172.21.15.110:0/1555627062 <== mgr.14204 v2:172.21.15.110:6800/1015288142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f7d5c1111a0 con 0x7f7d4406ed60 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [], 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "", 2024-09-16T02:05:08.974 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mgr daemons", 2024-09-16T02:05:08.975 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:05:08.975 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:05:08.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7d4406ed60 msgr2=0x7f7d44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7d4406ed60 0x7f7d44071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c02a530 tx=0x7f7d4c009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 msgr2=0x7f7d5c10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c10f780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000eb70 tx=0x7f7d5000b040 comp rx=0 tx=0).stop 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 shutdown_connections 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:6800/1015288142,v1:172.21.15.110:6801/1015288142] conn(0x7f7d4406ed60 0x7f7d44071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d5c0ffa30 0x7f7d5c10f780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 --2- 172.21.15.110:0/1555627062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d5c0fe760 0x7f7d5c10f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.974+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 >> 172.21.15.110:0/1555627062 conn(0x7f7d5c0f9f20 msgr2=0x7f7d5c0fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.975+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 shutdown_connections 2024-09-16T02:05:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:08.975+0000 7f7d625b5640 1 -- 172.21.15.110:0/1555627062 wait complete. 2024-09-16T02:05:09.421 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:09 smithi165 ceph-mon[34621]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:09.422 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:09 smithi165 ceph-mon[34621]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:09.422 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:09 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3451995768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:05:09.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:09 smithi110 ceph-mon[27634]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:09.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:09 smithi110 ceph-mon[27634]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:09.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:09 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3451995768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:05:10.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:10 smithi110 ceph-mon[27634]: pgmap v230: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 253 op/s 2024-09-16T02:05:10.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:10 smithi110 ceph-mon[27634]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:10.413 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:10 smithi165 ceph-mon[34621]: pgmap v230: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.9 MiB/s wr, 253 op/s 2024-09-16T02:05:10.414 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:10 smithi165 ceph-mon[34621]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:11.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:11 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:11 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:11 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:11 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:11 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:11 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:11 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:11 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:12.435 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:12 smithi165 ceph-mon[34621]: pgmap v231: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 195 op/s 2024-09-16T02:05:12.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:12 smithi110 ceph-mon[27634]: pgmap v231: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 195 op/s 2024-09-16T02:05:13.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:13 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:05:13.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:13 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:05:13.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:13 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot restarted 2024-09-16T02:05:13.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:13 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:05:13.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:13 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:05:13.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:13 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:05:13.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:13 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:05:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:13 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:05:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:13 smithi110 ceph-mon[27634]: Standby manager daemon smithi165.afwhot restarted 2024-09-16T02:05:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:13 smithi110 ceph-mon[27634]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:05:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:13 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:05:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:13 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:05:14.351 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:14 smithi165 ceph-mon[34621]: pgmap v232: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 194 op/s 2024-09-16T02:05:14.351 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:14 smithi165 ceph-mon[34621]: mgrmap e20: smithi110.hfirap(active, since 6m), standbys: smithi165.afwhot 2024-09-16T02:05:14.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:14 smithi110 ceph-mon[27634]: pgmap v232: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 194 op/s 2024-09-16T02:05:14.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:14 smithi110 ceph-mon[27634]: mgrmap e20: smithi110.hfirap(active, since 6m), standbys: smithi165.afwhot 2024-09-16T02:05:16.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:16 smithi165 ceph-mon[34621]: pgmap v233: 65 pgs: 65 active+clean; 99 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 220 op/s 2024-09-16T02:05:16.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:16 smithi110 ceph-mon[27634]: pgmap v233: 65 pgs: 65 active+clean; 99 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 220 op/s 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: pgmap v234: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 199 op/s 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr fail", "who": "smithi110.hfirap"}]: dispatch 2024-09-16T02:05:18.670 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: Activating manager daemon smithi165.afwhot 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "mgr fail", "who": "smithi110.hfirap"}]': finished 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: mgrmap e21: smithi165.afwhot(active, starting, since 0.00659175s) 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:05:18.671 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: Manager daemon smithi165.afwhot is now available 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:05:18.672 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:18.673 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:05:18.673 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:05:18.673 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/trash_purge_schedule"}]: dispatch 2024-09-16T02:05:18.673 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:18 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/trash_purge_schedule"}]: dispatch 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: pgmap v234: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 199 op/s 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr fail", "who": "smithi110.hfirap"}]: dispatch 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: Activating manager daemon smithi165.afwhot 2024-09-16T02:05:18.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.14204 172.21.15.110:0/555635368' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "mgr fail", "who": "smithi110.hfirap"}]': finished 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: mgrmap e21: smithi165.afwhot(active, starting, since 0.00659175s) 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:05:18.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: Manager daemon smithi165.afwhot is now available 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:05:18.703 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/trash_purge_schedule"}]: dispatch 2024-09-16T02:05:18.704 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:18 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.afwhot/trash_purge_schedule"}]: dispatch 2024-09-16T02:05:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: Checking for cert/key for grafana.smithi110 2024-09-16T02:05:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: Migrating grafana.smithi110 cert to cert store 2024-09-16T02:05:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: Migrating grafana.smithi110 key to cert store 2024-09-16T02:05:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: Deploying cephadm binary to smithi110 2024-09-16T02:05:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: Deploying cephadm binary to smithi165 2024-09-16T02:05:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: mgrmap e22: smithi165.afwhot(active, since 1.00928s) 2024-09-16T02:05:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: pgmap v3: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:19.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:19 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:19.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: Checking for cert/key for grafana.smithi110 2024-09-16T02:05:19.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: Migrating grafana.smithi110 cert to cert store 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: Migrating grafana.smithi110 key to cert store 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: Deploying cephadm binary to smithi110 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: Deploying cephadm binary to smithi165 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: mgrmap e22: smithi165.afwhot(active, since 1.00928s) 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: pgmap v3: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:19 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:20 smithi165 ceph-mon[34621]: pgmap v4: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:20 smithi165 ceph-mon[34621]: mgrmap e23: smithi165.afwhot(active, since 2s) 2024-09-16T02:05:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:20 smithi165 ceph-mon[34621]: [16/Sep/2024:02:05:19] ENGINE Bus STARTING 2024-09-16T02:05:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:20 smithi110 ceph-mon[27634]: pgmap v4: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:20 smithi110 ceph-mon[27634]: mgrmap e23: smithi165.afwhot(active, since 2s) 2024-09-16T02:05:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:20 smithi110 ceph-mon[27634]: [16/Sep/2024:02:05:19] ENGINE Bus STARTING 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:21 smithi165 ceph-mon[34621]: [16/Sep/2024:02:05:19] ENGINE Serving on http://172.21.15.165:8765 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:21 smithi165 ceph-mon[34621]: [16/Sep/2024:02:05:20] ENGINE Serving on https://172.21.15.165:7150 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:21 smithi165 ceph-mon[34621]: [16/Sep/2024:02:05:20] ENGINE Bus STARTED 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:21 smithi165 ceph-mon[34621]: [16/Sep/2024:02:05:20] ENGINE Error in HTTPServer.serve 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Traceback (most recent call last): 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._run(expiration_interval) 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T02:05:21.881 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s = self.context.wrap_socket( 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: return self.sslsocket_class._create( 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self.do_handshake() 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._sslobj.do_handshake() 2024-09-16T02:05:21.882 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T02:05:21.930 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:21 smithi110 ceph-mon[27634]: [16/Sep/2024:02:05:19] ENGINE Serving on http://172.21.15.165:8765 2024-09-16T02:05:21.930 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:21 smithi110 ceph-mon[27634]: [16/Sep/2024:02:05:20] ENGINE Serving on https://172.21.15.165:7150 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:21 smithi110 ceph-mon[27634]: [16/Sep/2024:02:05:20] ENGINE Bus STARTED 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:21 smithi110 ceph-mon[27634]: [16/Sep/2024:02:05:20] ENGINE Error in HTTPServer.serve 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Traceback (most recent call last): 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._run(expiration_interval) 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T02:05:21.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s = self.context.wrap_socket( 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: return self.sslsocket_class._create( 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self.do_handshake() 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._sslobj.do_handshake() 2024-09-16T02:05:21.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T02:05:22.908 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:22 smithi110 ceph-mon[27634]: pgmap v5: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:22.908 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:22 smithi110 ceph-mon[27634]: mgrmap e24: smithi165.afwhot(active, since 4s) 2024-09-16T02:05:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:22 smithi165 ceph-mon[34621]: pgmap v5: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:22 smithi165 ceph-mon[34621]: mgrmap e24: smithi165.afwhot(active, since 4s) 2024-09-16T02:05:24.932 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:24 smithi165 ceph-mon[34621]: pgmap v6: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:24.932 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:24 smithi165 ceph-mon[34621]: Standby manager daemon smithi110.hfirap started 2024-09-16T02:05:24.932 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:24 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/crt"}]: dispatch 2024-09-16T02:05:24.932 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:24 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:05:24.932 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:24 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/key"}]: dispatch 2024-09-16T02:05:24.933 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:24 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:05:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:24 smithi110 ceph-mon[27634]: pgmap v6: 65 pgs: 65 active+clean; 124 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:05:24.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:24 smithi110 ceph-mon[27634]: Standby manager daemon smithi110.hfirap started 2024-09-16T02:05:24.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:24 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/crt"}]: dispatch 2024-09-16T02:05:24.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:24 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:05:24.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:24 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/key"}]: dispatch 2024-09-16T02:05:24.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:24 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/3242203983' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:05:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:25 smithi165 ceph-mon[34621]: mgrmap e25: smithi165.afwhot(active, since 7s), standbys: smithi110.hfirap 2024-09-16T02:05:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:25 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T02:05:25.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:25 smithi110 ceph-mon[27634]: mgrmap e25: smithi165.afwhot(active, since 7s), standbys: smithi110.hfirap 2024-09-16T02:05:25.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:25 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T02:05:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:26 smithi165 ceph-mon[34621]: pgmap v7: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 240 op/s 2024-09-16T02:05:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:26 smithi110 ceph-mon[27634]: pgmap v7: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 240 op/s 2024-09-16T02:05:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:28 smithi165 ceph-mon[34621]: pgmap v8: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 187 op/s 2024-09-16T02:05:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:28 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:28 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:28 smithi110 ceph-mon[27634]: pgmap v8: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 187 op/s 2024-09-16T02:05:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:28 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:28 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:30.357 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:30 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:30.358 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:30 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:30.358 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:30 smithi165 ceph-mon[34621]: pgmap v9: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-16T02:05:30.451 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:30 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:30.451 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:30 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:30.451 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:30 smithi110 ceph-mon[27634]: pgmap v9: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-16T02:05:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:32 smithi165 ceph-mon[34621]: pgmap v10: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-09-16T02:05:32.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:32 smithi110 ceph-mon[27634]: pgmap v10: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-09-16T02:05:33.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:33 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:33.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:33 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:33.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:33 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:33.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:33 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:33.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:33 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:33.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:33 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:35.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: pgmap v11: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-09-16T02:05:35.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:35.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:35.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:34 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:35.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: pgmap v11: 65 pgs: 65 active+clean; 167 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:35.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:34 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:35 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi110 to 1557M 2024-09-16T02:05:36.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:35 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi110 to 1557M 2024-09-16T02:05:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:36 smithi165 ceph-mon[34621]: pgmap v12: 65 pgs: 65 active+clean; 186 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 472 op/s 2024-09-16T02:05:37.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:36 smithi110 ceph-mon[27634]: pgmap v12: 65 pgs: 65 active+clean; 186 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 472 op/s 2024-09-16T02:05:37.232 INFO:tasks.workunit.client.0.smithi110.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T02:05:37.237 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T02:05:37.237 INFO:tasks.workunit.client.0.smithi110.stderr:+ make 2024-09-16T02:05:37.734 INFO:tasks.workunit.client.0.smithi110.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T02:05:38.713 INFO:tasks.workunit.client.1.smithi165.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T02:05:38.716 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T02:05:38.717 INFO:tasks.workunit.client.1.smithi165.stderr:+ make 2024-09-16T02:05:38.814 INFO:tasks.workunit.client.1.smithi165.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T02:05:39.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.061+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2953458806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f80ff680 msgr2=0x7fc0f8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.061+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2953458806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f80ff680 0x7fc0f8101a60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0048d0 tx=0x7fc0ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.061+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2953458806 shutdown_connections 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.061+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2953458806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f80ff680 0x7fc0f8101a60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.061+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2953458806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0f8065c40 0x7fc0f80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.061+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2953458806 >> 172.21.15.110:0/2953458806 conn(0x7fc0f80f6c10 msgr2=0x7fc0f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2953458806 shutdown_connections 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2953458806 wait complete. 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 Processor -- start 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 -- start start 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 0x7fc0f810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0f80ff680 0x7fc0f810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f810dc00 con 0x7fc0f8065c40 2024-09-16T02:05:39.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0fc9f5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f810e420 con 0x7fc0f80ff680 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0f659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 0x7fc0f810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0f659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 0x7fc0f810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35488/0 (socket says 172.21.15.110:35488) 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0f659c640 1 -- 172.21.15.110:0/2402848723 learned_addr learned my addr 172.21.15.110:0/2402848723 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.062+0000 7fc0f5d9b640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0f80ff680 0x7fc0f810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0f659c640 1 -- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0f80ff680 msgr2=0x7fc0f810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0f659c640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0f80ff680 0x7fc0f810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0f659c640 1 -- 172.21.15.110:0/2402848723 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec005040 con 0x7fc0f8065c40 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0f659c640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 0x7fc0f810d070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800eb70 tx=0x7fc0e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e8007c30 con 0x7fc0f8065c40 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0e800f040 con 0x7fc0f8065c40 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f810e6b0 con 0x7fc0f8065c40 2024-09-16T02:05:39.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e800caa0 con 0x7fc0f8065c40 2024-09-16T02:05:39.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.063+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f810ec50 con 0x7fc0f8065c40 2024-09-16T02:05:39.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.064+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f80fa890 con 0x7fc0f8065c40 2024-09-16T02:05:39.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.065+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fc0e800cd10 con 0x7fc0f8065c40 2024-09-16T02:05:39.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.065+0000 7fc0e6ffd640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc0e006e6e0 0x7fc0e0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.065+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc0e808e080 con 0x7fc0f8065c40 2024-09-16T02:05:39.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.066+0000 7fc0f5d9b640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc0e006e6e0 0x7fc0e0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.066+0000 7fc0f5d9b640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc0e006e6e0 0x7fc0e0070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec007ac0 tx=0x7fc0ec035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:39.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.070+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc0e80579d0 con 0x7fc0f8065c40 2024-09-16T02:05:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: pgmap v13: 65 pgs: 65 active+clean; 186 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 332 op/s 2024-09-16T02:05:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:05:39.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:38 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:05:39.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: pgmap v13: 65 pgs: 65 active+clean; 186 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 332 op/s 2024-09-16T02:05:39.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:39.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:05:39.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:38 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:05:39.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.263+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f810f0b0 con 0x7fc0e006e6e0 2024-09-16T02:05:39.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.265+0000 7fc0e6ffd640 1 -- 172.21.15.110:0/2402848723 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc0f810f0b0 con 0x7fc0e006e6e0 2024-09-16T02:05:39.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc0e006e6e0 msgr2=0x7fc0e0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc0e006e6e0 0x7fc0e0070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec007ac0 tx=0x7fc0ec035040 comp rx=0 tx=0).stop 2024-09-16T02:05:39.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 msgr2=0x7fc0f810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 0x7fc0f810d070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800eb70 tx=0x7fc0e800b040 comp rx=0 tx=0).stop 2024-09-16T02:05:39.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 shutdown_connections 2024-09-16T02:05:39.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc0e006e6e0 0x7fc0e0070b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0f80ff680 0x7fc0f810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 --2- 172.21.15.110:0/2402848723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0f8065c40 0x7fc0f810d070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 >> 172.21.15.110:0/2402848723 conn(0x7fc0f80f6c10 msgr2=0x7fc0f80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:39.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 shutdown_connections 2024-09-16T02:05:39.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.268+0000 7fc0fc9f5640 1 -- 172.21.15.110:0/2402848723 wait complete. 2024-09-16T02:05:39.277 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:05:39.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 -- 172.21.15.110:0/259061146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 msgr2=0x7f33f40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 --2- 172.21.15.110:0/259061146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f40fc930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f33e40048d0 tx=0x7f33e4009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 -- 172.21.15.110:0/259061146 shutdown_connections 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 --2- 172.21.15.110:0/259061146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f40fd7f0 0x7f33f40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 --2- 172.21.15.110:0/259061146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f40fc930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 -- 172.21.15.110:0/259061146 >> 172.21.15.110:0/259061146 conn(0x7f33f40f7ce0 msgr2=0x7f33f40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 -- 172.21.15.110:0/259061146 shutdown_connections 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.349+0000 7f33f8fad640 1 -- 172.21.15.110:0/259061146 wait complete. 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f8fad640 1 Processor -- start 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f8fad640 1 -- start start 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f8fad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f8fad640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f40fd7f0 0x7f33f406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f8fad640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f406fff0 con 0x7f33f40fc520 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f8fad640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4070130 con 0x7f33f40fd7f0 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35506/0 (socket says 172.21.15.110:35506) 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f259c640 1 -- 172.21.15.110:0/1323943664 learned_addr learned my addr 172.21.15.110:0/1323943664 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.350+0000 7f33f1d9b640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f40fd7f0 0x7f33f406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33f259c640 1 -- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f40fd7f0 msgr2=0x7f33f406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33f259c640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f40fd7f0 0x7f33f406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33f259c640 1 -- 172.21.15.110:0/1323943664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4005040 con 0x7f33f40fc520 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33f259c640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f4071570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33e40043d0 tx=0x7f33e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e4038070 con 0x7f33f40fc520 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f33e402ae90 con 0x7f33f40fc520 2024-09-16T02:05:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40703b0 con 0x7f33f40fc520 2024-09-16T02:05:39.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e403e670 con 0x7f33f40fc520 2024-09-16T02:05:39.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.351+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f41150d0 con 0x7f33f40fc520 2024-09-16T02:05:39.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.352+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f40fb980 con 0x7f33f40fc520 2024-09-16T02:05:39.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.353+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f33e4030020 con 0x7f33f40fc520 2024-09-16T02:05:39.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.353+0000 7f33e2ffd640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f33dc06e6e0 0x7f33dc070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.353+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f33e40adfe0 con 0x7f33f40fc520 2024-09-16T02:05:39.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.354+0000 7f33f1d9b640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f33dc06e6e0 0x7f33dc070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.354+0000 7f33f1d9b640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f33dc06e6e0 0x7f33dc070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f33e8004eb0 tx=0x7f33e800b040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:39.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.358+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f33e4077a70 con 0x7f33f40fc520 2024-09-16T02:05:39.382 INFO:tasks.workunit.client.1.smithi165.stderr:++ readlink -f fsstress 2024-09-16T02:05:39.384 INFO:tasks.workunit.client.1.smithi165.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T02:05:39.384 INFO:tasks.workunit.client.1.smithi165.stderr:+ popd 2024-09-16T02:05:39.386 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T02:05:39.386 INFO:tasks.workunit.client.1.smithi165.stderr:+ popd 2024-09-16T02:05:39.386 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-16T02:05:39.387 INFO:tasks.workunit.client.1.smithi165.stderr:++ mktemp -d -p . 2024-09-16T02:05:39.389 INFO:tasks.workunit.client.1.smithi165.stderr:+ T=./tmp.tw6tRZH6tb 2024-09-16T02:05:39.390 INFO:tasks.workunit.client.1.smithi165.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.tw6tRZH6tb -l 1 -n 1000 -p 10 -v 2024-09-16T02:05:39.393 INFO:tasks.workunit.client.1.smithi165.stdout:seed = 1726059468 2024-09-16T02:05:39.399 INFO:tasks.workunit.client.1.smithi165.stdout:0/0: mkdir d0 0 2024-09-16T02:05:39.401 INFO:tasks.workunit.client.1.smithi165.stdout:2/0: dwrite - no filename 2024-09-16T02:05:39.402 INFO:tasks.workunit.client.1.smithi165.stdout:1/0: mknod c0 0 2024-09-16T02:05:39.402 INFO:tasks.workunit.client.1.smithi165.stdout:1/1: chown c0 2185428 1 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/2: fdatasync - no filename 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/3: dwrite - no filename 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/4: write - no filename 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/5: readlink - no filename 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/6: dwrite - no filename 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/7: readlink - no filename 2024-09-16T02:05:39.403 INFO:tasks.workunit.client.1.smithi165.stdout:3/0: readlink - no filename 2024-09-16T02:05:39.404 INFO:tasks.workunit.client.1.smithi165.stdout:0/1: creat d0/f1 x:0 0 0 2024-09-16T02:05:39.404 INFO:tasks.workunit.client.1.smithi165.stdout:0/2: rename d0 to d0/d2 22 2024-09-16T02:05:39.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/8: mkdir d1 0 2024-09-16T02:05:39.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/9: write - no filename 2024-09-16T02:05:39.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/10: dread - no filename 2024-09-16T02:05:39.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/11: readlink - no filename 2024-09-16T02:05:39.406 INFO:tasks.workunit.client.1.smithi165.stdout:4/0: chown . 1513 1 2024-09-16T02:05:39.407 INFO:tasks.workunit.client.1.smithi165.stdout:2/1: symlink l0 0 2024-09-16T02:05:39.407 INFO:tasks.workunit.client.1.smithi165.stdout:2/2: dwrite - no filename 2024-09-16T02:05:39.407 INFO:tasks.workunit.client.1.smithi165.stdout:2/3: dread - no filename 2024-09-16T02:05:39.407 INFO:tasks.workunit.client.1.smithi165.stdout:2/4: dwrite - no filename 2024-09-16T02:05:39.408 INFO:tasks.workunit.client.1.smithi165.stdout:0/3: creat d0/f3 x:0 0 0 2024-09-16T02:05:39.409 INFO:tasks.workunit.client.1.smithi165.stdout:1/12: unlink c0 0 2024-09-16T02:05:39.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/13: dread - no filename 2024-09-16T02:05:39.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/14: dread - no filename 2024-09-16T02:05:39.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/15: chown d1 11477 1 2024-09-16T02:05:39.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/16: chown d1 21 1 2024-09-16T02:05:39.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/17: truncate - no filename 2024-09-16T02:05:39.410 INFO:tasks.workunit.client.1.smithi165.stdout:3/1: symlink l0 0 2024-09-16T02:05:39.413 INFO:tasks.workunit.client.1.smithi165.stdout:2/5: unlink l0 0 2024-09-16T02:05:39.413 INFO:tasks.workunit.client.1.smithi165.stdout:2/6: unlink - no file 2024-09-16T02:05:39.413 INFO:tasks.workunit.client.1.smithi165.stdout:2/7: fsync - no filename 2024-09-16T02:05:39.414 INFO:tasks.workunit.client.1.smithi165.stdout:0/4: symlink d0/l4 0 2024-09-16T02:05:39.415 INFO:tasks.workunit.client.1.smithi165.stdout:3/2: creat f1 x:0 0 0 2024-09-16T02:05:39.416 INFO:tasks.workunit.client.1.smithi165.stdout:4/1: creat f0 x:0 0 0 2024-09-16T02:05:39.417 INFO:tasks.workunit.client.1.smithi165.stdout:6/0: dwrite - no filename 2024-09-16T02:05:39.417 INFO:tasks.workunit.client.1.smithi165.stdout:6/1: dread - no filename 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/2: rename - no filename 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/3: chown . 1366 1 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/4: dwrite - no filename 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/5: truncate - no filename 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/6: fsync - no filename 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/7: unlink - no file 2024-09-16T02:05:39.418 INFO:tasks.workunit.client.1.smithi165.stdout:2/8: creat f1 x:0 0 0 2024-09-16T02:05:39.419 INFO:tasks.workunit.client.1.smithi165.stdout:2/9: dread - f1 zero size 2024-09-16T02:05:39.419 INFO:tasks.workunit.client.1.smithi165.stdout:1/18: symlink d1/l2 0 2024-09-16T02:05:39.420 INFO:tasks.workunit.client.1.smithi165.stdout:0/5: symlink d0/l5 0 2024-09-16T02:05:39.421 INFO:tasks.workunit.client.1.smithi165.stdout:3/3: symlink l2 0 2024-09-16T02:05:39.422 INFO:tasks.workunit.client.1.smithi165.stdout:4/2: rename f0 to f1 0 2024-09-16T02:05:39.423 INFO:tasks.workunit.client.1.smithi165.stdout:5/0: mknod c0 0 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/0: dwrite - no filename 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/1: fsync - no filename 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/2: read - no filename 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/3: write - no filename 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/4: dwrite - no filename 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/5: write - no filename 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/6: link - no file 2024-09-16T02:05:39.425 INFO:tasks.workunit.client.1.smithi165.stdout:7/7: truncate - no filename 2024-09-16T02:05:39.426 INFO:tasks.workunit.client.1.smithi165.stdout:7/8: chown . 32403 1 2024-09-16T02:05:39.426 INFO:tasks.workunit.client.1.smithi165.stdout:3/4: creat f3 x:0 0 0 2024-09-16T02:05:39.427 INFO:tasks.workunit.client.1.smithi165.stdout:5/1: creat f1 x:0 0 0 2024-09-16T02:05:39.428 INFO:tasks.workunit.client.1.smithi165.stdout:6/8: mknod c0 0 2024-09-16T02:05:39.428 INFO:tasks.workunit.client.1.smithi165.stdout:6/9: truncate - no filename 2024-09-16T02:05:39.429 INFO:tasks.workunit.client.1.smithi165.stdout:2/10: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.432 INFO:tasks.workunit.client.1.smithi165.stdout:6/10: chown c0 6859 1 2024-09-16T02:05:39.432 INFO:tasks.workunit.client.1.smithi165.stdout:6/11: dwrite - no filename 2024-09-16T02:05:39.432 INFO:tasks.workunit.client.1.smithi165.stdout:6/12: write - no filename 2024-09-16T02:05:39.432 INFO:tasks.workunit.client.1.smithi165.stdout:3/5: symlink l4 0 2024-09-16T02:05:39.433 INFO:tasks.workunit.client.1.smithi165.stdout:6/13: stat c0 0 2024-09-16T02:05:39.433 INFO:tasks.workunit.client.1.smithi165.stdout:3/6: readlink l2 0 2024-09-16T02:05:39.433 INFO:tasks.workunit.client.1.smithi165.stdout:8/0: write - no filename 2024-09-16T02:05:39.433 INFO:tasks.workunit.client.1.smithi165.stdout:8/1: truncate - no filename 2024-09-16T02:05:39.434 INFO:tasks.workunit.client.1.smithi165.stdout:2/11: write f1 [2475632,107406] 0 2024-09-16T02:05:39.434 INFO:tasks.workunit.client.1.smithi165.stdout:7/9: getdents . 0 2024-09-16T02:05:39.436 INFO:tasks.workunit.client.1.smithi165.stdout:6/14: chown c0 1008216121 1 2024-09-16T02:05:39.437 INFO:tasks.workunit.client.1.smithi165.stdout:9/0: readlink - no filename 2024-09-16T02:05:39.437 INFO:tasks.workunit.client.1.smithi165.stdout:9/1: rename - no filename 2024-09-16T02:05:39.439 INFO:tasks.workunit.client.1.smithi165.stdout:3/7: write f3 [1015228,52624] 0 2024-09-16T02:05:39.442 INFO:tasks.workunit.client.1.smithi165.stdout:5/2: link c0 c2 0 2024-09-16T02:05:39.443 INFO:tasks.workunit.client.1.smithi165.stdout:6/15: symlink l1 0 2024-09-16T02:05:39.443 INFO:tasks.workunit.client.1.smithi165.stdout:6/16: dread - no filename 2024-09-16T02:05:39.443 INFO:tasks.workunit.client.1.smithi165.stdout:6/17: dread - no filename 2024-09-16T02:05:39.443 INFO:tasks.workunit.client.1.smithi165.stdout:6/18: write - no filename 2024-09-16T02:05:39.444 INFO:tasks.workunit.client.1.smithi165.stdout:4/3: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.445 INFO:tasks.workunit.client.1.smithi165.stdout:8/2: mknod c0 0 2024-09-16T02:05:39.447 INFO:tasks.workunit.client.1.smithi165.stdout:7/10: mkdir d0 0 2024-09-16T02:05:39.447 INFO:tasks.workunit.client.1.smithi165.stdout:7/11: dwrite - no filename 2024-09-16T02:05:39.447 INFO:tasks.workunit.client.1.smithi165.stdout:7/12: dread - no filename 2024-09-16T02:05:39.448 INFO:tasks.workunit.client.1.smithi165.stdout:6/19: creat f2 x:0 0 0 2024-09-16T02:05:39.450 INFO:tasks.workunit.client.1.smithi165.stdout:4/4: creat f2 x:0 0 0 2024-09-16T02:05:39.451 INFO:tasks.workunit.client.1.smithi165.stdout:6/20: dread - f2 zero size 2024-09-16T02:05:39.451 INFO:tasks.workunit.client.1.smithi165.stdout:9/2: mknod c0 0 2024-09-16T02:05:39.453 INFO:tasks.workunit.client.1.smithi165.stdout:8/3: symlink l1 0 2024-09-16T02:05:39.453 INFO:tasks.workunit.client.1.smithi165.stdout:8/4: dwrite - no filename 2024-09-16T02:05:39.453 INFO:tasks.workunit.client.1.smithi165.stdout:9/3: stat c0 0 2024-09-16T02:05:39.456 INFO:tasks.workunit.client.1.smithi165.stdout:2/12: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.456 INFO:tasks.workunit.client.1.smithi165.stdout:6/21: chown f2 1136 1 2024-09-16T02:05:39.457 INFO:tasks.workunit.client.1.smithi165.stdout:4/5: creat f3 x:0 0 0 2024-09-16T02:05:39.459 INFO:tasks.workunit.client.1.smithi165.stdout:2/13: read f1 [4073498,390] 0 2024-09-16T02:05:39.460 INFO:tasks.workunit.client.1.smithi165.stdout:6/22: truncate f2 120220 0 2024-09-16T02:05:39.461 INFO:tasks.workunit.client.1.smithi165.stdout:3/8: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.462 INFO:tasks.workunit.client.1.smithi165.stdout:9/4: mknod c1 0 2024-09-16T02:05:39.462 INFO:tasks.workunit.client.1.smithi165.stdout:9/5: read - no filename 2024-09-16T02:05:39.462 INFO:tasks.workunit.client.1.smithi165.stdout:9/6: dread - no filename 2024-09-16T02:05:39.462 INFO:tasks.workunit.client.1.smithi165.stdout:6/23: chown f2 1 1 2024-09-16T02:05:39.463 INFO:tasks.workunit.client.1.smithi165.stdout:7/13: getdents d0 0 2024-09-16T02:05:39.470 INFO:tasks.workunit.client.1.smithi165.stdout:9/7: creat f2 x:0 0 0 2024-09-16T02:05:39.474 INFO:tasks.workunit.client.1.smithi165.stdout:4/6: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.477 INFO:tasks.workunit.client.1.smithi165.stdout:7/14: creat d0/f1 x:0 0 0 2024-09-16T02:05:39.483 INFO:tasks.workunit.client.1.smithi165.stdout:4/7: mkdir d4 0 2024-09-16T02:05:39.484 INFO:tasks.workunit.client.1.smithi165.stdout:3/9: dread f1 [0,4194304] 0 2024-09-16T02:05:39.486 INFO:tasks.workunit.client.1.smithi165.stdout:9/8: mknod c3 0 2024-09-16T02:05:39.489 INFO:tasks.workunit.client.1.smithi165.stdout:6/24: dwrite f2 [0,4194304] 0 2024-09-16T02:05:39.490 INFO:tasks.workunit.client.1.smithi165.stdout:3/10: write f3 [335136,35342] 0 2024-09-16T02:05:39.491 INFO:tasks.workunit.client.1.smithi165.stdout:4/8: mknod d4/c5 0 2024-09-16T02:05:39.493 INFO:tasks.workunit.client.1.smithi165.stdout:9/9: creat f4 x:0 0 0 2024-09-16T02:05:39.496 INFO:tasks.workunit.client.1.smithi165.stdout:9/10: chown c3 10028768 1 2024-09-16T02:05:39.496 INFO:tasks.workunit.client.1.smithi165.stdout:7/15: dwrite d0/f1 [0,4194304] 0 2024-09-16T02:05:39.499 INFO:tasks.workunit.client.1.smithi165.stdout:7/16: stat d0/f1 0 2024-09-16T02:05:39.499 INFO:tasks.workunit.client.1.smithi165.stdout:3/11: mknod c5 0 2024-09-16T02:05:39.502 INFO:tasks.workunit.client.1.smithi165.stdout:9/11: write f4 [352221,23783] 0 2024-09-16T02:05:39.505 INFO:tasks.workunit.client.1.smithi165.stdout:6/25: dread f2 [0,4194304] 0 2024-09-16T02:05:39.506 INFO:tasks.workunit.client.1.smithi165.stdout:4/9: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.506 INFO:tasks.workunit.client.1.smithi165.stdout:3/12: write f1 [3326249,113444] 0 2024-09-16T02:05:39.510 INFO:tasks.workunit.client.1.smithi165.stdout:7/17: rename d0/f1 to d0/f2 0 2024-09-16T02:05:39.525 INFO:tasks.workunit.client.1.smithi165.stdout:7/18: link d0/f2 d0/f3 0 2024-09-16T02:05:39.525 INFO:tasks.workunit.client.1.smithi165.stdout:7/19: chown d0/f3 0 1 2024-09-16T02:05:39.525 INFO:tasks.workunit.client.1.smithi165.stdout:7/20: readlink - no filename 2024-09-16T02:05:39.526 INFO:tasks.workunit.client.1.smithi165.stdout:7/21: chown d0 79792059 1 2024-09-16T02:05:39.534 INFO:tasks.workunit.client.1.smithi165.stdout:7/22: dwrite d0/f2 [0,4194304] 0 2024-09-16T02:05:39.539 INFO:tasks.workunit.client.1.smithi165.stdout:7/23: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:39.560 INFO:tasks.workunit.client.1.smithi165.stdout:2/14: getdents . 0 2024-09-16T02:05:39.567 INFO:tasks.workunit.client.1.smithi165.stdout:5/3: fsync f1 0 2024-09-16T02:05:39.568 INFO:tasks.workunit.client.1.smithi165.stdout:2/15: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.568 INFO:tasks.workunit.client.1.smithi165.stdout:5/4: write f1 [479703,35497] 0 2024-09-16T02:05:39.569 INFO:tasks.workunit.client.1.smithi165.stdout:2/16: read f1 [3385474,85822] 0 2024-09-16T02:05:39.573 INFO:tasks.workunit.client.1.smithi165.stdout:5/5: dread f1 [0,4194304] 0 2024-09-16T02:05:39.574 INFO:tasks.workunit.client.1.smithi165.stdout:5/6: write f1 [371217,131011] 0 2024-09-16T02:05:39.581 INFO:tasks.workunit.client.1.smithi165.stdout:5/7: creat f3 x:0 0 0 2024-09-16T02:05:39.582 INFO:tasks.workunit.client.1.smithi165.stdout:8/5: getdents . 0 2024-09-16T02:05:39.582 INFO:tasks.workunit.client.1.smithi165.stdout:8/6: write - no filename 2024-09-16T02:05:39.584 INFO:tasks.workunit.client.1.smithi165.stdout:2/17: rename f1 to f2 0 2024-09-16T02:05:39.587 INFO:tasks.workunit.client.1.smithi165.stdout:8/7: symlink l2 0 2024-09-16T02:05:39.587 INFO:tasks.workunit.client.1.smithi165.stdout:8/8: dwrite - no filename 2024-09-16T02:05:39.587 INFO:tasks.workunit.client.1.smithi165.stdout:2/18: write f2 [334910,53666] 0 2024-09-16T02:05:39.589 INFO:tasks.workunit.client.1.smithi165.stdout:8/9: rename l1 to l3 0 2024-09-16T02:05:39.589 INFO:tasks.workunit.client.1.smithi165.stdout:8/10: write - no filename 2024-09-16T02:05:39.589 INFO:tasks.workunit.client.1.smithi165.stdout:5/8: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.593 INFO:tasks.workunit.client.1.smithi165.stdout:2/19: dread f2 [0,4194304] 0 2024-09-16T02:05:39.593 INFO:tasks.workunit.client.1.smithi165.stdout:2/20: read f2 [2244667,62166] 0 2024-09-16T02:05:39.597 INFO:tasks.workunit.client.1.smithi165.stdout:2/21: write f2 [1593355,64686] 0 2024-09-16T02:05:39.601 INFO:tasks.workunit.client.1.smithi165.stdout:2/22: mknod c3 0 2024-09-16T02:05:39.607 INFO:tasks.workunit.client.1.smithi165.stdout:9/12: getdents . 0 2024-09-16T02:05:39.607 INFO:tasks.workunit.client.1.smithi165.stdout:2/23: dwrite f2 [0,4194304] 0 2024-09-16T02:05:39.607 INFO:tasks.workunit.client.1.smithi165.stdout:9/13: fsync f4 0 2024-09-16T02:05:39.607 INFO:tasks.workunit.client.1.smithi165.stdout:2/24: read f2 [344185,65096] 0 2024-09-16T02:05:39.609 INFO:tasks.workunit.client.1.smithi165.stdout:5/9: fsync f1 0 2024-09-16T02:05:39.610 INFO:tasks.workunit.client.1.smithi165.stdout:6/26: truncate f2 3661296 0 2024-09-16T02:05:39.620 INFO:tasks.workunit.client.1.smithi165.stdout:7/24: dwrite d0/f3 [4194304,4194304] 0 2024-09-16T02:05:39.628 INFO:tasks.workunit.client.1.smithi165.stdout:2/25: dwrite f2 [0,4194304] 0 2024-09-16T02:05:39.629 INFO:tasks.workunit.client.1.smithi165.stdout:9/14: dwrite f2 [0,4194304] 0 2024-09-16T02:05:39.631 INFO:tasks.workunit.client.1.smithi165.stdout:3/13: truncate f1 2449940 0 2024-09-16T02:05:39.632 INFO:tasks.workunit.client.1.smithi165.stdout:3/14: readlink l2 0 2024-09-16T02:05:39.632 INFO:tasks.workunit.client.1.smithi165.stdout:5/10: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.632 INFO:tasks.workunit.client.1.smithi165.stdout:9/15: write f2 [2420152,82183] 0 2024-09-16T02:05:39.640 INFO:tasks.workunit.client.1.smithi165.stdout:7/25: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:39.641 INFO:tasks.workunit.client.1.smithi165.stdout:7/26: stat d0 0 2024-09-16T02:05:39.642 INFO:tasks.workunit.client.1.smithi165.stdout:5/11: creat f4 x:0 0 0 2024-09-16T02:05:39.644 INFO:tasks.workunit.client.1.smithi165.stdout:9/16: creat f5 x:0 0 0 2024-09-16T02:05:39.644 INFO:tasks.workunit.client.1.smithi165.stdout:3/15: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.645 INFO:tasks.workunit.client.1.smithi165.stdout:9/17: dread - f5 zero size 2024-09-16T02:05:39.646 INFO:tasks.workunit.client.1.smithi165.stdout:3/16: read f3 [139780,124736] 0 2024-09-16T02:05:39.647 INFO:tasks.workunit.client.1.smithi165.stdout:9/18: write f5 [58617,122341] 0 2024-09-16T02:05:39.654 INFO:tasks.workunit.client.1.smithi165.stdout:7/27: mkdir d0/d4 0 2024-09-16T02:05:39.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.651+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33f4101c50 con 0x7f33dc06e6e0 2024-09-16T02:05:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.653+0000 7f33e2ffd640 1 -- 172.21.15.110:0/1323943664 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f33f4101c50 con 0x7f33dc06e6e0 2024-09-16T02:05:39.656 INFO:tasks.workunit.client.1.smithi165.stdout:5/12: dwrite f4 [0,4194304] 0 2024-09-16T02:05:39.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f33dc06e6e0 msgr2=0x7f33dc070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f33dc06e6e0 0x7f33dc070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f33e8004eb0 tx=0x7f33e800b040 comp rx=0 tx=0).stop 2024-09-16T02:05:39.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 msgr2=0x7f33f4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f4071570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33e40043d0 tx=0x7f33e4009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 shutdown_connections 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f33dc06e6e0 0x7f33dc070b90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f40fd7f0 0x7f33f406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 --2- 172.21.15.110:0/1323943664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33f40fc520 0x7f33f4071570 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f33e40043d0 tx=0x7f33e4009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.658+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 >> 172.21.15.110:0/1323943664 conn(0x7f33f40f7ce0 msgr2=0x7f33f40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.659+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 shutdown_connections 2024-09-16T02:05:39.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.659+0000 7f33f8fad640 1 -- 172.21.15.110:0/1323943664 wait complete. 2024-09-16T02:05:39.663 INFO:tasks.workunit.client.1.smithi165.stdout:3/17: dread f3 [0,4194304] 0 2024-09-16T02:05:39.665 INFO:tasks.workunit.client.1.smithi165.stdout:9/19: dwrite f5 [0,4194304] 0 2024-09-16T02:05:39.670 INFO:tasks.workunit.client.1.smithi165.stdout:5/13: dread f4 [0,4194304] 0 2024-09-16T02:05:39.674 INFO:tasks.workunit.client.1.smithi165.stdout:3/18: mknod c6 0 2024-09-16T02:05:39.680 INFO:tasks.workunit.client.1.smithi165.stdout:3/19: rename l0 to l7 0 2024-09-16T02:05:39.683 INFO:tasks.workunit.client.1.smithi165.stdout:5/14: dread f3 [0,4194304] 0 2024-09-16T02:05:39.683 INFO:tasks.workunit.client.1.smithi165.stdout:9/20: dwrite f4 [0,4194304] 0 2024-09-16T02:05:39.690 INFO:tasks.workunit.client.1.smithi165.stdout:9/21: mkdir d6 0 2024-09-16T02:05:39.693 INFO:tasks.workunit.client.1.smithi165.stdout:3/20: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.694 INFO:tasks.workunit.client.1.smithi165.stdout:2/26: unlink f2 0 2024-09-16T02:05:39.698 INFO:tasks.workunit.client.1.smithi165.stdout:3/21: creat f8 x:0 0 0 2024-09-16T02:05:39.699 INFO:tasks.workunit.client.1.smithi165.stdout:3/22: chown f8 13578937 1 2024-09-16T02:05:39.703 INFO:tasks.workunit.client.1.smithi165.stdout:8/11: chown l3 13 1 2024-09-16T02:05:39.709 INFO:tasks.workunit.client.1.smithi165.stdout:8/12: unlink l2 0 2024-09-16T02:05:39.711 INFO:tasks.workunit.client.1.smithi165.stdout:9/22: rmdir d6 0 2024-09-16T02:05:39.711 INFO:tasks.workunit.client.1.smithi165.stdout:9/23: readlink - no filename 2024-09-16T02:05:39.715 INFO:tasks.workunit.client.1.smithi165.stdout:9/24: dread f4 [0,4194304] 0 2024-09-16T02:05:39.716 INFO:tasks.workunit.client.1.smithi165.stdout:8/13: mknod c4 0 2024-09-16T02:05:39.716 INFO:tasks.workunit.client.1.smithi165.stdout:8/14: dread - no filename 2024-09-16T02:05:39.723 INFO:tasks.workunit.client.1.smithi165.stdout:6/27: dread f2 [0,4194304] 0 2024-09-16T02:05:39.723 INFO:tasks.workunit.client.1.smithi165.stdout:9/25: mkdir d7 0 2024-09-16T02:05:39.724 INFO:tasks.workunit.client.1.smithi165.stdout:9/26: read f5 [3446548,120773] 0 2024-09-16T02:05:39.725 INFO:tasks.workunit.client.1.smithi165.stdout:8/15: symlink l5 0 2024-09-16T02:05:39.729 INFO:tasks.workunit.client.1.smithi165.stdout:6/28: creat f3 x:0 0 0 2024-09-16T02:05:39.731 INFO:tasks.workunit.client.1.smithi165.stdout:9/27: rename c0 to d7/c8 0 2024-09-16T02:05:39.732 INFO:tasks.workunit.client.1.smithi165.stdout:9/28: write f2 [2652971,25064] 0 2024-09-16T02:05:39.734 INFO:tasks.workunit.client.1.smithi165.stdout:8/16: creat f6 x:0 0 0 2024-09-16T02:05:39.738 INFO:tasks.workunit.client.1.smithi165.stdout:6/29: mknod c4 0 2024-09-16T02:05:39.738 INFO:tasks.workunit.client.1.smithi165.stdout:6/30: rmdir - no directory 2024-09-16T02:05:39.740 INFO:tasks.workunit.client.1.smithi165.stdout:3/23: fsync f1 0 2024-09-16T02:05:39.745 INFO:tasks.workunit.client.1.smithi165.stdout:8/17: mknod c7 0 2024-09-16T02:05:39.747 INFO:tasks.workunit.client.1.smithi165.stdout:9/29: dread f4 [0,4194304] 0 2024-09-16T02:05:39.747 INFO:tasks.workunit.client.1.smithi165.stdout:6/31: mknod c5 0 2024-09-16T02:05:39.747 INFO:tasks.workunit.client.1.smithi165.stdout:9/30: write f2 [549503,25053] 0 2024-09-16T02:05:39.748 INFO:tasks.workunit.client.1.smithi165.stdout:5/15: fsync f4 0 2024-09-16T02:05:39.751 INFO:tasks.workunit.client.1.smithi165.stdout:3/24: symlink l9 0 2024-09-16T02:05:39.753 INFO:tasks.workunit.client.1.smithi165.stdout:8/18: rename l3 to l8 0 2024-09-16T02:05:39.756 INFO:tasks.workunit.client.1.smithi165.stdout:5/16: mknod c5 0 2024-09-16T02:05:39.756 INFO:tasks.workunit.client.1.smithi165.stdout:6/32: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/19: creat f9 x:0 0 0 2024-09-16T02:05:39.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/17: creat f6 x:0 0 0 2024-09-16T02:05:39.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/18: readlink - no filename 2024-09-16T02:05:39.764 INFO:tasks.workunit.client.1.smithi165.stdout:7/28: truncate d0/f3 4022911 0 2024-09-16T02:05:39.764 INFO:tasks.workunit.client.1.smithi165.stdout:5/19: creat f7 x:0 0 0 2024-09-16T02:05:39.767 INFO:tasks.workunit.client.1.smithi165.stdout:9/31: dwrite f4 [0,4194304] 0 2024-09-16T02:05:39.769 INFO:tasks.workunit.client.1.smithi165.stdout:6/33: dwrite f2 [0,4194304] 0 2024-09-16T02:05:39.769 INFO:tasks.workunit.client.1.smithi165.stdout:6/34: stat c4 0 2024-09-16T02:05:39.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/29: creat d0/d4/f5 x:0 0 0 2024-09-16T02:05:39.772 INFO:tasks.workunit.client.1.smithi165.stdout:5/20: link c5 c8 0 2024-09-16T02:05:39.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/30: dread - d0/d4/f5 zero size 2024-09-16T02:05:39.773 INFO:tasks.workunit.client.1.smithi165.stdout:6/35: fdatasync f3 0 2024-09-16T02:05:39.781 INFO:tasks.workunit.client.1.smithi165.stdout:6/36: dwrite f3 [0,4194304] 0 2024-09-16T02:05:39.781 INFO:tasks.workunit.client.1.smithi165.stdout:6/37: rmdir - no directory 2024-09-16T02:05:39.781 INFO:tasks.workunit.client.1.smithi165.stdout:2/27: getdents . 0 2024-09-16T02:05:39.781 INFO:tasks.workunit.client.1.smithi165.stdout:2/28: dread - no filename 2024-09-16T02:05:39.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 -- 172.21.15.110:0/1151264672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806dbf0 msgr2=0x7ff65806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 --2- 172.21.15.110:0/1151264672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806dbf0 0x7ff65806e000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff6480048d0 tx=0x7ff648009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 -- 172.21.15.110:0/1151264672 shutdown_connections 2024-09-16T02:05:39.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 --2- 172.21.15.110:0/1151264672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65806e540 0x7ff65810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 --2- 172.21.15.110:0/1151264672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806dbf0 0x7ff65806e000 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff6480048d0 tx=0x7ff648009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 -- 172.21.15.110:0/1151264672 >> 172.21.15.110:0/1151264672 conn(0x7ff658069560 msgr2=0x7ff65806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 -- 172.21.15.110:0/1151264672 shutdown_connections 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.786+0000 7ff660215640 1 -- 172.21.15.110:0/1151264672 wait complete. 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff660215640 1 Processor -- start 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff660215640 1 -- start start 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff660215640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 0x7ff658106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff660215640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff658104830 0x7ff658104ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff660215640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff658119710 con 0x7ff65806e540 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff660215640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff658119880 con 0x7ff658104830 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff65dfb1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 0x7ff658106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.787+0000 7ff65dfb1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 0x7ff658106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35522/0 (socket says 172.21.15.110:35522) 2024-09-16T02:05:39.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.788+0000 7ff65dfb1640 1 -- 172.21.15.110:0/4233178860 learned_addr learned my addr 172.21.15.110:0/4233178860 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:39.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.788+0000 7ff65dfb1640 1 -- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff658104830 msgr2=0x7ff658104ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:39.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.788+0000 7ff65dfb1640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff658104830 0x7ff658104ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:39.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.788+0000 7ff65dfb1640 1 -- 172.21.15.110:0/4233178860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648005040 con 0x7ff65806e540 2024-09-16T02:05:39.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.789+0000 7ff65dfb1640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 0x7ff658106340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff648009900 tx=0x7ff648009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:39.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.789+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff648038070 con 0x7ff65806e540 2024-09-16T02:05:39.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.789+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff648033cb0 con 0x7ff65806e540 2024-09-16T02:05:39.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.789+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff658105240 con 0x7ff65806e540 2024-09-16T02:05:39.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.789+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64803cb80 con 0x7ff65806e540 2024-09-16T02:05:39.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.789+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff658122280 con 0x7ff65806e540 2024-09-16T02:05:39.793 INFO:tasks.workunit.client.1.smithi165.stdout:6/38: dread f3 [0,4194304] 0 2024-09-16T02:05:39.793 INFO:tasks.workunit.client.1.smithi165.stdout:2/29: link c3 c4 0 2024-09-16T02:05:39.794 INFO:tasks.workunit.client.1.smithi165.stdout:2/30: fsync - no filename 2024-09-16T02:05:39.794 INFO:tasks.workunit.client.1.smithi165.stdout:2/31: fdatasync - no filename 2024-09-16T02:05:39.794 INFO:tasks.workunit.client.1.smithi165.stdout:2/32: fsync - no filename 2024-09-16T02:05:39.794 INFO:tasks.workunit.client.1.smithi165.stdout:6/39: creat f6 x:0 0 0 2024-09-16T02:05:39.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.791+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65806d1b0 con 0x7ff65806e540 2024-09-16T02:05:39.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.792+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff648030020 con 0x7ff65806e540 2024-09-16T02:05:39.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.793+0000 7ff64e7fc640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff64406e6e0 0x7ff644070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:39.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.793+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff6480ae340 con 0x7ff65806e540 2024-09-16T02:05:39.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.794+0000 7ff65d7b0640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff64406e6e0 0x7ff644070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:39.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.795+0000 7ff65d7b0640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff64406e6e0 0x7ff644070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff654009740 tx=0x7ff654006c50 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:39.799 INFO:tasks.workunit.client.1.smithi165.stdout:6/40: dwrite f6 [0,4194304] 0 2024-09-16T02:05:39.800 INFO:tasks.workunit.client.1.smithi165.stdout:6/41: unlink f6 0 2024-09-16T02:05:39.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:39.800+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff648077d20 con 0x7ff65806e540 2024-09-16T02:05:39.812 INFO:tasks.workunit.client.1.smithi165.stdout:3/25: dwrite f1 [0,4194304] 0 2024-09-16T02:05:39.824 INFO:tasks.workunit.client.1.smithi165.stdout:8/20: getdents . 0 2024-09-16T02:05:39.824 INFO:tasks.workunit.client.1.smithi165.stdout:7/31: read d0/f3 [2469929,31132] 0 2024-09-16T02:05:39.825 INFO:tasks.workunit.client.1.smithi165.stdout:8/21: chown f6 248241464 1 2024-09-16T02:05:39.825 INFO:tasks.workunit.client.1.smithi165.stdout:9/32: truncate f2 33960 0 2024-09-16T02:05:39.825 INFO:tasks.workunit.client.1.smithi165.stdout:5/21: truncate f3 1228658 0 2024-09-16T02:05:39.826 INFO:tasks.workunit.client.1.smithi165.stdout:2/33: getdents . 0 2024-09-16T02:05:39.826 INFO:tasks.workunit.client.1.smithi165.stdout:5/22: fdatasync f7 0 2024-09-16T02:05:39.830 INFO:tasks.workunit.client.1.smithi165.stdout:6/42: getdents . 0 2024-09-16T02:05:39.944 INFO:tasks.workunit.client.1.smithi165.stdout:3/26: mkdir da 0 2024-09-16T02:05:39.944 INFO:tasks.workunit.client.1.smithi165.stdout:8/22: mknod ca 0 2024-09-16T02:05:39.945 INFO:tasks.workunit.client.1.smithi165.stdout:9/33: symlink d7/l9 0 2024-09-16T02:05:39.945 INFO:tasks.workunit.client.1.smithi165.stdout:3/27: write f3 [3908203,100652] 0 2024-09-16T02:05:39.945 INFO:tasks.workunit.client.1.smithi165.stdout:7/32: rename d0/f2 to d0/d4/f6 0 2024-09-16T02:05:39.946 INFO:tasks.workunit.client.1.smithi165.stdout:5/23: mknod c9 0 2024-09-16T02:05:39.946 INFO:tasks.workunit.client.1.smithi165.stdout:5/24: fsync f6 0 2024-09-16T02:05:39.947 INFO:tasks.workunit.client.1.smithi165.stdout:6/43: write f3 [3884028,104045] 0 2024-09-16T02:05:39.948 INFO:tasks.workunit.client.1.smithi165.stdout:8/23: mknod cb 0 2024-09-16T02:05:39.948 INFO:tasks.workunit.client.1.smithi165.stdout:6/44: chown c5 5 1 2024-09-16T02:05:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:39 smithi110 ceph-mon[27634]: Adjusting osd_memory_target on smithi165 to 2581M 2024-09-16T02:05:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:39 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T02:05:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:39 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T02:05:39.991 INFO:tasks.workunit.client.1.smithi165.stdout:5/25: rename f1 to fa 0 2024-09-16T02:05:39.991 INFO:tasks.workunit.client.1.smithi165.stdout:6/45: mkdir d7 0 2024-09-16T02:05:39.991 INFO:tasks.workunit.client.1.smithi165.stdout:3/28: dread f3 [0,4194304] 0 2024-09-16T02:05:39.992 INFO:tasks.workunit.client.1.smithi165.stdout:7/33: dread d0/d4/f6 [0,4194304] 0 2024-09-16T02:05:39.997 INFO:tasks.workunit.client.1.smithi165.stdout:8/24: mknod cc 0 2024-09-16T02:05:39.998 INFO:tasks.workunit.client.1.smithi165.stdout:7/34: mkdir d0/d4/d7 0 2024-09-16T02:05:39.998 INFO:tasks.workunit.client.1.smithi165.stdout:8/25: write f9 [998846,115824] 0 2024-09-16T02:05:39.999 INFO:tasks.workunit.client.1.smithi165.stdout:7/35: dread - d0/d4/f5 zero size 2024-09-16T02:05:39.999 INFO:tasks.workunit.client.1.smithi165.stdout:8/26: write f9 [801814,94015] 0 2024-09-16T02:05:39.999 INFO:tasks.workunit.client.1.smithi165.stdout:7/36: chown d0 17919455 1 2024-09-16T02:05:40.000 INFO:tasks.workunit.client.1.smithi165.stdout:8/27: write f6 [829846,45585] 0 2024-09-16T02:05:40.001 INFO:tasks.workunit.client.1.smithi165.stdout:3/29: creat da/fb x:0 0 0 2024-09-16T02:05:40.001 INFO:tasks.workunit.client.1.smithi165.stdout:3/30: stat l2 0 2024-09-16T02:05:40.003 INFO:tasks.workunit.client.1.smithi165.stdout:5/26: rename c5 to cb 0 2024-09-16T02:05:40.005 INFO:tasks.workunit.client.1.smithi165.stdout:8/28: dread f9 [0,4194304] 0 2024-09-16T02:05:40.009 INFO:tasks.workunit.client.1.smithi165.stdout:8/29: mkdir dd 0 2024-09-16T02:05:40.011 INFO:tasks.workunit.client.1.smithi165.stdout:8/30: symlink dd/le 0 2024-09-16T02:05:40.012 INFO:tasks.workunit.client.1.smithi165.stdout:8/31: chown c7 1 1 2024-09-16T02:05:40.013 INFO:tasks.workunit.client.1.smithi165.stdout:5/27: dwrite fa [0,4194304] 0 2024-09-16T02:05:40.015 INFO:tasks.workunit.client.1.smithi165.stdout:8/32: dread f9 [0,4194304] 0 2024-09-16T02:05:40.017 INFO:tasks.workunit.client.1.smithi165.stdout:8/33: creat dd/ff x:0 0 0 2024-09-16T02:05:40.018 INFO:tasks.workunit.client.1.smithi165.stdout:5/28: dread fa [0,4194304] 0 2024-09-16T02:05:40.018 INFO:tasks.workunit.client.1.smithi165.stdout:5/29: truncate f6 171819 0 2024-09-16T02:05:40.019 INFO:tasks.workunit.client.1.smithi165.stdout:8/34: rename c0 to dd/c10 0 2024-09-16T02:05:40.021 INFO:tasks.workunit.client.1.smithi165.stdout:5/30: creat fc x:0 0 0 2024-09-16T02:05:40.022 INFO:tasks.workunit.client.1.smithi165.stdout:8/35: mkdir dd/d11 0 2024-09-16T02:05:40.022 INFO:tasks.workunit.client.1.smithi165.stdout:5/31: dread f6 [0,4194304] 0 2024-09-16T02:05:40.025 INFO:tasks.workunit.client.1.smithi165.stdout:5/32: mknod cd 0 2024-09-16T02:05:40.026 INFO:tasks.workunit.client.1.smithi165.stdout:8/36: mknod dd/d11/c12 0 2024-09-16T02:05:40.027 INFO:tasks.workunit.client.1.smithi165.stdout:5/33: mkdir de 0 2024-09-16T02:05:40.028 INFO:tasks.workunit.client.1.smithi165.stdout:8/37: mkdir dd/d13 0 2024-09-16T02:05:40.036 INFO:tasks.workunit.client.1.smithi165.stdout:5/34: dwrite fa [0,4194304] 0 2024-09-16T02:05:40.037 INFO:tasks.workunit.client.1.smithi165.stdout:8/38: dwrite f9 [0,4194304] 0 2024-09-16T02:05:40.038 INFO:tasks.workunit.client.1.smithi165.stdout:8/39: chown dd/d11/c12 913738452 1 2024-09-16T02:05:40.039 INFO:tasks.workunit.client.1.smithi165.stdout:5/35: symlink de/lf 0 2024-09-16T02:05:40.039 INFO:tasks.workunit.client.1.smithi165.stdout:8/40: write f9 [501638,108146] 0 2024-09-16T02:05:40.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.058+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff65810a290 con 0x7ff64406e6e0 2024-09-16T02:05:40.059 INFO:tasks.workunit.client.1.smithi165.stdout:8/41: mkdir dd/d11/d14 0 2024-09-16T02:05:40.064 INFO:tasks.workunit.client.1.smithi165.stdout:8/42: link dd/le dd/d13/l15 0 2024-09-16T02:05:40.065 INFO:tasks.workunit.client.1.smithi165.stdout:5/36: dwrite f6 [0,4194304] 0 2024-09-16T02:05:40.067 INFO:tasks.workunit.client.1.smithi165.stdout:8/43: creat dd/d11/d14/f16 x:0 0 0 2024-09-16T02:05:40.070 INFO:tasks.workunit.client.1.smithi165.stdout:9/34: dread f2 [0,4194304] 0 2024-09-16T02:05:40.071 INFO:tasks.workunit.client.1.smithi165.stdout:8/44: dread f9 [0,4194304] 0 2024-09-16T02:05:40.071 INFO:tasks.workunit.client.1.smithi165.stdout:9/35: write f4 [1597849,29859] 0 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.071+0000 7ff64e7fc640 1 -- 172.21.15.110:0/4233178860 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff65810a290 con 0x7ff64406e6e0 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (6m) 6s ago 7m 24.4M - 0.25.0 c8568f914cd2 d98e35b955ee 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (7m) 6s ago 7m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (6m) 11s ago 6m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (6m) 6s ago 7m 89.2M - 9.4.7 954c08fa6188 02b51104ba52 2024-09-16T02:05:40.073 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (2m) 6s ago 2m 138M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (2m) 6s ago 2m 149M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (2m) 11s ago 2m 14.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (2m) 11s ago 2m 11.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:9283,8765,8443 running (8m) 6s ago 8m 207M - 17.2.7-1633-g6d025bc2 33ed8dba3996 093819b4fc7f 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (33s) 11s ago 6m 482M - 19.1.1-326-g8921c8ef f1455bd0219c 059ca54552a6 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (8m) 6s ago 9m 49.0M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (6m) 11s ago 6m 38.1M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 6s ago 7m 16.1M - 1.5.0 0da6a335fe13 69c375f8a058 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 11s ago 6m 16.9M - 1.5.0 0da6a335fe13 60a3c227d383 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (6m) 6s ago 6m 78.4M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (5m) 6s ago 5m 79.0M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (5m) 6s ago 5m 71.6M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:05:40.074 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (4m) 11s ago 4m 79.4M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:05:40.075 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (4m) 11s ago 4m 72.5M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:05:40.075 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (3m) 11s ago 3m 76.1M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:05:40.075 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (6m) 6s ago 7m 64.5M - 2.43.0 a07b618ecd1d 63397dfd0974 2024-09-16T02:05:40.075 INFO:tasks.workunit.client.1.smithi165.stdout:7/37: rmdir d0/d4 39 2024-09-16T02:05:40.076 INFO:tasks.workunit.client.1.smithi165.stdout:9/36: dread f4 [0,4194304] 0 2024-09-16T02:05:40.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff64406e6e0 msgr2=0x7ff644070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff64406e6e0 0x7ff644070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff654009740 tx=0x7ff654006c50 comp rx=0 tx=0).stop 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 msgr2=0x7ff658106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 0x7ff658106340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff648009900 tx=0x7ff648009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 shutdown_connections 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff64406e6e0 0x7ff644070b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff658104830 0x7ff658104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 --2- 172.21.15.110:0/4233178860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff65806e540 0x7ff658106340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 >> 172.21.15.110:0/4233178860 conn(0x7ff658069560 msgr2=0x7ff658108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 shutdown_connections 2024-09-16T02:05:40.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.075+0000 7ff660215640 1 -- 172.21.15.110:0/4233178860 wait complete. 2024-09-16T02:05:40.078 INFO:tasks.workunit.client.1.smithi165.stdout:6/46: truncate f2 708889 0 2024-09-16T02:05:40.078 INFO:tasks.workunit.client.1.smithi165.stdout:9/37: creat d7/fa x:0 0 0 2024-09-16T02:05:40.079 INFO:tasks.workunit.client.1.smithi165.stdout:8/45: link l8 dd/l17 0 2024-09-16T02:05:40.081 INFO:tasks.workunit.client.1.smithi165.stdout:6/47: mknod d7/c8 0 2024-09-16T02:05:40.082 INFO:tasks.workunit.client.1.smithi165.stdout:6/48: chown c4 9722038 1 2024-09-16T02:05:40.083 INFO:tasks.workunit.client.1.smithi165.stdout:9/38: dread f5 [0,4194304] 0 2024-09-16T02:05:40.084 INFO:tasks.workunit.client.1.smithi165.stdout:8/46: rename l5 to dd/d11/l18 0 2024-09-16T02:05:40.084 INFO:tasks.workunit.client.1.smithi165.stdout:3/31: truncate f3 3188297 0 2024-09-16T02:05:40.086 INFO:tasks.workunit.client.1.smithi165.stdout:6/49: dread f3 [0,4194304] 0 2024-09-16T02:05:40.088 INFO:tasks.workunit.client.1.smithi165.stdout:9/39: dread f4 [0,4194304] 0 2024-09-16T02:05:40.089 INFO:tasks.workunit.client.1.smithi165.stdout:8/47: creat dd/d11/d14/f19 x:0 0 0 2024-09-16T02:05:40.089 INFO:tasks.workunit.client.1.smithi165.stdout:3/32: dread f1 [0,4194304] 0 2024-09-16T02:05:40.091 INFO:tasks.workunit.client.1.smithi165.stdout:9/40: truncate f5 605618 0 2024-09-16T02:05:40.092 INFO:tasks.workunit.client.1.smithi165.stdout:9/41: dread f2 [0,4194304] 0 2024-09-16T02:05:40.092 INFO:tasks.workunit.client.1.smithi165.stdout:3/33: creat da/fc x:0 0 0 2024-09-16T02:05:40.093 INFO:tasks.workunit.client.1.smithi165.stdout:3/34: dread - da/fc zero size 2024-09-16T02:05:40.093 INFO:tasks.workunit.client.1.smithi165.stdout:8/48: rename ca to dd/d13/c1a 0 2024-09-16T02:05:40.096 INFO:tasks.workunit.client.1.smithi165.stdout:9/42: mknod d7/cb 0 2024-09-16T02:05:40.105 INFO:tasks.workunit.client.1.smithi165.stdout:9/43: dwrite f4 [0,4194304] 0 2024-09-16T02:05:40.107 INFO:tasks.workunit.client.1.smithi165.stdout:5/37: dwrite f3 [0,4194304] 0 2024-09-16T02:05:40.107 INFO:tasks.workunit.client.1.smithi165.stdout:9/44: dread f2 [0,4194304] 0 2024-09-16T02:05:40.108 INFO:tasks.workunit.client.1.smithi165.stdout:5/38: readlink de/lf 0 2024-09-16T02:05:40.108 INFO:tasks.workunit.client.1.smithi165.stdout:5/39: fdatasync fc 0 2024-09-16T02:05:40.109 INFO:tasks.workunit.client.1.smithi165.stdout:8/49: rename dd/d11/l18 to dd/l1b 0 2024-09-16T02:05:40.118 INFO:tasks.workunit.client.1.smithi165.stdout:5/40: link f4 de/f10 0 2024-09-16T02:05:40.120 INFO:tasks.workunit.client.1.smithi165.stdout:3/35: write f3 [519191,70012] 0 2024-09-16T02:05:40.120 INFO:tasks.workunit.client.1.smithi165.stdout:9/45: link d7/c8 d7/cc 0 2024-09-16T02:05:40.121 INFO:tasks.workunit.client.1.smithi165.stdout:8/50: dwrite f6 [0,4194304] 0 2024-09-16T02:05:40.123 INFO:tasks.workunit.client.1.smithi165.stdout:3/36: readlink l7 0 2024-09-16T02:05:40.124 INFO:tasks.workunit.client.1.smithi165.stdout:8/51: unlink dd/d11/c12 0 2024-09-16T02:05:40.125 INFO:tasks.workunit.client.1.smithi165.stdout:9/46: creat d7/fd x:0 0 0 2024-09-16T02:05:40.126 INFO:tasks.workunit.client.1.smithi165.stdout:3/37: rename l9 to da/ld 0 2024-09-16T02:05:40.126 INFO:tasks.workunit.client.1.smithi165.stdout:8/52: rmdir dd/d13 39 2024-09-16T02:05:40.127 INFO:tasks.workunit.client.1.smithi165.stdout:9/47: dread - d7/fd zero size 2024-09-16T02:05:40.128 INFO:tasks.workunit.client.1.smithi165.stdout:6/50: dwrite f2 [0,4194304] 0 2024-09-16T02:05:40.128 INFO:tasks.workunit.client.1.smithi165.stdout:3/38: write f3 [2319517,88659] 0 2024-09-16T02:05:40.129 INFO:tasks.workunit.client.1.smithi165.stdout:8/53: write f6 [930846,115900] 0 2024-09-16T02:05:40.130 INFO:tasks.workunit.client.1.smithi165.stdout:6/51: read f2 [119087,122507] 0 2024-09-16T02:05:40.131 INFO:tasks.workunit.client.1.smithi165.stdout:3/39: truncate f1 4395882 0 2024-09-16T02:05:40.131 INFO:tasks.workunit.client.1.smithi165.stdout:8/54: chown f9 19643 1 2024-09-16T02:05:40.133 INFO:tasks.workunit.client.1.smithi165.stdout:6/52: creat d7/f9 x:0 0 0 2024-09-16T02:05:40.134 INFO:tasks.workunit.client.1.smithi165.stdout:9/48: dread f4 [0,4194304] 0 2024-09-16T02:05:40.135 INFO:tasks.workunit.client.1.smithi165.stdout:3/40: mkdir da/de 0 2024-09-16T02:05:40.136 INFO:tasks.workunit.client.1.smithi165.stdout:8/55: mkdir dd/d11/d14/d1c 0 2024-09-16T02:05:40.137 INFO:tasks.workunit.client.1.smithi165.stdout:9/49: mkdir d7/de 0 2024-09-16T02:05:40.139 INFO:tasks.workunit.client.1.smithi165.stdout:6/53: dread f2 [0,4194304] 0 2024-09-16T02:05:40.140 INFO:tasks.workunit.client.1.smithi165.stdout:8/56: write f9 [846619,125032] 0 2024-09-16T02:05:40.142 INFO:tasks.workunit.client.1.smithi165.stdout:9/50: mkdir d7/df 0 2024-09-16T02:05:40.142 INFO:tasks.workunit.client.1.smithi165.stdout:8/57: write dd/d11/d14/f16 [71971,65417] 0 2024-09-16T02:05:40.143 INFO:tasks.workunit.client.1.smithi165.stdout:9/51: chown d7/de 106755948 1 2024-09-16T02:05:40.145 INFO:tasks.workunit.client.1.smithi165.stdout:6/54: mknod d7/ca 0 2024-09-16T02:05:40.147 INFO:tasks.workunit.client.1.smithi165.stdout:3/41: link l2 da/de/lf 0 2024-09-16T02:05:40.148 INFO:tasks.workunit.client.1.smithi165.stdout:6/55: fdatasync f3 0 2024-09-16T02:05:40.149 INFO:tasks.workunit.client.1.smithi165.stdout:9/52: creat d7/df/f10 x:0 0 0 2024-09-16T02:05:40.149 INFO:tasks.workunit.client.1.smithi165.stdout:3/42: rmdir da/de 39 2024-09-16T02:05:40.151 INFO:tasks.workunit.client.1.smithi165.stdout:6/56: creat d7/fb x:0 0 0 2024-09-16T02:05:40.152 INFO:tasks.workunit.client.1.smithi165.stdout:8/58: getdents dd/d11 0 2024-09-16T02:05:40.153 INFO:tasks.workunit.client.1.smithi165.stdout:6/57: mkdir d7/dc 0 2024-09-16T02:05:40.159 INFO:tasks.workunit.client.1.smithi165.stdout:9/53: write f2 [983347,103129] 0 2024-09-16T02:05:40.160 INFO:tasks.workunit.client.1.smithi165.stdout:3/43: dwrite da/fb [0,4194304] 0 2024-09-16T02:05:40.164 INFO:tasks.workunit.client.1.smithi165.stdout:3/44: write f1 [3580595,59384] 0 2024-09-16T02:05:40.167 INFO:tasks.workunit.client.1.smithi165.stdout:8/59: dwrite dd/ff [0,4194304] 0 2024-09-16T02:05:40.168 INFO:tasks.workunit.client.1.smithi165.stdout:6/58: dwrite f2 [0,4194304] 0 2024-09-16T02:05:40.168 INFO:tasks.workunit.client.1.smithi165.stdout:3/45: dread - da/fc zero size 2024-09-16T02:05:40.173 INFO:tasks.workunit.client.1.smithi165.stdout:6/59: creat d7/fd x:0 0 0 2024-09-16T02:05:40.177 INFO:tasks.workunit.client.1.smithi165.stdout:9/54: dwrite d7/fa [0,4194304] 0 2024-09-16T02:05:40.177 INFO:tasks.workunit.client.1.smithi165.stdout:3/46: chown da/de/lf 765299 1 2024-09-16T02:05:40.177 INFO:tasks.workunit.client.1.smithi165.stdout:6/60: dread - d7/fd zero size 2024-09-16T02:05:40.180 INFO:tasks.workunit.client.1.smithi165.stdout:8/60: dread dd/ff [0,4194304] 0 2024-09-16T02:05:40.181 INFO:tasks.workunit.client.1.smithi165.stdout:3/47: creat da/de/f10 x:0 0 0 2024-09-16T02:05:40.182 INFO:tasks.workunit.client.1.smithi165.stdout:9/55: symlink d7/df/l11 0 2024-09-16T02:05:40.189 INFO:tasks.workunit.client.1.smithi165.stdout:6/61: dwrite d7/fd [0,4194304] 0 2024-09-16T02:05:40.192 INFO:tasks.workunit.client.1.smithi165.stdout:3/48: dread f3 [0,4194304] 0 2024-09-16T02:05:40.193 INFO:tasks.workunit.client.1.smithi165.stdout:6/62: dread - d7/fb zero size 2024-09-16T02:05:40.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 -- 172.21.15.110:0/834434079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 msgr2=0x7f48bc0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 --2- 172.21.15.110:0/834434079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc0ff130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f48b80048d0 tx=0x7f48b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 -- 172.21.15.110:0/834434079 shutdown_connections 2024-09-16T02:05:40.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 --2- 172.21.15.110:0/834434079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48bc0ff670 0x7f48bc101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 --2- 172.21.15.110:0/834434079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc0ff130 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 -- 172.21.15.110:0/834434079 >> 172.21.15.110:0/834434079 conn(0x7f48bc0f6c00 msgr2=0x7f48bc0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:40.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 -- 172.21.15.110:0/834434079 shutdown_connections 2024-09-16T02:05:40.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.193+0000 7f48c47ca640 1 -- 172.21.15.110:0/834434079 wait complete. 2024-09-16T02:05:40.195 INFO:tasks.workunit.client.1.smithi165.stdout:3/49: chown l4 57538 1 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c47ca640 1 Processor -- start 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c47ca640 1 -- start start 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c47ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c47ca640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48bc0ff670 0x7f48bc10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c47ca640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc10e480 con 0x7f48bc0664d0 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c47ca640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc10e5f0 con 0x7f48bc0ff670 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c2566640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c2566640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35540/0 (socket says 172.21.15.110:35540) 2024-09-16T02:05:40.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c2566640 1 -- 172.21.15.110:0/3392334570 learned_addr learned my addr 172.21.15.110:0/3392334570 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c1d65640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48bc0ff670 0x7f48bc10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c2566640 1 -- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48bc0ff670 msgr2=0x7f48bc10d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c2566640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48bc0ff670 0x7f48bc10d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.194+0000 7f48c2566640 1 -- 172.21.15.110:0/3392334570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8005040 con 0x7f48bc0664d0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.195+0000 7f48c2566640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc10d120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48b80048a0 tx=0x7f48b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.195+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b8038070 con 0x7f48bc0664d0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.195+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc10e870 con 0x7f48bc0664d0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.195+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f48b802abd0 con 0x7f48bc0664d0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.195+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b8033640 con 0x7f48bc0664d0 2024-09-16T02:05:40.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.195+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc10ed90 con 0x7f48bc0664d0 2024-09-16T02:05:40.199 INFO:tasks.workunit.client.1.smithi165.stdout:6/63: write d7/fb [591348,90062] 0 2024-09-16T02:05:40.199 INFO:tasks.workunit.client.1.smithi165.stdout:8/61: dwrite dd/d11/d14/f16 [0,4194304] 0 2024-09-16T02:05:40.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.196+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc1057b0 con 0x7f48bc0664d0 2024-09-16T02:05:40.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.197+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f48b8030020 con 0x7f48bc0664d0 2024-09-16T02:05:40.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.197+0000 7f48b2ffd640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f48a806e6e0 0x7f48a8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:40.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.197+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f48b80ae150 con 0x7f48bc0664d0 2024-09-16T02:05:40.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.198+0000 7f48c1d65640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f48a806e6e0 0x7f48a8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:40.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.199+0000 7f48c1d65640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f48a806e6e0 0x7f48a8070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006fd0 tx=0x7f48ac008040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:40.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/56: dwrite f4 [0,4194304] 0 2024-09-16T02:05:40.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:39 smithi165 ceph-mon[34621]: Adjusting osd_memory_target on smithi165 to 2581M 2024-09-16T02:05:40.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:39 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T02:05:40.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:39 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T02:05:40.202 INFO:tasks.workunit.client.1.smithi165.stdout:6/64: creat d7/fe x:0 0 0 2024-09-16T02:05:40.203 INFO:tasks.workunit.client.1.smithi165.stdout:6/65: readlink l1 0 2024-09-16T02:05:40.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.203+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f48b8077b30 con 0x7f48bc0664d0 2024-09-16T02:05:40.205 INFO:tasks.workunit.client.1.smithi165.stdout:9/57: truncate d7/df/f10 103159 0 2024-09-16T02:05:40.205 INFO:tasks.workunit.client.1.smithi165.stdout:6/66: dread - d7/fe zero size 2024-09-16T02:05:40.206 INFO:tasks.workunit.client.1.smithi165.stdout:3/50: dread f3 [0,4194304] 0 2024-09-16T02:05:40.206 INFO:tasks.workunit.client.1.smithi165.stdout:9/58: readlink d7/l9 0 2024-09-16T02:05:40.210 INFO:tasks.workunit.client.1.smithi165.stdout:3/51: creat da/de/f11 x:0 0 0 2024-09-16T02:05:40.210 INFO:tasks.workunit.client.1.smithi165.stdout:8/62: dwrite f6 [0,4194304] 0 2024-09-16T02:05:40.210 INFO:tasks.workunit.client.1.smithi165.stdout:6/67: mkdir d7/dc/df 0 2024-09-16T02:05:40.211 INFO:tasks.workunit.client.1.smithi165.stdout:9/59: truncate f5 515833 0 2024-09-16T02:05:40.212 INFO:tasks.workunit.client.1.smithi165.stdout:6/68: write d7/f9 [679551,15358] 0 2024-09-16T02:05:40.212 INFO:tasks.workunit.client.1.smithi165.stdout:9/60: chown d7/df 0 1 2024-09-16T02:05:40.217 INFO:tasks.workunit.client.1.smithi165.stdout:6/69: creat d7/dc/df/f10 x:0 0 0 2024-09-16T02:05:40.218 INFO:tasks.workunit.client.1.smithi165.stdout:3/52: getdents da 0 2024-09-16T02:05:40.219 INFO:tasks.workunit.client.1.smithi165.stdout:3/53: write f1 [119668,85525] 0 2024-09-16T02:05:40.222 INFO:tasks.workunit.client.1.smithi165.stdout:6/70: symlink d7/dc/l11 0 2024-09-16T02:05:40.222 INFO:tasks.workunit.client.1.smithi165.stdout:8/63: dwrite dd/ff [0,4194304] 0 2024-09-16T02:05:40.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/64: write dd/d11/d14/f19 [944821,81210] 0 2024-09-16T02:05:40.227 INFO:tasks.workunit.client.1.smithi165.stdout:6/71: read d7/fb [543755,111252] 0 2024-09-16T02:05:40.231 INFO:tasks.workunit.client.1.smithi165.stdout:3/54: fsync f1 0 2024-09-16T02:05:40.232 INFO:tasks.workunit.client.1.smithi165.stdout:3/55: read f1 [2512480,82233] 0 2024-09-16T02:05:40.236 INFO:tasks.workunit.client.1.smithi165.stdout:3/56: rename da/ld to da/de/l12 0 2024-09-16T02:05:40.242 INFO:tasks.workunit.client.1.smithi165.stdout:3/57: dwrite f3 [0,4194304] 0 2024-09-16T02:05:40.251 INFO:tasks.workunit.client.1.smithi165.stdout:3/58: creat da/de/f13 x:0 0 0 2024-09-16T02:05:40.259 INFO:tasks.workunit.client.1.smithi165.stdout:3/59: rmdir da/de 39 2024-09-16T02:05:40.265 INFO:tasks.workunit.client.1.smithi165.stdout:3/60: unlink l7 0 2024-09-16T02:05:40.270 INFO:tasks.workunit.client.1.smithi165.stdout:3/61: dread - da/de/f11 zero size 2024-09-16T02:05:40.274 INFO:tasks.workunit.client.1.smithi165.stdout:3/62: creat da/f14 x:0 0 0 2024-09-16T02:05:40.278 INFO:tasks.workunit.client.1.smithi165.stdout:6/72: dread d7/f9 [0,4194304] 0 2024-09-16T02:05:40.280 INFO:tasks.workunit.client.1.smithi165.stdout:3/63: creat da/f15 x:0 0 0 2024-09-16T02:05:40.281 INFO:tasks.workunit.client.1.smithi165.stdout:6/73: mknod d7/dc/df/c12 0 2024-09-16T02:05:40.281 INFO:tasks.workunit.client.1.smithi165.stdout:6/74: readlink l1 0 2024-09-16T02:05:40.281 INFO:tasks.workunit.client.1.smithi165.stdout:6/75: read d7/fd [3089712,49176] 0 2024-09-16T02:05:40.283 INFO:tasks.workunit.client.1.smithi165.stdout:3/64: rename da/de/f13 to da/de/f16 0 2024-09-16T02:05:40.285 INFO:tasks.workunit.client.1.smithi165.stdout:3/65: dread - da/fc zero size 2024-09-16T02:05:40.288 INFO:tasks.workunit.client.1.smithi165.stdout:3/66: write da/de/f16 [959725,70034] 0 2024-09-16T02:05:40.289 INFO:tasks.workunit.client.1.smithi165.stdout:6/76: dwrite d7/fd [0,4194304] 0 2024-09-16T02:05:40.291 INFO:tasks.workunit.client.1.smithi165.stdout:6/77: mknod d7/dc/df/c13 0 2024-09-16T02:05:40.292 INFO:tasks.workunit.client.1.smithi165.stdout:3/67: mkdir da/d17 0 2024-09-16T02:05:40.294 INFO:tasks.workunit.client.1.smithi165.stdout:6/78: write d7/fb [1651182,31543] 0 2024-09-16T02:05:40.295 INFO:tasks.workunit.client.1.smithi165.stdout:3/68: symlink da/l18 0 2024-09-16T02:05:40.303 INFO:tasks.workunit.client.1.smithi165.stdout:6/79: dwrite d7/f9 [0,4194304] 0 2024-09-16T02:05:40.303 INFO:tasks.workunit.client.1.smithi165.stdout:3/69: dread da/fb [0,4194304] 0 2024-09-16T02:05:40.304 INFO:tasks.workunit.client.1.smithi165.stdout:3/70: dread - f8 zero size 2024-09-16T02:05:40.304 INFO:tasks.workunit.client.1.smithi165.stdout:6/80: write d7/fb [1010127,17649] 0 2024-09-16T02:05:40.309 INFO:tasks.workunit.client.1.smithi165.stdout:3/71: rmdir da 39 2024-09-16T02:05:40.313 INFO:tasks.workunit.client.1.smithi165.stdout:6/81: truncate d7/fd 1204189 0 2024-09-16T02:05:40.314 INFO:tasks.workunit.client.1.smithi165.stdout:6/82: truncate d7/dc/df/f10 606970 0 2024-09-16T02:05:40.314 INFO:tasks.workunit.client.1.smithi165.stdout:3/72: rename l4 to da/de/l19 0 2024-09-16T02:05:40.314 INFO:tasks.workunit.client.1.smithi165.stdout:6/83: chown l1 1 1 2024-09-16T02:05:40.315 INFO:tasks.workunit.client.1.smithi165.stdout:3/73: truncate da/f14 893406 0 2024-09-16T02:05:40.316 INFO:tasks.workunit.client.1.smithi165.stdout:3/74: stat da/de/f10 0 2024-09-16T02:05:40.316 INFO:tasks.workunit.client.1.smithi165.stdout:6/84: symlink d7/dc/l14 0 2024-09-16T02:05:40.317 INFO:tasks.workunit.client.1.smithi165.stdout:6/85: chown d7/dc 3852 1 2024-09-16T02:05:40.318 INFO:tasks.workunit.client.1.smithi165.stdout:3/75: rename da/de/f10 to da/d17/f1a 0 2024-09-16T02:05:40.321 INFO:tasks.workunit.client.1.smithi165.stdout:3/76: rename c6 to da/d17/c1b 0 2024-09-16T02:05:40.322 INFO:tasks.workunit.client.1.smithi165.stdout:3/77: write f8 [820264,110126] 0 2024-09-16T02:05:40.323 INFO:tasks.workunit.client.1.smithi165.stdout:6/86: dread d7/f9 [0,4194304] 0 2024-09-16T02:05:40.326 INFO:tasks.workunit.client.1.smithi165.stdout:3/78: mknod da/d17/c1c 0 2024-09-16T02:05:40.327 INFO:tasks.workunit.client.1.smithi165.stdout:3/79: write f8 [1907505,104327] 0 2024-09-16T02:05:40.327 INFO:tasks.workunit.client.1.smithi165.stdout:6/87: symlink d7/l15 0 2024-09-16T02:05:40.333 INFO:tasks.workunit.client.1.smithi165.stdout:3/80: dwrite f3 [0,4194304] 0 2024-09-16T02:05:40.336 INFO:tasks.workunit.client.1.smithi165.stdout:6/88: write d7/fd [1419410,17413] 0 2024-09-16T02:05:40.336 INFO:tasks.workunit.client.1.smithi165.stdout:3/81: link da/f15 da/de/f1d 0 2024-09-16T02:05:40.339 INFO:tasks.workunit.client.1.smithi165.stdout:3/82: mkdir da/de/d1e 0 2024-09-16T02:05:40.341 INFO:tasks.workunit.client.1.smithi165.stdout:3/83: mknod da/d17/c1f 0 2024-09-16T02:05:40.342 INFO:tasks.workunit.client.1.smithi165.stdout:3/84: readlink da/de/lf 0 2024-09-16T02:05:40.344 INFO:tasks.workunit.client.1.smithi165.stdout:6/89: truncate d7/fb 483259 0 2024-09-16T02:05:40.346 INFO:tasks.workunit.client.1.smithi165.stdout:6/90: rmdir d7/dc/df 39 2024-09-16T02:05:40.348 INFO:tasks.workunit.client.1.smithi165.stdout:3/85: dwrite f1 [0,4194304] 0 2024-09-16T02:05:40.353 INFO:tasks.workunit.client.1.smithi165.stdout:3/86: getdents da/de 0 2024-09-16T02:05:40.364 INFO:tasks.workunit.client.1.smithi165.stdout:3/87: write da/de/f1d [781434,86120] 0 2024-09-16T02:05:40.366 INFO:tasks.workunit.client.1.smithi165.stdout:3/88: mkdir da/d20 0 2024-09-16T02:05:40.368 INFO:tasks.workunit.client.1.smithi165.stdout:3/89: creat da/de/f21 x:0 0 0 2024-09-16T02:05:40.369 INFO:tasks.workunit.client.1.smithi165.stdout:3/90: symlink da/l22 0 2024-09-16T02:05:40.370 INFO:tasks.workunit.client.1.smithi165.stdout:3/91: read da/de/f1d [463184,6325] 0 2024-09-16T02:05:40.372 INFO:tasks.workunit.client.1.smithi165.stdout:3/92: creat da/de/d1e/f23 x:0 0 0 2024-09-16T02:05:40.377 INFO:tasks.workunit.client.1.smithi165.stdout:3/93: dwrite f1 [0,4194304] 0 2024-09-16T02:05:40.387 INFO:tasks.workunit.client.1.smithi165.stdout:3/94: dwrite da/fb [4194304,4194304] 0 2024-09-16T02:05:40.395 INFO:tasks.workunit.client.1.smithi165.stdout:3/95: dwrite da/de/f21 [0,4194304] 0 2024-09-16T02:05:40.395 INFO:tasks.workunit.client.1.smithi165.stdout:3/96: chown da/de/d1e 468927631 1 2024-09-16T02:05:40.399 INFO:tasks.workunit.client.1.smithi165.stdout:3/97: link da/de/d1e/f23 da/de/f24 0 2024-09-16T02:05:40.403 INFO:tasks.workunit.client.1.smithi165.stdout:3/98: rename da/d17/c1b to da/c25 0 2024-09-16T02:05:40.405 INFO:tasks.workunit.client.1.smithi165.stdout:3/99: mkdir da/d20/d26 0 2024-09-16T02:05:40.406 INFO:tasks.workunit.client.1.smithi165.stdout:3/100: mknod da/d17/c27 0 2024-09-16T02:05:40.407 INFO:tasks.workunit.client.1.smithi165.stdout:3/101: symlink da/d17/l28 0 2024-09-16T02:05:40.409 INFO:tasks.workunit.client.1.smithi165.stdout:3/102: creat da/d20/f29 x:0 0 0 2024-09-16T02:05:40.411 INFO:tasks.workunit.client.1.smithi165.stdout:3/103: creat da/d20/d26/f2a x:0 0 0 2024-09-16T02:05:40.414 INFO:tasks.workunit.client.1.smithi165.stdout:3/104: rename da/d17/c27 to da/d20/d26/c2b 0 2024-09-16T02:05:40.427 INFO:tasks.workunit.client.1.smithi165.stdout:3/105: dwrite da/de/f24 [0,4194304] 0 2024-09-16T02:05:40.429 INFO:tasks.workunit.client.1.smithi165.stdout:3/106: mkdir da/de/d1e/d2c 0 2024-09-16T02:05:40.434 INFO:tasks.workunit.client.1.smithi165.stdout:3/107: truncate da/de/f21 1340306 0 2024-09-16T02:05:40.448 INFO:tasks.workunit.client.1.smithi165.stdout:3/108: dwrite da/f15 [0,4194304] 0 2024-09-16T02:05:40.453 INFO:tasks.workunit.client.1.smithi165.stdout:3/109: dread f3 [0,4194304] 0 2024-09-16T02:05:40.458 INFO:tasks.workunit.client.1.smithi165.stdout:3/110: getdents da 0 2024-09-16T02:05:40.458 INFO:tasks.workunit.client.1.smithi165.stdout:3/111: write f8 [26445,112266] 0 2024-09-16T02:05:40.465 INFO:tasks.workunit.client.1.smithi165.stdout:3/112: dwrite da/d20/f29 [0,4194304] 0 2024-09-16T02:05:40.466 INFO:tasks.workunit.client.1.smithi165.stdout:3/113: write f1 [3476627,103350] 0 2024-09-16T02:05:40.468 INFO:tasks.workunit.client.1.smithi165.stdout:3/114: write da/de/f1d [583238,89193] 0 2024-09-16T02:05:40.471 INFO:tasks.workunit.client.1.smithi165.stdout:3/115: mkdir da/de/d1e/d2c/d2d 0 2024-09-16T02:05:40.471 INFO:tasks.workunit.client.1.smithi165.stdout:3/116: chown da/de/l19 244747868 1 2024-09-16T02:05:40.472 INFO:tasks.workunit.client.1.smithi165.stdout:3/117: write da/de/f11 [634596,112930] 0 2024-09-16T02:05:40.473 INFO:tasks.workunit.client.1.smithi165.stdout:3/118: readlink l2 0 2024-09-16T02:05:40.475 INFO:tasks.workunit.client.1.smithi165.stdout:3/119: mknod da/de/d1e/c2e 0 2024-09-16T02:05:40.477 INFO:tasks.workunit.client.1.smithi165.stdout:3/120: mknod da/de/d1e/d2c/c2f 0 2024-09-16T02:05:40.478 INFO:tasks.workunit.client.1.smithi165.stdout:3/121: write da/fc [601036,1573] 0 2024-09-16T02:05:40.481 INFO:tasks.workunit.client.1.smithi165.stdout:3/122: truncate da/de/f21 1254487 0 2024-09-16T02:05:40.482 INFO:tasks.workunit.client.1.smithi165.stdout:3/123: creat da/d20/d26/f30 x:0 0 0 2024-09-16T02:05:40.487 INFO:tasks.workunit.client.1.smithi165.stdout:3/124: rename da/f15 to da/d20/d26/f31 0 2024-09-16T02:05:40.507 INFO:tasks.workunit.client.1.smithi165.stdout:3/125: unlink da/d17/c1c 0 2024-09-16T02:05:40.526 INFO:tasks.workunit.client.1.smithi165.stdout:3/126: truncate f1 333050 0 2024-09-16T02:05:40.528 INFO:tasks.workunit.client.1.smithi165.stdout:3/127: truncate da/de/f1d 5056574 0 2024-09-16T02:05:40.534 INFO:tasks.workunit.client.1.smithi165.stdout:3/128: rename da/de/f11 to da/d20/d26/f32 0 2024-09-16T02:05:40.536 INFO:tasks.workunit.client.1.smithi165.stdout:3/129: write f3 [1856415,118720] 0 2024-09-16T02:05:40.539 INFO:tasks.workunit.client.1.smithi165.stdout:3/130: unlink da/d20/f29 0 2024-09-16T02:05:40.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.554+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f48bc105080 con 0x7f48bc0664d0 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.554+0000 7f48b2ffd640 1 -- 172.21.15.110:0/3392334570 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f48b807b1f0 con 0x7f48bc0664d0 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 1, 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:05:40.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 13, 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:05:40.557 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:05:40.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f48a806e6e0 msgr2=0x7f48a8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f48a806e6e0 0x7f48a8070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006fd0 tx=0x7f48ac008040 comp rx=0 tx=0).stop 2024-09-16T02:05:40.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 msgr2=0x7f48bc10d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc10d120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48b80048a0 tx=0x7f48b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 shutdown_connections 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f48a806e6e0 0x7f48a8070b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48bc0ff670 0x7f48bc10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 --2- 172.21.15.110:0/3392334570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0664d0 0x7f48bc10d120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 >> 172.21.15.110:0/3392334570 conn(0x7f48bc0f6c00 msgr2=0x7f48bc0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 shutdown_connections 2024-09-16T02:05:40.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.558+0000 7f48c47ca640 1 -- 172.21.15.110:0/3392334570 wait complete. 2024-09-16T02:05:40.603 INFO:tasks.workunit.client.1.smithi165.stdout:3/131: rmdir da/d20/d26 39 2024-09-16T02:05:40.609 INFO:tasks.workunit.client.1.smithi165.stdout:3/132: symlink da/de/d1e/d2c/d2d/l33 0 2024-09-16T02:05:40.613 INFO:tasks.workunit.client.1.smithi165.stdout:3/133: chown da/fb 301 1 2024-09-16T02:05:40.616 INFO:tasks.workunit.client.1.smithi165.stdout:3/134: creat da/de/d1e/f34 x:0 0 0 2024-09-16T02:05:40.620 INFO:tasks.workunit.client.1.smithi165.stdout:3/135: write da/d17/f1a [295475,53497] 0 2024-09-16T02:05:40.620 INFO:tasks.workunit.client.1.smithi165.stdout:3/136: stat l2 0 2024-09-16T02:05:40.624 INFO:tasks.workunit.client.1.smithi165.stdout:3/137: symlink da/d20/l35 0 2024-09-16T02:05:40.625 INFO:tasks.workunit.client.1.smithi165.stdout:3/138: fsync da/d17/f1a 0 2024-09-16T02:05:40.628 INFO:tasks.workunit.client.1.smithi165.stdout:3/139: creat da/de/d1e/d2c/f36 x:0 0 0 2024-09-16T02:05:40.631 INFO:tasks.workunit.client.1.smithi165.stdout:3/140: mknod da/de/d1e/d2c/c37 0 2024-09-16T02:05:40.631 INFO:tasks.workunit.client.1.smithi165.stdout:3/141: write da/de/d1e/f34 [424446,54129] 0 2024-09-16T02:05:40.639 INFO:tasks.workunit.client.1.smithi165.stdout:3/142: getdents da 0 2024-09-16T02:05:40.645 INFO:tasks.workunit.client.1.smithi165.stdout:3/143: symlink da/d20/d26/l38 0 2024-09-16T02:05:40.647 INFO:tasks.workunit.client.1.smithi165.stdout:3/144: symlink da/de/d1e/l39 0 2024-09-16T02:05:40.649 INFO:tasks.workunit.client.1.smithi165.stdout:3/145: mknod da/de/d1e/d2c/c3a 0 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.663+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2307568044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fc560 msgr2=0x7fb2e80fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.663+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2307568044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fc560 0x7fb2e80fc970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0048d0 tx=0x7fb2dc009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2307568044 shutdown_connections 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2307568044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fd830 0x7fb2e80fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2307568044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fc560 0x7fb2e80fc970 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2307568044 >> 172.21.15.110:0/2307568044 conn(0x7fb2e80f7d20 msgr2=0x7fb2e80fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2307568044 shutdown_connections 2024-09-16T02:05:40.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2307568044 wait complete. 2024-09-16T02:05:40.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.664+0000 7fb2ef07b640 1 Processor -- start 2024-09-16T02:05:40.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ef07b640 1 -- start start 2024-09-16T02:05:40.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ef07b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 0x7fb2e810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:40.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ef07b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fd830 0x7fb2e810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:40.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ef07b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e810e470 con 0x7fb2e80fd830 2024-09-16T02:05:40.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ef07b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e810e5e0 con 0x7fb2e80fc560 2024-09-16T02:05:40.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ece17640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 0x7fb2e810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:40.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fd830 0x7fb2e810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:40.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ece17640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 0x7fb2e810d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:36494/0 (socket says 172.21.15.110:36494) 2024-09-16T02:05:40.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.665+0000 7fb2ece17640 1 -- 172.21.15.110:0/2376763276 learned_addr learned my addr 172.21.15.110:0/2376763276 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.666+0000 7fb2ece17640 1 -- 172.21.15.110:0/2376763276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fd830 msgr2=0x7fb2e810d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.666+0000 7fb2ece17640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fd830 0x7fb2e810d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.666+0000 7fb2ece17640 1 -- 172.21.15.110:0/2376763276 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc005040 con 0x7fb2e80fc560 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.666+0000 7fb2e7fff640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fd830 0x7fb2e810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.666+0000 7fb2ece17640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 0x7fb2e810d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc003080 tx=0x7fb2dc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.667+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2dc038070 con 0x7fb2e80fc560 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.667+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e810e860 con 0x7fb2e80fc560 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.667+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e810ed80 con 0x7fb2e80fc560 2024-09-16T02:05:40.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.667+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2dc02abd0 con 0x7fb2e80fc560 2024-09-16T02:05:40.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.667+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2dc03e670 con 0x7fb2e80fc560 2024-09-16T02:05:40.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.668+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e81057f0 con 0x7fb2e80fc560 2024-09-16T02:05:40.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.669+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fb2dc030020 con 0x7fb2e80fc560 2024-09-16T02:05:40.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.669+0000 7fb2e57fa640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fb2d8072af0 0x7fb2d8074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:05:40.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.669+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fb2dc0ae040 con 0x7fb2e80fc560 2024-09-16T02:05:40.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.670+0000 7fb2e7fff640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fb2d8072af0 0x7fb2d8074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:05:40.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.670+0000 7fb2e7fff640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fb2d8072af0 0x7fb2d8074fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb2e810ce70 tx=0x7fb2d4009120 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:05:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.674+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb2dc077d10 con 0x7fb2e80fc560 2024-09-16T02:05:40.727 INFO:tasks.workunit.client.1.smithi165.stdout:3/146: truncate da/d20/d26/f31 2374573 0 2024-09-16T02:05:40.727 INFO:tasks.workunit.client.1.smithi165.stdout:3/147: stat da/de/d1e/d2c/c2f 0 2024-09-16T02:05:40.733 INFO:tasks.workunit.client.1.smithi165.stdout:3/148: dwrite da/de/d1e/f23 [0,4194304] 0 2024-09-16T02:05:40.817 INFO:tasks.workunit.client.1.smithi165.stdout:3/149: dwrite da/de/f21 [0,4194304] 0 2024-09-16T02:05:40.842 INFO:tasks.workunit.client.1.smithi165.stdout:3/150: dwrite f8 [0,4194304] 0 2024-09-16T02:05:40.857 INFO:tasks.workunit.client.0.smithi110.stderr:++ readlink -f fsstress 2024-09-16T02:05:40.859 INFO:tasks.workunit.client.0.smithi110.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T02:05:40.859 INFO:tasks.workunit.client.0.smithi110.stderr:+ popd 2024-09-16T02:05:40.860 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T02:05:40.860 INFO:tasks.workunit.client.0.smithi110.stderr:+ popd 2024-09-16T02:05:40.861 INFO:tasks.workunit.client.0.smithi110.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-16T02:05:40.861 INFO:tasks.workunit.client.0.smithi110.stderr:++ mktemp -d -p . 2024-09-16T02:05:40.864 INFO:tasks.workunit.client.0.smithi110.stderr:+ T=./tmp.wsFuqpKAq6 2024-09-16T02:05:40.864 INFO:tasks.workunit.client.0.smithi110.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.wsFuqpKAq6 -l 1 -n 1000 -p 10 -v 2024-09-16T02:05:40.869 INFO:tasks.workunit.client.0.smithi110.stdout:seed = 1726664856 2024-09-16T02:05:40.875 INFO:tasks.workunit.client.0.smithi110.stdout:1/0: chown . 223717 1 2024-09-16T02:05:40.875 INFO:tasks.workunit.client.0.smithi110.stdout:1/1: read - no filename 2024-09-16T02:05:40.875 INFO:tasks.workunit.client.0.smithi110.stdout:1/2: dwrite - no filename 2024-09-16T02:05:40.875 INFO:tasks.workunit.client.0.smithi110.stdout:1/3: rmdir - no directory 2024-09-16T02:05:40.877 INFO:tasks.workunit.client.0.smithi110.stdout:2/0: fdatasync - no filename 2024-09-16T02:05:40.878 INFO:tasks.workunit.client.0.smithi110.stdout:3/0: write - no filename 2024-09-16T02:05:40.878 INFO:tasks.workunit.client.0.smithi110.stdout:3/1: dwrite - no filename 2024-09-16T02:05:40.878 INFO:tasks.workunit.client.0.smithi110.stdout:3/2: unlink - no file 2024-09-16T02:05:40.878 INFO:tasks.workunit.client.0.smithi110.stdout:1/4: getdents . 0 2024-09-16T02:05:40.878 INFO:tasks.workunit.client.0.smithi110.stdout:1/5: unlink - no file 2024-09-16T02:05:40.879 INFO:tasks.workunit.client.0.smithi110.stdout:1/6: dwrite - no filename 2024-09-16T02:05:40.881 INFO:tasks.workunit.client.0.smithi110.stdout:2/1: mkdir d0 0 2024-09-16T02:05:40.882 INFO:tasks.workunit.client.0.smithi110.stdout:2/2: truncate - no filename 2024-09-16T02:05:40.884 INFO:tasks.workunit.client.0.smithi110.stdout:5/0: chown . 34 1 2024-09-16T02:05:40.884 INFO:tasks.workunit.client.0.smithi110.stdout:5/1: unlink - no file 2024-09-16T02:05:40.884 INFO:tasks.workunit.client.0.smithi110.stdout:1/7: mkdir d0 0 2024-09-16T02:05:40.884 INFO:tasks.workunit.client.0.smithi110.stdout:1/8: dwrite - no filename 2024-09-16T02:05:40.885 INFO:tasks.workunit.client.0.smithi110.stdout:1/9: dread - no filename 2024-09-16T02:05:40.885 INFO:tasks.workunit.client.0.smithi110.stdout:1/10: link - no file 2024-09-16T02:05:40.887 INFO:tasks.workunit.client.0.smithi110.stdout:6/0: readlink - no filename 2024-09-16T02:05:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:6/1: dread - no filename 2024-09-16T02:05:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:6/2: unlink - no file 2024-09-16T02:05:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:6/3: dwrite - no filename 2024-09-16T02:05:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:6/4: chown . 2691 1 2024-09-16T02:05:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:4/0: creat f0 x:0 0 0 2024-09-16T02:05:40.888 INFO:tasks.workunit.client.0.smithi110.stdout:4/1: fdatasync f0 0 2024-09-16T02:05:40.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/2: chown f0 14235 1 2024-09-16T02:05:40.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/3: dread - f0 zero size 2024-09-16T02:05:40.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/4: read - f0 zero size 2024-09-16T02:05:40.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.926+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e81051a0 con 0x7fb2d8072af0 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.928+0000 7fb2e57fa640 1 -- 172.21.15.110:0/2376763276 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb2e81051a0 con 0x7fb2d8072af0 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [], 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "1/2 daemons upgraded", 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "", 2024-09-16T02:05:40.929 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:05:40.930 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fb2d8072af0 msgr2=0x7fb2d8074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fb2d8072af0 0x7fb2d8074fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb2e810ce70 tx=0x7fb2d4009120 comp rx=0 tx=0).stop 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 msgr2=0x7fb2e810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 0x7fb2e810d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc003080 tx=0x7fb2dc009da0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 shutdown_connections 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fb2d8072af0 0x7fb2d8074fa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e80fd830 0x7fb2e810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 --2- 172.21.15.110:0/2376763276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2e80fc560 0x7fb2e810d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:05:40.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 >> 172.21.15.110:0/2376763276 conn(0x7fb2e80f7d20 msgr2=0x7fb2e80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:05:40.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 shutdown_connections 2024-09-16T02:05:40.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:05:40.930+0000 7fb2ef07b640 1 -- 172.21.15.110:0/2376763276 wait complete. 2024-09-16T02:05:40.995 INFO:tasks.workunit.client.0.smithi110.stdout:2/3: mkdir d0/d1 0 2024-09-16T02:05:40.995 INFO:tasks.workunit.client.0.smithi110.stdout:2/4: truncate - no filename 2024-09-16T02:05:40.995 INFO:tasks.workunit.client.0.smithi110.stdout:2/5: dread - no filename 2024-09-16T02:05:40.997 INFO:tasks.workunit.client.0.smithi110.stdout:1/11: getdents d0 0 2024-09-16T02:05:41.000 INFO:tasks.workunit.client.0.smithi110.stdout:4/5: unlink f0 0 2024-09-16T02:05:41.006 INFO:tasks.workunit.client.0.smithi110.stdout:6/5: mkdir d0 0 2024-09-16T02:05:41.008 INFO:tasks.workunit.client.0.smithi110.stdout:4/6: symlink l1 0 2024-09-16T02:05:41.009 INFO:tasks.workunit.client.0.smithi110.stdout:2/6: mknod d0/d1/c2 0 2024-09-16T02:05:41.011 INFO:tasks.workunit.client.0.smithi110.stdout:9/0: dwrite - no filename 2024-09-16T02:05:41.011 INFO:tasks.workunit.client.0.smithi110.stdout:9/1: fdatasync - no filename 2024-09-16T02:05:41.011 INFO:tasks.workunit.client.0.smithi110.stdout:9/2: dwrite - no filename 2024-09-16T02:05:41.013 INFO:tasks.workunit.client.0.smithi110.stdout:7/0: creat f0 x:0 0 0 2024-09-16T02:05:41.014 INFO:tasks.workunit.client.0.smithi110.stdout:1/12: mkdir d0/d1 0 2024-09-16T02:05:41.017 INFO:tasks.workunit.client.0.smithi110.stdout:4/7: symlink l2 0 2024-09-16T02:05:41.019 INFO:tasks.workunit.client.0.smithi110.stdout:2/7: creat d0/f3 x:0 0 0 2024-09-16T02:05:41.019 INFO:tasks.workunit.client.0.smithi110.stdout:8/0: mknod c0 0 2024-09-16T02:05:41.021 INFO:tasks.workunit.client.0.smithi110.stdout:1/13: mkdir d0/d2 0 2024-09-16T02:05:41.021 INFO:tasks.workunit.client.0.smithi110.stdout:1/14: unlink - no file 2024-09-16T02:05:41.021 INFO:tasks.workunit.client.0.smithi110.stdout:1/15: dwrite - no filename 2024-09-16T02:05:41.021 INFO:tasks.workunit.client.0.smithi110.stdout:1/16: dwrite - no filename 2024-09-16T02:05:41.022 INFO:tasks.workunit.client.0.smithi110.stdout:1/17: dread - no filename 2024-09-16T02:05:41.022 INFO:tasks.workunit.client.0.smithi110.stdout:1/18: read - no filename 2024-09-16T02:05:41.022 INFO:tasks.workunit.client.0.smithi110.stdout:6/6: getdents d0 0 2024-09-16T02:05:41.022 INFO:tasks.workunit.client.0.smithi110.stdout:6/7: dwrite - no filename 2024-09-16T02:05:41.022 INFO:tasks.workunit.client.0.smithi110.stdout:6/8: dread - no filename 2024-09-16T02:05:41.023 INFO:tasks.workunit.client.0.smithi110.stdout:4/8: creat f3 x:0 0 0 2024-09-16T02:05:41.025 INFO:tasks.workunit.client.0.smithi110.stdout:2/8: symlink d0/l4 0 2024-09-16T02:05:41.026 INFO:tasks.workunit.client.0.smithi110.stdout:8/1: mknod c1 0 2024-09-16T02:05:41.026 INFO:tasks.workunit.client.0.smithi110.stdout:8/2: dwrite - no filename 2024-09-16T02:05:41.027 INFO:tasks.workunit.client.0.smithi110.stdout:7/1: link f0 f1 0 2024-09-16T02:05:41.028 INFO:tasks.workunit.client.0.smithi110.stdout:7/2: dread - f0 zero size 2024-09-16T02:05:41.030 INFO:tasks.workunit.client.0.smithi110.stdout:7/3: dread - f1 zero size 2024-09-16T02:05:41.032 INFO:tasks.workunit.client.0.smithi110.stdout:7/4: dread - f0 zero size 2024-09-16T02:05:41.032 INFO:tasks.workunit.client.0.smithi110.stdout:4/9: mkdir d4 0 2024-09-16T02:05:41.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/3: mknod c2 0 2024-09-16T02:05:41.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/4: dread - no filename 2024-09-16T02:05:41.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/5: write - no filename 2024-09-16T02:05:41.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/6: write - no filename 2024-09-16T02:05:41.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/7: dwrite - no filename 2024-09-16T02:05:41.035 INFO:tasks.workunit.client.0.smithi110.stdout:8/8: dread - no filename 2024-09-16T02:05:41.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/9: stat c2 0 2024-09-16T02:05:41.039 INFO:tasks.workunit.client.0.smithi110.stdout:2/9: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:41.040 INFO:tasks.workunit.client.0.smithi110.stdout:6/9: symlink d0/l1 0 2024-09-16T02:05:41.041 INFO:tasks.workunit.client.0.smithi110.stdout:6/10: chown d0/l1 865890886 1 2024-09-16T02:05:41.042 INFO:tasks.workunit.client.0.smithi110.stdout:6/11: chown d0/l1 662860198 1 2024-09-16T02:05:41.042 INFO:tasks.workunit.client.0.smithi110.stdout:6/12: dwrite - no filename 2024-09-16T02:05:41.042 INFO:tasks.workunit.client.0.smithi110.stdout:6/13: write - no filename 2024-09-16T02:05:41.042 INFO:tasks.workunit.client.0.smithi110.stdout:6/14: write - no filename 2024-09-16T02:05:41.042 INFO:tasks.workunit.client.0.smithi110.stdout:6/15: truncate - no filename 2024-09-16T02:05:41.042 INFO:tasks.workunit.client.0.smithi110.stdout:6/16: dread - no filename 2024-09-16T02:05:41.043 INFO:tasks.workunit.client.0.smithi110.stdout:6/17: chown d0 92 1 2024-09-16T02:05:41.043 INFO:tasks.workunit.client.0.smithi110.stdout:6/18: stat d0 0 2024-09-16T02:05:41.050 INFO:tasks.workunit.client.0.smithi110.stdout:6/19: mkdir d0/d2 0 2024-09-16T02:05:41.053 INFO:tasks.workunit.client.0.smithi110.stdout:7/5: link f1 f2 0 2024-09-16T02:05:41.059 INFO:tasks.workunit.client.0.smithi110.stdout:7/6: fdatasync f1 0 2024-09-16T02:05:41.061 INFO:tasks.workunit.client.0.smithi110.stdout:6/20: creat d0/d2/f3 x:0 0 0 2024-09-16T02:05:41.063 INFO:tasks.workunit.client.0.smithi110.stdout:7/7: mkdir d3 0 2024-09-16T02:05:41.065 INFO:tasks.workunit.client.0.smithi110.stdout:6/21: symlink d0/l4 0 2024-09-16T02:05:41.067 INFO:tasks.workunit.client.0.smithi110.stdout:6/22: mkdir d0/d2/d5 0 2024-09-16T02:05:41.069 INFO:tasks.workunit.client.0.smithi110.stdout:7/8: mknod d3/c4 0 2024-09-16T02:05:41.069 INFO:tasks.workunit.client.0.smithi110.stdout:7/9: readlink - no filename 2024-09-16T02:05:41.070 INFO:tasks.workunit.client.0.smithi110.stdout:7/10: write f1 [996858,76680] 0 2024-09-16T02:05:41.070 INFO:tasks.workunit.client.0.smithi110.stdout:6/23: unlink d0/d2/f3 0 2024-09-16T02:05:41.071 INFO:tasks.workunit.client.0.smithi110.stdout:6/24: dread - no filename 2024-09-16T02:05:41.071 INFO:tasks.workunit.client.0.smithi110.stdout:6/25: dwrite - no filename 2024-09-16T02:05:41.071 INFO:tasks.workunit.client.0.smithi110.stdout:7/11: chown d3/c4 1357742242 1 2024-09-16T02:05:41.071 INFO:tasks.workunit.client.0.smithi110.stdout:7/12: stat f1 0 2024-09-16T02:05:41.075 INFO:tasks.workunit.client.0.smithi110.stdout:6/26: rename d0/l1 to d0/d2/l6 0 2024-09-16T02:05:41.174 INFO:tasks.workunit.client.0.smithi110.stdout:8/10: getdents . 0 2024-09-16T02:05:41.174 INFO:tasks.workunit.client.0.smithi110.stdout:8/11: rmdir - no directory 2024-09-16T02:05:41.174 INFO:tasks.workunit.client.0.smithi110.stdout:8/12: write - no filename 2024-09-16T02:05:41.176 INFO:tasks.workunit.client.0.smithi110.stdout:8/13: mkdir d3 0 2024-09-16T02:05:41.176 INFO:tasks.workunit.client.0.smithi110.stdout:8/14: dread - no filename 2024-09-16T02:05:41.176 INFO:tasks.workunit.client.0.smithi110.stdout:8/15: dread - no filename 2024-09-16T02:05:41.179 INFO:tasks.workunit.client.0.smithi110.stdout:8/16: symlink d3/l4 0 2024-09-16T02:05:41.179 INFO:tasks.workunit.client.0.smithi110.stdout:8/17: truncate - no filename 2024-09-16T02:05:41.179 INFO:tasks.workunit.client.0.smithi110.stdout:8/18: dwrite - no filename 2024-09-16T02:05:41.179 INFO:tasks.workunit.client.0.smithi110.stdout:8/19: fsync - no filename 2024-09-16T02:05:41.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/20: unlink d3/l4 0 2024-09-16T02:05:41.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/21: fdatasync - no filename 2024-09-16T02:05:41.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/22: chown c0 85 1 2024-09-16T02:05:41.189 INFO:tasks.workunit.client.0.smithi110.stdout:2/10: truncate d0/f3 3415407 0 2024-09-16T02:05:41.199 INFO:tasks.workunit.client.0.smithi110.stdout:7/13: getdents d3 0 2024-09-16T02:05:41.199 INFO:tasks.workunit.client.0.smithi110.stdout:7/14: fdatasync f0 0 2024-09-16T02:05:41.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:05:41.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: pgmap v14: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 498 op/s 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Reconfiguring node-exporter.smithi110 (dependencies changed)... 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: Deploying daemon node-exporter.smithi110 on smithi110 2024-09-16T02:05:41.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:40 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3392334570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:05:41.202 INFO:tasks.workunit.client.1.smithi165.stdout:3/151: rename f3 to da/d20/f3b 0 2024-09-16T02:05:41.203 INFO:tasks.workunit.client.1.smithi165.stdout:3/152: creat da/de/f3c x:0 0 0 2024-09-16T02:05:41.203 INFO:tasks.workunit.client.0.smithi110.stdout:6/27: getdents d0 0 2024-09-16T02:05:41.203 INFO:tasks.workunit.client.0.smithi110.stdout:6/28: write - no filename 2024-09-16T02:05:41.204 INFO:tasks.workunit.client.0.smithi110.stdout:6/29: readlink d0/d2/l6 0 2024-09-16T02:05:41.206 INFO:tasks.workunit.client.1.smithi165.stdout:3/153: link da/de/f3c da/d20/f3d 0 2024-09-16T02:05:41.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:05:41.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: pgmap v14: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 498 op/s 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:05:41.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:41.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Reconfiguring node-exporter.smithi110 (dependencies changed)... 2024-09-16T02:05:41.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: Deploying daemon node-exporter.smithi110 on smithi110 2024-09-16T02:05:41.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:40 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3392334570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:05:41.209 INFO:tasks.workunit.client.1.smithi165.stdout:3/154: symlink da/de/d1e/d2c/l3e 0 2024-09-16T02:05:41.209 INFO:tasks.workunit.client.1.smithi165.stdout:3/155: mknod da/c3f 0 2024-09-16T02:05:41.210 INFO:tasks.workunit.client.0.smithi110.stdout:6/30: creat d0/d2/f7 x:0 0 0 2024-09-16T02:05:41.210 INFO:tasks.workunit.client.0.smithi110.stdout:6/31: dread - d0/d2/f7 zero size 2024-09-16T02:05:41.210 INFO:tasks.workunit.client.0.smithi110.stdout:6/32: mknod d0/d2/d5/c8 0 2024-09-16T02:05:41.210 INFO:tasks.workunit.client.0.smithi110.stdout:6/33: chown d0/d2/d5/c8 465234 1 2024-09-16T02:05:41.212 INFO:tasks.workunit.client.0.smithi110.stdout:6/34: mkdir d0/d2/d9 0 2024-09-16T02:05:41.213 INFO:tasks.workunit.client.0.smithi110.stdout:6/35: write d0/d2/f7 [233092,87262] 0 2024-09-16T02:05:41.220 INFO:tasks.workunit.client.0.smithi110.stdout:6/36: dwrite d0/d2/f7 [0,4194304] 0 2024-09-16T02:05:41.221 INFO:tasks.workunit.client.0.smithi110.stdout:6/37: write d0/d2/f7 [3524255,6638] 0 2024-09-16T02:05:41.225 INFO:tasks.workunit.client.0.smithi110.stdout:6/38: dread d0/d2/f7 [0,4194304] 0 2024-09-16T02:05:41.226 INFO:tasks.workunit.client.0.smithi110.stdout:6/39: chown d0/d2/d5/c8 2097119 1 2024-09-16T02:05:41.228 INFO:tasks.workunit.client.0.smithi110.stdout:6/40: write d0/d2/f7 [1023506,64430] 0 2024-09-16T02:05:41.242 INFO:tasks.workunit.client.0.smithi110.stdout:8/23: getdents d3 0 2024-09-16T02:05:41.242 INFO:tasks.workunit.client.0.smithi110.stdout:8/24: dread - no filename 2024-09-16T02:05:41.244 INFO:tasks.workunit.client.0.smithi110.stdout:8/25: mknod d3/c5 0 2024-09-16T02:05:41.244 INFO:tasks.workunit.client.0.smithi110.stdout:8/26: dwrite - no filename 2024-09-16T02:05:41.254 INFO:tasks.workunit.client.0.smithi110.stdout:6/41: truncate d0/d2/f7 1180046 0 2024-09-16T02:05:41.257 INFO:tasks.workunit.client.1.smithi165.stdout:3/156: link da/l22 da/de/l40 0 2024-09-16T02:05:41.258 INFO:tasks.workunit.client.0.smithi110.stdout:2/11: truncate d0/f3 1231865 0 2024-09-16T02:05:41.259 INFO:tasks.workunit.client.0.smithi110.stdout:6/42: rmdir d0/d2/d9 0 2024-09-16T02:05:41.259 INFO:tasks.workunit.client.0.smithi110.stdout:6/43: chown d0/d2/l6 4104 1 2024-09-16T02:05:41.260 INFO:tasks.workunit.client.0.smithi110.stdout:2/12: creat d0/f5 x:0 0 0 2024-09-16T02:05:41.261 INFO:tasks.workunit.client.1.smithi165.stdout:3/157: mknod da/c41 0 2024-09-16T02:05:41.265 INFO:tasks.workunit.client.0.smithi110.stdout:6/44: dread d0/d2/f7 [0,4194304] 0 2024-09-16T02:05:41.265 INFO:tasks.workunit.client.1.smithi165.stdout:3/158: chown da/de/d1e 759 1 2024-09-16T02:05:41.267 INFO:tasks.workunit.client.0.smithi110.stdout:6/45: write d0/d2/f7 [1122205,93681] 0 2024-09-16T02:05:41.270 INFO:tasks.workunit.client.0.smithi110.stdout:6/46: creat d0/d2/d5/fa x:0 0 0 2024-09-16T02:05:41.271 INFO:tasks.workunit.client.0.smithi110.stdout:6/47: read d0/d2/f7 [91941,62489] 0 2024-09-16T02:05:41.272 INFO:tasks.workunit.client.1.smithi165.stdout:3/159: write f1 [759193,4911] 0 2024-09-16T02:05:41.273 INFO:tasks.workunit.client.0.smithi110.stdout:6/48: chown d0/d2/d5 168491 1 2024-09-16T02:05:41.273 INFO:tasks.workunit.client.1.smithi165.stdout:3/160: chown da/de/d1e/c2e 261132607 1 2024-09-16T02:05:41.273 INFO:tasks.workunit.client.0.smithi110.stdout:6/49: stat d0/d2/d5/c8 0 2024-09-16T02:05:41.275 INFO:tasks.workunit.client.0.smithi110.stdout:6/50: read - d0/d2/d5/fa zero size 2024-09-16T02:05:41.277 INFO:tasks.workunit.client.0.smithi110.stdout:2/13: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:41.277 INFO:tasks.workunit.client.0.smithi110.stdout:6/51: creat d0/d2/d5/fb x:0 0 0 2024-09-16T02:05:41.285 INFO:tasks.workunit.client.1.smithi165.stdout:3/161: dwrite da/d20/f3d [0,4194304] 0 2024-09-16T02:05:41.286 INFO:tasks.workunit.client.0.smithi110.stdout:6/52: dwrite d0/d2/d5/fb [0,4194304] 0 2024-09-16T02:05:41.289 INFO:tasks.workunit.client.1.smithi165.stdout:3/162: unlink da/de/l40 0 2024-09-16T02:05:41.289 INFO:tasks.workunit.client.0.smithi110.stdout:2/14: fdatasync d0/f3 0 2024-09-16T02:05:41.290 INFO:tasks.workunit.client.1.smithi165.stdout:3/163: fsync da/de/d1e/d2c/f36 0 2024-09-16T02:05:41.293 INFO:tasks.workunit.client.0.smithi110.stdout:6/53: dread d0/d2/d5/fb [0,4194304] 0 2024-09-16T02:05:41.294 INFO:tasks.workunit.client.1.smithi165.stdout:3/164: rmdir da/de 39 2024-09-16T02:05:41.299 INFO:tasks.workunit.client.1.smithi165.stdout:3/165: dread da/de/d1e/f34 [0,4194304] 0 2024-09-16T02:05:41.299 INFO:tasks.workunit.client.0.smithi110.stdout:6/54: truncate d0/d2/f7 909920 0 2024-09-16T02:05:41.300 INFO:tasks.workunit.client.0.smithi110.stdout:2/15: dwrite d0/f5 [0,4194304] 0 2024-09-16T02:05:41.301 INFO:tasks.workunit.client.0.smithi110.stdout:2/16: rename d0 to d0/d1/d6 22 2024-09-16T02:05:41.302 INFO:tasks.workunit.client.0.smithi110.stdout:2/17: write d0/f5 [1676254,38935] 0 2024-09-16T02:05:41.303 INFO:tasks.workunit.client.1.smithi165.stdout:3/166: rename l2 to da/d20/d26/l42 0 2024-09-16T02:05:41.304 INFO:tasks.workunit.client.1.smithi165.stdout:3/167: chown da/de/d1e/d2c/c37 16 1 2024-09-16T02:05:41.310 INFO:tasks.workunit.client.0.smithi110.stdout:6/55: chown d0/d2/f7 149884008 1 2024-09-16T02:05:41.311 INFO:tasks.workunit.client.1.smithi165.stdout:3/168: symlink da/de/d1e/l43 0 2024-09-16T02:05:41.312 INFO:tasks.workunit.client.1.smithi165.stdout:3/169: dread - da/d20/d26/f30 zero size 2024-09-16T02:05:41.312 INFO:tasks.workunit.client.0.smithi110.stdout:2/18: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:41.313 INFO:tasks.workunit.client.0.smithi110.stdout:6/56: write d0/d2/d5/fa [544185,7201] 0 2024-09-16T02:05:41.316 INFO:tasks.workunit.client.1.smithi165.stdout:3/170: dread da/d17/f1a [0,4194304] 0 2024-09-16T02:05:41.316 INFO:tasks.workunit.client.1.smithi165.stdout:3/171: fdatasync f1 0 2024-09-16T02:05:41.317 INFO:tasks.workunit.client.1.smithi165.stdout:3/172: fsync da/de/f21 0 2024-09-16T02:05:41.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/57: mkdir d0/d2/dc 0 2024-09-16T02:05:41.321 INFO:tasks.workunit.client.0.smithi110.stdout:2/19: link d0/f3 d0/f7 0 2024-09-16T02:05:41.323 INFO:tasks.workunit.client.0.smithi110.stdout:6/58: dread d0/d2/d5/fb [0,4194304] 0 2024-09-16T02:05:41.328 INFO:tasks.workunit.client.1.smithi165.stdout:3/173: dwrite da/fb [0,4194304] 0 2024-09-16T02:05:41.332 INFO:tasks.workunit.client.0.smithi110.stdout:2/20: fsync d0/f7 0 2024-09-16T02:05:41.342 INFO:tasks.workunit.client.0.smithi110.stdout:6/59: dwrite d0/d2/f7 [0,4194304] 0 2024-09-16T02:05:41.342 INFO:tasks.workunit.client.0.smithi110.stdout:2/21: dwrite d0/f7 [0,4194304] 0 2024-09-16T02:05:41.343 INFO:tasks.workunit.client.0.smithi110.stdout:2/22: stat d0/d1 0 2024-09-16T02:05:42.146 INFO:tasks.workunit.client.1.smithi165.stdout:1/19: sync 2024-09-16T02:05:42.146 INFO:tasks.workunit.client.1.smithi165.stdout:1/20: chown d1 61789 1 2024-09-16T02:05:42.146 INFO:tasks.workunit.client.1.smithi165.stdout:1/21: read - no filename 2024-09-16T02:05:42.146 INFO:tasks.workunit.client.1.smithi165.stdout:1/22: dread - no filename 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:4/10: sync 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:7/38: sync 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:2/34: sync 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:3/174: sync 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:2/35: write - no filename 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:2/36: dread - no filename 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:5/41: sync 2024-09-16T02:05:42.147 INFO:tasks.workunit.client.1.smithi165.stdout:9/61: sync 2024-09-16T02:05:42.148 INFO:tasks.workunit.client.1.smithi165.stdout:6/91: sync 2024-09-16T02:05:42.148 INFO:tasks.workunit.client.1.smithi165.stdout:8/65: sync 2024-09-16T02:05:42.148 INFO:tasks.workunit.client.1.smithi165.stdout:0/6: sync 2024-09-16T02:05:42.149 INFO:tasks.workunit.client.1.smithi165.stdout:1/23: symlink d1/l3 0 2024-09-16T02:05:42.149 INFO:tasks.workunit.client.1.smithi165.stdout:1/24: dwrite - no filename 2024-09-16T02:05:42.151 INFO:tasks.workunit.client.1.smithi165.stdout:6/92: chown d7/fe 883 1 2024-09-16T02:05:42.151 INFO:tasks.workunit.client.1.smithi165.stdout:2/37: chown c4 371791857 1 2024-09-16T02:05:42.152 INFO:tasks.workunit.client.1.smithi165.stdout:0/7: truncate d0/f3 101971 0 2024-09-16T02:05:42.153 INFO:tasks.workunit.client.1.smithi165.stdout:4/11: symlink d4/l6 0 2024-09-16T02:05:42.159 INFO:tasks.workunit.client.1.smithi165.stdout:5/42: dread f4 [0,4194304] 0 2024-09-16T02:05:42.161 INFO:tasks.workunit.client.1.smithi165.stdout:9/62: dwrite f4 [0,4194304] 0 2024-09-16T02:05:42.164 INFO:tasks.workunit.client.1.smithi165.stdout:0/8: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:42.173 INFO:tasks.workunit.client.1.smithi165.stdout:0/9: dwrite d0/f1 [0,4194304] 0 2024-09-16T02:05:42.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:41 smithi165 ceph-mon[34621]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:42.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:41 smithi165 ceph-mon[34621]: pgmap v15: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 355 op/s 2024-09-16T02:05:42.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:41 smithi110 ceph-mon[27634]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:05:42.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:41 smithi110 ceph-mon[27634]: pgmap v15: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 355 op/s 2024-09-16T02:05:42.285 INFO:tasks.workunit.client.1.smithi165.stdout:1/25: mkdir d1/d4 0 2024-09-16T02:05:42.285 INFO:tasks.workunit.client.1.smithi165.stdout:2/38: unlink c4 0 2024-09-16T02:05:42.285 INFO:tasks.workunit.client.1.smithi165.stdout:2/39: fdatasync - no filename 2024-09-16T02:05:42.286 INFO:tasks.workunit.client.1.smithi165.stdout:2/40: dwrite - no filename 2024-09-16T02:05:42.286 INFO:tasks.workunit.client.1.smithi165.stdout:3/175: mknod da/c44 0 2024-09-16T02:05:42.289 INFO:tasks.workunit.client.1.smithi165.stdout:7/39: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:42.292 INFO:tasks.workunit.client.1.smithi165.stdout:3/176: dread da/de/f24 [0,4194304] 0 2024-09-16T02:05:42.293 INFO:tasks.workunit.client.1.smithi165.stdout:7/40: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:42.313 INFO:tasks.workunit.client.1.smithi165.stdout:0/10: symlink d0/l6 0 2024-09-16T02:05:42.313 INFO:tasks.workunit.client.1.smithi165.stdout:0/11: write d0/f3 [844991,72400] 0 2024-09-16T02:05:42.314 INFO:tasks.workunit.client.1.smithi165.stdout:1/26: rename d1/l3 to d1/l5 0 2024-09-16T02:05:42.323 INFO:tasks.workunit.client.1.smithi165.stdout:9/63: creat d7/de/f12 x:0 0 0 2024-09-16T02:05:42.324 INFO:tasks.workunit.client.1.smithi165.stdout:9/64: chown d7/df/l11 19189 1 2024-09-16T02:05:42.324 INFO:tasks.workunit.client.1.smithi165.stdout:0/12: creat d0/f7 x:0 0 0 2024-09-16T02:05:42.325 INFO:tasks.workunit.client.1.smithi165.stdout:2/41: chown c3 0 1 2024-09-16T02:05:42.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/65: dread f4 [0,4194304] 0 2024-09-16T02:05:42.332 INFO:tasks.workunit.client.1.smithi165.stdout:2/42: creat f5 x:0 0 0 2024-09-16T02:05:42.333 INFO:tasks.workunit.client.1.smithi165.stdout:6/93: rename d7/dc/df/c13 to d7/dc/c16 0 2024-09-16T02:05:42.334 INFO:tasks.workunit.client.1.smithi165.stdout:0/13: rename d0 to d0/d8 22 2024-09-16T02:05:42.334 INFO:tasks.workunit.client.1.smithi165.stdout:6/94: fsync f3 0 2024-09-16T02:05:42.335 INFO:tasks.workunit.client.1.smithi165.stdout:9/66: mknod d7/c13 0 2024-09-16T02:05:42.336 INFO:tasks.workunit.client.1.smithi165.stdout:7/41: dwrite d0/d4/f6 [0,4194304] 0 2024-09-16T02:05:42.337 INFO:tasks.workunit.client.1.smithi165.stdout:1/27: rmdir d1/d4 0 2024-09-16T02:05:42.337 INFO:tasks.workunit.client.1.smithi165.stdout:1/28: dread - no filename 2024-09-16T02:05:42.337 INFO:tasks.workunit.client.1.smithi165.stdout:1/29: dwrite - no filename 2024-09-16T02:05:42.339 INFO:tasks.workunit.client.1.smithi165.stdout:0/14: creat d0/f9 x:0 0 0 2024-09-16T02:05:42.340 INFO:tasks.workunit.client.1.smithi165.stdout:1/30: creat d1/f6 x:0 0 0 2024-09-16T02:05:42.341 INFO:tasks.workunit.client.1.smithi165.stdout:0/15: chown d0/f1 8462 1 2024-09-16T02:05:42.341 INFO:tasks.workunit.client.1.smithi165.stdout:6/95: fdatasync d7/fb 0 2024-09-16T02:05:42.344 INFO:tasks.workunit.client.1.smithi165.stdout:1/31: stat d1/l2 0 2024-09-16T02:05:42.345 INFO:tasks.workunit.client.1.smithi165.stdout:9/67: dread f2 [0,4194304] 0 2024-09-16T02:05:42.345 INFO:tasks.workunit.client.1.smithi165.stdout:6/96: mkdir d7/d17 0 2024-09-16T02:05:42.346 INFO:tasks.workunit.client.1.smithi165.stdout:2/43: dwrite f5 [0,4194304] 0 2024-09-16T02:05:42.346 INFO:tasks.workunit.client.1.smithi165.stdout:0/16: symlink d0/la 0 2024-09-16T02:05:42.348 INFO:tasks.workunit.client.1.smithi165.stdout:1/32: chown d1/f6 88 1 2024-09-16T02:05:42.351 INFO:tasks.workunit.client.1.smithi165.stdout:2/44: unlink f5 0 2024-09-16T02:05:42.352 INFO:tasks.workunit.client.1.smithi165.stdout:0/17: creat d0/fb x:0 0 0 2024-09-16T02:05:42.354 INFO:tasks.workunit.client.1.smithi165.stdout:1/33: truncate d1/f6 1010094 0 2024-09-16T02:05:42.355 INFO:tasks.workunit.client.1.smithi165.stdout:7/42: dwrite d0/d4/f5 [0,4194304] 0 2024-09-16T02:05:42.356 INFO:tasks.workunit.client.1.smithi165.stdout:0/18: write d0/f9 [36255,22940] 0 2024-09-16T02:05:42.359 INFO:tasks.workunit.client.1.smithi165.stdout:2/45: link c3 c6 0 2024-09-16T02:05:42.359 INFO:tasks.workunit.client.1.smithi165.stdout:2/46: fdatasync - no filename 2024-09-16T02:05:42.359 INFO:tasks.workunit.client.1.smithi165.stdout:1/34: truncate d1/f6 1504120 0 2024-09-16T02:05:42.360 INFO:tasks.workunit.client.1.smithi165.stdout:0/19: chown d0/f9 257 1 2024-09-16T02:05:42.363 INFO:tasks.workunit.client.1.smithi165.stdout:9/68: dwrite d7/de/f12 [0,4194304] 0 2024-09-16T02:05:42.363 INFO:tasks.workunit.client.1.smithi165.stdout:2/47: symlink l7 0 2024-09-16T02:05:42.364 INFO:tasks.workunit.client.1.smithi165.stdout:6/97: dwrite f2 [0,4194304] 0 2024-09-16T02:05:42.367 INFO:tasks.workunit.client.1.smithi165.stdout:1/35: symlink d1/l7 0 2024-09-16T02:05:42.367 INFO:tasks.workunit.client.1.smithi165.stdout:0/20: symlink d0/lc 0 2024-09-16T02:05:42.368 INFO:tasks.workunit.client.1.smithi165.stdout:1/36: write d1/f6 [1033906,20961] 0 2024-09-16T02:05:42.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/43: getdents d0 0 2024-09-16T02:05:42.370 INFO:tasks.workunit.client.1.smithi165.stdout:7/44: write d0/d4/f6 [3517279,58634] 0 2024-09-16T02:05:42.374 INFO:tasks.workunit.client.1.smithi165.stdout:1/37: fdatasync d1/f6 0 2024-09-16T02:05:42.375 INFO:tasks.workunit.client.1.smithi165.stdout:7/45: dread d0/d4/f6 [0,4194304] 0 2024-09-16T02:05:42.388 INFO:tasks.workunit.client.1.smithi165.stdout:6/98: link d7/c8 d7/d17/c18 0 2024-09-16T02:05:42.391 INFO:tasks.workunit.client.1.smithi165.stdout:7/46: rename d0/d4/f6 to d0/d4/d7/f8 0 2024-09-16T02:05:42.392 INFO:tasks.workunit.client.1.smithi165.stdout:6/99: dread f3 [0,4194304] 0 2024-09-16T02:05:42.393 INFO:tasks.workunit.client.1.smithi165.stdout:7/47: write d0/d4/d7/f8 [1209689,127819] 0 2024-09-16T02:05:42.394 INFO:tasks.workunit.client.1.smithi165.stdout:6/100: creat d7/dc/df/f19 x:0 0 0 2024-09-16T02:05:42.395 INFO:tasks.workunit.client.1.smithi165.stdout:7/48: symlink d0/d4/d7/l9 0 2024-09-16T02:05:42.396 INFO:tasks.workunit.client.1.smithi165.stdout:7/49: write d0/f3 [3351667,60413] 0 2024-09-16T02:05:42.397 INFO:tasks.workunit.client.1.smithi165.stdout:7/50: rmdir d0/d4/d7 39 2024-09-16T02:05:42.399 INFO:tasks.workunit.client.1.smithi165.stdout:7/51: read d0/d4/f5 [3973044,96030] 0 2024-09-16T02:05:42.402 INFO:tasks.workunit.client.1.smithi165.stdout:6/101: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T02:05:42.405 INFO:tasks.workunit.client.1.smithi165.stdout:6/102: mkdir d7/dc/df/d1a 0 2024-09-16T02:05:42.409 INFO:tasks.workunit.client.1.smithi165.stdout:7/52: link d0/d4/d7/l9 d0/d4/d7/la 0 2024-09-16T02:05:42.411 INFO:tasks.workunit.client.1.smithi165.stdout:6/103: truncate f3 1763119 0 2024-09-16T02:05:42.412 INFO:tasks.workunit.client.1.smithi165.stdout:7/53: symlink d0/d4/d7/lb 0 2024-09-16T02:05:42.413 INFO:tasks.workunit.client.1.smithi165.stdout:6/104: rmdir d7/d17 39 2024-09-16T02:05:42.416 INFO:tasks.workunit.client.1.smithi165.stdout:7/54: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:42.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/55: stat d0/d4/f5 0 2024-09-16T02:05:42.420 INFO:tasks.workunit.client.1.smithi165.stdout:7/56: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:42.421 INFO:tasks.workunit.client.1.smithi165.stdout:7/57: chown d0/d4/f5 6425 1 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/48: sync 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/49: write - no filename 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/50: dread - no filename 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/51: dwrite - no filename 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/52: fdatasync - no filename 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/53: write - no filename 2024-09-16T02:05:42.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/54: read - no filename 2024-09-16T02:05:42.461 INFO:tasks.workunit.client.1.smithi165.stdout:2/55: symlink l8 0 2024-09-16T02:05:42.463 INFO:tasks.workunit.client.1.smithi165.stdout:2/56: stat c3 0 2024-09-16T02:05:42.464 INFO:tasks.workunit.client.1.smithi165.stdout:2/57: rename l7 to l9 0 2024-09-16T02:05:42.465 INFO:tasks.workunit.client.1.smithi165.stdout:2/58: creat fa x:0 0 0 2024-09-16T02:05:42.466 INFO:tasks.workunit.client.1.smithi165.stdout:2/59: chown c3 3595 1 2024-09-16T02:05:42.468 INFO:tasks.workunit.client.1.smithi165.stdout:2/60: chown c6 22611 1 2024-09-16T02:05:42.468 INFO:tasks.workunit.client.1.smithi165.stdout:2/61: stat l8 0 2024-09-16T02:05:42.469 INFO:tasks.workunit.client.1.smithi165.stdout:2/62: symlink lb 0 2024-09-16T02:05:42.557 INFO:tasks.workunit.client.1.smithi165.stdout:0/21: sync 2024-09-16T02:05:42.559 INFO:tasks.workunit.client.1.smithi165.stdout:0/22: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:42.575 INFO:tasks.workunit.client.1.smithi165.stdout:2/63: sync 2024-09-16T02:05:42.581 INFO:tasks.workunit.client.1.smithi165.stdout:2/64: dwrite fa [0,4194304] 0 2024-09-16T02:05:42.588 INFO:tasks.workunit.client.1.smithi165.stdout:2/65: dwrite fa [0,4194304] 0 2024-09-16T02:05:42.627 INFO:tasks.workunit.client.1.smithi165.stdout:0/23: creat d0/fd x:0 0 0 2024-09-16T02:05:42.632 INFO:tasks.workunit.client.1.smithi165.stdout:0/24: symlink d0/le 0 2024-09-16T02:05:42.633 INFO:tasks.workunit.client.1.smithi165.stdout:0/25: stat d0/la 0 2024-09-16T02:05:42.634 INFO:tasks.workunit.client.1.smithi165.stdout:0/26: creat d0/ff x:0 0 0 2024-09-16T02:05:42.642 INFO:tasks.workunit.client.1.smithi165.stdout:4/12: getdents d4 0 2024-09-16T02:05:42.643 INFO:tasks.workunit.client.1.smithi165.stdout:4/13: getdents d4 0 2024-09-16T02:05:42.645 INFO:tasks.workunit.client.1.smithi165.stdout:4/14: symlink d4/l7 0 2024-09-16T02:05:42.647 INFO:tasks.workunit.client.1.smithi165.stdout:4/15: creat d4/f8 x:0 0 0 2024-09-16T02:05:42.647 INFO:tasks.workunit.client.1.smithi165.stdout:8/66: truncate dd/ff 1260118 0 2024-09-16T02:05:42.647 INFO:tasks.workunit.client.1.smithi165.stdout:4/16: write f1 [1306700,109262] 0 2024-09-16T02:05:42.648 INFO:tasks.workunit.client.1.smithi165.stdout:8/67: write dd/d11/d14/f19 [886741,13384] 0 2024-09-16T02:05:42.649 INFO:tasks.workunit.client.1.smithi165.stdout:5/43: truncate fa 2888383 0 2024-09-16T02:05:42.650 INFO:tasks.workunit.client.1.smithi165.stdout:9/69: getdents d7/de 0 2024-09-16T02:05:42.653 INFO:tasks.workunit.client.1.smithi165.stdout:9/70: rename d7/de to d7/d14 0 2024-09-16T02:05:42.658 INFO:tasks.workunit.client.1.smithi165.stdout:3/177: dwrite da/d20/d26/f31 [0,4194304] 0 2024-09-16T02:05:42.658 INFO:tasks.workunit.client.1.smithi165.stdout:1/38: fsync d1/f6 0 2024-09-16T02:05:42.660 INFO:tasks.workunit.client.1.smithi165.stdout:3/178: write da/fc [1277284,4934] 0 2024-09-16T02:05:42.660 INFO:tasks.workunit.client.1.smithi165.stdout:1/39: mknod d1/c8 0 2024-09-16T02:05:42.670 INFO:tasks.workunit.client.1.smithi165.stdout:1/40: dwrite d1/f6 [0,4194304] 0 2024-09-16T02:05:42.673 INFO:tasks.workunit.client.1.smithi165.stdout:1/41: creat d1/f9 x:0 0 0 2024-09-16T02:05:42.674 INFO:tasks.workunit.client.1.smithi165.stdout:7/58: dwrite d0/d4/f5 [4194304,4194304] 0 2024-09-16T02:05:42.675 INFO:tasks.workunit.client.1.smithi165.stdout:7/59: chown d0/d4 2377471 1 2024-09-16T02:05:42.675 INFO:tasks.workunit.client.1.smithi165.stdout:1/42: creat d1/fa x:0 0 0 2024-09-16T02:05:42.676 INFO:tasks.workunit.client.1.smithi165.stdout:1/43: truncate d1/fa 1034573 0 2024-09-16T02:05:42.677 INFO:tasks.workunit.client.1.smithi165.stdout:7/60: symlink d0/d4/lc 0 2024-09-16T02:05:42.679 INFO:tasks.workunit.client.1.smithi165.stdout:2/66: truncate fa 1571979 0 2024-09-16T02:05:42.681 INFO:tasks.workunit.client.1.smithi165.stdout:1/44: unlink d1/f6 0 2024-09-16T02:05:42.681 INFO:tasks.workunit.client.1.smithi165.stdout:0/27: fsync d0/ff 0 2024-09-16T02:05:42.682 INFO:tasks.workunit.client.1.smithi165.stdout:7/61: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:42.682 INFO:tasks.workunit.client.1.smithi165.stdout:2/67: chown l9 2 1 2024-09-16T02:05:42.682 INFO:tasks.workunit.client.1.smithi165.stdout:2/68: rmdir - no directory 2024-09-16T02:05:42.683 INFO:tasks.workunit.client.1.smithi165.stdout:7/62: chown d0/d4 3699911 1 2024-09-16T02:05:42.684 INFO:tasks.workunit.client.1.smithi165.stdout:1/45: creat d1/fb x:0 0 0 2024-09-16T02:05:42.690 INFO:tasks.workunit.client.1.smithi165.stdout:0/28: link d0/f7 d0/f10 0 2024-09-16T02:05:42.691 INFO:tasks.workunit.client.1.smithi165.stdout:0/29: chown d0/f9 69304 1 2024-09-16T02:05:42.692 INFO:tasks.workunit.client.1.smithi165.stdout:0/30: stat d0/lc 0 2024-09-16T02:05:42.696 INFO:tasks.workunit.client.1.smithi165.stdout:7/63: dwrite d0/d4/f5 [4194304,4194304] 0 2024-09-16T02:05:42.696 INFO:tasks.workunit.client.1.smithi165.stdout:1/46: creat d1/fc x:0 0 0 2024-09-16T02:05:42.697 INFO:tasks.workunit.client.1.smithi165.stdout:8/68: truncate dd/d11/d14/f16 3813298 0 2024-09-16T02:05:42.697 INFO:tasks.workunit.client.1.smithi165.stdout:9/71: write f5 [326584,84290] 0 2024-09-16T02:05:42.697 INFO:tasks.workunit.client.1.smithi165.stdout:3/179: truncate f8 748097 0 2024-09-16T02:05:42.697 INFO:tasks.workunit.client.1.smithi165.stdout:7/64: rename d0 to d0/d4/d7/dd 22 2024-09-16T02:05:42.698 INFO:tasks.workunit.client.1.smithi165.stdout:0/31: mknod d0/c11 0 2024-09-16T02:05:42.700 INFO:tasks.workunit.client.1.smithi165.stdout:1/47: mkdir d1/dd 0 2024-09-16T02:05:42.703 INFO:tasks.workunit.client.1.smithi165.stdout:0/32: mknod d0/c12 0 2024-09-16T02:05:42.705 INFO:tasks.workunit.client.1.smithi165.stdout:8/69: dread dd/d11/d14/f19 [0,4194304] 0 2024-09-16T02:05:42.705 INFO:tasks.workunit.client.1.smithi165.stdout:7/65: creat d0/d4/d7/fe x:0 0 0 2024-09-16T02:05:42.707 INFO:tasks.workunit.client.1.smithi165.stdout:0/33: chown d0/ff 973 1 2024-09-16T02:05:42.708 INFO:tasks.workunit.client.1.smithi165.stdout:9/72: rename d7/cb to d7/c15 0 2024-09-16T02:05:42.711 INFO:tasks.workunit.client.1.smithi165.stdout:9/73: chown d7 2766 1 2024-09-16T02:05:42.712 INFO:tasks.workunit.client.1.smithi165.stdout:0/34: write d0/fd [726891,64548] 0 2024-09-16T02:05:42.712 INFO:tasks.workunit.client.1.smithi165.stdout:6/105: dwrite f3 [0,4194304] 0 2024-09-16T02:05:42.714 INFO:tasks.workunit.client.1.smithi165.stdout:6/106: stat c0 0 2024-09-16T02:05:42.714 INFO:tasks.workunit.client.1.smithi165.stdout:1/48: mknod d1/dd/ce 0 2024-09-16T02:05:42.714 INFO:tasks.workunit.client.1.smithi165.stdout:2/69: dwrite fa [0,4194304] 0 2024-09-16T02:05:42.716 INFO:tasks.workunit.client.1.smithi165.stdout:8/70: creat dd/d11/d14/f1d x:0 0 0 2024-09-16T02:05:42.716 INFO:tasks.workunit.client.1.smithi165.stdout:2/70: write fa [4016672,77484] 0 2024-09-16T02:05:42.717 INFO:tasks.workunit.client.1.smithi165.stdout:0/35: creat d0/f13 x:0 0 0 2024-09-16T02:05:42.721 INFO:tasks.workunit.client.1.smithi165.stdout:2/71: chown c6 199091026 1 2024-09-16T02:05:42.722 INFO:tasks.workunit.client.1.smithi165.stdout:8/71: creat dd/d11/d14/f1e x:0 0 0 2024-09-16T02:05:42.724 INFO:tasks.workunit.client.1.smithi165.stdout:7/66: rename d0/d4 to d0/df 0 2024-09-16T02:05:42.725 INFO:tasks.workunit.client.1.smithi165.stdout:0/36: write d0/fb [502986,67155] 0 2024-09-16T02:05:42.727 INFO:tasks.workunit.client.1.smithi165.stdout:2/72: write fa [103620,6731] 0 2024-09-16T02:05:42.730 INFO:tasks.workunit.client.1.smithi165.stdout:8/72: mknod dd/c1f 0 2024-09-16T02:05:42.730 INFO:tasks.workunit.client.1.smithi165.stdout:2/73: chown c3 400 1 2024-09-16T02:05:42.731 INFO:tasks.workunit.client.1.smithi165.stdout:1/49: dwrite d1/f9 [0,4194304] 0 2024-09-16T02:05:42.731 INFO:tasks.workunit.client.1.smithi165.stdout:2/74: readlink l9 0 2024-09-16T02:05:42.731 INFO:tasks.workunit.client.1.smithi165.stdout:7/67: symlink d0/df/l10 0 2024-09-16T02:05:42.736 INFO:tasks.workunit.client.1.smithi165.stdout:3/180: dwrite da/de/d1e/f23 [0,4194304] 0 2024-09-16T02:05:42.736 INFO:tasks.workunit.client.1.smithi165.stdout:2/75: rename l9 to lc 0 2024-09-16T02:05:42.736 INFO:tasks.workunit.client.1.smithi165.stdout:7/68: symlink d0/l11 0 2024-09-16T02:05:42.737 INFO:tasks.workunit.client.1.smithi165.stdout:2/76: readlink l8 0 2024-09-16T02:05:42.738 INFO:tasks.workunit.client.1.smithi165.stdout:8/73: rename cc to dd/d13/c20 0 2024-09-16T02:05:42.739 INFO:tasks.workunit.client.1.smithi165.stdout:2/77: read fa [2890387,77326] 0 2024-09-16T02:05:42.742 INFO:tasks.workunit.client.1.smithi165.stdout:8/74: write f6 [2925215,47459] 0 2024-09-16T02:05:42.744 INFO:tasks.workunit.client.1.smithi165.stdout:0/37: dwrite d0/ff [0,4194304] 0 2024-09-16T02:05:42.745 INFO:tasks.workunit.client.1.smithi165.stdout:3/181: mknod da/de/d1e/d2c/d2d/c45 0 2024-09-16T02:05:42.748 INFO:tasks.workunit.client.1.smithi165.stdout:3/182: chown da/de/d1e/d2c/d2d 4806 1 2024-09-16T02:05:42.748 INFO:tasks.workunit.client.1.smithi165.stdout:2/78: rename c3 to cd 0 2024-09-16T02:05:42.750 INFO:tasks.workunit.client.1.smithi165.stdout:9/74: dwrite f4 [0,4194304] 0 2024-09-16T02:05:42.751 INFO:tasks.workunit.client.1.smithi165.stdout:0/38: symlink d0/l14 0 2024-09-16T02:05:42.753 INFO:tasks.workunit.client.1.smithi165.stdout:7/69: dread d0/df/d7/f8 [0,4194304] 0 2024-09-16T02:05:42.754 INFO:tasks.workunit.client.1.smithi165.stdout:1/50: truncate d1/fa 418161 0 2024-09-16T02:05:42.754 INFO:tasks.workunit.client.1.smithi165.stdout:1/51: chown d1/c8 382 1 2024-09-16T02:05:42.755 INFO:tasks.workunit.client.1.smithi165.stdout:3/183: symlink da/de/d1e/l46 0 2024-09-16T02:05:42.756 INFO:tasks.workunit.client.1.smithi165.stdout:1/52: readlink d1/l2 0 2024-09-16T02:05:42.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/75: dread dd/d11/d14/f16 [0,4194304] 0 2024-09-16T02:05:42.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/76: dread - dd/d11/d14/f1d zero size 2024-09-16T02:05:42.759 INFO:tasks.workunit.client.1.smithi165.stdout:1/53: creat d1/dd/ff x:0 0 0 2024-09-16T02:05:42.760 INFO:tasks.workunit.client.1.smithi165.stdout:1/54: dread - d1/fc zero size 2024-09-16T02:05:42.763 INFO:tasks.workunit.client.1.smithi165.stdout:3/184: symlink da/d20/d26/l47 0 2024-09-16T02:05:42.764 INFO:tasks.workunit.client.1.smithi165.stdout:2/79: truncate fa 340177 0 2024-09-16T02:05:42.771 INFO:tasks.workunit.client.1.smithi165.stdout:8/77: creat dd/d13/f21 x:0 0 0 2024-09-16T02:05:42.772 INFO:tasks.workunit.client.1.smithi165.stdout:9/75: fsync f4 0 2024-09-16T02:05:42.772 INFO:tasks.workunit.client.1.smithi165.stdout:1/55: creat d1/dd/f10 x:0 0 0 2024-09-16T02:05:42.773 INFO:tasks.workunit.client.1.smithi165.stdout:2/80: symlink le 0 2024-09-16T02:05:42.778 INFO:tasks.workunit.client.1.smithi165.stdout:0/39: dwrite d0/f3 [4194304,4194304] 0 2024-09-16T02:05:42.779 INFO:tasks.workunit.client.1.smithi165.stdout:0/40: stat d0/f7 0 2024-09-16T02:05:42.781 INFO:tasks.workunit.client.1.smithi165.stdout:1/56: mkdir d1/dd/d11 0 2024-09-16T02:05:42.783 INFO:tasks.workunit.client.1.smithi165.stdout:9/76: dwrite f5 [0,4194304] 0 2024-09-16T02:05:42.786 INFO:tasks.workunit.client.1.smithi165.stdout:7/70: truncate d0/f3 3655757 0 2024-09-16T02:05:42.788 INFO:tasks.workunit.client.1.smithi165.stdout:7/71: chown d0/df/d7/fe 4 1 2024-09-16T02:05:42.790 INFO:tasks.workunit.client.1.smithi165.stdout:1/57: creat d1/f12 x:0 0 0 2024-09-16T02:05:42.791 INFO:tasks.workunit.client.1.smithi165.stdout:9/77: creat d7/d14/f16 x:0 0 0 2024-09-16T02:05:42.792 INFO:tasks.workunit.client.1.smithi165.stdout:8/78: truncate f9 1105765 0 2024-09-16T02:05:42.792 INFO:tasks.workunit.client.1.smithi165.stdout:9/78: write d7/d14/f16 [291877,84251] 0 2024-09-16T02:05:42.794 INFO:tasks.workunit.client.1.smithi165.stdout:2/81: fsync fa 0 2024-09-16T02:05:42.796 INFO:tasks.workunit.client.1.smithi165.stdout:1/58: creat d1/f13 x:0 0 0 2024-09-16T02:05:42.799 INFO:tasks.workunit.client.1.smithi165.stdout:2/82: mkdir df 0 2024-09-16T02:05:42.799 INFO:tasks.workunit.client.1.smithi165.stdout:9/79: dwrite d7/fa [0,4194304] 0 2024-09-16T02:05:42.800 INFO:tasks.workunit.client.1.smithi165.stdout:1/59: unlink d1/f12 0 2024-09-16T02:05:42.805 INFO:tasks.workunit.client.1.smithi165.stdout:0/41: write d0/f7 [203204,18736] 0 2024-09-16T02:05:42.807 INFO:tasks.workunit.client.1.smithi165.stdout:7/72: rename d0/df/f5 to d0/f12 0 2024-09-16T02:05:42.810 INFO:tasks.workunit.client.1.smithi165.stdout:9/80: mknod d7/c17 0 2024-09-16T02:05:42.816 INFO:tasks.workunit.client.1.smithi165.stdout:0/42: rename d0/f7 to d0/f15 0 2024-09-16T02:05:42.819 INFO:tasks.workunit.client.1.smithi165.stdout:9/81: creat d7/df/f18 x:0 0 0 2024-09-16T02:05:42.820 INFO:tasks.workunit.client.1.smithi165.stdout:9/82: fsync f5 0 2024-09-16T02:05:42.825 INFO:tasks.workunit.client.1.smithi165.stdout:9/83: mknod d7/c19 0 2024-09-16T02:05:42.827 INFO:tasks.workunit.client.1.smithi165.stdout:0/43: dwrite d0/f15 [0,4194304] 0 2024-09-16T02:05:42.827 INFO:tasks.workunit.client.1.smithi165.stdout:9/84: symlink d7/d14/l1a 0 2024-09-16T02:05:42.829 INFO:tasks.workunit.client.1.smithi165.stdout:9/85: chown d7/c19 0 1 2024-09-16T02:05:42.829 INFO:tasks.workunit.client.1.smithi165.stdout:0/44: read d0/f9 [53370,86279] 0 2024-09-16T02:05:42.833 INFO:tasks.workunit.client.1.smithi165.stdout:9/86: write d7/d14/f16 [849799,7628] 0 2024-09-16T02:05:42.834 INFO:tasks.workunit.client.1.smithi165.stdout:7/73: rename d0/df/d7/f8 to d0/df/d7/f13 0 2024-09-16T02:05:42.835 INFO:tasks.workunit.client.1.smithi165.stdout:8/79: dwrite dd/ff [0,4194304] 0 2024-09-16T02:05:42.836 INFO:tasks.workunit.client.1.smithi165.stdout:7/74: chown d0/df/lc 1230 1 2024-09-16T02:05:42.837 INFO:tasks.workunit.client.1.smithi165.stdout:0/45: creat d0/f16 x:0 0 0 2024-09-16T02:05:42.837 INFO:tasks.workunit.client.1.smithi165.stdout:7/75: chown d0/df 20972 1 2024-09-16T02:05:42.837 INFO:tasks.workunit.client.1.smithi165.stdout:0/46: chown d0/l6 27 1 2024-09-16T02:05:42.838 INFO:tasks.workunit.client.1.smithi165.stdout:7/76: dread - d0/df/d7/fe zero size 2024-09-16T02:05:42.841 INFO:tasks.workunit.client.1.smithi165.stdout:2/83: fdatasync fa 0 2024-09-16T02:05:42.841 INFO:tasks.workunit.client.1.smithi165.stdout:0/47: dread d0/fb [0,4194304] 0 2024-09-16T02:05:42.843 INFO:tasks.workunit.client.1.smithi165.stdout:9/87: rename c1 to d7/d14/c1b 0 2024-09-16T02:05:42.845 INFO:tasks.workunit.client.1.smithi165.stdout:0/48: dread d0/f3 [4194304,4194304] 0 2024-09-16T02:05:42.847 INFO:tasks.workunit.client.1.smithi165.stdout:7/77: creat d0/df/d7/f14 x:0 0 0 2024-09-16T02:05:42.850 INFO:tasks.workunit.client.1.smithi165.stdout:9/88: creat d7/df/f1c x:0 0 0 2024-09-16T02:05:42.851 INFO:tasks.workunit.client.1.smithi165.stdout:8/80: creat dd/d11/d14/d1c/f22 x:0 0 0 2024-09-16T02:05:42.853 INFO:tasks.workunit.client.1.smithi165.stdout:0/49: symlink d0/l17 0 2024-09-16T02:05:42.856 INFO:tasks.workunit.client.1.smithi165.stdout:2/84: mkdir df/d10 0 2024-09-16T02:05:42.859 INFO:tasks.workunit.client.1.smithi165.stdout:9/89: mkdir d7/d1d 0 2024-09-16T02:05:42.863 INFO:tasks.workunit.client.1.smithi165.stdout:0/50: fsync d0/f9 0 2024-09-16T02:05:42.865 INFO:tasks.workunit.client.1.smithi165.stdout:2/85: creat df/f11 x:0 0 0 2024-09-16T02:05:42.866 INFO:tasks.workunit.client.1.smithi165.stdout:2/86: dread - df/f11 zero size 2024-09-16T02:05:42.869 INFO:tasks.workunit.client.1.smithi165.stdout:8/81: dwrite dd/ff [4194304,4194304] 0 2024-09-16T02:05:42.869 INFO:tasks.workunit.client.1.smithi165.stdout:0/51: mknod d0/c18 0 2024-09-16T02:05:42.871 INFO:tasks.workunit.client.1.smithi165.stdout:9/90: symlink d7/d1d/l1e 0 2024-09-16T02:05:42.873 INFO:tasks.workunit.client.1.smithi165.stdout:8/82: mkdir dd/d13/d23 0 2024-09-16T02:05:42.874 INFO:tasks.workunit.client.1.smithi165.stdout:2/87: creat df/d10/f12 x:0 0 0 2024-09-16T02:05:42.875 INFO:tasks.workunit.client.1.smithi165.stdout:9/91: dread d7/fa [0,4194304] 0 2024-09-16T02:05:42.875 INFO:tasks.workunit.client.1.smithi165.stdout:9/92: fsync d7/fd 0 2024-09-16T02:05:42.876 INFO:tasks.workunit.client.1.smithi165.stdout:0/52: rename d0/c11 to d0/c19 0 2024-09-16T02:05:42.902 INFO:tasks.workunit.client.1.smithi165.stdout:2/88: creat df/d10/f13 x:0 0 0 2024-09-16T02:05:42.903 INFO:tasks.workunit.client.1.smithi165.stdout:4/17: sync 2024-09-16T02:05:42.903 INFO:tasks.workunit.client.1.smithi165.stdout:5/44: sync 2024-09-16T02:05:42.903 INFO:tasks.workunit.client.1.smithi165.stdout:6/107: sync 2024-09-16T02:05:42.904 INFO:tasks.workunit.client.1.smithi165.stdout:5/45: chown de 752469 1 2024-09-16T02:05:42.908 INFO:tasks.workunit.client.1.smithi165.stdout:5/46: dread - f7 zero size 2024-09-16T02:05:42.909 INFO:tasks.workunit.client.1.smithi165.stdout:4/18: creat d4/f9 x:0 0 0 2024-09-16T02:05:42.912 INFO:tasks.workunit.client.1.smithi165.stdout:4/19: fsync f3 0 2024-09-16T02:05:42.912 INFO:tasks.workunit.client.1.smithi165.stdout:5/47: read f4 [132066,77803] 0 2024-09-16T02:05:42.931 INFO:tasks.workunit.client.1.smithi165.stdout:4/20: chown f1 6540560 1 2024-09-16T02:05:42.931 INFO:tasks.workunit.client.1.smithi165.stdout:0/53: write d0/fb [817035,125759] 0 2024-09-16T02:05:42.932 INFO:tasks.workunit.client.1.smithi165.stdout:2/89: dwrite fa [0,4194304] 0 2024-09-16T02:05:42.935 INFO:tasks.workunit.client.1.smithi165.stdout:9/93: dwrite f2 [0,4194304] 0 2024-09-16T02:05:42.937 INFO:tasks.workunit.client.1.smithi165.stdout:0/54: write d0/f1 [88603,118511] 0 2024-09-16T02:05:42.937 INFO:tasks.workunit.client.1.smithi165.stdout:6/108: dwrite f2 [0,4194304] 0 2024-09-16T02:05:42.941 INFO:tasks.workunit.client.1.smithi165.stdout:9/94: truncate d7/d14/f16 1298298 0 2024-09-16T02:05:42.943 INFO:tasks.workunit.client.1.smithi165.stdout:8/83: dwrite f9 [0,4194304] 0 2024-09-16T02:05:42.943 INFO:tasks.workunit.client.1.smithi165.stdout:9/95: dread - d7/df/f1c zero size 2024-09-16T02:05:42.944 INFO:tasks.workunit.client.1.smithi165.stdout:3/185: sync 2024-09-16T02:05:42.951 INFO:tasks.workunit.client.1.smithi165.stdout:0/55: read d0/fd [352473,99205] 0 2024-09-16T02:05:43.073 INFO:tasks.workunit.client.1.smithi165.stdout:7/78: sync 2024-09-16T02:05:43.073 INFO:tasks.workunit.client.1.smithi165.stdout:1/60: sync 2024-09-16T02:05:43.074 INFO:tasks.workunit.client.1.smithi165.stdout:1/61: dread - d1/dd/ff zero size 2024-09-16T02:05:43.096 INFO:tasks.workunit.client.1.smithi165.stdout:0/56: sync 2024-09-16T02:05:43.192 INFO:tasks.workunit.client.1.smithi165.stdout:2/90: symlink df/d10/l14 0 2024-09-16T02:05:43.193 INFO:tasks.workunit.client.1.smithi165.stdout:4/21: creat d4/fa x:0 0 0 2024-09-16T02:05:43.193 INFO:tasks.workunit.client.1.smithi165.stdout:9/96: mkdir d7/d1f 0 2024-09-16T02:05:43.194 INFO:tasks.workunit.client.1.smithi165.stdout:8/84: fdatasync dd/d11/d14/f19 0 2024-09-16T02:05:43.195 INFO:tasks.workunit.client.1.smithi165.stdout:1/62: rmdir d1 39 2024-09-16T02:05:43.195 INFO:tasks.workunit.client.1.smithi165.stdout:0/57: mknod d0/c1a 0 2024-09-16T02:05:43.199 INFO:tasks.workunit.client.1.smithi165.stdout:2/91: rename le to df/d10/l15 0 2024-09-16T02:05:43.200 INFO:tasks.workunit.client.1.smithi165.stdout:7/79: mknod d0/c15 0 2024-09-16T02:05:43.201 INFO:tasks.workunit.client.1.smithi165.stdout:6/109: rename d7/dc/l14 to d7/dc/l1b 0 2024-09-16T02:05:43.202 INFO:tasks.workunit.client.1.smithi165.stdout:2/92: write df/d10/f12 [1037800,128895] 0 2024-09-16T02:05:43.202 INFO:tasks.workunit.client.1.smithi165.stdout:4/22: dread f1 [0,4194304] 0 2024-09-16T02:05:43.203 INFO:tasks.workunit.client.1.smithi165.stdout:1/63: write d1/fb [411566,61399] 0 2024-09-16T02:05:43.205 INFO:tasks.workunit.client.1.smithi165.stdout:1/64: stat d1/dd 0 2024-09-16T02:05:43.205 INFO:tasks.workunit.client.1.smithi165.stdout:9/97: dread f4 [0,4194304] 0 2024-09-16T02:05:43.206 INFO:tasks.workunit.client.1.smithi165.stdout:7/80: mknod d0/c16 0 2024-09-16T02:05:43.206 INFO:tasks.workunit.client.1.smithi165.stdout:6/110: write d7/dc/df/f10 [1129210,104083] 0 2024-09-16T02:05:43.206 INFO:tasks.workunit.client.1.smithi165.stdout:9/98: chown d7/d1f 0 1 2024-09-16T02:05:43.208 INFO:tasks.workunit.client.1.smithi165.stdout:8/85: getdents dd 0 2024-09-16T02:05:43.209 INFO:tasks.workunit.client.1.smithi165.stdout:1/65: creat d1/dd/f14 x:0 0 0 2024-09-16T02:05:43.210 INFO:tasks.workunit.client.1.smithi165.stdout:2/93: link df/d10/f13 df/f16 0 2024-09-16T02:05:43.211 INFO:tasks.workunit.client.1.smithi165.stdout:9/99: symlink d7/d14/l20 0 2024-09-16T02:05:43.214 INFO:tasks.workunit.client.1.smithi165.stdout:7/81: mknod d0/c17 0 2024-09-16T02:05:43.217 INFO:tasks.workunit.client.1.smithi165.stdout:1/66: rename d1/f13 to d1/dd/d11/f15 0 2024-09-16T02:05:43.217 INFO:tasks.workunit.client.1.smithi165.stdout:2/94: mknod df/d10/c17 0 2024-09-16T02:05:43.218 INFO:tasks.workunit.client.1.smithi165.stdout:4/23: dwrite d4/f9 [0,4194304] 0 2024-09-16T02:05:43.220 INFO:tasks.workunit.client.1.smithi165.stdout:1/67: dread - d1/fc zero size 2024-09-16T02:05:43.220 INFO:tasks.workunit.client.1.smithi165.stdout:6/111: dwrite d7/fd [0,4194304] 0 2024-09-16T02:05:43.220 INFO:tasks.workunit.client.1.smithi165.stdout:7/82: fdatasync d0/f12 0 2024-09-16T02:05:43.223 INFO:tasks.workunit.client.1.smithi165.stdout:1/68: read - d1/dd/d11/f15 zero size 2024-09-16T02:05:43.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/86: dread dd/ff [4194304,4194304] 0 2024-09-16T02:05:43.225 INFO:tasks.workunit.client.1.smithi165.stdout:7/83: chown d0/df/d7/fe 1550500859 1 2024-09-16T02:05:43.227 INFO:tasks.workunit.client.1.smithi165.stdout:2/95: write df/f16 [413446,21078] 0 2024-09-16T02:05:43.227 INFO:tasks.workunit.client.1.smithi165.stdout:4/24: write f1 [1874151,45644] 0 2024-09-16T02:05:43.227 INFO:tasks.workunit.client.1.smithi165.stdout:6/112: rename c0 to d7/dc/df/d1a/c1c 0 2024-09-16T02:05:43.229 INFO:tasks.workunit.client.1.smithi165.stdout:9/100: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:43.230 INFO:tasks.workunit.client.1.smithi165.stdout:7/84: readlink d0/df/d7/l9 0 2024-09-16T02:05:43.230 INFO:tasks.workunit.client.1.smithi165.stdout:2/96: creat df/f18 x:0 0 0 2024-09-16T02:05:43.232 INFO:tasks.workunit.client.1.smithi165.stdout:8/87: rename dd/d11/d14/f16 to dd/d13/d23/f24 0 2024-09-16T02:05:43.235 INFO:tasks.workunit.client.1.smithi165.stdout:2/97: unlink df/d10/l14 0 2024-09-16T02:05:43.237 INFO:tasks.workunit.client.1.smithi165.stdout:9/101: mknod d7/d1f/c21 0 2024-09-16T02:05:43.237 INFO:tasks.workunit.client.1.smithi165.stdout:4/25: dwrite d4/f9 [0,4194304] 0 2024-09-16T02:05:43.239 INFO:tasks.workunit.client.1.smithi165.stdout:8/88: rename dd/d11/d14/d1c to dd/d13/d23/d25 0 2024-09-16T02:05:43.240 INFO:tasks.workunit.client.1.smithi165.stdout:2/98: creat df/f19 x:0 0 0 2024-09-16T02:05:43.241 INFO:tasks.workunit.client.1.smithi165.stdout:7/85: creat d0/df/f18 x:0 0 0 2024-09-16T02:05:43.241 INFO:tasks.workunit.client.1.smithi165.stdout:9/102: creat d7/f22 x:0 0 0 2024-09-16T02:05:43.244 INFO:tasks.workunit.client.1.smithi165.stdout:2/99: mkdir df/d10/d1a 0 2024-09-16T02:05:43.245 INFO:tasks.workunit.client.1.smithi165.stdout:4/26: link f2 d4/fb 0 2024-09-16T02:05:43.246 INFO:tasks.workunit.client.1.smithi165.stdout:7/86: read d0/df/d7/f13 [300198,117467] 0 2024-09-16T02:05:43.246 INFO:tasks.workunit.client.1.smithi165.stdout:4/27: read f1 [209814,43712] 0 2024-09-16T02:05:43.246 INFO:tasks.workunit.client.1.smithi165.stdout:9/103: symlink d7/df/l23 0 2024-09-16T02:05:43.247 INFO:tasks.workunit.client.1.smithi165.stdout:8/89: rename dd/d13/c20 to dd/c26 0 2024-09-16T02:05:43.249 INFO:tasks.workunit.client.1.smithi165.stdout:2/100: rename df/d10/f12 to df/d10/f1b 0 2024-09-16T02:05:43.249 INFO:tasks.workunit.client.1.smithi165.stdout:2/101: chown df 3870804 1 2024-09-16T02:05:43.253 INFO:tasks.workunit.client.1.smithi165.stdout:2/102: mknod df/d10/c1c 0 2024-09-16T02:05:43.253 INFO:tasks.workunit.client.1.smithi165.stdout:9/104: dwrite f4 [0,4194304] 0 2024-09-16T02:05:43.255 INFO:tasks.workunit.client.1.smithi165.stdout:7/87: link d0/df/f18 d0/f19 0 2024-09-16T02:05:43.256 INFO:tasks.workunit.client.1.smithi165.stdout:2/103: write df/d10/f1b [1146834,83859] 0 2024-09-16T02:05:43.257 INFO:tasks.workunit.client.1.smithi165.stdout:9/105: creat d7/d14/f24 x:0 0 0 2024-09-16T02:05:43.257 INFO:tasks.workunit.client.1.smithi165.stdout:2/104: dread - df/f19 zero size 2024-09-16T02:05:43.257 INFO:tasks.workunit.client.1.smithi165.stdout:9/106: stat d7/d14/l1a 0 2024-09-16T02:05:43.258 INFO:tasks.workunit.client.1.smithi165.stdout:2/105: chown lc 1 1 2024-09-16T02:05:43.260 INFO:tasks.workunit.client.1.smithi165.stdout:7/88: mkdir d0/d1a 0 2024-09-16T02:05:43.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/107: link d7/df/f10 d7/df/f25 0 2024-09-16T02:05:43.265 INFO:tasks.workunit.client.1.smithi165.stdout:9/108: dread - d7/df/f18 zero size 2024-09-16T02:05:43.266 INFO:tasks.workunit.client.1.smithi165.stdout:2/106: dwrite df/d10/f13 [0,4194304] 0 2024-09-16T02:05:43.266 INFO:tasks.workunit.client.1.smithi165.stdout:7/89: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:43.267 INFO:tasks.workunit.client.1.smithi165.stdout:9/109: truncate d7/fd 220398 0 2024-09-16T02:05:43.267 INFO:tasks.workunit.client.1.smithi165.stdout:7/90: dread - d0/df/f18 zero size 2024-09-16T02:05:43.268 INFO:tasks.workunit.client.1.smithi165.stdout:2/107: truncate df/f18 716190 0 2024-09-16T02:05:43.268 INFO:tasks.workunit.client.1.smithi165.stdout:9/110: readlink d7/d1d/l1e 0 2024-09-16T02:05:43.268 INFO:tasks.workunit.client.1.smithi165.stdout:7/91: dread - d0/df/f18 zero size 2024-09-16T02:05:43.272 INFO:tasks.workunit.client.1.smithi165.stdout:9/111: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:43.275 INFO:tasks.workunit.client.1.smithi165.stdout:7/92: dread d0/f12 [0,4194304] 0 2024-09-16T02:05:43.277 INFO:tasks.workunit.client.1.smithi165.stdout:2/108: dwrite df/f11 [0,4194304] 0 2024-09-16T02:05:43.277 INFO:tasks.workunit.client.1.smithi165.stdout:9/112: write d7/df/f25 [868020,82074] 0 2024-09-16T02:05:43.285 INFO:tasks.workunit.client.1.smithi165.stdout:2/109: dread df/d10/f1b [0,4194304] 0 2024-09-16T02:05:43.287 INFO:tasks.workunit.client.1.smithi165.stdout:7/93: dwrite d0/f12 [4194304,4194304] 0 2024-09-16T02:05:43.289 INFO:tasks.workunit.client.1.smithi165.stdout:2/110: rename df/d10/c1c to df/c1d 0 2024-09-16T02:05:43.291 INFO:tasks.workunit.client.1.smithi165.stdout:7/94: rename d0/c16 to d0/d1a/c1b 0 2024-09-16T02:05:43.344 INFO:tasks.workunit.client.1.smithi165.stdout:1/69: sync 2024-09-16T02:05:43.345 INFO:tasks.workunit.client.1.smithi165.stdout:1/70: creat d1/dd/f16 x:0 0 0 2024-09-16T02:05:43.347 INFO:tasks.workunit.client.1.smithi165.stdout:1/71: dread d1/fa [0,4194304] 0 2024-09-16T02:05:43.378 INFO:tasks.workunit.client.1.smithi165.stdout:9/113: sync 2024-09-16T02:05:43.381 INFO:tasks.workunit.client.1.smithi165.stdout:0/58: getdents d0 0 2024-09-16T02:05:43.384 INFO:tasks.workunit.client.1.smithi165.stdout:5/48: write fa [725614,58248] 0 2024-09-16T02:05:43.384 INFO:tasks.workunit.client.1.smithi165.stdout:3/186: truncate da/de/f3c 1192902 0 2024-09-16T02:05:43.384 INFO:tasks.workunit.client.1.smithi165.stdout:9/114: link d7/c15 d7/d1f/c26 0 2024-09-16T02:05:43.385 INFO:tasks.workunit.client.1.smithi165.stdout:9/115: write f5 [268181,127943] 0 2024-09-16T02:05:43.385 INFO:tasks.workunit.client.1.smithi165.stdout:0/59: symlink d0/l1b 0 2024-09-16T02:05:43.386 INFO:tasks.workunit.client.1.smithi165.stdout:6/113: getdents d7/dc 0 2024-09-16T02:05:43.387 INFO:tasks.workunit.client.1.smithi165.stdout:5/49: mknod de/c11 0 2024-09-16T02:05:43.387 INFO:tasks.workunit.client.1.smithi165.stdout:5/50: stat f3 0 2024-09-16T02:05:43.388 INFO:tasks.workunit.client.1.smithi165.stdout:3/187: mknod da/d20/d26/c48 0 2024-09-16T02:05:43.388 INFO:tasks.workunit.client.1.smithi165.stdout:9/116: mkdir d7/d1f/d27 0 2024-09-16T02:05:43.389 INFO:tasks.workunit.client.1.smithi165.stdout:0/60: creat d0/f1c x:0 0 0 2024-09-16T02:05:43.390 INFO:tasks.workunit.client.1.smithi165.stdout:2/111: fsync df/f16 0 2024-09-16T02:05:43.390 INFO:tasks.workunit.client.1.smithi165.stdout:5/51: mknod de/c12 0 2024-09-16T02:05:43.391 INFO:tasks.workunit.client.1.smithi165.stdout:5/52: write fc [513636,117053] 0 2024-09-16T02:05:43.391 INFO:tasks.workunit.client.1.smithi165.stdout:3/188: mknod da/de/d1e/c49 0 2024-09-16T02:05:43.394 INFO:tasks.workunit.client.1.smithi165.stdout:0/61: creat d0/f1d x:0 0 0 2024-09-16T02:05:43.394 INFO:tasks.workunit.client.1.smithi165.stdout:1/72: fsync d1/dd/d11/f15 0 2024-09-16T02:05:43.395 INFO:tasks.workunit.client.1.smithi165.stdout:2/112: stat df/d10/l15 0 2024-09-16T02:05:43.395 INFO:tasks.workunit.client.1.smithi165.stdout:0/62: truncate d0/f1 4813245 0 2024-09-16T02:05:43.396 INFO:tasks.workunit.client.1.smithi165.stdout:5/53: symlink de/l13 0 2024-09-16T02:05:43.397 INFO:tasks.workunit.client.1.smithi165.stdout:3/189: unlink da/d20/d26/f32 0 2024-09-16T02:05:43.399 INFO:tasks.workunit.client.1.smithi165.stdout:0/63: fsync d0/fd 0 2024-09-16T02:05:43.401 INFO:tasks.workunit.client.1.smithi165.stdout:2/113: rename lc to df/d10/l1e 0 2024-09-16T02:05:43.401 INFO:tasks.workunit.client.1.smithi165.stdout:1/73: dwrite d1/f9 [0,4194304] 0 2024-09-16T02:05:43.403 INFO:tasks.workunit.client.1.smithi165.stdout:5/54: creat de/f14 x:0 0 0 2024-09-16T02:05:43.404 INFO:tasks.workunit.client.1.smithi165.stdout:1/74: chown d1/fa 262530369 1 2024-09-16T02:05:43.404 INFO:tasks.workunit.client.1.smithi165.stdout:5/55: chown de 234 1 2024-09-16T02:05:43.405 INFO:tasks.workunit.client.1.smithi165.stdout:5/56: fsync fa 0 2024-09-16T02:05:43.406 INFO:tasks.workunit.client.1.smithi165.stdout:3/190: dwrite da/de/d1e/f23 [0,4194304] 0 2024-09-16T02:05:43.407 INFO:tasks.workunit.client.1.smithi165.stdout:2/114: mknod df/c1f 0 2024-09-16T02:05:43.408 INFO:tasks.workunit.client.1.smithi165.stdout:3/191: dread - da/d20/d26/f30 zero size 2024-09-16T02:05:43.408 INFO:tasks.workunit.client.1.smithi165.stdout:0/64: dread d0/ff [0,4194304] 0 2024-09-16T02:05:43.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/75: creat d1/dd/d11/f17 x:0 0 0 2024-09-16T02:05:43.411 INFO:tasks.workunit.client.1.smithi165.stdout:4/28: rmdir d4 39 2024-09-16T02:05:43.413 INFO:tasks.workunit.client.1.smithi165.stdout:0/65: dread d0/f15 [0,4194304] 0 2024-09-16T02:05:43.414 INFO:tasks.workunit.client.1.smithi165.stdout:1/76: dread d1/f9 [0,4194304] 0 2024-09-16T02:05:43.415 INFO:tasks.workunit.client.1.smithi165.stdout:1/77: readlink d1/l2 0 2024-09-16T02:05:43.417 INFO:tasks.workunit.client.1.smithi165.stdout:3/192: creat da/d17/f4a x:0 0 0 2024-09-16T02:05:43.417 INFO:tasks.workunit.client.1.smithi165.stdout:3/193: read - da/d20/d26/f30 zero size 2024-09-16T02:05:43.420 INFO:tasks.workunit.client.1.smithi165.stdout:0/66: mkdir d0/d1e 0 2024-09-16T02:05:43.421 INFO:tasks.workunit.client.1.smithi165.stdout:0/67: write d0/f1c [275462,23074] 0 2024-09-16T02:05:43.423 INFO:tasks.workunit.client.1.smithi165.stdout:1/78: rename d1/fa to d1/dd/f18 0 2024-09-16T02:05:43.424 INFO:tasks.workunit.client.1.smithi165.stdout:3/194: creat da/d17/f4b x:0 0 0 2024-09-16T02:05:43.425 INFO:tasks.workunit.client.1.smithi165.stdout:3/195: write da/d17/f4b [747380,38233] 0 2024-09-16T02:05:43.426 INFO:tasks.workunit.client.1.smithi165.stdout:5/57: link de/l13 de/l15 0 2024-09-16T02:05:43.429 INFO:tasks.workunit.client.1.smithi165.stdout:8/90: symlink dd/l27 0 2024-09-16T02:05:43.430 INFO:tasks.workunit.client.1.smithi165.stdout:1/79: mkdir d1/d19 0 2024-09-16T02:05:43.431 INFO:tasks.workunit.client.1.smithi165.stdout:7/95: getdents d0 0 2024-09-16T02:05:43.432 INFO:tasks.workunit.client.1.smithi165.stdout:3/196: write da/f14 [721454,31191] 0 2024-09-16T02:05:43.433 INFO:tasks.workunit.client.1.smithi165.stdout:3/197: stat da/de/d1e/d2c/l3e 0 2024-09-16T02:05:43.434 INFO:tasks.workunit.client.1.smithi165.stdout:3/198: truncate da/d20/f3b 4203608 0 2024-09-16T02:05:43.436 INFO:tasks.workunit.client.1.smithi165.stdout:1/80: chown d1/l5 1068741525 1 2024-09-16T02:05:43.438 INFO:tasks.workunit.client.1.smithi165.stdout:7/96: mknod d0/d1a/c1c 0 2024-09-16T02:05:43.441 INFO:tasks.workunit.client.1.smithi165.stdout:3/199: dwrite da/fc [0,4194304] 0 2024-09-16T02:05:43.442 INFO:tasks.workunit.client.1.smithi165.stdout:3/200: chown da/de/d1e/d2c/c3a 672050707 1 2024-09-16T02:05:43.442 INFO:tasks.workunit.client.1.smithi165.stdout:1/81: mknod d1/c1a 0 2024-09-16T02:05:43.443 INFO:tasks.workunit.client.1.smithi165.stdout:4/29: getdents d4 0 2024-09-16T02:05:43.444 INFO:tasks.workunit.client.1.smithi165.stdout:1/82: chown d1/l7 126059 1 2024-09-16T02:05:43.444 INFO:tasks.workunit.client.1.smithi165.stdout:1/83: fdatasync d1/dd/f10 0 2024-09-16T02:05:43.445 INFO:tasks.workunit.client.1.smithi165.stdout:1/84: readlink d1/l2 0 2024-09-16T02:05:43.450 INFO:tasks.workunit.client.1.smithi165.stdout:1/85: creat d1/dd/d11/f1b x:0 0 0 2024-09-16T02:05:43.451 INFO:tasks.workunit.client.1.smithi165.stdout:1/86: dread - d1/dd/d11/f1b zero size 2024-09-16T02:05:43.452 INFO:tasks.workunit.client.1.smithi165.stdout:1/87: dread - d1/dd/f16 zero size 2024-09-16T02:05:43.456 INFO:tasks.workunit.client.1.smithi165.stdout:1/88: rename d1/l5 to d1/d19/l1c 0 2024-09-16T02:05:43.457 INFO:tasks.workunit.client.1.smithi165.stdout:1/89: rmdir d1 39 2024-09-16T02:05:43.459 INFO:tasks.workunit.client.1.smithi165.stdout:1/90: dread - d1/fc zero size 2024-09-16T02:05:43.461 INFO:tasks.workunit.client.1.smithi165.stdout:1/91: write d1/f9 [2268842,25840] 0 2024-09-16T02:05:43.461 INFO:tasks.workunit.client.1.smithi165.stdout:1/92: chown d1/d19 155913710 1 2024-09-16T02:05:43.462 INFO:tasks.workunit.client.1.smithi165.stdout:1/93: truncate d1/dd/d11/f1b 211863 0 2024-09-16T02:05:43.466 INFO:tasks.workunit.client.1.smithi165.stdout:1/94: rename d1/dd/ff to d1/dd/d11/f1d 0 2024-09-16T02:05:43.466 INFO:tasks.workunit.client.1.smithi165.stdout:1/95: chown d1/dd/f16 1411 1 2024-09-16T02:05:43.467 INFO:tasks.workunit.client.1.smithi165.stdout:1/96: fdatasync d1/dd/f14 0 2024-09-16T02:05:43.470 INFO:tasks.workunit.client.1.smithi165.stdout:1/97: dread d1/fb [0,4194304] 0 2024-09-16T02:05:43.477 INFO:tasks.workunit.client.1.smithi165.stdout:6/114: truncate f2 3649779 0 2024-09-16T02:05:43.478 INFO:tasks.workunit.client.1.smithi165.stdout:6/115: fsync d7/fd 0 2024-09-16T02:05:43.481 INFO:tasks.workunit.client.1.smithi165.stdout:9/117: dwrite d7/fa [0,4194304] 0 2024-09-16T02:05:43.483 INFO:tasks.workunit.client.1.smithi165.stdout:2/115: getdents df 0 2024-09-16T02:05:43.485 INFO:tasks.workunit.client.1.smithi165.stdout:0/68: rmdir d0 39 2024-09-16T02:05:43.486 INFO:tasks.workunit.client.1.smithi165.stdout:2/116: mknod df/d10/d1a/c20 0 2024-09-16T02:05:43.489 INFO:tasks.workunit.client.1.smithi165.stdout:9/118: dwrite d7/f22 [0,4194304] 0 2024-09-16T02:05:43.490 INFO:tasks.workunit.client.1.smithi165.stdout:2/117: mknod df/d10/c21 0 2024-09-16T02:05:43.493 INFO:tasks.workunit.client.1.smithi165.stdout:5/58: write f4 [3769687,117079] 0 2024-09-16T02:05:43.493 INFO:tasks.workunit.client.1.smithi165.stdout:0/69: mknod d0/d1e/c1f 0 2024-09-16T02:05:43.498 INFO:tasks.workunit.client.1.smithi165.stdout:5/59: unlink de/lf 0 2024-09-16T02:05:43.499 INFO:tasks.workunit.client.1.smithi165.stdout:0/70: mkdir d0/d1e/d20 0 2024-09-16T02:05:43.502 INFO:tasks.workunit.client.1.smithi165.stdout:5/60: mkdir de/d16 0 2024-09-16T02:05:43.502 INFO:tasks.workunit.client.1.smithi165.stdout:5/61: dread - de/f14 zero size 2024-09-16T02:05:43.503 INFO:tasks.workunit.client.1.smithi165.stdout:0/71: fsync d0/f10 0 2024-09-16T02:05:43.505 INFO:tasks.workunit.client.1.smithi165.stdout:9/119: getdents d7/d14 0 2024-09-16T02:05:43.507 INFO:tasks.workunit.client.1.smithi165.stdout:9/120: chown f5 10557 1 2024-09-16T02:05:43.507 INFO:tasks.workunit.client.1.smithi165.stdout:0/72: mknod d0/d1e/c21 0 2024-09-16T02:05:43.511 INFO:tasks.workunit.client.1.smithi165.stdout:1/98: rmdir d1/dd/d11 39 2024-09-16T02:05:43.512 INFO:tasks.workunit.client.1.smithi165.stdout:0/73: write d0/f16 [237262,93701] 0 2024-09-16T02:05:43.512 INFO:tasks.workunit.client.1.smithi165.stdout:9/121: creat d7/d1d/f28 x:0 0 0 2024-09-16T02:05:43.515 INFO:tasks.workunit.client.1.smithi165.stdout:5/62: dread de/f10 [0,4194304] 0 2024-09-16T02:05:43.521 INFO:tasks.workunit.client.1.smithi165.stdout:6/116: write d7/fd [5169744,20510] 0 2024-09-16T02:05:43.521 INFO:tasks.workunit.client.1.smithi165.stdout:5/63: fdatasync de/f14 0 2024-09-16T02:05:43.521 INFO:tasks.workunit.client.1.smithi165.stdout:2/118: getdents df/d10 0 2024-09-16T02:05:43.521 INFO:tasks.workunit.client.1.smithi165.stdout:7/97: dwrite d0/df/f18 [0,4194304] 0 2024-09-16T02:05:43.522 INFO:tasks.workunit.client.1.smithi165.stdout:8/91: dwrite dd/d13/d23/f24 [0,4194304] 0 2024-09-16T02:05:43.524 INFO:tasks.workunit.client.1.smithi165.stdout:1/99: mkdir d1/dd/d11/d1e 0 2024-09-16T02:05:43.526 INFO:tasks.workunit.client.1.smithi165.stdout:4/30: dwrite f1 [0,4194304] 0 2024-09-16T02:05:43.536 INFO:tasks.workunit.client.1.smithi165.stdout:6/117: dwrite d7/f9 [0,4194304] 0 2024-09-16T02:05:43.536 INFO:tasks.workunit.client.1.smithi165.stdout:2/119: dread df/f11 [0,4194304] 0 2024-09-16T02:05:43.538 INFO:tasks.workunit.client.1.smithi165.stdout:7/98: dread d0/df/d7/f13 [0,4194304] 0 2024-09-16T02:05:43.541 INFO:tasks.workunit.client.1.smithi165.stdout:8/92: dwrite dd/d13/d23/d25/f22 [0,4194304] 0 2024-09-16T02:05:43.544 INFO:tasks.workunit.client.1.smithi165.stdout:7/99: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:43.545 INFO:tasks.workunit.client.1.smithi165.stdout:7/100: dread - d0/df/d7/fe zero size 2024-09-16T02:05:43.546 INFO:tasks.workunit.client.1.smithi165.stdout:7/101: chown d0/f3 4408874 1 2024-09-16T02:05:43.554 INFO:tasks.workunit.client.1.smithi165.stdout:7/102: dwrite d0/df/d7/f14 [0,4194304] 0 2024-09-16T02:05:43.554 INFO:tasks.workunit.client.1.smithi165.stdout:7/103: stat d0/df 0 2024-09-16T02:05:43.555 INFO:tasks.workunit.client.1.smithi165.stdout:7/104: chown d0/df/d7/l9 36 1 2024-09-16T02:05:43.584 INFO:tasks.workunit.client.1.smithi165.stdout:3/201: sync 2024-09-16T02:05:43.603 INFO:tasks.workunit.client.1.smithi165.stdout:0/74: sync 2024-09-16T02:05:43.606 INFO:tasks.workunit.client.1.smithi165.stdout:1/100: creat d1/dd/d11/f1f x:0 0 0 2024-09-16T02:05:43.608 INFO:tasks.workunit.client.1.smithi165.stdout:4/31: mkdir d4/dc 0 2024-09-16T02:05:43.609 INFO:tasks.workunit.client.1.smithi165.stdout:5/64: symlink de/d16/l17 0 2024-09-16T02:05:43.609 INFO:tasks.workunit.client.1.smithi165.stdout:9/122: link d7/c13 d7/df/c29 0 2024-09-16T02:05:43.610 INFO:tasks.workunit.client.1.smithi165.stdout:5/65: write f7 [436741,128369] 0 2024-09-16T02:05:43.610 INFO:tasks.workunit.client.1.smithi165.stdout:9/123: write d7/d1d/f28 [385553,73411] 0 2024-09-16T02:05:43.611 INFO:tasks.workunit.client.1.smithi165.stdout:6/118: symlink d7/dc/df/l1d 0 2024-09-16T02:05:43.611 INFO:tasks.workunit.client.1.smithi165.stdout:2/120: creat df/d10/d1a/f22 x:0 0 0 2024-09-16T02:05:43.613 INFO:tasks.workunit.client.1.smithi165.stdout:7/105: rename d0/l11 to d0/d1a/l1d 0 2024-09-16T02:05:43.614 INFO:tasks.workunit.client.1.smithi165.stdout:3/202: mknod da/de/d1e/d2c/d2d/c4c 0 2024-09-16T02:05:43.615 INFO:tasks.workunit.client.1.smithi165.stdout:0/75: fdatasync d0/f3 0 2024-09-16T02:05:43.618 INFO:tasks.workunit.client.1.smithi165.stdout:8/93: dread dd/d11/d14/f19 [0,4194304] 0 2024-09-16T02:05:43.618 INFO:tasks.workunit.client.1.smithi165.stdout:1/101: creat d1/dd/d11/d1e/f20 x:0 0 0 2024-09-16T02:05:43.619 INFO:tasks.workunit.client.1.smithi165.stdout:4/32: mknod d4/dc/cd 0 2024-09-16T02:05:43.620 INFO:tasks.workunit.client.1.smithi165.stdout:4/33: fsync d4/fa 0 2024-09-16T02:05:43.621 INFO:tasks.workunit.client.1.smithi165.stdout:5/66: dread f3 [0,4194304] 0 2024-09-16T02:05:43.622 INFO:tasks.workunit.client.1.smithi165.stdout:3/203: mknod da/d20/c4d 0 2024-09-16T02:05:43.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/102: symlink d1/l21 0 2024-09-16T02:05:43.622 INFO:tasks.workunit.client.1.smithi165.stdout:8/94: mknod dd/d11/d14/c28 0 2024-09-16T02:05:43.624 INFO:tasks.workunit.client.1.smithi165.stdout:0/76: dread d0/ff [0,4194304] 0 2024-09-16T02:05:43.624 INFO:tasks.workunit.client.1.smithi165.stdout:6/119: creat d7/f1e x:0 0 0 2024-09-16T02:05:43.626 INFO:tasks.workunit.client.1.smithi165.stdout:3/204: rmdir da/de 39 2024-09-16T02:05:43.626 INFO:tasks.workunit.client.1.smithi165.stdout:5/67: write f4 [4454053,101098] 0 2024-09-16T02:05:43.627 INFO:tasks.workunit.client.1.smithi165.stdout:6/120: chown d7/dc/df/f19 6 1 2024-09-16T02:05:43.628 INFO:tasks.workunit.client.1.smithi165.stdout:7/106: write d0/df/f18 [3899294,83213] 0 2024-09-16T02:05:43.628 INFO:tasks.workunit.client.1.smithi165.stdout:5/68: fdatasync f7 0 2024-09-16T02:05:43.629 INFO:tasks.workunit.client.1.smithi165.stdout:6/121: stat d7/f9 0 2024-09-16T02:05:43.631 INFO:tasks.workunit.client.1.smithi165.stdout:2/121: truncate df/f11 3735965 0 2024-09-16T02:05:43.631 INFO:tasks.workunit.client.1.smithi165.stdout:8/95: mknod dd/c29 0 2024-09-16T02:05:43.632 INFO:tasks.workunit.client.1.smithi165.stdout:3/205: write da/de/f1d [3471206,101613] 0 2024-09-16T02:05:43.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/122: chown df/d10/l15 2994603 1 2024-09-16T02:05:43.638 INFO:tasks.workunit.client.1.smithi165.stdout:7/107: mknod d0/c1e 0 2024-09-16T02:05:43.640 INFO:tasks.workunit.client.1.smithi165.stdout:1/103: dwrite d1/dd/d11/f15 [0,4194304] 0 2024-09-16T02:05:43.641 INFO:tasks.workunit.client.1.smithi165.stdout:0/77: link d0/c19 d0/d1e/c22 0 2024-09-16T02:05:43.642 INFO:tasks.workunit.client.1.smithi165.stdout:3/206: creat da/de/d1e/d2c/f4e x:0 0 0 2024-09-16T02:05:43.643 INFO:tasks.workunit.client.1.smithi165.stdout:8/96: creat dd/d13/d23/d25/f2a x:0 0 0 2024-09-16T02:05:43.644 INFO:tasks.workunit.client.1.smithi165.stdout:2/123: mkdir df/d23 0 2024-09-16T02:05:43.645 INFO:tasks.workunit.client.1.smithi165.stdout:2/124: read - df/f19 zero size 2024-09-16T02:05:43.645 INFO:tasks.workunit.client.1.smithi165.stdout:5/69: dwrite fa [0,4194304] 0 2024-09-16T02:05:43.648 INFO:tasks.workunit.client.1.smithi165.stdout:0/78: creat d0/f23 x:0 0 0 2024-09-16T02:05:43.652 INFO:tasks.workunit.client.1.smithi165.stdout:8/97: dread dd/d13/d23/d25/f22 [0,4194304] 0 2024-09-16T02:05:43.652 INFO:tasks.workunit.client.1.smithi165.stdout:1/104: rename d1/dd/d11/d1e to d1/d22 0 2024-09-16T02:05:43.652 INFO:tasks.workunit.client.1.smithi165.stdout:0/79: dread d0/f16 [0,4194304] 0 2024-09-16T02:05:43.653 INFO:tasks.workunit.client.1.smithi165.stdout:0/80: dread - d0/f23 zero size 2024-09-16T02:05:43.653 INFO:tasks.workunit.client.1.smithi165.stdout:8/98: write f6 [619491,54974] 0 2024-09-16T02:05:43.654 INFO:tasks.workunit.client.1.smithi165.stdout:1/105: write d1/dd/f14 [543642,33089] 0 2024-09-16T02:05:43.654 INFO:tasks.workunit.client.1.smithi165.stdout:8/99: chown dd 245598 1 2024-09-16T02:05:43.654 INFO:tasks.workunit.client.1.smithi165.stdout:3/207: creat da/d20/d26/f4f x:0 0 0 2024-09-16T02:05:43.655 INFO:tasks.workunit.client.1.smithi165.stdout:6/122: getdents d7/d17 0 2024-09-16T02:05:43.657 INFO:tasks.workunit.client.1.smithi165.stdout:7/108: symlink d0/d1a/l1f 0 2024-09-16T02:05:43.659 INFO:tasks.workunit.client.1.smithi165.stdout:2/125: mkdir df/d10/d1a/d24 0 2024-09-16T02:05:43.661 INFO:tasks.workunit.client.1.smithi165.stdout:8/100: chown dd/l17 46849822 1 2024-09-16T02:05:43.662 INFO:tasks.workunit.client.1.smithi165.stdout:0/81: creat d0/d1e/f24 x:0 0 0 2024-09-16T02:05:43.664 INFO:tasks.workunit.client.1.smithi165.stdout:2/126: creat df/f25 x:0 0 0 2024-09-16T02:05:43.665 INFO:tasks.workunit.client.1.smithi165.stdout:7/109: read - d0/df/d7/fe zero size 2024-09-16T02:05:43.666 INFO:tasks.workunit.client.1.smithi165.stdout:6/123: mkdir d7/d1f 0 2024-09-16T02:05:43.668 INFO:tasks.workunit.client.1.smithi165.stdout:5/70: dwrite f3 [0,4194304] 0 2024-09-16T02:05:43.668 INFO:tasks.workunit.client.1.smithi165.stdout:1/106: getdents d1/dd 0 2024-09-16T02:05:43.668 INFO:tasks.workunit.client.1.smithi165.stdout:7/110: chown d0/df/lc 5062414 1 2024-09-16T02:05:43.670 INFO:tasks.workunit.client.1.smithi165.stdout:6/124: write d7/dc/df/f19 [245856,18862] 0 2024-09-16T02:05:43.670 INFO:tasks.workunit.client.1.smithi165.stdout:2/127: creat df/d10/f26 x:0 0 0 2024-09-16T02:05:43.674 INFO:tasks.workunit.client.1.smithi165.stdout:0/82: write d0/f15 [4086950,60370] 0 2024-09-16T02:05:43.674 INFO:tasks.workunit.client.1.smithi165.stdout:5/71: creat de/f18 x:0 0 0 2024-09-16T02:05:43.675 INFO:tasks.workunit.client.1.smithi165.stdout:8/101: dwrite f9 [0,4194304] 0 2024-09-16T02:05:43.677 INFO:tasks.workunit.client.1.smithi165.stdout:6/125: symlink d7/dc/df/d1a/l20 0 2024-09-16T02:05:43.679 INFO:tasks.workunit.client.1.smithi165.stdout:2/128: creat df/d10/d1a/f27 x:0 0 0 2024-09-16T02:05:43.679 INFO:tasks.workunit.client.1.smithi165.stdout:2/129: readlink lb 0 2024-09-16T02:05:43.679 INFO:tasks.workunit.client.1.smithi165.stdout:7/111: mknod d0/df/c20 0 2024-09-16T02:05:43.680 INFO:tasks.workunit.client.1.smithi165.stdout:6/126: fsync d7/fb 0 2024-09-16T02:05:43.681 INFO:tasks.workunit.client.1.smithi165.stdout:0/83: unlink d0/f1c 0 2024-09-16T02:05:43.682 INFO:tasks.workunit.client.1.smithi165.stdout:2/130: write df/f25 [305404,110564] 0 2024-09-16T02:05:43.687 INFO:tasks.workunit.client.1.smithi165.stdout:5/72: dread de/f10 [0,4194304] 0 2024-09-16T02:05:43.687 INFO:tasks.workunit.client.1.smithi165.stdout:1/107: getdents d1/d22 0 2024-09-16T02:05:43.688 INFO:tasks.workunit.client.1.smithi165.stdout:8/102: dwrite dd/d11/d14/f1e [0,4194304] 0 2024-09-16T02:05:43.689 INFO:tasks.workunit.client.1.smithi165.stdout:6/127: symlink d7/dc/l21 0 2024-09-16T02:05:43.691 INFO:tasks.workunit.client.1.smithi165.stdout:1/108: rmdir d1/dd/d11 39 2024-09-16T02:05:43.692 INFO:tasks.workunit.client.1.smithi165.stdout:5/73: mkdir de/d19 0 2024-09-16T02:05:43.695 INFO:tasks.workunit.client.1.smithi165.stdout:2/131: mkdir df/d23/d28 0 2024-09-16T02:05:43.696 INFO:tasks.workunit.client.1.smithi165.stdout:6/128: read d7/dc/df/f19 [238553,2909] 0 2024-09-16T02:05:43.696 INFO:tasks.workunit.client.1.smithi165.stdout:8/103: fsync dd/d13/d23/d25/f22 0 2024-09-16T02:05:43.698 INFO:tasks.workunit.client.1.smithi165.stdout:0/84: link d0/f16 d0/d1e/f25 0 2024-09-16T02:05:43.700 INFO:tasks.workunit.client.1.smithi165.stdout:6/129: write d7/f9 [2444285,44840] 0 2024-09-16T02:05:43.702 INFO:tasks.workunit.client.1.smithi165.stdout:0/85: unlink d0/f3 0 2024-09-16T02:05:43.710 INFO:tasks.workunit.client.1.smithi165.stdout:0/86: creat d0/d1e/f26 x:0 0 0 2024-09-16T02:05:43.710 INFO:tasks.workunit.client.1.smithi165.stdout:7/112: dwrite d0/df/d7/f13 [0,4194304] 0 2024-09-16T02:05:43.711 INFO:tasks.workunit.client.1.smithi165.stdout:5/74: dwrite f7 [0,4194304] 0 2024-09-16T02:05:43.715 INFO:tasks.workunit.client.1.smithi165.stdout:0/87: write d0/f13 [474114,114098] 0 2024-09-16T02:05:43.716 INFO:tasks.workunit.client.1.smithi165.stdout:8/104: dread f6 [0,4194304] 0 2024-09-16T02:05:43.717 INFO:tasks.workunit.client.1.smithi165.stdout:1/109: dwrite d1/fb [0,4194304] 0 2024-09-16T02:05:43.720 INFO:tasks.workunit.client.1.smithi165.stdout:5/75: symlink de/d19/l1a 0 2024-09-16T02:05:43.721 INFO:tasks.workunit.client.1.smithi165.stdout:0/88: fdatasync d0/f1 0 2024-09-16T02:05:43.722 INFO:tasks.workunit.client.1.smithi165.stdout:7/113: mknod d0/df/c21 0 2024-09-16T02:05:43.724 INFO:tasks.workunit.client.1.smithi165.stdout:5/76: dread - de/f18 zero size 2024-09-16T02:05:43.728 INFO:tasks.workunit.client.1.smithi165.stdout:8/105: write dd/d11/d14/f1e [3822610,101937] 0 2024-09-16T02:05:43.730 INFO:tasks.workunit.client.1.smithi165.stdout:5/77: symlink de/l1b 0 2024-09-16T02:05:43.732 INFO:tasks.workunit.client.1.smithi165.stdout:7/114: truncate d0/df/d7/f13 4286089 0 2024-09-16T02:05:43.733 INFO:tasks.workunit.client.1.smithi165.stdout:8/106: creat dd/d13/f2b x:0 0 0 2024-09-16T02:05:43.735 INFO:tasks.workunit.client.1.smithi165.stdout:6/130: dwrite f2 [0,4194304] 0 2024-09-16T02:05:43.735 INFO:tasks.workunit.client.1.smithi165.stdout:2/132: dwrite df/f11 [0,4194304] 0 2024-09-16T02:05:43.735 INFO:tasks.workunit.client.1.smithi165.stdout:5/78: write f6 [3017023,112573] 0 2024-09-16T02:05:43.741 INFO:tasks.workunit.client.1.smithi165.stdout:2/133: readlink df/d10/l1e 0 2024-09-16T02:05:43.743 INFO:tasks.workunit.client.1.smithi165.stdout:0/89: dwrite d0/f1d [0,4194304] 0 2024-09-16T02:05:43.744 INFO:tasks.workunit.client.1.smithi165.stdout:5/79: unlink de/d16/l17 0 2024-09-16T02:05:43.744 INFO:tasks.workunit.client.1.smithi165.stdout:8/107: creat dd/d13/f2c x:0 0 0 2024-09-16T02:05:43.744 INFO:tasks.workunit.client.1.smithi165.stdout:1/110: link d1/d19/l1c d1/dd/l23 0 2024-09-16T02:05:43.746 INFO:tasks.workunit.client.1.smithi165.stdout:6/131: mknod d7/dc/c22 0 2024-09-16T02:05:43.746 INFO:tasks.workunit.client.1.smithi165.stdout:7/115: creat d0/f22 x:0 0 0 2024-09-16T02:05:43.746 INFO:tasks.workunit.client.1.smithi165.stdout:0/90: dread - d0/f23 zero size 2024-09-16T02:05:43.746 INFO:tasks.workunit.client.1.smithi165.stdout:5/80: chown f3 282161826 1 2024-09-16T02:05:43.747 INFO:tasks.workunit.client.1.smithi165.stdout:2/134: dread df/d10/f1b [0,4194304] 0 2024-09-16T02:05:43.748 INFO:tasks.workunit.client.1.smithi165.stdout:0/91: fdatasync d0/f15 0 2024-09-16T02:05:43.750 INFO:tasks.workunit.client.1.smithi165.stdout:7/116: creat d0/df/d7/f23 x:0 0 0 2024-09-16T02:05:43.751 INFO:tasks.workunit.client.1.smithi165.stdout:0/92: fdatasync d0/d1e/f24 0 2024-09-16T02:05:43.751 INFO:tasks.workunit.client.1.smithi165.stdout:5/81: mkdir de/d19/d1c 0 2024-09-16T02:05:43.751 INFO:tasks.workunit.client.1.smithi165.stdout:2/135: write df/f16 [856070,63280] 0 2024-09-16T02:05:43.753 INFO:tasks.workunit.client.1.smithi165.stdout:8/108: rename dd/c29 to dd/d13/d23/c2d 0 2024-09-16T02:05:43.755 INFO:tasks.workunit.client.1.smithi165.stdout:7/117: chown d0/c17 1021 1 2024-09-16T02:05:43.755 INFO:tasks.workunit.client.1.smithi165.stdout:0/93: mknod d0/c27 0 2024-09-16T02:05:43.756 INFO:tasks.workunit.client.1.smithi165.stdout:7/118: write d0/df/d7/fe [112093,46222] 0 2024-09-16T02:05:43.757 INFO:tasks.workunit.client.1.smithi165.stdout:2/136: write df/d10/f1b [1805842,81275] 0 2024-09-16T02:05:43.758 INFO:tasks.workunit.client.1.smithi165.stdout:0/94: chown d0/l1b 91 1 2024-09-16T02:05:43.758 INFO:tasks.workunit.client.1.smithi165.stdout:5/82: rename f3 to de/f1d 0 2024-09-16T02:05:43.759 INFO:tasks.workunit.client.1.smithi165.stdout:7/119: chown d0/df/l10 10650255 1 2024-09-16T02:05:43.761 INFO:tasks.workunit.client.1.smithi165.stdout:5/83: write f7 [3208321,93902] 0 2024-09-16T02:05:43.762 INFO:tasks.workunit.client.1.smithi165.stdout:8/109: rename cb to dd/d13/d23/c2e 0 2024-09-16T02:05:43.763 INFO:tasks.workunit.client.1.smithi165.stdout:1/111: read - d1/dd/f10 zero size 2024-09-16T02:05:43.763 INFO:tasks.workunit.client.1.smithi165.stdout:0/95: mkdir d0/d1e/d20/d28 0 2024-09-16T02:05:43.764 INFO:tasks.workunit.client.1.smithi165.stdout:2/137: creat df/d23/d28/f29 x:0 0 0 2024-09-16T02:05:43.765 INFO:tasks.workunit.client.1.smithi165.stdout:8/110: creat dd/d11/f2f x:0 0 0 2024-09-16T02:05:43.767 INFO:tasks.workunit.client.1.smithi165.stdout:2/138: write df/d10/f1b [1895405,102310] 0 2024-09-16T02:05:43.768 INFO:tasks.workunit.client.1.smithi165.stdout:2/139: write df/f19 [751992,96943] 0 2024-09-16T02:05:43.769 INFO:tasks.workunit.client.1.smithi165.stdout:0/96: dread d0/f10 [0,4194304] 0 2024-09-16T02:05:43.770 INFO:tasks.workunit.client.1.smithi165.stdout:8/111: creat dd/d11/f30 x:0 0 0 2024-09-16T02:05:43.771 INFO:tasks.workunit.client.1.smithi165.stdout:1/112: unlink d1/dd/f16 0 2024-09-16T02:05:43.771 INFO:tasks.workunit.client.1.smithi165.stdout:5/84: link cd de/c1e 0 2024-09-16T02:05:43.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/120: getdents d0/df/d7 0 2024-09-16T02:05:43.773 INFO:tasks.workunit.client.1.smithi165.stdout:6/132: truncate d7/f9 344312 0 2024-09-16T02:05:43.773 INFO:tasks.workunit.client.1.smithi165.stdout:2/140: mkdir df/d23/d2a 0 2024-09-16T02:05:43.775 INFO:tasks.workunit.client.1.smithi165.stdout:8/112: readlink dd/d13/l15 0 2024-09-16T02:05:43.776 INFO:tasks.workunit.client.1.smithi165.stdout:0/97: unlink d0/f10 0 2024-09-16T02:05:43.776 INFO:tasks.workunit.client.1.smithi165.stdout:0/98: chown d0/l5 146477 1 2024-09-16T02:05:43.777 INFO:tasks.workunit.client.1.smithi165.stdout:5/85: creat de/d19/f1f x:0 0 0 2024-09-16T02:05:43.781 INFO:tasks.workunit.client.1.smithi165.stdout:8/113: rmdir dd/d11/d14 39 2024-09-16T02:05:43.782 INFO:tasks.workunit.client.1.smithi165.stdout:0/99: unlink d0/f1 0 2024-09-16T02:05:43.783 INFO:tasks.workunit.client.1.smithi165.stdout:7/121: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:43.783 INFO:tasks.workunit.client.1.smithi165.stdout:0/100: stat d0/l6 0 2024-09-16T02:05:43.783 INFO:tasks.workunit.client.1.smithi165.stdout:1/113: unlink d1/dd/ce 0 2024-09-16T02:05:43.784 INFO:tasks.workunit.client.1.smithi165.stdout:1/114: fsync d1/fc 0 2024-09-16T02:05:43.784 INFO:tasks.workunit.client.1.smithi165.stdout:5/86: write de/f10 [3408179,109955] 0 2024-09-16T02:05:43.785 INFO:tasks.workunit.client.1.smithi165.stdout:0/101: truncate d0/fb 1624080 0 2024-09-16T02:05:43.786 INFO:tasks.workunit.client.1.smithi165.stdout:9/124: sync 2024-09-16T02:05:43.788 INFO:tasks.workunit.client.1.smithi165.stdout:6/133: write d7/fb [1094529,40379] 0 2024-09-16T02:05:43.789 INFO:tasks.workunit.client.1.smithi165.stdout:8/114: rename dd/c10 to dd/d13/d23/c31 0 2024-09-16T02:05:43.790 INFO:tasks.workunit.client.1.smithi165.stdout:0/102: write d0/d1e/f26 [803692,122117] 0 2024-09-16T02:05:43.791 INFO:tasks.workunit.client.1.smithi165.stdout:9/125: fsync d7/d14/f16 0 2024-09-16T02:05:43.792 INFO:tasks.workunit.client.1.smithi165.stdout:1/115: write d1/dd/d11/f15 [5015815,119755] 0 2024-09-16T02:05:43.792 INFO:tasks.workunit.client.1.smithi165.stdout:5/87: symlink de/d19/d1c/l20 0 2024-09-16T02:05:43.794 INFO:tasks.workunit.client.1.smithi165.stdout:7/122: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:43.795 INFO:tasks.workunit.client.1.smithi165.stdout:6/134: unlink d7/dc/df/f10 0 2024-09-16T02:05:43.796 INFO:tasks.workunit.client.1.smithi165.stdout:5/88: write fc [760577,68158] 0 2024-09-16T02:05:43.797 INFO:tasks.workunit.client.1.smithi165.stdout:0/103: mkdir d0/d1e/d29 0 2024-09-16T02:05:43.798 INFO:tasks.workunit.client.1.smithi165.stdout:6/135: write d7/fe [613810,92806] 0 2024-09-16T02:05:43.799 INFO:tasks.workunit.client.1.smithi165.stdout:0/104: fsync d0/fb 0 2024-09-16T02:05:43.800 INFO:tasks.workunit.client.1.smithi165.stdout:2/141: dwrite fa [0,4194304] 0 2024-09-16T02:05:43.801 INFO:tasks.workunit.client.1.smithi165.stdout:6/136: write f2 [4525310,108037] 0 2024-09-16T02:05:43.804 INFO:tasks.workunit.client.1.smithi165.stdout:8/115: rename dd/d13/d23/f24 to dd/d13/f32 0 2024-09-16T02:05:43.804 INFO:tasks.workunit.client.1.smithi165.stdout:2/142: write df/d23/d28/f29 [962676,77175] 0 2024-09-16T02:05:43.807 INFO:tasks.workunit.client.1.smithi165.stdout:2/143: chown df/d10/c17 44370 1 2024-09-16T02:05:43.807 INFO:tasks.workunit.client.1.smithi165.stdout:7/123: dread d0/df/d7/f14 [0,4194304] 0 2024-09-16T02:05:43.808 INFO:tasks.workunit.client.1.smithi165.stdout:2/144: chown lb 303 1 2024-09-16T02:05:43.809 INFO:tasks.workunit.client.1.smithi165.stdout:0/105: mkdir d0/d2a 0 2024-09-16T02:05:43.810 INFO:tasks.workunit.client.1.smithi165.stdout:1/116: dread d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:43.810 INFO:tasks.workunit.client.1.smithi165.stdout:2/145: rename df to df/d10/d1a/d2b 22 2024-09-16T02:05:43.811 INFO:tasks.workunit.client.1.smithi165.stdout:8/116: dread dd/d13/f32 [0,4194304] 0 2024-09-16T02:05:43.815 INFO:tasks.workunit.client.1.smithi165.stdout:3/208: sync 2024-09-16T02:05:43.815 INFO:tasks.workunit.client.1.smithi165.stdout:4/34: sync 2024-09-16T02:05:43.815 INFO:tasks.workunit.client.1.smithi165.stdout:9/126: dwrite d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:43.815 INFO:tasks.workunit.client.1.smithi165.stdout:7/124: mknod d0/d1a/c24 0 2024-09-16T02:05:43.816 INFO:tasks.workunit.client.1.smithi165.stdout:2/146: creat df/d23/d28/f2c x:0 0 0 2024-09-16T02:05:43.817 INFO:tasks.workunit.client.1.smithi165.stdout:3/209: chown da/d20/d26/f31 15 1 2024-09-16T02:05:43.818 INFO:tasks.workunit.client.1.smithi165.stdout:3/210: write da/fc [152988,74907] 0 2024-09-16T02:05:43.818 INFO:tasks.workunit.client.1.smithi165.stdout:9/127: creat d7/d1f/f2a x:0 0 0 2024-09-16T02:05:43.819 INFO:tasks.workunit.client.1.smithi165.stdout:8/117: fsync dd/ff 0 2024-09-16T02:05:43.820 INFO:tasks.workunit.client.1.smithi165.stdout:7/125: mknod d0/c25 0 2024-09-16T02:05:43.820 INFO:tasks.workunit.client.1.smithi165.stdout:2/147: mkdir df/d10/d1a/d2d 0 2024-09-16T02:05:43.821 INFO:tasks.workunit.client.1.smithi165.stdout:9/128: stat d7/d14/l1a 0 2024-09-16T02:05:43.821 INFO:tasks.workunit.client.1.smithi165.stdout:0/106: getdents d0/d1e 0 2024-09-16T02:05:43.823 INFO:tasks.workunit.client.1.smithi165.stdout:3/211: symlink da/de/d1e/d2c/d2d/l50 0 2024-09-16T02:05:43.825 INFO:tasks.workunit.client.1.smithi165.stdout:5/89: truncate de/f1d 1900052 0 2024-09-16T02:05:43.827 INFO:tasks.workunit.client.1.smithi165.stdout:0/107: symlink d0/d1e/l2b 0 2024-09-16T02:05:43.829 INFO:tasks.workunit.client.1.smithi165.stdout:0/108: stat d0/l14 0 2024-09-16T02:05:43.829 INFO:tasks.workunit.client.1.smithi165.stdout:8/118: mknod dd/d11/d14/c33 0 2024-09-16T02:05:43.830 INFO:tasks.workunit.client.1.smithi165.stdout:2/148: dwrite fa [0,4194304] 0 2024-09-16T02:05:43.832 INFO:tasks.workunit.client.1.smithi165.stdout:7/126: dwrite d0/df/d7/fe [0,4194304] 0 2024-09-16T02:05:43.835 INFO:tasks.workunit.client.1.smithi165.stdout:2/149: dread - df/d23/d28/f2c zero size 2024-09-16T02:05:43.838 INFO:tasks.workunit.client.1.smithi165.stdout:0/109: write d0/f23 [188349,34147] 0 2024-09-16T02:05:43.838 INFO:tasks.workunit.client.1.smithi165.stdout:3/212: dread da/de/f3c [0,4194304] 0 2024-09-16T02:05:43.839 INFO:tasks.workunit.client.1.smithi165.stdout:8/119: mkdir dd/d34 0 2024-09-16T02:05:43.839 INFO:tasks.workunit.client.1.smithi165.stdout:9/129: truncate d7/df/f10 480976 0 2024-09-16T02:05:43.840 INFO:tasks.workunit.client.1.smithi165.stdout:7/127: stat d0/df/d7/f14 0 2024-09-16T02:05:43.840 INFO:tasks.workunit.client.1.smithi165.stdout:2/150: write fa [5019190,121425] 0 2024-09-16T02:05:43.841 INFO:tasks.workunit.client.1.smithi165.stdout:9/130: chown d7/c17 0 1 2024-09-16T02:05:43.843 INFO:tasks.workunit.client.1.smithi165.stdout:0/110: read d0/fd [640105,17953] 0 2024-09-16T02:05:43.843 INFO:tasks.workunit.client.1.smithi165.stdout:5/90: dwrite de/f14 [0,4194304] 0 2024-09-16T02:05:43.844 INFO:tasks.workunit.client.1.smithi165.stdout:9/131: stat d7/d1f/d27 0 2024-09-16T02:05:43.845 INFO:tasks.workunit.client.1.smithi165.stdout:7/128: symlink d0/df/d7/l26 0 2024-09-16T02:05:43.846 INFO:tasks.workunit.client.1.smithi165.stdout:8/120: dread dd/d11/d14/f19 [0,4194304] 0 2024-09-16T02:05:43.849 INFO:tasks.workunit.client.1.smithi165.stdout:0/111: unlink d0/d1e/c22 0 2024-09-16T02:05:43.854 INFO:tasks.workunit.client.1.smithi165.stdout:0/112: fsync d0/fd 0 2024-09-16T02:05:43.858 INFO:tasks.workunit.client.1.smithi165.stdout:3/213: dread da/fb [0,4194304] 0 2024-09-16T02:05:43.859 INFO:tasks.workunit.client.1.smithi165.stdout:0/113: creat d0/d1e/f2c x:0 0 0 2024-09-16T02:05:43.859 INFO:tasks.workunit.client.1.smithi165.stdout:8/121: link dd/d11/f30 dd/d13/d23/f35 0 2024-09-16T02:05:43.865 INFO:tasks.workunit.client.1.smithi165.stdout:2/151: dwrite df/f16 [0,4194304] 0 2024-09-16T02:05:43.867 INFO:tasks.workunit.client.1.smithi165.stdout:8/122: dread - dd/d13/f2c zero size 2024-09-16T02:05:43.870 INFO:tasks.workunit.client.1.smithi165.stdout:3/214: write da/d17/f1a [57707,56039] 0 2024-09-16T02:05:43.870 INFO:tasks.workunit.client.1.smithi165.stdout:9/132: dwrite d7/d1d/f28 [0,4194304] 0 2024-09-16T02:05:43.871 INFO:tasks.workunit.client.1.smithi165.stdout:5/91: dwrite de/f14 [4194304,4194304] 0 2024-09-16T02:05:43.872 INFO:tasks.workunit.client.1.smithi165.stdout:2/152: chown df/c1d 2 1 2024-09-16T02:05:43.873 INFO:tasks.workunit.client.1.smithi165.stdout:3/215: stat da/de/d1e/d2c/c3a 0 2024-09-16T02:05:43.874 INFO:tasks.workunit.client.1.smithi165.stdout:7/129: dread d0/f19 [0,4194304] 0 2024-09-16T02:05:43.874 INFO:tasks.workunit.client.1.smithi165.stdout:8/123: write dd/d13/f21 [357291,61437] 0 2024-09-16T02:05:43.875 INFO:tasks.workunit.client.1.smithi165.stdout:5/92: write fc [1733307,3597] 0 2024-09-16T02:05:43.879 INFO:tasks.workunit.client.1.smithi165.stdout:8/124: dread - dd/d13/d23/d25/f2a zero size 2024-09-16T02:05:43.879 INFO:tasks.workunit.client.1.smithi165.stdout:9/133: truncate d7/d1f/f2a 920042 0 2024-09-16T02:05:43.881 INFO:tasks.workunit.client.1.smithi165.stdout:0/114: dread d0/ff [0,4194304] 0 2024-09-16T02:05:43.881 INFO:tasks.workunit.client.1.smithi165.stdout:5/93: mkdir de/d21 0 2024-09-16T02:05:43.881 INFO:tasks.workunit.client.1.smithi165.stdout:3/216: dread da/d17/f1a [0,4194304] 0 2024-09-16T02:05:43.881 INFO:tasks.workunit.client.1.smithi165.stdout:8/125: dread - dd/d11/f2f zero size 2024-09-16T02:05:43.882 INFO:tasks.workunit.client.1.smithi165.stdout:2/153: rename df/d10/f26 to df/d10/d1a/d2d/f2e 0 2024-09-16T02:05:43.883 INFO:tasks.workunit.client.1.smithi165.stdout:0/115: write d0/f1d [4333704,99945] 0 2024-09-16T02:05:43.884 INFO:tasks.workunit.client.1.smithi165.stdout:8/126: write f9 [1762942,27784] 0 2024-09-16T02:05:43.884 INFO:tasks.workunit.client.1.smithi165.stdout:2/154: chown l8 16765 1 2024-09-16T02:05:43.884 INFO:tasks.workunit.client.1.smithi165.stdout:9/134: mkdir d7/d1d/d2b 0 2024-09-16T02:05:43.885 INFO:tasks.workunit.client.1.smithi165.stdout:2/155: readlink lb 0 2024-09-16T02:05:43.885 INFO:tasks.workunit.client.1.smithi165.stdout:0/116: chown d0/l6 109435 1 2024-09-16T02:05:43.885 INFO:tasks.workunit.client.1.smithi165.stdout:9/135: fsync d7/fd 0 2024-09-16T02:05:43.886 INFO:tasks.workunit.client.1.smithi165.stdout:8/127: read dd/ff [1538464,112084] 0 2024-09-16T02:05:43.886 INFO:tasks.workunit.client.1.smithi165.stdout:2/156: read fa [3394432,20327] 0 2024-09-16T02:05:43.886 INFO:tasks.workunit.client.1.smithi165.stdout:5/94: symlink de/d19/l22 0 2024-09-16T02:05:43.888 INFO:tasks.workunit.client.1.smithi165.stdout:7/130: creat d0/df/f27 x:0 0 0 2024-09-16T02:05:43.889 INFO:tasks.workunit.client.1.smithi165.stdout:5/95: mknod de/d19/c23 0 2024-09-16T02:05:43.890 INFO:tasks.workunit.client.1.smithi165.stdout:9/136: rename d7/d14/c1b to d7/d14/c2c 0 2024-09-16T02:05:43.891 INFO:tasks.workunit.client.1.smithi165.stdout:2/157: unlink df/d10/f1b 0 2024-09-16T02:05:43.892 INFO:tasks.workunit.client.1.smithi165.stdout:3/217: getdents da/de/d1e 0 2024-09-16T02:05:43.893 INFO:tasks.workunit.client.1.smithi165.stdout:0/117: mknod d0/d1e/d20/d28/c2d 0 2024-09-16T02:05:43.893 INFO:tasks.workunit.client.1.smithi165.stdout:2/158: write df/f16 [1562444,123475] 0 2024-09-16T02:05:43.894 INFO:tasks.workunit.client.1.smithi165.stdout:0/118: dread - d0/d1e/f24 zero size 2024-09-16T02:05:43.894 INFO:tasks.workunit.client.1.smithi165.stdout:7/131: write d0/df/d7/f14 [1939088,43392] 0 2024-09-16T02:05:43.895 INFO:tasks.workunit.client.1.smithi165.stdout:3/218: readlink da/de/d1e/l39 0 2024-09-16T02:05:43.895 INFO:tasks.workunit.client.1.smithi165.stdout:5/96: dread f7 [0,4194304] 0 2024-09-16T02:05:43.897 INFO:tasks.workunit.client.1.smithi165.stdout:7/132: stat d0/d1a/l1f 0 2024-09-16T02:05:43.897 INFO:tasks.workunit.client.1.smithi165.stdout:2/159: truncate df/d10/f13 4894063 0 2024-09-16T02:05:43.898 INFO:tasks.workunit.client.1.smithi165.stdout:5/97: write fc [2320302,124233] 0 2024-09-16T02:05:43.898 INFO:tasks.workunit.client.1.smithi165.stdout:7/133: chown d0/c17 1456285 1 2024-09-16T02:05:43.899 INFO:tasks.workunit.client.1.smithi165.stdout:2/160: write df/f16 [299360,29775] 0 2024-09-16T02:05:43.901 INFO:tasks.workunit.client.1.smithi165.stdout:0/119: rmdir d0/d1e/d29 0 2024-09-16T02:05:43.902 INFO:tasks.workunit.client.1.smithi165.stdout:3/219: dread da/fb [0,4194304] 0 2024-09-16T02:05:43.904 INFO:tasks.workunit.client.1.smithi165.stdout:5/98: symlink de/d21/l24 0 2024-09-16T02:05:43.905 INFO:tasks.workunit.client.1.smithi165.stdout:0/120: truncate d0/fd 178799 0 2024-09-16T02:05:43.905 INFO:tasks.workunit.client.1.smithi165.stdout:8/128: truncate f6 1521584 0 2024-09-16T02:05:43.909 INFO:tasks.workunit.client.1.smithi165.stdout:0/121: creat d0/f2e x:0 0 0 2024-09-16T02:05:43.911 INFO:tasks.workunit.client.1.smithi165.stdout:3/220: link da/de/d1e/d2c/f4e da/d20/d26/f51 0 2024-09-16T02:05:43.912 INFO:tasks.workunit.client.1.smithi165.stdout:8/129: mkdir dd/d13/d23/d25/d36 0 2024-09-16T02:05:43.914 INFO:tasks.workunit.client.1.smithi165.stdout:7/134: dwrite d0/f19 [4194304,4194304] 0 2024-09-16T02:05:43.914 INFO:tasks.workunit.client.1.smithi165.stdout:2/161: truncate df/d10/f13 4805757 0 2024-09-16T02:05:43.914 INFO:tasks.workunit.client.1.smithi165.stdout:5/99: dread fc [0,4194304] 0 2024-09-16T02:05:43.919 INFO:tasks.workunit.client.1.smithi165.stdout:8/130: write dd/d13/d23/d25/f22 [545964,19369] 0 2024-09-16T02:05:43.919 INFO:tasks.workunit.client.1.smithi165.stdout:2/162: unlink df/d10/d1a/c20 0 2024-09-16T02:05:43.920 INFO:tasks.workunit.client.1.smithi165.stdout:8/131: stat dd 0 2024-09-16T02:05:43.922 INFO:tasks.workunit.client.1.smithi165.stdout:3/221: dread da/de/f16 [0,4194304] 0 2024-09-16T02:05:43.923 INFO:tasks.workunit.client.1.smithi165.stdout:5/100: creat de/d19/f25 x:0 0 0 2024-09-16T02:05:43.924 INFO:tasks.workunit.client.1.smithi165.stdout:0/122: truncate d0/d1e/f25 180711 0 2024-09-16T02:05:43.928 INFO:tasks.workunit.client.1.smithi165.stdout:7/135: dwrite d0/f19 [0,4194304] 0 2024-09-16T02:05:43.928 INFO:tasks.workunit.client.1.smithi165.stdout:3/222: mkdir da/d20/d26/d52 0 2024-09-16T02:05:43.929 INFO:tasks.workunit.client.1.smithi165.stdout:8/132: dread f9 [0,4194304] 0 2024-09-16T02:05:43.945 INFO:tasks.workunit.client.1.smithi165.stdout:5/101: rename de/d16 to de/d21/d26 0 2024-09-16T02:05:43.946 INFO:tasks.workunit.client.1.smithi165.stdout:0/123: mknod d0/d1e/d20/c2f 0 2024-09-16T02:05:43.946 INFO:tasks.workunit.client.1.smithi165.stdout:2/163: write fa [3596529,123260] 0 2024-09-16T02:05:43.948 INFO:tasks.workunit.client.1.smithi165.stdout:7/136: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:43.949 INFO:tasks.workunit.client.1.smithi165.stdout:7/137: write d0/df/f27 [120794,81918] 0 2024-09-16T02:05:44.013 INFO:tasks.workunit.client.1.smithi165.stdout:6/137: sync 2024-09-16T02:05:44.014 INFO:tasks.workunit.client.1.smithi165.stdout:6/138: chown l1 0 1 2024-09-16T02:05:44.018 INFO:tasks.workunit.client.1.smithi165.stdout:6/139: dread d7/fd [4194304,4194304] 0 2024-09-16T02:05:44.023 INFO:tasks.workunit.client.1.smithi165.stdout:6/140: dwrite d7/f1e [0,4194304] 0 2024-09-16T02:05:44.072 INFO:tasks.workunit.client.1.smithi165.stdout:4/35: sync 2024-09-16T02:05:44.072 INFO:tasks.workunit.client.1.smithi165.stdout:1/117: sync 2024-09-16T02:05:44.078 INFO:tasks.workunit.client.1.smithi165.stdout:1/118: dwrite d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:44.113 INFO:tasks.workunit.client.1.smithi165.stdout:9/137: sync 2024-09-16T02:05:44.128 INFO:tasks.workunit.client.1.smithi165.stdout:8/133: write f9 [3321480,47701] 0 2024-09-16T02:05:44.132 INFO:tasks.workunit.client.1.smithi165.stdout:0/124: creat d0/f30 x:0 0 0 2024-09-16T02:05:44.134 INFO:tasks.workunit.client.1.smithi165.stdout:2/164: unlink df/f11 0 2024-09-16T02:05:44.135 INFO:tasks.workunit.client.1.smithi165.stdout:4/36: creat d4/dc/fe x:0 0 0 2024-09-16T02:05:44.135 INFO:tasks.workunit.client.1.smithi165.stdout:1/119: mkdir d1/d19/d24 0 2024-09-16T02:05:44.137 INFO:tasks.workunit.client.1.smithi165.stdout:2/165: dread df/f19 [0,4194304] 0 2024-09-16T02:05:44.137 INFO:tasks.workunit.client.1.smithi165.stdout:9/138: rename d7/d1d/f28 to d7/d1f/d27/f2d 0 2024-09-16T02:05:44.138 INFO:tasks.workunit.client.1.smithi165.stdout:2/166: write df/d10/d1a/f27 [674767,60389] 0 2024-09-16T02:05:44.139 INFO:tasks.workunit.client.1.smithi165.stdout:0/125: symlink d0/d1e/d20/d28/l31 0 2024-09-16T02:05:44.140 INFO:tasks.workunit.client.1.smithi165.stdout:7/138: symlink d0/l28 0 2024-09-16T02:05:44.142 INFO:tasks.workunit.client.1.smithi165.stdout:9/139: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:44.144 INFO:tasks.workunit.client.1.smithi165.stdout:8/134: mknod dd/d34/c37 0 2024-09-16T02:05:44.145 INFO:tasks.workunit.client.1.smithi165.stdout:2/167: creat df/d10/d1a/d2d/f2f x:0 0 0 2024-09-16T02:05:44.147 INFO:tasks.workunit.client.1.smithi165.stdout:7/139: creat d0/d1a/f29 x:0 0 0 2024-09-16T02:05:44.147 INFO:tasks.workunit.client.1.smithi165.stdout:7/140: chown d0/d1a/f29 187106792 1 2024-09-16T02:05:44.148 INFO:tasks.workunit.client.1.smithi165.stdout:9/140: symlink d7/df/l2e 0 2024-09-16T02:05:44.149 INFO:tasks.workunit.client.1.smithi165.stdout:1/120: mkdir d1/dd/d25 0 2024-09-16T02:05:44.151 INFO:tasks.workunit.client.1.smithi165.stdout:2/168: symlink df/d10/d1a/d2d/l30 0 2024-09-16T02:05:44.152 INFO:tasks.workunit.client.1.smithi165.stdout:9/141: dread d7/d1f/f2a [0,4194304] 0 2024-09-16T02:05:44.154 INFO:tasks.workunit.client.1.smithi165.stdout:8/135: mkdir dd/d11/d38 0 2024-09-16T02:05:44.155 INFO:tasks.workunit.client.1.smithi165.stdout:0/126: link d0/d1e/d20/d28/l31 d0/d1e/d20/l32 0 2024-09-16T02:05:44.156 INFO:tasks.workunit.client.1.smithi165.stdout:7/141: dwrite d0/d1a/f29 [0,4194304] 0 2024-09-16T02:05:44.157 INFO:tasks.workunit.client.1.smithi165.stdout:9/142: unlink d7/df/f18 0 2024-09-16T02:05:44.158 INFO:tasks.workunit.client.1.smithi165.stdout:0/127: truncate d0/d1e/f24 1043127 0 2024-09-16T02:05:44.159 INFO:tasks.workunit.client.1.smithi165.stdout:1/121: dread d1/fb [0,4194304] 0 2024-09-16T02:05:44.159 INFO:tasks.workunit.client.1.smithi165.stdout:1/122: readlink d1/l21 0 2024-09-16T02:05:44.160 INFO:tasks.workunit.client.1.smithi165.stdout:8/136: creat dd/d11/d38/f39 x:0 0 0 2024-09-16T02:05:44.161 INFO:tasks.workunit.client.1.smithi165.stdout:9/143: symlink d7/l2f 0 2024-09-16T02:05:44.163 INFO:tasks.workunit.client.1.smithi165.stdout:9/144: truncate d7/df/f1c 642588 0 2024-09-16T02:05:44.163 INFO:tasks.workunit.client.1.smithi165.stdout:8/137: stat dd/le 0 2024-09-16T02:05:44.167 INFO:tasks.workunit.client.1.smithi165.stdout:7/142: getdents d0/df/d7 0 2024-09-16T02:05:44.169 INFO:tasks.workunit.client.1.smithi165.stdout:7/143: write d0/df/f18 [4551949,19317] 0 2024-09-16T02:05:44.170 INFO:tasks.workunit.client.1.smithi165.stdout:8/138: rename dd/d13/d23/c2d to dd/d11/d38/c3a 0 2024-09-16T02:05:44.172 INFO:tasks.workunit.client.1.smithi165.stdout:8/139: mknod dd/d13/d23/c3b 0 2024-09-16T02:05:44.175 INFO:tasks.workunit.client.1.smithi165.stdout:7/144: dwrite d0/d1a/f29 [0,4194304] 0 2024-09-16T02:05:44.176 INFO:tasks.workunit.client.1.smithi165.stdout:8/140: rename dd/d13/d23/d25/f22 to dd/d11/d38/f3c 0 2024-09-16T02:05:44.177 INFO:tasks.workunit.client.1.smithi165.stdout:8/141: fsync dd/d13/f2c 0 2024-09-16T02:05:44.180 INFO:tasks.workunit.client.1.smithi165.stdout:8/142: dread - dd/d13/d23/d25/f2a zero size 2024-09-16T02:05:44.181 INFO:tasks.workunit.client.1.smithi165.stdout:8/143: chown c4 13082 1 2024-09-16T02:05:44.181 INFO:tasks.workunit.client.1.smithi165.stdout:7/145: dread d0/df/d7/fe [0,4194304] 0 2024-09-16T02:05:44.183 INFO:tasks.workunit.client.1.smithi165.stdout:8/144: write dd/d13/f32 [272017,107717] 0 2024-09-16T02:05:44.185 INFO:tasks.workunit.client.1.smithi165.stdout:7/146: write d0/f12 [25303,8822] 0 2024-09-16T02:05:44.185 INFO:tasks.workunit.client.1.smithi165.stdout:8/145: write dd/d11/d14/f1e [4887565,1987] 0 2024-09-16T02:05:44.185 INFO:tasks.workunit.client.1.smithi165.stdout:7/147: readlink d0/d1a/l1f 0 2024-09-16T02:05:44.185 INFO:tasks.workunit.client.1.smithi165.stdout:8/146: write dd/d13/f21 [1442797,112149] 0 2024-09-16T02:05:44.189 INFO:tasks.workunit.client.1.smithi165.stdout:7/148: mkdir d0/d1a/d2a 0 2024-09-16T02:05:44.191 INFO:tasks.workunit.client.1.smithi165.stdout:8/147: unlink dd/d13/f2b 0 2024-09-16T02:05:44.191 INFO:tasks.workunit.client.1.smithi165.stdout:8/148: dread - dd/d11/d38/f39 zero size 2024-09-16T02:05:44.193 INFO:tasks.workunit.client.1.smithi165.stdout:8/149: mknod dd/d13/d23/d25/c3d 0 2024-09-16T02:05:44.193 INFO:tasks.workunit.client.1.smithi165.stdout:8/150: fdatasync dd/d11/f2f 0 2024-09-16T02:05:44.193 INFO:tasks.workunit.client.1.smithi165.stdout:7/149: symlink d0/df/l2b 0 2024-09-16T02:05:44.194 INFO:tasks.workunit.client.1.smithi165.stdout:8/151: chown dd/d13/d23/c31 517 1 2024-09-16T02:05:44.195 INFO:tasks.workunit.client.1.smithi165.stdout:7/150: write d0/df/d7/fe [2598234,47384] 0 2024-09-16T02:05:44.197 INFO:tasks.workunit.client.1.smithi165.stdout:7/151: write d0/f19 [9178594,93272] 0 2024-09-16T02:05:44.199 INFO:tasks.workunit.client.1.smithi165.stdout:7/152: write d0/df/d7/f14 [1843047,15994] 0 2024-09-16T02:05:44.200 INFO:tasks.workunit.client.1.smithi165.stdout:7/153: fdatasync d0/df/d7/fe 0 2024-09-16T02:05:44.201 INFO:tasks.workunit.client.1.smithi165.stdout:8/152: dwrite f9 [0,4194304] 0 2024-09-16T02:05:44.201 INFO:tasks.workunit.client.1.smithi165.stdout:7/154: stat d0/d1a/c24 0 2024-09-16T02:05:44.202 INFO:tasks.workunit.client.1.smithi165.stdout:8/153: dread - dd/d11/d14/f1d zero size 2024-09-16T02:05:44.202 INFO:tasks.workunit.client.1.smithi165.stdout:7/155: write d0/df/f27 [148058,22709] 0 2024-09-16T02:05:44.203 INFO:tasks.workunit.client.1.smithi165.stdout:7/156: write d0/f22 [473240,61192] 0 2024-09-16T02:05:44.205 INFO:tasks.workunit.client.1.smithi165.stdout:8/154: mknod dd/d13/d23/c3e 0 2024-09-16T02:05:44.207 INFO:tasks.workunit.client.1.smithi165.stdout:7/157: mkdir d0/d2c 0 2024-09-16T02:05:44.211 INFO:tasks.workunit.client.1.smithi165.stdout:7/158: mknod d0/df/c2d 0 2024-09-16T02:05:44.240 INFO:tasks.workunit.client.1.smithi165.stdout:3/223: truncate da/f14 503880 0 2024-09-16T02:05:44.241 INFO:tasks.workunit.client.1.smithi165.stdout:0/128: read d0/f16 [17314,64660] 0 2024-09-16T02:05:44.242 INFO:tasks.workunit.client.1.smithi165.stdout:0/129: dread - d0/f30 zero size 2024-09-16T02:05:44.243 INFO:tasks.workunit.client.1.smithi165.stdout:4/37: getdents d4/dc 0 2024-09-16T02:05:44.245 INFO:tasks.workunit.client.1.smithi165.stdout:5/102: write de/f1d [957136,55025] 0 2024-09-16T02:05:44.245 INFO:tasks.workunit.client.1.smithi165.stdout:4/38: truncate f3 4705431 0 2024-09-16T02:05:44.247 INFO:tasks.workunit.client.1.smithi165.stdout:7/159: fsync d0/d1a/f29 0 2024-09-16T02:05:44.249 INFO:tasks.workunit.client.1.smithi165.stdout:1/123: getdents d1/dd 0 2024-09-16T02:05:44.250 INFO:tasks.workunit.client.1.smithi165.stdout:3/224: dwrite da/d20/d26/f31 [0,4194304] 0 2024-09-16T02:05:44.250 INFO:tasks.workunit.client.1.smithi165.stdout:5/103: mknod de/d19/d1c/c27 0 2024-09-16T02:05:44.251 INFO:tasks.workunit.client.1.smithi165.stdout:6/141: dwrite d7/dc/df/f19 [0,4194304] 0 2024-09-16T02:05:44.253 INFO:tasks.workunit.client.1.smithi165.stdout:5/104: write de/d19/f1f [33886,36270] 0 2024-09-16T02:05:44.253 INFO:tasks.workunit.client.1.smithi165.stdout:2/169: truncate df/d23/d28/f29 63201 0 2024-09-16T02:05:44.255 INFO:tasks.workunit.client.1.smithi165.stdout:9/145: truncate f4 945610 0 2024-09-16T02:05:44.255 INFO:tasks.workunit.client.1.smithi165.stdout:3/225: write da/d20/d26/f2a [318618,39675] 0 2024-09-16T02:05:44.256 INFO:tasks.workunit.client.1.smithi165.stdout:5/105: readlink de/d19/l1a 0 2024-09-16T02:05:44.258 INFO:tasks.workunit.client.1.smithi165.stdout:6/142: rmdir d7/dc/df/d1a 39 2024-09-16T02:05:44.261 INFO:tasks.workunit.client.1.smithi165.stdout:5/106: write de/d19/f1f [822974,76804] 0 2024-09-16T02:05:44.262 INFO:tasks.workunit.client.1.smithi165.stdout:7/160: getdents d0/d1a/d2a 0 2024-09-16T02:05:44.266 INFO:tasks.workunit.client.1.smithi165.stdout:3/226: symlink da/d17/l53 0 2024-09-16T02:05:44.266 INFO:tasks.workunit.client.1.smithi165.stdout:8/155: rename dd/d13/d23 to dd/d11/d14/d3f 0 2024-09-16T02:05:44.267 INFO:tasks.workunit.client.1.smithi165.stdout:1/124: dwrite d1/fb [0,4194304] 0 2024-09-16T02:05:44.270 INFO:tasks.workunit.client.1.smithi165.stdout:3/227: write da/de/f1d [4581297,111329] 0 2024-09-16T02:05:44.272 INFO:tasks.workunit.client.1.smithi165.stdout:0/130: rename d0/fd to d0/d1e/d20/d28/f33 0 2024-09-16T02:05:44.272 INFO:tasks.workunit.client.1.smithi165.stdout:5/107: link de/d19/l22 de/d19/l28 0 2024-09-16T02:05:44.272 INFO:tasks.workunit.client.1.smithi165.stdout:6/143: dwrite d7/fe [0,4194304] 0 2024-09-16T02:05:44.272 INFO:tasks.workunit.client.1.smithi165.stdout:1/125: write d1/dd/d11/f1f [168784,51370] 0 2024-09-16T02:05:44.277 INFO:tasks.workunit.client.1.smithi165.stdout:4/39: rename d4/dc/cd to d4/cf 0 2024-09-16T02:05:44.277 INFO:tasks.workunit.client.1.smithi165.stdout:1/126: chown d1/dd/d11/f1f 20195 1 2024-09-16T02:05:44.279 INFO:tasks.workunit.client.1.smithi165.stdout:0/131: mkdir d0/d1e/d34 0 2024-09-16T02:05:44.279 INFO:tasks.workunit.client.1.smithi165.stdout:3/228: chown da/de/d1e/d2c/f36 318937676 1 2024-09-16T02:05:44.282 INFO:tasks.workunit.client.1.smithi165.stdout:2/170: unlink df/d23/d28/f29 0 2024-09-16T02:05:44.287 INFO:tasks.workunit.client.1.smithi165.stdout:4/40: rename d4/c5 to d4/c10 0 2024-09-16T02:05:44.288 INFO:tasks.workunit.client.1.smithi165.stdout:5/108: dread de/d19/f1f [0,4194304] 0 2024-09-16T02:05:44.288 INFO:tasks.workunit.client.1.smithi165.stdout:2/171: mknod df/d10/c31 0 2024-09-16T02:05:44.290 INFO:tasks.workunit.client.1.smithi165.stdout:0/132: rename d0/f16 to d0/d2a/f35 0 2024-09-16T02:05:44.291 INFO:tasks.workunit.client.1.smithi165.stdout:3/229: symlink da/l54 0 2024-09-16T02:05:44.291 INFO:tasks.workunit.client.1.smithi165.stdout:8/156: dwrite dd/d11/d38/f3c [0,4194304] 0 2024-09-16T02:05:44.292 INFO:tasks.workunit.client.1.smithi165.stdout:6/144: creat d7/f23 x:0 0 0 2024-09-16T02:05:44.292 INFO:tasks.workunit.client.1.smithi165.stdout:5/109: mknod de/c29 0 2024-09-16T02:05:44.292 INFO:tasks.workunit.client.1.smithi165.stdout:1/127: dwrite d1/dd/d11/f1f [0,4194304] 0 2024-09-16T02:05:44.296 INFO:tasks.workunit.client.1.smithi165.stdout:8/157: readlink dd/le 0 2024-09-16T02:05:44.298 INFO:tasks.workunit.client.1.smithi165.stdout:3/230: write da/de/f21 [1549474,59752] 0 2024-09-16T02:05:44.300 INFO:tasks.workunit.client.1.smithi165.stdout:2/172: getdents df/d23/d2a 0 2024-09-16T02:05:44.300 INFO:tasks.workunit.client.1.smithi165.stdout:5/110: creat de/f2a x:0 0 0 2024-09-16T02:05:44.301 INFO:tasks.workunit.client.1.smithi165.stdout:8/158: chown dd/d11/d14/f1d 394069902 1 2024-09-16T02:05:44.302 INFO:tasks.workunit.client.1.smithi165.stdout:6/145: mkdir d7/d17/d24 0 2024-09-16T02:05:44.302 INFO:tasks.workunit.client.1.smithi165.stdout:9/146: dwrite d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:44.303 INFO:tasks.workunit.client.1.smithi165.stdout:0/133: mkdir d0/d1e/d20/d36 0 2024-09-16T02:05:44.305 INFO:tasks.workunit.client.1.smithi165.stdout:7/161: truncate d0/f19 2907442 0 2024-09-16T02:05:44.305 INFO:tasks.workunit.client.1.smithi165.stdout:3/231: chown f8 22109 1 2024-09-16T02:05:44.305 INFO:tasks.workunit.client.1.smithi165.stdout:5/111: readlink de/d19/l22 0 2024-09-16T02:05:44.305 INFO:tasks.workunit.client.1.smithi165.stdout:0/134: chown d0/c12 2922 1 2024-09-16T02:05:44.306 INFO:tasks.workunit.client.1.smithi165.stdout:2/173: write df/d10/d1a/d2d/f2f [982813,87712] 0 2024-09-16T02:05:44.307 INFO:tasks.workunit.client.1.smithi165.stdout:5/112: write fa [707477,5690] 0 2024-09-16T02:05:44.308 INFO:tasks.workunit.client.1.smithi165.stdout:0/135: chown d0/d1e/d20/d28 360294 1 2024-09-16T02:05:44.309 INFO:tasks.workunit.client.1.smithi165.stdout:6/146: mknod d7/d1f/c25 0 2024-09-16T02:05:44.309 INFO:tasks.workunit.client.1.smithi165.stdout:8/159: read dd/d13/f21 [1442367,84323] 0 2024-09-16T02:05:44.309 INFO:tasks.workunit.client.1.smithi165.stdout:2/174: write df/d10/d1a/f27 [1126447,33925] 0 2024-09-16T02:05:44.310 INFO:tasks.workunit.client.1.smithi165.stdout:5/113: write de/f1d [1164580,103818] 0 2024-09-16T02:05:44.311 INFO:tasks.workunit.client.1.smithi165.stdout:3/232: symlink da/d20/d26/l55 0 2024-09-16T02:05:44.312 INFO:tasks.workunit.client.1.smithi165.stdout:7/162: creat d0/d2c/f2e x:0 0 0 2024-09-16T02:05:44.313 INFO:tasks.workunit.client.1.smithi165.stdout:2/175: dread df/f18 [0,4194304] 0 2024-09-16T02:05:44.313 INFO:tasks.workunit.client.1.smithi165.stdout:7/163: chown d0/df/d7/lb 356029885 1 2024-09-16T02:05:44.314 INFO:tasks.workunit.client.1.smithi165.stdout:8/160: readlink dd/l1b 0 2024-09-16T02:05:44.315 INFO:tasks.workunit.client.1.smithi165.stdout:7/164: stat d0/df/d7/la 0 2024-09-16T02:05:44.316 INFO:tasks.workunit.client.1.smithi165.stdout:6/147: symlink d7/d1f/l26 0 2024-09-16T02:05:44.316 INFO:tasks.workunit.client.1.smithi165.stdout:1/128: fsync d1/dd/d11/f1f 0 2024-09-16T02:05:44.318 INFO:tasks.workunit.client.1.smithi165.stdout:0/136: creat d0/d1e/d20/d36/f37 x:0 0 0 2024-09-16T02:05:44.320 INFO:tasks.workunit.client.1.smithi165.stdout:3/233: dwrite da/de/f24 [0,4194304] 0 2024-09-16T02:05:44.324 INFO:tasks.workunit.client.1.smithi165.stdout:3/234: mkdir da/d17/d56 0 2024-09-16T02:05:44.324 INFO:tasks.workunit.client.1.smithi165.stdout:4/41: truncate f1 1833651 0 2024-09-16T02:05:44.325 INFO:tasks.workunit.client.1.smithi165.stdout:6/148: rmdir d7/dc/df/d1a 39 2024-09-16T02:05:44.326 INFO:tasks.workunit.client.1.smithi165.stdout:1/129: dwrite d1/dd/d11/f1f [0,4194304] 0 2024-09-16T02:05:44.327 INFO:tasks.workunit.client.1.smithi165.stdout:6/149: write d7/dc/df/f19 [3226357,12274] 0 2024-09-16T02:05:44.329 INFO:tasks.workunit.client.1.smithi165.stdout:0/137: creat d0/d1e/d34/f38 x:0 0 0 2024-09-16T02:05:44.336 INFO:tasks.workunit.client.1.smithi165.stdout:7/165: link d0/df/d7/la d0/df/d7/l2f 0 2024-09-16T02:05:44.337 INFO:tasks.workunit.client.1.smithi165.stdout:3/235: mkdir da/d57 0 2024-09-16T02:05:44.337 INFO:tasks.workunit.client.1.smithi165.stdout:0/138: mkdir d0/d1e/d39 0 2024-09-16T02:05:44.339 INFO:tasks.workunit.client.1.smithi165.stdout:3/236: dread da/de/f16 [0,4194304] 0 2024-09-16T02:05:44.340 INFO:tasks.workunit.client.1.smithi165.stdout:1/130: symlink d1/d19/d24/l26 0 2024-09-16T02:05:44.340 INFO:tasks.workunit.client.1.smithi165.stdout:3/237: readlink da/d17/l53 0 2024-09-16T02:05:44.340 INFO:tasks.workunit.client.1.smithi165.stdout:0/139: mkdir d0/d2a/d3a 0 2024-09-16T02:05:44.341 INFO:tasks.workunit.client.1.smithi165.stdout:0/140: stat d0/d1e/c1f 0 2024-09-16T02:05:44.342 INFO:tasks.workunit.client.1.smithi165.stdout:0/141: fdatasync d0/ff 0 2024-09-16T02:05:44.342 INFO:tasks.workunit.client.1.smithi165.stdout:5/114: truncate de/d19/f1f 460307 0 2024-09-16T02:05:44.343 INFO:tasks.workunit.client.1.smithi165.stdout:5/115: dread - de/d19/f25 zero size 2024-09-16T02:05:44.344 INFO:tasks.workunit.client.1.smithi165.stdout:3/238: creat da/d20/f58 x:0 0 0 2024-09-16T02:05:44.344 INFO:tasks.workunit.client.1.smithi165.stdout:5/116: write f6 [2475668,28286] 0 2024-09-16T02:05:44.347 INFO:tasks.workunit.client.1.smithi165.stdout:0/142: dread d0/fb [0,4194304] 0 2024-09-16T02:05:44.349 INFO:tasks.workunit.client.1.smithi165.stdout:5/117: unlink cb 0 2024-09-16T02:05:44.350 INFO:tasks.workunit.client.1.smithi165.stdout:6/150: write d7/fe [4458396,27839] 0 2024-09-16T02:05:44.353 INFO:tasks.workunit.client.1.smithi165.stdout:4/42: truncate f3 3458432 0 2024-09-16T02:05:44.354 INFO:tasks.workunit.client.1.smithi165.stdout:4/43: fsync d4/fa 0 2024-09-16T02:05:44.355 INFO:tasks.workunit.client.1.smithi165.stdout:1/131: write d1/dd/f18 [242045,84700] 0 2024-09-16T02:05:44.355 INFO:tasks.workunit.client.1.smithi165.stdout:6/151: dread d7/f1e [0,4194304] 0 2024-09-16T02:05:44.356 INFO:tasks.workunit.client.1.smithi165.stdout:5/118: rename de/d19/l28 to de/d19/l2b 0 2024-09-16T02:05:44.357 INFO:tasks.workunit.client.1.smithi165.stdout:6/152: stat d7/fe 0 2024-09-16T02:05:44.357 INFO:tasks.workunit.client.1.smithi165.stdout:0/143: rmdir d0/d2a/d3a 0 2024-09-16T02:05:44.358 INFO:tasks.workunit.client.1.smithi165.stdout:6/153: dread - d7/f23 zero size 2024-09-16T02:05:44.359 INFO:tasks.workunit.client.1.smithi165.stdout:9/147: write f4 [1806040,53983] 0 2024-09-16T02:05:44.360 INFO:tasks.workunit.client.1.smithi165.stdout:6/154: stat d7/f9 0 2024-09-16T02:05:44.363 INFO:tasks.workunit.client.1.smithi165.stdout:9/148: read - d7/d14/f24 zero size 2024-09-16T02:05:44.365 INFO:tasks.workunit.client.1.smithi165.stdout:0/144: rename d0/c27 to d0/d1e/d20/d36/c3b 0 2024-09-16T02:05:44.366 INFO:tasks.workunit.client.1.smithi165.stdout:3/239: dread da/de/f21 [0,4194304] 0 2024-09-16T02:05:44.366 INFO:tasks.workunit.client.1.smithi165.stdout:4/44: getdents d4/dc 0 2024-09-16T02:05:44.367 INFO:tasks.workunit.client.1.smithi165.stdout:5/119: dwrite de/f14 [0,4194304] 0 2024-09-16T02:05:44.368 INFO:tasks.workunit.client.1.smithi165.stdout:6/155: creat d7/d1f/f27 x:0 0 0 2024-09-16T02:05:44.370 INFO:tasks.workunit.client.1.smithi165.stdout:6/156: chown d7/ca 13 1 2024-09-16T02:05:44.374 INFO:tasks.workunit.client.1.smithi165.stdout:4/45: mknod d4/c11 0 2024-09-16T02:05:44.374 INFO:tasks.workunit.client.1.smithi165.stdout:3/240: mknod da/c59 0 2024-09-16T02:05:44.375 INFO:tasks.workunit.client.1.smithi165.stdout:9/149: dwrite f4 [0,4194304] 0 2024-09-16T02:05:44.375 INFO:tasks.workunit.client.1.smithi165.stdout:0/145: symlink d0/d1e/d39/l3c 0 2024-09-16T02:05:44.375 INFO:tasks.workunit.client.1.smithi165.stdout:6/157: mkdir d7/d17/d28 0 2024-09-16T02:05:44.376 INFO:tasks.workunit.client.1.smithi165.stdout:4/46: rename d4/dc to d4/dc/d12 22 2024-09-16T02:05:44.376 INFO:tasks.workunit.client.1.smithi165.stdout:9/150: fsync f5 0 2024-09-16T02:05:44.376 INFO:tasks.workunit.client.1.smithi165.stdout:5/120: symlink de/d19/l2c 0 2024-09-16T02:05:44.377 INFO:tasks.workunit.client.1.smithi165.stdout:9/151: fdatasync f5 0 2024-09-16T02:05:44.379 INFO:tasks.workunit.client.1.smithi165.stdout:0/146: write d0/d1e/f26 [184551,21122] 0 2024-09-16T02:05:44.382 INFO:tasks.workunit.client.1.smithi165.stdout:6/158: dread d7/dc/df/f19 [0,4194304] 0 2024-09-16T02:05:44.383 INFO:tasks.workunit.client.1.smithi165.stdout:3/241: rename f8 to da/d17/d56/f5a 0 2024-09-16T02:05:44.385 INFO:tasks.workunit.client.1.smithi165.stdout:4/47: symlink d4/dc/l13 0 2024-09-16T02:05:44.386 INFO:tasks.workunit.client.1.smithi165.stdout:0/147: symlink d0/d2a/l3d 0 2024-09-16T02:05:44.388 INFO:tasks.workunit.client.1.smithi165.stdout:9/152: rename d7/c17 to d7/d1f/c30 0 2024-09-16T02:05:44.388 INFO:tasks.workunit.client.1.smithi165.stdout:3/242: creat da/d17/f5b x:0 0 0 2024-09-16T02:05:44.389 INFO:tasks.workunit.client.1.smithi165.stdout:4/48: creat d4/f14 x:0 0 0 2024-09-16T02:05:44.390 INFO:tasks.workunit.client.1.smithi165.stdout:9/153: write d7/df/f1c [1116415,91559] 0 2024-09-16T02:05:44.391 INFO:tasks.workunit.client.1.smithi165.stdout:4/49: read - f2 zero size 2024-09-16T02:05:44.394 INFO:tasks.workunit.client.1.smithi165.stdout:4/50: rename d4/dc/l13 to d4/dc/l15 0 2024-09-16T02:05:44.396 INFO:tasks.workunit.client.1.smithi165.stdout:6/159: rename d7/d17/c18 to d7/dc/c29 0 2024-09-16T02:05:44.397 INFO:tasks.workunit.client.1.smithi165.stdout:4/51: unlink d4/f8 0 2024-09-16T02:05:44.401 INFO:tasks.workunit.client.1.smithi165.stdout:3/243: dwrite da/fb [4194304,4194304] 0 2024-09-16T02:05:44.402 INFO:tasks.workunit.client.1.smithi165.stdout:9/154: dwrite f4 [0,4194304] 0 2024-09-16T02:05:44.402 INFO:tasks.workunit.client.1.smithi165.stdout:5/121: write de/d19/f1f [132386,102888] 0 2024-09-16T02:05:44.402 INFO:tasks.workunit.client.1.smithi165.stdout:0/148: truncate d0/d1e/f26 901624 0 2024-09-16T02:05:44.403 INFO:tasks.workunit.client.1.smithi165.stdout:4/52: rename f3 to d4/dc/f16 0 2024-09-16T02:05:44.404 INFO:tasks.workunit.client.1.smithi165.stdout:0/149: stat d0/d1e/d34 0 2024-09-16T02:05:44.406 INFO:tasks.workunit.client.1.smithi165.stdout:5/122: fsync f4 0 2024-09-16T02:05:44.406 INFO:tasks.workunit.client.1.smithi165.stdout:3/244: chown da/f14 46009 1 2024-09-16T02:05:44.407 INFO:tasks.workunit.client.1.smithi165.stdout:4/53: creat d4/f17 x:0 0 0 2024-09-16T02:05:44.408 INFO:tasks.workunit.client.1.smithi165.stdout:3/245: chown f1 1 1 2024-09-16T02:05:44.408 INFO:tasks.workunit.client.1.smithi165.stdout:6/160: dwrite f2 [0,4194304] 0 2024-09-16T02:05:44.411 INFO:tasks.workunit.client.1.smithi165.stdout:9/155: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:44.411 INFO:tasks.workunit.client.1.smithi165.stdout:3/246: fdatasync da/de/f3c 0 2024-09-16T02:05:44.500 INFO:tasks.workunit.client.1.smithi165.stdout:2/176: sync 2024-09-16T02:05:44.500 INFO:tasks.workunit.client.1.smithi165.stdout:8/161: sync 2024-09-16T02:05:44.500 INFO:tasks.workunit.client.1.smithi165.stdout:1/132: sync 2024-09-16T02:05:44.500 INFO:tasks.workunit.client.1.smithi165.stdout:7/166: sync 2024-09-16T02:05:44.501 INFO:tasks.workunit.client.1.smithi165.stdout:8/162: readlink dd/l1b 0 2024-09-16T02:05:44.503 INFO:tasks.workunit.client.1.smithi165.stdout:3/247: mknod da/de/d1e/d2c/d2d/c5c 0 2024-09-16T02:05:44.505 INFO:tasks.workunit.client.1.smithi165.stdout:0/150: link d0/l4 d0/d1e/d34/l3e 0 2024-09-16T02:05:44.506 INFO:tasks.workunit.client.1.smithi165.stdout:6/161: symlink d7/d17/d24/l2a 0 2024-09-16T02:05:44.508 INFO:tasks.workunit.client.1.smithi165.stdout:3/248: dread da/de/f24 [0,4194304] 0 2024-09-16T02:05:44.509 INFO:tasks.workunit.client.1.smithi165.stdout:7/167: rmdir d0 39 2024-09-16T02:05:44.509 INFO:tasks.workunit.client.1.smithi165.stdout:3/249: write da/d20/d26/f30 [13840,32790] 0 2024-09-16T02:05:44.510 INFO:tasks.workunit.client.1.smithi165.stdout:3/250: readlink da/de/d1e/d2c/l3e 0 2024-09-16T02:05:44.510 INFO:tasks.workunit.client.1.smithi165.stdout:1/133: symlink d1/d22/l27 0 2024-09-16T02:05:44.512 INFO:tasks.workunit.client.1.smithi165.stdout:2/177: rename df/f25 to df/d23/d28/f32 0 2024-09-16T02:05:44.513 INFO:tasks.workunit.client.1.smithi165.stdout:2/178: write df/d10/d1a/f27 [477999,85573] 0 2024-09-16T02:05:44.514 INFO:tasks.workunit.client.1.smithi165.stdout:5/123: truncate fa 2032872 0 2024-09-16T02:05:44.516 INFO:tasks.workunit.client.1.smithi165.stdout:4/54: getdents d4/dc 0 2024-09-16T02:05:44.516 INFO:tasks.workunit.client.1.smithi165.stdout:6/162: chown d7/dc/l1b 1046766 1 2024-09-16T02:05:44.518 INFO:tasks.workunit.client.1.smithi165.stdout:3/251: write da/d17/f1a [202543,708] 0 2024-09-16T02:05:44.519 INFO:tasks.workunit.client.1.smithi165.stdout:1/134: symlink d1/d22/l28 0 2024-09-16T02:05:44.520 INFO:tasks.workunit.client.1.smithi165.stdout:9/156: truncate f2 2284802 0 2024-09-16T02:05:44.521 INFO:tasks.workunit.client.1.smithi165.stdout:0/151: dread d0/f15 [0,4194304] 0 2024-09-16T02:05:44.521 INFO:tasks.workunit.client.1.smithi165.stdout:8/163: rename dd/d11/d14/d3f/d25/f2a to dd/d11/d14/f40 0 2024-09-16T02:05:44.521 INFO:tasks.workunit.client.1.smithi165.stdout:3/252: fdatasync da/d20/d26/f4f 0 2024-09-16T02:05:44.524 INFO:tasks.workunit.client.1.smithi165.stdout:9/157: write d7/d14/f12 [4099802,57112] 0 2024-09-16T02:05:44.525 INFO:tasks.workunit.client.1.smithi165.stdout:5/124: read f7 [274319,70677] 0 2024-09-16T02:05:44.530 INFO:tasks.workunit.client.1.smithi165.stdout:3/253: creat da/de/f5d x:0 0 0 2024-09-16T02:05:44.530 INFO:tasks.workunit.client.1.smithi165.stdout:6/163: dread d7/dc/df/f19 [0,4194304] 0 2024-09-16T02:05:44.531 INFO:tasks.workunit.client.1.smithi165.stdout:7/168: dwrite d0/df/f27 [0,4194304] 0 2024-09-16T02:05:44.531 INFO:tasks.workunit.client.1.smithi165.stdout:8/164: chown dd/d13/c1a 333653890 1 2024-09-16T02:05:44.534 INFO:tasks.workunit.client.1.smithi165.stdout:0/152: fsync d0/d2a/f35 0 2024-09-16T02:05:44.537 INFO:tasks.workunit.client.1.smithi165.stdout:6/164: chown d7/fe 1934459292 1 2024-09-16T02:05:44.537 INFO:tasks.workunit.client.1.smithi165.stdout:8/165: write dd/d11/d14/f1d [516536,48917] 0 2024-09-16T02:05:44.541 INFO:tasks.workunit.client.1.smithi165.stdout:3/254: creat da/de/d1e/f5e x:0 0 0 2024-09-16T02:05:44.541 INFO:tasks.workunit.client.1.smithi165.stdout:8/166: read dd/d13/f21 [1068398,61457] 0 2024-09-16T02:05:44.542 INFO:tasks.workunit.client.1.smithi165.stdout:1/135: dwrite d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:44.543 INFO:tasks.workunit.client.1.smithi165.stdout:0/153: mknod d0/d1e/d34/c3f 0 2024-09-16T02:05:44.545 INFO:tasks.workunit.client.1.smithi165.stdout:1/136: dread - d1/fc zero size 2024-09-16T02:05:44.545 INFO:tasks.workunit.client.1.smithi165.stdout:2/179: link c6 df/d10/d1a/c33 0 2024-09-16T02:05:44.548 INFO:tasks.workunit.client.1.smithi165.stdout:7/169: rename d0/df/d7/la to d0/d2c/l30 0 2024-09-16T02:05:44.549 INFO:tasks.workunit.client.1.smithi165.stdout:5/125: link de/l15 de/d21/d26/l2d 0 2024-09-16T02:05:44.551 INFO:tasks.workunit.client.1.smithi165.stdout:1/137: stat d1/dd/d25 0 2024-09-16T02:05:44.553 INFO:tasks.workunit.client.1.smithi165.stdout:4/55: dwrite d4/fb [0,4194304] 0 2024-09-16T02:05:44.553 INFO:tasks.workunit.client.1.smithi165.stdout:2/180: rename df/f18 to df/f34 0 2024-09-16T02:05:44.554 INFO:tasks.workunit.client.1.smithi165.stdout:5/126: chown fc 304 1 2024-09-16T02:05:44.554 INFO:tasks.workunit.client.1.smithi165.stdout:6/165: write d7/f9 [874559,112089] 0 2024-09-16T02:05:44.555 INFO:tasks.workunit.client.1.smithi165.stdout:1/138: chown d1/dd/f10 6402511 1 2024-09-16T02:05:44.556 INFO:tasks.workunit.client.1.smithi165.stdout:3/255: rename da/d20/c4d to da/d57/c5f 0 2024-09-16T02:05:44.557 INFO:tasks.workunit.client.1.smithi165.stdout:7/170: symlink d0/d2c/l31 0 2024-09-16T02:05:44.561 INFO:tasks.workunit.client.1.smithi165.stdout:1/139: fdatasync d1/d22/f20 0 2024-09-16T02:05:44.562 INFO:tasks.workunit.client.1.smithi165.stdout:4/56: mkdir d4/dc/d18 0 2024-09-16T02:05:44.564 INFO:tasks.workunit.client.1.smithi165.stdout:8/167: dwrite dd/d11/d38/f39 [0,4194304] 0 2024-09-16T02:05:44.566 INFO:tasks.workunit.client.1.smithi165.stdout:3/256: unlink da/de/f5d 0 2024-09-16T02:05:44.568 INFO:tasks.workunit.client.1.smithi165.stdout:7/171: truncate d0/df/d7/f23 723972 0 2024-09-16T02:05:44.569 INFO:tasks.workunit.client.1.smithi165.stdout:0/154: rename d0/l4 to d0/d1e/d20/d36/l40 0 2024-09-16T02:05:44.570 INFO:tasks.workunit.client.1.smithi165.stdout:5/127: dwrite de/f14 [8388608,4194304] 0 2024-09-16T02:05:44.571 INFO:tasks.workunit.client.1.smithi165.stdout:2/181: mknod df/d10/d1a/d24/c35 0 2024-09-16T02:05:44.572 INFO:tasks.workunit.client.1.smithi165.stdout:0/155: read d0/d1e/f24 [613378,104282] 0 2024-09-16T02:05:44.573 INFO:tasks.workunit.client.1.smithi165.stdout:9/158: dread d7/d14/f12 [0,4194304] 0 2024-09-16T02:05:44.573 INFO:tasks.workunit.client.1.smithi165.stdout:5/128: write de/f10 [3885427,98068] 0 2024-09-16T02:05:44.574 INFO:tasks.workunit.client.1.smithi165.stdout:7/172: creat d0/d1a/f32 x:0 0 0 2024-09-16T02:05:44.576 INFO:tasks.workunit.client.1.smithi165.stdout:2/182: write df/d10/d1a/f27 [374153,106785] 0 2024-09-16T02:05:44.577 INFO:tasks.workunit.client.1.smithi165.stdout:1/140: dread d1/f9 [0,4194304] 0 2024-09-16T02:05:44.578 INFO:tasks.workunit.client.1.smithi165.stdout:6/166: truncate f3 1992148 0 2024-09-16T02:05:44.579 INFO:tasks.workunit.client.1.smithi165.stdout:0/156: write d0/f13 [859257,129165] 0 2024-09-16T02:05:44.580 INFO:tasks.workunit.client.1.smithi165.stdout:3/257: write da/de/d1e/f34 [952855,48815] 0 2024-09-16T02:05:44.581 INFO:tasks.workunit.client.1.smithi165.stdout:5/129: creat de/d19/f2e x:0 0 0 2024-09-16T02:05:44.581 INFO:tasks.workunit.client.1.smithi165.stdout:4/57: getdents d4/dc 0 2024-09-16T02:05:44.583 INFO:tasks.workunit.client.1.smithi165.stdout:2/183: mkdir df/d10/d1a/d24/d36 0 2024-09-16T02:05:44.584 INFO:tasks.workunit.client.1.smithi165.stdout:6/167: symlink d7/l2b 0 2024-09-16T02:05:44.584 INFO:tasks.workunit.client.1.smithi165.stdout:4/58: write f2 [2748247,87139] 0 2024-09-16T02:05:44.585 INFO:tasks.workunit.client.1.smithi165.stdout:2/184: stat df/d10 0 2024-09-16T02:05:44.589 INFO:tasks.workunit.client.1.smithi165.stdout:9/159: link d7/d1f/c26 d7/df/c31 0 2024-09-16T02:05:44.593 INFO:tasks.workunit.client.1.smithi165.stdout:2/185: dread - df/d23/d28/f2c zero size 2024-09-16T02:05:44.594 INFO:tasks.workunit.client.1.smithi165.stdout:6/168: dread d7/f9 [0,4194304] 0 2024-09-16T02:05:44.595 INFO:tasks.workunit.client.1.smithi165.stdout:7/173: dwrite d0/df/d7/f14 [0,4194304] 0 2024-09-16T02:05:44.597 INFO:tasks.workunit.client.1.smithi165.stdout:5/130: dwrite de/f1d [0,4194304] 0 2024-09-16T02:05:44.599 INFO:tasks.workunit.client.1.smithi165.stdout:0/157: write d0/d1e/f26 [842552,101648] 0 2024-09-16T02:05:44.600 INFO:tasks.workunit.client.1.smithi165.stdout:3/258: dwrite da/d20/d26/f30 [0,4194304] 0 2024-09-16T02:05:44.601 INFO:tasks.workunit.client.1.smithi165.stdout:7/174: truncate d0/d1a/f29 4845866 0 2024-09-16T02:05:44.602 INFO:tasks.workunit.client.1.smithi165.stdout:5/131: read - de/d19/f25 zero size 2024-09-16T02:05:44.605 INFO:tasks.workunit.client.1.smithi165.stdout:7/175: write d0/d1a/f29 [4956773,12597] 0 2024-09-16T02:05:44.606 INFO:tasks.workunit.client.1.smithi165.stdout:2/186: write df/f19 [1317145,25706] 0 2024-09-16T02:05:44.606 INFO:tasks.workunit.client.1.smithi165.stdout:0/158: symlink d0/d1e/d20/d28/l41 0 2024-09-16T02:05:44.608 INFO:tasks.workunit.client.1.smithi165.stdout:6/169: write d7/fd [5418988,101459] 0 2024-09-16T02:05:44.609 INFO:tasks.workunit.client.1.smithi165.stdout:7/176: readlink d0/df/d7/lb 0 2024-09-16T02:05:44.610 INFO:tasks.workunit.client.1.smithi165.stdout:5/132: mkdir de/d19/d2f 0 2024-09-16T02:05:44.613 INFO:tasks.workunit.client.1.smithi165.stdout:4/59: getdents d4/dc 0 2024-09-16T02:05:44.614 INFO:tasks.workunit.client.1.smithi165.stdout:0/159: mknod d0/d1e/d20/d28/c42 0 2024-09-16T02:05:44.615 INFO:tasks.workunit.client.1.smithi165.stdout:3/259: rename da/d57/c5f to da/d17/c60 0 2024-09-16T02:05:44.615 INFO:tasks.workunit.client.1.smithi165.stdout:7/177: write d0/df/d7/f23 [341986,10930] 0 2024-09-16T02:05:44.618 INFO:tasks.workunit.client.1.smithi165.stdout:9/160: dwrite d7/d14/f12 [4194304,4194304] 0 2024-09-16T02:05:44.619 INFO:tasks.workunit.client.1.smithi165.stdout:4/60: creat d4/dc/f19 x:0 0 0 2024-09-16T02:05:44.621 INFO:tasks.workunit.client.1.smithi165.stdout:3/260: chown da/d17/c1f 136616019 1 2024-09-16T02:05:44.621 INFO:tasks.workunit.client.1.smithi165.stdout:7/178: read d0/df/d7/f14 [1546759,90130] 0 2024-09-16T02:05:44.622 INFO:tasks.workunit.client.1.smithi165.stdout:7/179: chown d0/df 52063254 1 2024-09-16T02:05:44.623 INFO:tasks.workunit.client.1.smithi165.stdout:0/160: rename d0/lc to d0/d1e/d20/d28/l43 0 2024-09-16T02:05:44.625 INFO:tasks.workunit.client.1.smithi165.stdout:5/133: dwrite de/f14 [4194304,4194304] 0 2024-09-16T02:05:44.626 INFO:tasks.workunit.client.1.smithi165.stdout:0/161: dread - d0/d1e/d34/f38 zero size 2024-09-16T02:05:44.627 INFO:tasks.workunit.client.1.smithi165.stdout:3/261: rename f1 to da/d17/d56/f61 0 2024-09-16T02:05:44.628 INFO:tasks.workunit.client.1.smithi165.stdout:0/162: truncate d0/d1e/f2c 934634 0 2024-09-16T02:05:44.630 INFO:tasks.workunit.client.1.smithi165.stdout:3/262: chown da/d20/d26/c2b 14 1 2024-09-16T02:05:44.631 INFO:tasks.workunit.client.1.smithi165.stdout:5/134: rmdir de/d19 39 2024-09-16T02:05:44.631 INFO:tasks.workunit.client.1.smithi165.stdout:3/263: chown da/de/l19 1 1 2024-09-16T02:05:44.644 INFO:tasks.workunit.client.1.smithi165.stdout:9/161: fdatasync d7/d14/f12 0 2024-09-16T02:05:44.644 INFO:tasks.workunit.client.1.smithi165.stdout:6/170: truncate d7/fb 740287 0 2024-09-16T02:05:44.645 INFO:tasks.workunit.client.1.smithi165.stdout:2/187: truncate df/f19 875818 0 2024-09-16T02:05:44.645 INFO:tasks.workunit.client.1.smithi165.stdout:3/264: read da/d20/d26/f2a [39049,5742] 0 2024-09-16T02:05:44.646 INFO:tasks.workunit.client.1.smithi165.stdout:9/162: mkdir d7/d32 0 2024-09-16T02:05:44.646 INFO:tasks.workunit.client.1.smithi165.stdout:4/61: write d4/dc/f16 [1013143,94236] 0 2024-09-16T02:05:44.647 INFO:tasks.workunit.client.1.smithi165.stdout:0/163: write d0/f9 [847286,50464] 0 2024-09-16T02:05:44.648 INFO:tasks.workunit.client.1.smithi165.stdout:5/135: dread fc [0,4194304] 0 2024-09-16T02:05:44.648 INFO:tasks.workunit.client.1.smithi165.stdout:6/171: mknod d7/c2c 0 2024-09-16T02:05:44.648 INFO:tasks.workunit.client.1.smithi165.stdout:2/188: fsync df/d23/d28/f32 0 2024-09-16T02:05:44.649 INFO:tasks.workunit.client.1.smithi165.stdout:3/265: symlink da/d20/l62 0 2024-09-16T02:05:44.649 INFO:tasks.workunit.client.1.smithi165.stdout:9/163: chown d7/fd 1746 1 2024-09-16T02:05:44.650 INFO:tasks.workunit.client.1.smithi165.stdout:4/62: creat d4/dc/d18/f1a x:0 0 0 2024-09-16T02:05:44.652 INFO:tasks.workunit.client.1.smithi165.stdout:0/164: write d0/d1e/f2c [1873272,105896] 0 2024-09-16T02:05:44.652 INFO:tasks.workunit.client.1.smithi165.stdout:3/266: chown da/de/d1e/d2c/d2d/c4c 14 1 2024-09-16T02:05:44.653 INFO:tasks.workunit.client.1.smithi165.stdout:4/63: creat d4/f1b x:0 0 0 2024-09-16T02:05:44.654 INFO:tasks.workunit.client.1.smithi165.stdout:5/136: rename de/d19/c23 to de/d19/c30 0 2024-09-16T02:05:44.655 INFO:tasks.workunit.client.1.smithi165.stdout:6/172: creat d7/dc/df/d1a/f2d x:0 0 0 2024-09-16T02:05:44.656 INFO:tasks.workunit.client.1.smithi165.stdout:4/64: write f2 [4758650,38254] 0 2024-09-16T02:05:44.660 INFO:tasks.workunit.client.1.smithi165.stdout:2/189: getdents df/d10/d1a 0 2024-09-16T02:05:44.661 INFO:tasks.workunit.client.1.smithi165.stdout:5/137: mknod de/d19/c31 0 2024-09-16T02:05:44.662 INFO:tasks.workunit.client.1.smithi165.stdout:4/65: write d4/dc/f16 [3705715,27792] 0 2024-09-16T02:05:44.663 INFO:tasks.workunit.client.1.smithi165.stdout:9/164: dwrite f4 [0,4194304] 0 2024-09-16T02:05:44.666 INFO:tasks.workunit.client.1.smithi165.stdout:5/138: fsync fc 0 2024-09-16T02:05:44.668 INFO:tasks.workunit.client.1.smithi165.stdout:5/139: dread - de/d19/f25 zero size 2024-09-16T02:05:44.668 INFO:tasks.workunit.client.1.smithi165.stdout:2/190: fsync df/f16 0 2024-09-16T02:05:44.670 INFO:tasks.workunit.client.1.smithi165.stdout:6/173: dread f2 [0,4194304] 0 2024-09-16T02:05:44.671 INFO:tasks.workunit.client.1.smithi165.stdout:3/267: write da/d20/d26/f51 [233577,82367] 0 2024-09-16T02:05:44.673 INFO:tasks.workunit.client.1.smithi165.stdout:3/268: fsync da/fc 0 2024-09-16T02:05:44.674 INFO:tasks.workunit.client.1.smithi165.stdout:0/165: truncate d0/d1e/f2c 860525 0 2024-09-16T02:05:44.675 INFO:tasks.workunit.client.1.smithi165.stdout:4/66: dread d4/fb [0,4194304] 0 2024-09-16T02:05:44.676 INFO:tasks.workunit.client.1.smithi165.stdout:6/174: dread d7/f9 [0,4194304] 0 2024-09-16T02:05:44.676 INFO:tasks.workunit.client.1.smithi165.stdout:0/166: chown d0/d1e/d39 3036 1 2024-09-16T02:05:44.677 INFO:tasks.workunit.client.1.smithi165.stdout:3/269: readlink da/de/d1e/d2c/d2d/l50 0 2024-09-16T02:05:44.677 INFO:tasks.workunit.client.1.smithi165.stdout:9/165: dread d7/d1f/d27/f2d [0,4194304] 0 2024-09-16T02:05:44.678 INFO:tasks.workunit.client.1.smithi165.stdout:2/191: dread df/f34 [0,4194304] 0 2024-09-16T02:05:44.680 INFO:tasks.workunit.client.1.smithi165.stdout:4/67: mknod d4/dc/d18/c1c 0 2024-09-16T02:05:44.680 INFO:tasks.workunit.client.1.smithi165.stdout:5/140: dwrite de/f2a [0,4194304] 0 2024-09-16T02:05:44.681 INFO:tasks.workunit.client.1.smithi165.stdout:0/167: rmdir d0/d1e/d34 39 2024-09-16T02:05:44.683 INFO:tasks.workunit.client.1.smithi165.stdout:6/175: symlink d7/dc/df/l2e 0 2024-09-16T02:05:44.684 INFO:tasks.workunit.client.1.smithi165.stdout:6/176: stat c4 0 2024-09-16T02:05:44.685 INFO:tasks.workunit.client.1.smithi165.stdout:4/68: symlink d4/l1d 0 2024-09-16T02:05:44.686 INFO:tasks.workunit.client.1.smithi165.stdout:8/168: sync 2024-09-16T02:05:44.687 INFO:tasks.workunit.client.1.smithi165.stdout:2/192: rename df/d10/d1a/d24 to df/d10/d37 0 2024-09-16T02:05:44.689 INFO:tasks.workunit.client.1.smithi165.stdout:2/193: write df/d23/d28/f32 [361828,50084] 0 2024-09-16T02:05:44.690 INFO:tasks.workunit.client.1.smithi165.stdout:0/168: dwrite d0/f9 [0,4194304] 0 2024-09-16T02:05:44.691 INFO:tasks.workunit.client.1.smithi165.stdout:0/169: dread - d0/f30 zero size 2024-09-16T02:05:44.691 INFO:tasks.workunit.client.1.smithi165.stdout:3/270: mknod da/d20/d26/d52/c63 0 2024-09-16T02:05:44.692 INFO:tasks.workunit.client.1.smithi165.stdout:0/170: readlink d0/d1e/l2b 0 2024-09-16T02:05:44.692 INFO:tasks.workunit.client.1.smithi165.stdout:6/177: write f2 [3829084,127253] 0 2024-09-16T02:05:44.694 INFO:tasks.workunit.client.1.smithi165.stdout:4/69: unlink d4/f17 0 2024-09-16T02:05:44.697 INFO:tasks.workunit.client.1.smithi165.stdout:2/194: creat df/d23/f38 x:0 0 0 2024-09-16T02:05:44.697 INFO:tasks.workunit.client.1.smithi165.stdout:2/195: dread - df/d10/d1a/f22 zero size 2024-09-16T02:05:44.699 INFO:tasks.workunit.client.1.smithi165.stdout:2/196: write df/d23/d28/f32 [1052052,91140] 0 2024-09-16T02:05:44.699 INFO:tasks.workunit.client.1.smithi165.stdout:0/171: creat d0/d1e/d20/d36/f44 x:0 0 0 2024-09-16T02:05:44.734 INFO:tasks.workunit.client.1.smithi165.stdout:9/166: link d7/df/c29 d7/c33 0 2024-09-16T02:05:44.735 INFO:tasks.workunit.client.1.smithi165.stdout:2/197: write df/f34 [1594033,62941] 0 2024-09-16T02:05:44.736 INFO:tasks.workunit.client.1.smithi165.stdout:6/178: truncate f2 1630004 0 2024-09-16T02:05:44.736 INFO:tasks.workunit.client.1.smithi165.stdout:8/169: creat dd/f41 x:0 0 0 2024-09-16T02:05:44.737 INFO:tasks.workunit.client.1.smithi165.stdout:5/141: getdents de/d21 0 2024-09-16T02:05:44.737 INFO:tasks.workunit.client.1.smithi165.stdout:9/167: mknod d7/c34 0 2024-09-16T02:05:44.738 INFO:tasks.workunit.client.1.smithi165.stdout:0/172: rename d0/d1e/d20/d36 to d0/d1e/d34/d45 0 2024-09-16T02:05:44.740 INFO:tasks.workunit.client.1.smithi165.stdout:2/198: rename df/d10/d1a/d2d/f2e to df/d23/d28/f39 0 2024-09-16T02:05:44.743 INFO:tasks.workunit.client.1.smithi165.stdout:4/70: write f1 [2017171,52185] 0 2024-09-16T02:05:44.746 INFO:tasks.workunit.client.1.smithi165.stdout:6/179: dwrite d7/f23 [0,4194304] 0 2024-09-16T02:05:44.747 INFO:tasks.workunit.client.1.smithi165.stdout:8/170: symlink dd/d11/d14/d3f/d25/d36/l42 0 2024-09-16T02:05:44.749 INFO:tasks.workunit.client.1.smithi165.stdout:8/171: fdatasync dd/d13/f32 0 2024-09-16T02:05:44.751 INFO:tasks.workunit.client.1.smithi165.stdout:5/142: truncate f7 1233752 0 2024-09-16T02:05:44.751 INFO:tasks.workunit.client.1.smithi165.stdout:9/168: write d7/df/f10 [1523715,37995] 0 2024-09-16T02:05:44.752 INFO:tasks.workunit.client.1.smithi165.stdout:8/172: write dd/ff [6282577,80328] 0 2024-09-16T02:05:44.757 INFO:tasks.workunit.client.1.smithi165.stdout:2/199: truncate df/f34 8254 0 2024-09-16T02:05:44.757 INFO:tasks.workunit.client.1.smithi165.stdout:9/169: write d7/fd [1248374,69098] 0 2024-09-16T02:05:44.758 INFO:tasks.workunit.client.1.smithi165.stdout:4/71: dwrite d4/dc/fe [0,4194304] 0 2024-09-16T02:05:44.759 INFO:tasks.workunit.client.1.smithi165.stdout:5/143: write de/d19/f2e [43274,89603] 0 2024-09-16T02:05:44.759 INFO:tasks.workunit.client.1.smithi165.stdout:8/173: dread - dd/d11/d14/f40 zero size 2024-09-16T02:05:44.761 INFO:tasks.workunit.client.1.smithi165.stdout:8/174: chown dd/d11/d38 490318 1 2024-09-16T02:05:44.763 INFO:tasks.workunit.client.1.smithi165.stdout:6/180: dread d7/f23 [0,4194304] 0 2024-09-16T02:05:44.763 INFO:tasks.workunit.client.1.smithi165.stdout:4/72: stat d4/cf 0 2024-09-16T02:05:44.763 INFO:tasks.workunit.client.1.smithi165.stdout:9/170: creat d7/f35 x:0 0 0 2024-09-16T02:05:44.764 INFO:tasks.workunit.client.1.smithi165.stdout:2/200: mkdir df/d23/d28/d3a 0 2024-09-16T02:05:44.768 INFO:tasks.workunit.client.1.smithi165.stdout:6/181: readlink d7/dc/df/l1d 0 2024-09-16T02:05:44.770 INFO:tasks.workunit.client.1.smithi165.stdout:0/173: dwrite d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:44.771 INFO:tasks.workunit.client.1.smithi165.stdout:4/73: write d4/dc/f16 [4254246,81357] 0 2024-09-16T02:05:44.775 INFO:tasks.workunit.client.1.smithi165.stdout:8/175: write dd/d11/f30 [268818,65761] 0 2024-09-16T02:05:44.776 INFO:tasks.workunit.client.1.smithi165.stdout:0/174: unlink d0/l1b 0 2024-09-16T02:05:44.776 INFO:tasks.workunit.client.1.smithi165.stdout:9/171: write d7/d1f/f2a [1813843,80757] 0 2024-09-16T02:05:44.777 INFO:tasks.workunit.client.1.smithi165.stdout:2/201: dread fa [4194304,4194304] 0 2024-09-16T02:05:44.779 INFO:tasks.workunit.client.1.smithi165.stdout:8/176: dread - dd/d11/f2f zero size 2024-09-16T02:05:44.779 INFO:tasks.workunit.client.1.smithi165.stdout:5/144: dwrite f4 [4194304,4194304] 0 2024-09-16T02:05:44.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/172: write d7/fd [170679,3355] 0 2024-09-16T02:05:44.782 INFO:tasks.workunit.client.1.smithi165.stdout:5/145: write de/d19/f25 [138851,21762] 0 2024-09-16T02:05:44.783 INFO:tasks.workunit.client.1.smithi165.stdout:2/202: unlink df/d10/c31 0 2024-09-16T02:05:44.783 INFO:tasks.workunit.client.1.smithi165.stdout:9/173: write d7/f35 [798520,70463] 0 2024-09-16T02:05:44.784 INFO:tasks.workunit.client.1.smithi165.stdout:5/146: chown de/c11 405 1 2024-09-16T02:05:44.784 INFO:tasks.workunit.client.1.smithi165.stdout:0/175: creat d0/d1e/d20/f46 x:0 0 0 2024-09-16T02:05:44.785 INFO:tasks.workunit.client.1.smithi165.stdout:0/176: truncate d0/f9 4961882 0 2024-09-16T02:05:44.786 INFO:tasks.workunit.client.1.smithi165.stdout:8/177: mkdir dd/d11/d14/d3f/d25/d36/d43 0 2024-09-16T02:05:44.787 INFO:tasks.workunit.client.1.smithi165.stdout:6/182: write d7/fb [974905,11280] 0 2024-09-16T02:05:44.788 INFO:tasks.workunit.client.1.smithi165.stdout:1/141: sync 2024-09-16T02:05:44.788 INFO:tasks.workunit.client.1.smithi165.stdout:9/174: symlink d7/l36 0 2024-09-16T02:05:44.789 INFO:tasks.workunit.client.1.smithi165.stdout:4/74: truncate d4/fb 3270113 0 2024-09-16T02:05:44.790 INFO:tasks.workunit.client.1.smithi165.stdout:8/178: write dd/d11/f2f [726047,22213] 0 2024-09-16T02:05:44.791 INFO:tasks.workunit.client.1.smithi165.stdout:5/147: creat de/d19/f32 x:0 0 0 2024-09-16T02:05:44.793 INFO:tasks.workunit.client.1.smithi165.stdout:4/75: creat d4/f1e x:0 0 0 2024-09-16T02:05:44.794 INFO:tasks.workunit.client.1.smithi165.stdout:6/183: rename d7/ca to d7/d17/d24/c2f 0 2024-09-16T02:05:44.796 INFO:tasks.workunit.client.1.smithi165.stdout:2/203: getdents df/d10/d1a 0 2024-09-16T02:05:44.797 INFO:tasks.workunit.client.1.smithi165.stdout:5/148: dread de/d19/f25 [0,4194304] 0 2024-09-16T02:05:44.800 INFO:tasks.workunit.client.1.smithi165.stdout:9/175: rename d7/d1d/d2b to d7/df/d37 0 2024-09-16T02:05:44.800 INFO:tasks.workunit.client.1.smithi165.stdout:0/177: dwrite d0/f2e [0,4194304] 0 2024-09-16T02:05:44.800 INFO:tasks.workunit.client.1.smithi165.stdout:1/142: write d1/dd/f14 [547209,78316] 0 2024-09-16T02:05:44.800 INFO:tasks.workunit.client.1.smithi165.stdout:8/179: dread dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:44.801 INFO:tasks.workunit.client.1.smithi165.stdout:6/184: fdatasync d7/dc/df/f19 0 2024-09-16T02:05:44.802 INFO:tasks.workunit.client.1.smithi165.stdout:5/149: write de/f1d [2884094,110865] 0 2024-09-16T02:05:44.804 INFO:tasks.workunit.client.1.smithi165.stdout:1/143: stat d1/l2 0 2024-09-16T02:05:44.806 INFO:tasks.workunit.client.1.smithi165.stdout:2/204: rename df/d23/d28/d3a to df/d23/d28/d3b 0 2024-09-16T02:05:44.808 INFO:tasks.workunit.client.1.smithi165.stdout:4/76: getdents d4 0 2024-09-16T02:05:44.809 INFO:tasks.workunit.client.1.smithi165.stdout:5/150: rename f4 to de/d19/f33 0 2024-09-16T02:05:44.809 INFO:tasks.workunit.client.1.smithi165.stdout:8/180: unlink dd/c1f 0 2024-09-16T02:05:44.811 INFO:tasks.workunit.client.1.smithi165.stdout:0/178: truncate d0/d1e/d34/d45/f44 995795 0 2024-09-16T02:05:44.812 INFO:tasks.workunit.client.1.smithi165.stdout:1/144: rename d1/d19/d24/l26 to d1/dd/d25/l29 0 2024-09-16T02:05:44.812 INFO:tasks.workunit.client.1.smithi165.stdout:2/205: dread df/f34 [0,4194304] 0 2024-09-16T02:05:44.814 INFO:tasks.workunit.client.1.smithi165.stdout:8/181: write dd/f41 [492887,32377] 0 2024-09-16T02:05:44.815 INFO:tasks.workunit.client.1.smithi165.stdout:0/179: mkdir d0/d47 0 2024-09-16T02:05:44.815 INFO:tasks.workunit.client.1.smithi165.stdout:4/77: link d4/dc/l15 d4/l1f 0 2024-09-16T02:05:44.816 INFO:tasks.workunit.client.1.smithi165.stdout:9/176: dwrite d7/f35 [0,4194304] 0 2024-09-16T02:05:44.816 INFO:tasks.workunit.client.1.smithi165.stdout:7/180: sync 2024-09-16T02:05:44.819 INFO:tasks.workunit.client.1.smithi165.stdout:8/182: rename dd/d11/d14/d3f to dd/d11/d14/d3f/d44 22 2024-09-16T02:05:44.819 INFO:tasks.workunit.client.1.smithi165.stdout:5/151: dread fc [0,4194304] 0 2024-09-16T02:05:44.820 INFO:tasks.workunit.client.1.smithi165.stdout:2/206: symlink df/d23/d28/l3c 0 2024-09-16T02:05:44.821 INFO:tasks.workunit.client.1.smithi165.stdout:7/181: write d0/d1a/f29 [4086160,74511] 0 2024-09-16T02:05:44.822 INFO:tasks.workunit.client.1.smithi165.stdout:7/182: stat d0 0 2024-09-16T02:05:44.824 INFO:tasks.workunit.client.1.smithi165.stdout:2/207: read df/d23/d28/f32 [644376,43486] 0 2024-09-16T02:05:44.825 INFO:tasks.workunit.client.1.smithi165.stdout:4/78: mkdir d4/dc/d20 0 2024-09-16T02:05:44.828 INFO:tasks.workunit.client.1.smithi165.stdout:0/180: write d0/d1e/f24 [246029,61730] 0 2024-09-16T02:05:44.828 INFO:tasks.workunit.client.1.smithi165.stdout:9/177: mkdir d7/d32/d38 0 2024-09-16T02:05:44.829 INFO:tasks.workunit.client.1.smithi165.stdout:7/183: write d0/df/d7/fe [3420747,38224] 0 2024-09-16T02:05:44.829 INFO:tasks.workunit.client.1.smithi165.stdout:2/208: dread df/f34 [0,4194304] 0 2024-09-16T02:05:44.832 INFO:tasks.workunit.client.1.smithi165.stdout:4/79: unlink d4/f14 0 2024-09-16T02:05:44.833 INFO:tasks.workunit.client.1.smithi165.stdout:0/181: write d0/f13 [1429812,43665] 0 2024-09-16T02:05:44.835 INFO:tasks.workunit.client.1.smithi165.stdout:5/152: dread de/f14 [0,4194304] 0 2024-09-16T02:05:44.835 INFO:tasks.workunit.client.1.smithi165.stdout:6/185: dread d7/fd [0,4194304] 0 2024-09-16T02:05:44.835 INFO:tasks.workunit.client.1.smithi165.stdout:1/145: getdents d1/dd/d11 0 2024-09-16T02:05:44.836 INFO:tasks.workunit.client.1.smithi165.stdout:4/80: dread - d4/fa zero size 2024-09-16T02:05:44.836 INFO:tasks.workunit.client.1.smithi165.stdout:9/178: creat d7/d32/f39 x:0 0 0 2024-09-16T02:05:44.837 INFO:tasks.workunit.client.1.smithi165.stdout:8/183: dwrite dd/d11/d14/d3f/f35 [0,4194304] 0 2024-09-16T02:05:44.837 INFO:tasks.workunit.client.1.smithi165.stdout:2/209: creat df/d10/d37/f3d x:0 0 0 2024-09-16T02:05:44.838 INFO:tasks.workunit.client.1.smithi165.stdout:0/182: write d0/ff [4923379,51916] 0 2024-09-16T02:05:44.840 INFO:tasks.workunit.client.1.smithi165.stdout:7/184: rename d0/d1a to d0/df/d33 0 2024-09-16T02:05:44.842 INFO:tasks.workunit.client.1.smithi165.stdout:1/146: mknod d1/d22/c2a 0 2024-09-16T02:05:44.843 INFO:tasks.workunit.client.1.smithi165.stdout:4/81: read d4/f9 [225397,32423] 0 2024-09-16T02:05:44.844 INFO:tasks.workunit.client.1.smithi165.stdout:6/186: mknod d7/dc/c30 0 2024-09-16T02:05:44.845 INFO:tasks.workunit.client.1.smithi165.stdout:0/183: stat d0/d1e/d20/d28/l41 0 2024-09-16T02:05:44.847 INFO:tasks.workunit.client.1.smithi165.stdout:2/210: symlink df/d23/d2a/l3e 0 2024-09-16T02:05:44.849 INFO:tasks.workunit.client.1.smithi165.stdout:9/179: dread d7/fd [0,4194304] 0 2024-09-16T02:05:44.849 INFO:tasks.workunit.client.1.smithi165.stdout:4/82: readlink d4/dc/l15 0 2024-09-16T02:05:44.849 INFO:tasks.workunit.client.1.smithi165.stdout:2/211: stat l8 0 2024-09-16T02:05:44.852 INFO:tasks.workunit.client.1.smithi165.stdout:1/147: symlink d1/d19/l2b 0 2024-09-16T02:05:44.852 INFO:tasks.workunit.client.1.smithi165.stdout:5/153: dwrite de/f1d [4194304,4194304] 0 2024-09-16T02:05:44.854 INFO:tasks.workunit.client.1.smithi165.stdout:0/184: rename d0/d1e/d34 to d0/d1e/d39/d48 0 2024-09-16T02:05:44.854 INFO:tasks.workunit.client.1.smithi165.stdout:2/212: unlink df/c1d 0 2024-09-16T02:05:44.857 INFO:tasks.workunit.client.1.smithi165.stdout:1/148: fdatasync d1/f9 0 2024-09-16T02:05:44.861 INFO:tasks.workunit.client.1.smithi165.stdout:0/185: chown d0/c19 51597294 1 2024-09-16T02:05:44.861 INFO:tasks.workunit.client.1.smithi165.stdout:1/149: chown d1/dd/f10 1278769545 1 2024-09-16T02:05:44.863 INFO:tasks.workunit.client.1.smithi165.stdout:3/271: sync 2024-09-16T02:05:44.864 INFO:tasks.workunit.client.1.smithi165.stdout:6/187: truncate d7/fd 1364125 0 2024-09-16T02:05:44.866 INFO:tasks.workunit.client.1.smithi165.stdout:9/180: write f2 [2372612,745] 0 2024-09-16T02:05:44.867 INFO:tasks.workunit.client.1.smithi165.stdout:5/154: rename de/c11 to de/c34 0 2024-09-16T02:05:44.867 INFO:tasks.workunit.client.1.smithi165.stdout:2/213: write df/f34 [294286,51412] 0 2024-09-16T02:05:44.869 INFO:tasks.workunit.client.1.smithi165.stdout:0/186: unlink d0/d1e/d39/l3c 0 2024-09-16T02:05:44.869 INFO:tasks.workunit.client.1.smithi165.stdout:8/184: dwrite f6 [0,4194304] 0 2024-09-16T02:05:44.870 INFO:tasks.workunit.client.1.smithi165.stdout:1/150: rename d1/fb to d1/d22/f2c 0 2024-09-16T02:05:44.872 INFO:tasks.workunit.client.1.smithi165.stdout:0/187: write d0/d1e/f24 [819642,11844] 0 2024-09-16T02:05:44.872 INFO:tasks.workunit.client.1.smithi165.stdout:5/155: unlink de/c29 0 2024-09-16T02:05:44.873 INFO:tasks.workunit.client.1.smithi165.stdout:9/181: mkdir d7/d32/d3a 0 2024-09-16T02:05:44.874 INFO:tasks.workunit.client.1.smithi165.stdout:2/214: chown df/d10/d1a/f27 1114766 1 2024-09-16T02:05:44.874 INFO:tasks.workunit.client.1.smithi165.stdout:1/151: chown d1/fc 1 1 2024-09-16T02:05:44.875 INFO:tasks.workunit.client.1.smithi165.stdout:7/185: dwrite d0/f19 [0,4194304] 0 2024-09-16T02:05:44.879 INFO:tasks.workunit.client.1.smithi165.stdout:5/156: write fc [1999839,7064] 0 2024-09-16T02:05:44.883 INFO:tasks.workunit.client.1.smithi165.stdout:1/152: chown d1/d22/l28 6420 1 2024-09-16T02:05:44.884 INFO:tasks.workunit.client.1.smithi165.stdout:7/186: read d0/df/f18 [2589355,63624] 0 2024-09-16T02:05:44.885 INFO:tasks.workunit.client.1.smithi165.stdout:9/182: truncate d7/fa 4889884 0 2024-09-16T02:05:44.886 INFO:tasks.workunit.client.1.smithi165.stdout:4/83: dread d4/dc/f16 [0,4194304] 0 2024-09-16T02:05:44.886 INFO:tasks.workunit.client.1.smithi165.stdout:6/188: dwrite d7/f1e [4194304,4194304] 0 2024-09-16T02:05:44.891 INFO:tasks.workunit.client.1.smithi165.stdout:3/272: getdents da/d17 0 2024-09-16T02:05:44.896 INFO:tasks.workunit.client.1.smithi165.stdout:9/183: chown d7/c33 3300 1 2024-09-16T02:05:44.897 INFO:tasks.workunit.client.1.smithi165.stdout:4/84: symlink d4/l21 0 2024-09-16T02:05:44.898 INFO:tasks.workunit.client.1.smithi165.stdout:7/187: rename d0/df/d33/f32 to d0/df/d33/f34 0 2024-09-16T02:05:44.899 INFO:tasks.workunit.client.1.smithi165.stdout:2/215: dwrite df/d10/d1a/f27 [0,4194304] 0 2024-09-16T02:05:44.900 INFO:tasks.workunit.client.1.smithi165.stdout:4/85: chown d4/l1f 108135 1 2024-09-16T02:05:44.900 INFO:tasks.workunit.client.1.smithi165.stdout:8/185: getdents dd/d11 0 2024-09-16T02:05:44.901 INFO:tasks.workunit.client.1.smithi165.stdout:6/189: creat d7/d17/d28/f31 x:0 0 0 2024-09-16T02:05:44.902 INFO:tasks.workunit.client.1.smithi165.stdout:8/186: stat dd/d11/d38 0 2024-09-16T02:05:44.902 INFO:tasks.workunit.client.1.smithi165.stdout:5/157: dread de/f1d [4194304,4194304] 0 2024-09-16T02:05:44.904 INFO:tasks.workunit.client.1.smithi165.stdout:7/188: mknod d0/df/d33/c35 0 2024-09-16T02:05:44.906 INFO:tasks.workunit.client.1.smithi165.stdout:4/86: chown d4/c10 2 1 2024-09-16T02:05:44.906 INFO:tasks.workunit.client.1.smithi165.stdout:9/184: link d7/df/f1c d7/df/d37/f3b 0 2024-09-16T02:05:44.907 INFO:tasks.workunit.client.1.smithi165.stdout:1/153: dwrite d1/dd/d11/f15 [0,4194304] 0 2024-09-16T02:05:44.908 INFO:tasks.workunit.client.1.smithi165.stdout:6/190: creat d7/d1f/f32 x:0 0 0 2024-09-16T02:05:44.909 INFO:tasks.workunit.client.1.smithi165.stdout:2/216: rmdir df/d10/d37/d36 0 2024-09-16T02:05:44.910 INFO:tasks.workunit.client.1.smithi165.stdout:9/185: chown d7/fa 351852 1 2024-09-16T02:05:44.910 INFO:tasks.workunit.client.1.smithi165.stdout:3/273: dread da/de/f21 [0,4194304] 0 2024-09-16T02:05:44.911 INFO:tasks.workunit.client.1.smithi165.stdout:8/187: write dd/d11/d14/f1e [3067693,119634] 0 2024-09-16T02:05:44.911 INFO:tasks.workunit.client.1.smithi165.stdout:5/158: symlink de/l35 0 2024-09-16T02:05:44.912 INFO:tasks.workunit.client.1.smithi165.stdout:1/154: write d1/fc [620763,110691] 0 2024-09-16T02:05:44.916 INFO:tasks.workunit.client.1.smithi165.stdout:5/159: stat de/d21/l24 0 2024-09-16T02:05:44.916 INFO:tasks.workunit.client.1.smithi165.stdout:2/217: write fa [6131070,102316] 0 2024-09-16T02:05:44.917 INFO:tasks.workunit.client.1.smithi165.stdout:4/87: creat d4/dc/d18/f22 x:0 0 0 2024-09-16T02:05:44.917 INFO:tasks.workunit.client.1.smithi165.stdout:0/188: dwrite d0/d1e/d20/d28/f33 [0,4194304] 0 2024-09-16T02:05:44.918 INFO:tasks.workunit.client.1.smithi165.stdout:8/188: dread - dd/d13/f2c zero size 2024-09-16T02:05:44.919 INFO:tasks.workunit.client.1.smithi165.stdout:1/155: fsync d1/dd/d11/f17 0 2024-09-16T02:05:44.919 INFO:tasks.workunit.client.1.smithi165.stdout:3/274: mknod da/de/d1e/c64 0 2024-09-16T02:05:44.921 INFO:tasks.workunit.client.1.smithi165.stdout:4/88: chown d4/f1b 373815 1 2024-09-16T02:05:44.922 INFO:tasks.workunit.client.1.smithi165.stdout:7/189: getdents d0 0 2024-09-16T02:05:44.923 INFO:tasks.workunit.client.1.smithi165.stdout:2/218: creat df/f3f x:0 0 0 2024-09-16T02:05:44.925 INFO:tasks.workunit.client.1.smithi165.stdout:0/189: creat d0/d1e/d39/f49 x:0 0 0 2024-09-16T02:05:44.926 INFO:tasks.workunit.client.1.smithi165.stdout:1/156: unlink d1/l2 0 2024-09-16T02:05:44.926 INFO:tasks.workunit.client.1.smithi165.stdout:8/189: fdatasync dd/d11/d14/f40 0 2024-09-16T02:05:44.927 INFO:tasks.workunit.client.1.smithi165.stdout:6/191: dread d7/fe [0,4194304] 0 2024-09-16T02:05:44.929 INFO:tasks.workunit.client.1.smithi165.stdout:7/190: write d0/d2c/f2e [105511,113028] 0 2024-09-16T02:05:44.929 INFO:tasks.workunit.client.1.smithi165.stdout:4/89: creat d4/dc/d18/f23 x:0 0 0 2024-09-16T02:05:44.930 INFO:tasks.workunit.client.1.smithi165.stdout:0/190: stat d0/d1e/d39/d48/d45 0 2024-09-16T02:05:44.930 INFO:tasks.workunit.client.1.smithi165.stdout:9/186: dwrite d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:44.931 INFO:tasks.workunit.client.1.smithi165.stdout:2/219: symlink df/d10/d37/l40 0 2024-09-16T02:05:44.931 INFO:tasks.workunit.client.1.smithi165.stdout:6/192: readlink d7/d1f/l26 0 2024-09-16T02:05:44.934 INFO:tasks.workunit.client.1.smithi165.stdout:8/190: creat dd/d11/d38/f45 x:0 0 0 2024-09-16T02:05:44.935 INFO:tasks.workunit.client.1.smithi165.stdout:9/187: unlink d7/l9 0 2024-09-16T02:05:44.936 INFO:tasks.workunit.client.1.smithi165.stdout:0/191: mknod d0/c4a 0 2024-09-16T02:05:44.936 INFO:tasks.workunit.client.1.smithi165.stdout:4/90: truncate d4/fa 28628 0 2024-09-16T02:05:44.940 INFO:tasks.workunit.client.1.smithi165.stdout:6/193: creat d7/d1f/f33 x:0 0 0 2024-09-16T02:05:44.941 INFO:tasks.workunit.client.1.smithi165.stdout:7/191: creat d0/df/d33/d2a/f36 x:0 0 0 2024-09-16T02:05:44.941 INFO:tasks.workunit.client.1.smithi165.stdout:9/188: creat d7/d1f/d27/f3c x:0 0 0 2024-09-16T02:05:44.942 INFO:tasks.workunit.client.1.smithi165.stdout:4/91: chown d4/l21 1891 1 2024-09-16T02:05:44.944 INFO:tasks.workunit.client.1.smithi165.stdout:7/192: rmdir d0 39 2024-09-16T02:05:44.950 INFO:tasks.workunit.client.1.smithi165.stdout:0/192: rename d0/d2a/f35 to d0/d1e/d39/d48/d45/f4b 0 2024-09-16T02:05:44.950 INFO:tasks.workunit.client.1.smithi165.stdout:6/194: write d7/f23 [582337,56832] 0 2024-09-16T02:05:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:44 smithi165 ceph-mon[34621]: pgmap v16: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 19 MiB/s wr, 367 op/s 2024-09-16T02:05:44.952 INFO:tasks.workunit.client.1.smithi165.stdout:5/160: dread de/d19/f33 [0,4194304] 0 2024-09-16T02:05:44.952 INFO:tasks.workunit.client.1.smithi165.stdout:1/157: dwrite d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:44.954 INFO:tasks.workunit.client.1.smithi165.stdout:4/92: write d4/dc/d18/f22 [1008626,117653] 0 2024-09-16T02:05:44.956 INFO:tasks.workunit.client.1.smithi165.stdout:6/195: write d7/fb [113019,130460] 0 2024-09-16T02:05:44.956 INFO:tasks.workunit.client.1.smithi165.stdout:2/220: dwrite df/f34 [0,4194304] 0 2024-09-16T02:05:44.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:44 smithi110 ceph-mon[27634]: pgmap v16: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 19 MiB/s wr, 367 op/s 2024-09-16T02:05:44.957 INFO:tasks.workunit.client.1.smithi165.stdout:1/158: write d1/d22/f20 [671235,29325] 0 2024-09-16T02:05:44.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/93: write d4/fa [833488,126952] 0 2024-09-16T02:05:44.959 INFO:tasks.workunit.client.1.smithi165.stdout:9/189: rename d7/df/c31 to d7/c3d 0 2024-09-16T02:05:44.961 INFO:tasks.workunit.client.1.smithi165.stdout:7/193: creat d0/df/d33/f37 x:0 0 0 2024-09-16T02:05:44.964 INFO:tasks.workunit.client.1.smithi165.stdout:6/196: unlink c5 0 2024-09-16T02:05:44.964 INFO:tasks.workunit.client.1.smithi165.stdout:8/191: write dd/d11/f30 [5150720,123144] 0 2024-09-16T02:05:44.964 INFO:tasks.workunit.client.1.smithi165.stdout:0/193: write d0/f15 [5124180,38445] 0 2024-09-16T02:05:44.966 INFO:tasks.workunit.client.1.smithi165.stdout:6/197: chown d7/d1f/f33 5050 1 2024-09-16T02:05:44.970 INFO:tasks.workunit.client.1.smithi165.stdout:8/192: write dd/d11/f2f [333406,106408] 0 2024-09-16T02:05:44.970 INFO:tasks.workunit.client.1.smithi165.stdout:7/194: symlink d0/df/d33/l38 0 2024-09-16T02:05:44.970 INFO:tasks.workunit.client.1.smithi165.stdout:9/190: creat d7/d1f/d27/f3e x:0 0 0 2024-09-16T02:05:44.974 INFO:tasks.workunit.client.1.smithi165.stdout:9/191: mknod d7/df/c3f 0 2024-09-16T02:05:44.974 INFO:tasks.workunit.client.1.smithi165.stdout:8/193: mknod dd/d34/c46 0 2024-09-16T02:05:44.974 INFO:tasks.workunit.client.1.smithi165.stdout:2/221: write df/f16 [1681786,84755] 0 2024-09-16T02:05:44.975 INFO:tasks.workunit.client.1.smithi165.stdout:1/159: dwrite d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:44.975 INFO:tasks.workunit.client.1.smithi165.stdout:0/194: symlink d0/d1e/l4c 0 2024-09-16T02:05:44.977 INFO:tasks.workunit.client.1.smithi165.stdout:1/160: read d1/dd/f10 [1938113,77216] 0 2024-09-16T02:05:44.979 INFO:tasks.workunit.client.1.smithi165.stdout:1/161: stat d1/fc 0 2024-09-16T02:05:44.980 INFO:tasks.workunit.client.1.smithi165.stdout:2/222: creat df/d23/d2a/f41 x:0 0 0 2024-09-16T02:05:44.981 INFO:tasks.workunit.client.1.smithi165.stdout:0/195: write d0/d1e/d39/d48/d45/f37 [1012190,52267] 0 2024-09-16T02:05:44.983 INFO:tasks.workunit.client.1.smithi165.stdout:1/162: symlink d1/d22/l2d 0 2024-09-16T02:05:44.989 INFO:tasks.workunit.client.1.smithi165.stdout:9/192: dwrite f5 [4194304,4194304] 0 2024-09-16T02:05:44.991 INFO:tasks.workunit.client.1.smithi165.stdout:4/94: write f2 [1581499,17857] 0 2024-09-16T02:05:44.991 INFO:tasks.workunit.client.1.smithi165.stdout:1/163: unlink d1/dd/d11/f17 0 2024-09-16T02:05:44.992 INFO:tasks.workunit.client.1.smithi165.stdout:7/195: truncate d0/df/f18 3504701 0 2024-09-16T02:05:44.995 INFO:tasks.workunit.client.1.smithi165.stdout:2/223: link c6 df/d10/d37/c42 0 2024-09-16T02:05:44.997 INFO:tasks.workunit.client.1.smithi165.stdout:8/194: dwrite dd/d11/d38/f3c [0,4194304] 0 2024-09-16T02:05:45.000 INFO:tasks.workunit.client.1.smithi165.stdout:1/164: read d1/dd/f18 [326814,14569] 0 2024-09-16T02:05:45.002 INFO:tasks.workunit.client.1.smithi165.stdout:7/196: mknod d0/df/d7/c39 0 2024-09-16T02:05:45.003 INFO:tasks.workunit.client.1.smithi165.stdout:2/224: chown df/f16 1522 1 2024-09-16T02:05:45.005 INFO:tasks.workunit.client.1.smithi165.stdout:8/195: write dd/f41 [6383,119975] 0 2024-09-16T02:05:45.007 INFO:tasks.workunit.client.1.smithi165.stdout:7/197: chown d0/df/d33 7637022 1 2024-09-16T02:05:45.007 INFO:tasks.workunit.client.1.smithi165.stdout:6/198: dread f3 [0,4194304] 0 2024-09-16T02:05:45.009 INFO:tasks.workunit.client.1.smithi165.stdout:0/196: dwrite d0/d1e/f24 [0,4194304] 0 2024-09-16T02:05:45.010 INFO:tasks.workunit.client.1.smithi165.stdout:1/165: link d1/dd/f14 d1/dd/f2e 0 2024-09-16T02:05:45.011 INFO:tasks.workunit.client.1.smithi165.stdout:8/196: creat dd/d11/f47 x:0 0 0 2024-09-16T02:05:45.014 INFO:tasks.workunit.client.1.smithi165.stdout:0/197: chown d0/d2a/l3d 1132100958 1 2024-09-16T02:05:45.015 INFO:tasks.workunit.client.1.smithi165.stdout:1/166: chown d1/l21 127848 1 2024-09-16T02:05:45.015 INFO:tasks.workunit.client.1.smithi165.stdout:7/198: truncate d0/f22 1517647 0 2024-09-16T02:05:45.016 INFO:tasks.workunit.client.1.smithi165.stdout:4/95: dwrite d4/f1b [0,4194304] 0 2024-09-16T02:05:45.019 INFO:tasks.workunit.client.1.smithi165.stdout:9/193: dwrite f2 [0,4194304] 0 2024-09-16T02:05:45.020 INFO:tasks.workunit.client.1.smithi165.stdout:8/197: creat dd/d34/f48 x:0 0 0 2024-09-16T02:05:45.021 INFO:tasks.workunit.client.1.smithi165.stdout:1/167: stat d1/dd/l23 0 2024-09-16T02:05:45.023 INFO:tasks.workunit.client.1.smithi165.stdout:4/96: write d4/fb [899404,34216] 0 2024-09-16T02:05:45.027 INFO:tasks.workunit.client.1.smithi165.stdout:2/225: dwrite df/d10/d37/f3d [0,4194304] 0 2024-09-16T02:05:45.028 INFO:tasks.workunit.client.1.smithi165.stdout:9/194: unlink d7/d14/f12 0 2024-09-16T02:05:45.029 INFO:tasks.workunit.client.1.smithi165.stdout:4/97: creat d4/dc/d18/f24 x:0 0 0 2024-09-16T02:05:45.031 INFO:tasks.workunit.client.1.smithi165.stdout:2/226: symlink df/d23/d2a/l43 0 2024-09-16T02:05:45.031 INFO:tasks.workunit.client.1.smithi165.stdout:0/198: dread d0/d1e/f24 [0,4194304] 0 2024-09-16T02:05:45.031 INFO:tasks.workunit.client.1.smithi165.stdout:4/98: chown d4/dc/f16 913 1 2024-09-16T02:05:45.033 INFO:tasks.workunit.client.1.smithi165.stdout:0/199: chown d0/d2a/l3d 232376 1 2024-09-16T02:05:45.033 INFO:tasks.workunit.client.1.smithi165.stdout:4/99: readlink d4/dc/l15 0 2024-09-16T02:05:45.033 INFO:tasks.workunit.client.1.smithi165.stdout:9/195: write d7/d1f/d27/f2d [888898,22107] 0 2024-09-16T02:05:45.035 INFO:tasks.workunit.client.1.smithi165.stdout:2/227: mknod df/d10/d37/c44 0 2024-09-16T02:05:45.036 INFO:tasks.workunit.client.1.smithi165.stdout:1/168: dread d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:45.039 INFO:tasks.workunit.client.1.smithi165.stdout:4/100: mknod d4/dc/c25 0 2024-09-16T02:05:45.040 INFO:tasks.workunit.client.1.smithi165.stdout:4/101: chown d4/dc/c25 481 1 2024-09-16T02:05:45.040 INFO:tasks.workunit.client.1.smithi165.stdout:8/198: rmdir dd/d11/d14 39 2024-09-16T02:05:45.043 INFO:tasks.workunit.client.1.smithi165.stdout:1/169: dread d1/d22/f20 [0,4194304] 0 2024-09-16T02:05:45.043 INFO:tasks.workunit.client.1.smithi165.stdout:9/196: dread d7/df/d37/f3b [0,4194304] 0 2024-09-16T02:05:45.043 INFO:tasks.workunit.client.1.smithi165.stdout:1/170: readlink d1/l21 0 2024-09-16T02:05:45.056 INFO:tasks.workunit.client.1.smithi165.stdout:4/102: dread d4/f9 [0,4194304] 0 2024-09-16T02:05:45.123 INFO:tasks.workunit.client.1.smithi165.stdout:9/197: creat d7/df/f40 x:0 0 0 2024-09-16T02:05:45.123 INFO:tasks.workunit.client.1.smithi165.stdout:1/171: mknod d1/d19/d24/c2f 0 2024-09-16T02:05:45.124 INFO:tasks.workunit.client.1.smithi165.stdout:8/199: symlink dd/d11/d14/d3f/d25/d36/l49 0 2024-09-16T02:05:45.125 INFO:tasks.workunit.client.1.smithi165.stdout:7/199: chown d0/df/f18 53 1 2024-09-16T02:05:45.126 INFO:tasks.workunit.client.1.smithi165.stdout:4/103: creat d4/f26 x:0 0 0 2024-09-16T02:05:45.127 INFO:tasks.workunit.client.1.smithi165.stdout:9/198: mkdir d7/df/d37/d41 0 2024-09-16T02:05:45.128 INFO:tasks.workunit.client.1.smithi165.stdout:1/172: mkdir d1/d19/d24/d30 0 2024-09-16T02:05:45.131 INFO:tasks.workunit.client.1.smithi165.stdout:4/104: creat d4/dc/d20/f27 x:0 0 0 2024-09-16T02:05:45.136 INFO:tasks.workunit.client.1.smithi165.stdout:3/275: sync 2024-09-16T02:05:45.136 INFO:tasks.workunit.client.1.smithi165.stdout:8/200: rename dd/l17 to dd/d11/d38/l4a 0 2024-09-16T02:05:45.137 INFO:tasks.workunit.client.1.smithi165.stdout:9/199: mkdir d7/df/d37/d41/d42 0 2024-09-16T02:05:45.138 INFO:tasks.workunit.client.1.smithi165.stdout:9/200: fsync f4 0 2024-09-16T02:05:45.138 INFO:tasks.workunit.client.1.smithi165.stdout:2/228: dwrite df/d23/d28/f32 [0,4194304] 0 2024-09-16T02:05:45.139 INFO:tasks.workunit.client.1.smithi165.stdout:3/276: stat da/de/d1e/d2c/l3e 0 2024-09-16T02:05:45.139 INFO:tasks.workunit.client.1.smithi165.stdout:4/105: mkdir d4/dc/d28 0 2024-09-16T02:05:45.140 INFO:tasks.workunit.client.1.smithi165.stdout:1/173: dread d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:45.140 INFO:tasks.workunit.client.1.smithi165.stdout:2/229: chown df/d23/d2a/l43 313910946 1 2024-09-16T02:05:45.141 INFO:tasks.workunit.client.1.smithi165.stdout:8/201: write dd/d11/f30 [321552,101214] 0 2024-09-16T02:05:45.142 INFO:tasks.workunit.client.1.smithi165.stdout:9/201: mkdir d7/df/d37/d43 0 2024-09-16T02:05:45.143 INFO:tasks.workunit.client.1.smithi165.stdout:4/106: truncate d4/dc/d18/f1a 1031813 0 2024-09-16T02:05:45.143 INFO:tasks.workunit.client.1.smithi165.stdout:2/230: write df/d10/d37/f3d [1770818,19340] 0 2024-09-16T02:05:45.144 INFO:tasks.workunit.client.1.smithi165.stdout:4/107: truncate f2 3737996 0 2024-09-16T02:05:45.145 INFO:tasks.workunit.client.1.smithi165.stdout:3/277: write da/d20/d26/f2a [703464,120719] 0 2024-09-16T02:05:45.147 INFO:tasks.workunit.client.1.smithi165.stdout:8/202: stat dd/d11/d38/c3a 0 2024-09-16T02:05:45.148 INFO:tasks.workunit.client.1.smithi165.stdout:8/203: stat dd/d13/c1a 0 2024-09-16T02:05:45.149 INFO:tasks.workunit.client.1.smithi165.stdout:2/231: mkdir df/d10/d37/d45 0 2024-09-16T02:05:45.149 INFO:tasks.workunit.client.1.smithi165.stdout:2/232: stat df/d23/d2a/f41 0 2024-09-16T02:05:45.149 INFO:tasks.workunit.client.1.smithi165.stdout:3/278: mknod da/de/c65 0 2024-09-16T02:05:45.153 INFO:tasks.workunit.client.1.smithi165.stdout:9/202: write d7/df/f1c [1150620,117370] 0 2024-09-16T02:05:45.154 INFO:tasks.workunit.client.1.smithi165.stdout:2/233: creat df/d23/d28/f46 x:0 0 0 2024-09-16T02:05:45.157 INFO:tasks.workunit.client.1.smithi165.stdout:4/108: getdents d4/dc/d20 0 2024-09-16T02:05:45.157 INFO:tasks.workunit.client.1.smithi165.stdout:1/174: getdents d1 0 2024-09-16T02:05:45.158 INFO:tasks.workunit.client.1.smithi165.stdout:8/204: dwrite dd/d11/d14/f19 [0,4194304] 0 2024-09-16T02:05:45.159 INFO:tasks.workunit.client.1.smithi165.stdout:4/109: stat d4/dc/f19 0 2024-09-16T02:05:45.161 INFO:tasks.workunit.client.1.smithi165.stdout:1/175: creat d1/d22/f31 x:0 0 0 2024-09-16T02:05:45.163 INFO:tasks.workunit.client.1.smithi165.stdout:4/110: mknod d4/dc/d20/c29 0 2024-09-16T02:05:45.166 INFO:tasks.workunit.client.1.smithi165.stdout:1/176: chown d1/d22/f31 2045 1 2024-09-16T02:05:45.169 INFO:tasks.workunit.client.1.smithi165.stdout:2/234: dwrite df/d23/d28/f46 [0,4194304] 0 2024-09-16T02:05:45.169 INFO:tasks.workunit.client.1.smithi165.stdout:4/111: symlink d4/dc/l2a 0 2024-09-16T02:05:45.169 INFO:tasks.workunit.client.1.smithi165.stdout:1/177: fdatasync d1/dd/d11/f1f 0 2024-09-16T02:05:45.171 INFO:tasks.workunit.client.1.smithi165.stdout:1/178: write d1/d22/f31 [692130,107721] 0 2024-09-16T02:05:45.175 INFO:tasks.workunit.client.1.smithi165.stdout:1/179: chown d1/dd/d11/f1f 0 1 2024-09-16T02:05:45.175 INFO:tasks.workunit.client.1.smithi165.stdout:2/235: mknod df/d10/d37/c47 0 2024-09-16T02:05:45.177 INFO:tasks.workunit.client.1.smithi165.stdout:9/203: dread d7/f22 [0,4194304] 0 2024-09-16T02:05:45.179 INFO:tasks.workunit.client.1.smithi165.stdout:8/205: truncate dd/d11/f30 131341 0 2024-09-16T02:05:45.180 INFO:tasks.workunit.client.1.smithi165.stdout:2/236: write df/d23/d28/f2c [874966,5985] 0 2024-09-16T02:05:45.182 INFO:tasks.workunit.client.1.smithi165.stdout:3/279: dread da/d20/f3b [0,4194304] 0 2024-09-16T02:05:45.182 INFO:tasks.workunit.client.1.smithi165.stdout:4/112: dwrite d4/dc/d20/f27 [0,4194304] 0 2024-09-16T02:05:45.183 INFO:tasks.workunit.client.1.smithi165.stdout:8/206: creat dd/d11/d38/f4b x:0 0 0 2024-09-16T02:05:45.184 INFO:tasks.workunit.client.1.smithi165.stdout:2/237: creat df/d23/f48 x:0 0 0 2024-09-16T02:05:45.185 INFO:tasks.workunit.client.1.smithi165.stdout:3/280: mknod da/d57/c66 0 2024-09-16T02:05:45.186 INFO:tasks.workunit.client.1.smithi165.stdout:1/180: dread d1/dd/d11/f15 [0,4194304] 0 2024-09-16T02:05:45.191 INFO:tasks.workunit.client.1.smithi165.stdout:9/204: rename d7/d1f/c30 to d7/df/d37/d41/d42/c44 0 2024-09-16T02:05:45.192 INFO:tasks.workunit.client.1.smithi165.stdout:4/113: mkdir d4/dc/d28/d2b 0 2024-09-16T02:05:45.193 INFO:tasks.workunit.client.1.smithi165.stdout:2/238: mknod df/d10/d37/c49 0 2024-09-16T02:05:45.194 INFO:tasks.workunit.client.1.smithi165.stdout:8/207: rmdir dd 39 2024-09-16T02:05:45.196 INFO:tasks.workunit.client.1.smithi165.stdout:4/114: symlink d4/dc/l2c 0 2024-09-16T02:05:45.198 INFO:tasks.workunit.client.1.smithi165.stdout:4/115: read - d4/dc/d18/f24 zero size 2024-09-16T02:05:45.201 INFO:tasks.workunit.client.1.smithi165.stdout:2/239: mknod df/d10/d1a/c4a 0 2024-09-16T02:05:45.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/205: creat d7/df/d37/d43/f45 x:0 0 0 2024-09-16T02:05:45.202 INFO:tasks.workunit.client.1.smithi165.stdout:8/208: read - dd/d34/f48 zero size 2024-09-16T02:05:45.203 INFO:tasks.workunit.client.1.smithi165.stdout:3/281: link da/d17/f5b da/f67 0 2024-09-16T02:05:45.203 INFO:tasks.workunit.client.1.smithi165.stdout:9/206: chown d7/df/d37/d43/f45 30662251 1 2024-09-16T02:05:45.205 INFO:tasks.workunit.client.1.smithi165.stdout:8/209: dread - dd/d11/d38/f4b zero size 2024-09-16T02:05:45.205 INFO:tasks.workunit.client.1.smithi165.stdout:2/240: creat df/d10/d1a/d2d/f4b x:0 0 0 2024-09-16T02:05:45.205 INFO:tasks.workunit.client.1.smithi165.stdout:9/207: stat d7/d32/d3a 0 2024-09-16T02:05:45.206 INFO:tasks.workunit.client.1.smithi165.stdout:2/241: fsync df/d23/f48 0 2024-09-16T02:05:45.207 INFO:tasks.workunit.client.1.smithi165.stdout:3/282: rename da/d20/l62 to da/l68 0 2024-09-16T02:05:45.208 INFO:tasks.workunit.client.1.smithi165.stdout:5/161: sync 2024-09-16T02:05:45.208 INFO:tasks.workunit.client.1.smithi165.stdout:6/199: sync 2024-09-16T02:05:45.208 INFO:tasks.workunit.client.1.smithi165.stdout:4/116: dread d4/dc/f16 [0,4194304] 0 2024-09-16T02:05:45.209 INFO:tasks.workunit.client.1.smithi165.stdout:1/181: dread d1/dd/d11/f1f [0,4194304] 0 2024-09-16T02:05:45.210 INFO:tasks.workunit.client.1.smithi165.stdout:3/283: mknod da/d57/c69 0 2024-09-16T02:05:45.211 INFO:tasks.workunit.client.1.smithi165.stdout:5/162: mkdir de/d21/d36 0 2024-09-16T02:05:45.212 INFO:tasks.workunit.client.1.smithi165.stdout:6/200: truncate d7/fb 2004019 0 2024-09-16T02:05:45.213 INFO:tasks.workunit.client.1.smithi165.stdout:4/117: write d4/dc/d18/f24 [131866,50881] 0 2024-09-16T02:05:45.215 INFO:tasks.workunit.client.1.smithi165.stdout:3/284: symlink da/l6a 0 2024-09-16T02:05:45.215 INFO:tasks.workunit.client.1.smithi165.stdout:1/182: read d1/dd/f18 [3193,85990] 0 2024-09-16T02:05:45.217 INFO:tasks.workunit.client.1.smithi165.stdout:4/118: stat d4/dc/fe 0 2024-09-16T02:05:45.218 INFO:tasks.workunit.client.1.smithi165.stdout:1/183: unlink d1/l7 0 2024-09-16T02:05:45.220 INFO:tasks.workunit.client.1.smithi165.stdout:8/210: dwrite dd/d11/d14/f40 [0,4194304] 0 2024-09-16T02:05:45.220 INFO:tasks.workunit.client.1.smithi165.stdout:6/201: getdents d7/d17 0 2024-09-16T02:05:45.220 INFO:tasks.workunit.client.1.smithi165.stdout:4/119: write d4/dc/fe [4098943,106453] 0 2024-09-16T02:05:45.223 INFO:tasks.workunit.client.1.smithi165.stdout:3/285: chown da/d17/d56/f5a 5293 1 2024-09-16T02:05:45.225 INFO:tasks.workunit.client.1.smithi165.stdout:9/208: dread d7/fa [0,4194304] 0 2024-09-16T02:05:45.225 INFO:tasks.workunit.client.1.smithi165.stdout:5/163: getdents de/d19 0 2024-09-16T02:05:45.225 INFO:tasks.workunit.client.1.smithi165.stdout:8/211: chown dd/d11/d14/c33 10343761 1 2024-09-16T02:05:45.226 INFO:tasks.workunit.client.1.smithi165.stdout:6/202: unlink d7/fb 0 2024-09-16T02:05:45.226 INFO:tasks.workunit.client.1.smithi165.stdout:9/209: chown d7/c19 1 1 2024-09-16T02:05:45.227 INFO:tasks.workunit.client.1.smithi165.stdout:2/242: truncate df/d10/d37/f3d 2827645 0 2024-09-16T02:05:45.229 INFO:tasks.workunit.client.1.smithi165.stdout:3/286: mkdir da/d20/d26/d52/d6b 0 2024-09-16T02:05:45.231 INFO:tasks.workunit.client.1.smithi165.stdout:9/210: creat d7/d1f/f46 x:0 0 0 2024-09-16T02:05:45.233 INFO:tasks.workunit.client.1.smithi165.stdout:1/184: dwrite d1/f9 [0,4194304] 0 2024-09-16T02:05:45.234 INFO:tasks.workunit.client.1.smithi165.stdout:4/120: dread d4/f9 [0,4194304] 0 2024-09-16T02:05:45.235 INFO:tasks.workunit.client.1.smithi165.stdout:1/185: chown d1/d22/l2d 7311326 1 2024-09-16T02:05:45.235 INFO:tasks.workunit.client.1.smithi165.stdout:5/164: unlink de/d19/l2b 0 2024-09-16T02:05:45.239 INFO:tasks.workunit.client.1.smithi165.stdout:4/121: write d4/dc/d18/f23 [448785,39305] 0 2024-09-16T02:05:45.239 INFO:tasks.workunit.client.1.smithi165.stdout:9/211: creat d7/d32/f47 x:0 0 0 2024-09-16T02:05:45.240 INFO:tasks.workunit.client.1.smithi165.stdout:1/186: mkdir d1/d32 0 2024-09-16T02:05:45.242 INFO:tasks.workunit.client.1.smithi165.stdout:8/212: rmdir dd/d11/d14/d3f/d25/d36/d43 0 2024-09-16T02:05:45.244 INFO:tasks.workunit.client.1.smithi165.stdout:5/165: fdatasync f7 0 2024-09-16T02:05:45.247 INFO:tasks.workunit.client.1.smithi165.stdout:6/203: getdents d7/dc/df/d1a 0 2024-09-16T02:05:45.247 INFO:tasks.workunit.client.1.smithi165.stdout:1/187: mkdir d1/dd/d11/d33 0 2024-09-16T02:05:45.249 INFO:tasks.workunit.client.1.smithi165.stdout:4/122: rename d4/dc/d18/f1a to d4/dc/d28/d2b/f2d 0 2024-09-16T02:05:45.253 INFO:tasks.workunit.client.1.smithi165.stdout:6/204: mknod d7/d17/d28/c34 0 2024-09-16T02:05:45.253 INFO:tasks.workunit.client.1.smithi165.stdout:2/243: dwrite df/d10/d37/f3d [0,4194304] 0 2024-09-16T02:05:45.254 INFO:tasks.workunit.client.1.smithi165.stdout:5/166: truncate de/d19/f32 9250 0 2024-09-16T02:05:45.257 INFO:tasks.workunit.client.1.smithi165.stdout:4/123: chown d4/dc/d20/c29 0 1 2024-09-16T02:05:45.257 INFO:tasks.workunit.client.1.smithi165.stdout:7/200: sync 2024-09-16T02:05:45.257 INFO:tasks.workunit.client.1.smithi165.stdout:0/200: sync 2024-09-16T02:05:45.260 INFO:tasks.workunit.client.1.smithi165.stdout:6/205: dread - d7/dc/df/d1a/f2d zero size 2024-09-16T02:05:45.262 INFO:tasks.workunit.client.1.smithi165.stdout:2/244: unlink df/d23/d28/f2c 0 2024-09-16T02:05:45.262 INFO:tasks.workunit.client.1.smithi165.stdout:5/167: chown de/d21/d26/l2d 75845 1 2024-09-16T02:05:45.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/212: dwrite d7/f22 [0,4194304] 0 2024-09-16T02:05:45.263 INFO:tasks.workunit.client.1.smithi165.stdout:8/213: dwrite dd/d13/f2c [0,4194304] 0 2024-09-16T02:05:45.263 INFO:tasks.workunit.client.1.smithi165.stdout:0/201: write d0/f23 [1024537,20024] 0 2024-09-16T02:05:45.264 INFO:tasks.workunit.client.1.smithi165.stdout:7/201: symlink d0/df/d7/l3a 0 2024-09-16T02:05:45.270 INFO:tasks.workunit.client.1.smithi165.stdout:8/214: dread - dd/d11/d38/f4b zero size 2024-09-16T02:05:45.272 INFO:tasks.workunit.client.1.smithi165.stdout:3/287: dwrite da/d20/f3d [0,4194304] 0 2024-09-16T02:05:45.273 INFO:tasks.workunit.client.1.smithi165.stdout:0/202: fsync d0/d1e/d39/d48/d45/f37 0 2024-09-16T02:05:45.274 INFO:tasks.workunit.client.1.smithi165.stdout:2/245: mknod df/d23/d28/c4c 0 2024-09-16T02:05:45.275 INFO:tasks.workunit.client.1.smithi165.stdout:7/202: unlink d0/df/d7/f13 0 2024-09-16T02:05:45.277 INFO:tasks.workunit.client.1.smithi165.stdout:8/215: chown dd/le 7 1 2024-09-16T02:05:45.280 INFO:tasks.workunit.client.1.smithi165.stdout:4/124: dread f2 [0,4194304] 0 2024-09-16T02:05:45.280 INFO:tasks.workunit.client.1.smithi165.stdout:1/188: dread d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:45.280 INFO:tasks.workunit.client.1.smithi165.stdout:5/168: rename c2 to de/c37 0 2024-09-16T02:05:45.280 INFO:tasks.workunit.client.1.smithi165.stdout:7/203: stat d0/df/d33/l1f 0 2024-09-16T02:05:45.280 INFO:tasks.workunit.client.1.smithi165.stdout:0/203: mknod d0/d1e/d20/d28/c4d 0 2024-09-16T02:05:45.283 INFO:tasks.workunit.client.1.smithi165.stdout:6/206: dread d7/fe [0,4194304] 0 2024-09-16T02:05:45.285 INFO:tasks.workunit.client.1.smithi165.stdout:7/204: write d0/d2c/f2e [837078,43719] 0 2024-09-16T02:05:45.286 INFO:tasks.workunit.client.1.smithi165.stdout:0/204: rmdir d0 39 2024-09-16T02:05:45.287 INFO:tasks.workunit.client.1.smithi165.stdout:4/125: write d4/fb [529202,46700] 0 2024-09-16T02:05:45.290 INFO:tasks.workunit.client.1.smithi165.stdout:1/189: creat d1/d32/f34 x:0 0 0 2024-09-16T02:05:45.291 INFO:tasks.workunit.client.1.smithi165.stdout:4/126: fsync d4/f1b 0 2024-09-16T02:05:45.292 INFO:tasks.workunit.client.1.smithi165.stdout:2/246: getdents df/d23/d2a 0 2024-09-16T02:05:45.292 INFO:tasks.workunit.client.1.smithi165.stdout:6/207: truncate d7/d17/d28/f31 341135 0 2024-09-16T02:05:45.295 INFO:tasks.workunit.client.1.smithi165.stdout:5/169: getdents de/d21/d26 0 2024-09-16T02:05:45.295 INFO:tasks.workunit.client.1.smithi165.stdout:1/190: chown d1/d19/d24/c2f 2016 1 2024-09-16T02:05:45.296 INFO:tasks.workunit.client.1.smithi165.stdout:8/216: dwrite dd/d11/d14/f40 [4194304,4194304] 0 2024-09-16T02:05:45.296 INFO:tasks.workunit.client.1.smithi165.stdout:2/247: write df/f3f [187485,87768] 0 2024-09-16T02:05:45.297 INFO:tasks.workunit.client.1.smithi165.stdout:4/127: fdatasync d4/dc/d28/d2b/f2d 0 2024-09-16T02:05:45.298 INFO:tasks.workunit.client.1.smithi165.stdout:3/288: dwrite da/d17/d56/f5a [0,4194304] 0 2024-09-16T02:05:45.298 INFO:tasks.workunit.client.1.smithi165.stdout:0/205: creat d0/d1e/d39/d48/f4e x:0 0 0 2024-09-16T02:05:45.301 INFO:tasks.workunit.client.1.smithi165.stdout:9/213: fdatasync d7/f22 0 2024-09-16T02:05:45.302 INFO:tasks.workunit.client.1.smithi165.stdout:4/128: write d4/f26 [608112,69363] 0 2024-09-16T02:05:45.302 INFO:tasks.workunit.client.1.smithi165.stdout:5/170: chown de/d19/f1f 244296 1 2024-09-16T02:05:45.303 INFO:tasks.workunit.client.1.smithi165.stdout:3/289: dread - da/d17/f4a zero size 2024-09-16T02:05:45.303 INFO:tasks.workunit.client.1.smithi165.stdout:0/206: dread - d0/d1e/d39/d48/f4e zero size 2024-09-16T02:05:45.305 INFO:tasks.workunit.client.1.smithi165.stdout:2/248: rename lb to df/l4d 0 2024-09-16T02:05:45.307 INFO:tasks.workunit.client.1.smithi165.stdout:2/249: write df/d23/d28/f46 [1199934,8973] 0 2024-09-16T02:05:45.308 INFO:tasks.workunit.client.1.smithi165.stdout:2/250: write df/d10/d1a/f22 [1022697,1674] 0 2024-09-16T02:05:45.309 INFO:tasks.workunit.client.1.smithi165.stdout:9/214: symlink d7/df/l48 0 2024-09-16T02:05:45.310 INFO:tasks.workunit.client.1.smithi165.stdout:4/129: mknod d4/c2e 0 2024-09-16T02:05:45.311 INFO:tasks.workunit.client.1.smithi165.stdout:6/208: truncate d7/f23 3323962 0 2024-09-16T02:05:45.315 INFO:tasks.workunit.client.1.smithi165.stdout:3/290: rename da/d17/d56 to da/de/d1e/d2c/d2d/d6c 0 2024-09-16T02:05:45.316 INFO:tasks.workunit.client.1.smithi165.stdout:1/191: getdents d1/d19/d24/d30 0 2024-09-16T02:05:45.317 INFO:tasks.workunit.client.1.smithi165.stdout:6/209: fdatasync d7/fe 0 2024-09-16T02:05:45.318 INFO:tasks.workunit.client.1.smithi165.stdout:5/171: mkdir de/d21/d36/d38 0 2024-09-16T02:05:45.318 INFO:tasks.workunit.client.1.smithi165.stdout:1/192: chown d1/dd/d11/f1f 37409 1 2024-09-16T02:05:45.321 INFO:tasks.workunit.client.1.smithi165.stdout:7/205: dwrite d0/d2c/f2e [0,4194304] 0 2024-09-16T02:05:45.323 INFO:tasks.workunit.client.1.smithi165.stdout:9/215: rename d7/d32/d3a to d7/d1f/d27/d49 0 2024-09-16T02:05:45.324 INFO:tasks.workunit.client.1.smithi165.stdout:3/291: write da/de/f21 [4765777,38342] 0 2024-09-16T02:05:45.326 INFO:tasks.workunit.client.1.smithi165.stdout:0/207: write d0/d1e/d39/d48/d45/f4b [204525,66554] 0 2024-09-16T02:05:45.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/217: getdents dd/d11/d14 0 2024-09-16T02:05:45.327 INFO:tasks.workunit.client.1.smithi165.stdout:2/251: truncate df/d10/f13 3711083 0 2024-09-16T02:05:45.328 INFO:tasks.workunit.client.1.smithi165.stdout:2/252: fsync df/f3f 0 2024-09-16T02:05:45.329 INFO:tasks.workunit.client.1.smithi165.stdout:4/130: truncate d4/fb 2842115 0 2024-09-16T02:05:45.330 INFO:tasks.workunit.client.1.smithi165.stdout:2/253: fsync df/f34 0 2024-09-16T02:05:45.330 INFO:tasks.workunit.client.1.smithi165.stdout:4/131: stat d4/dc/d20/f27 0 2024-09-16T02:05:45.330 INFO:tasks.workunit.client.1.smithi165.stdout:7/206: chown d0/df/lc 22884 1 2024-09-16T02:05:45.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/207: read d0/d2c/f2e [2038414,86713] 0 2024-09-16T02:05:45.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/208: chown d0/df/c2d 11294 1 2024-09-16T02:05:45.332 INFO:tasks.workunit.client.1.smithi165.stdout:9/216: mkdir d7/d32/d4a 0 2024-09-16T02:05:45.333 INFO:tasks.workunit.client.1.smithi165.stdout:1/193: mkdir d1/dd/d11/d33/d35 0 2024-09-16T02:05:45.333 INFO:tasks.workunit.client.1.smithi165.stdout:3/292: creat da/d20/d26/d52/f6d x:0 0 0 2024-09-16T02:05:45.333 INFO:tasks.workunit.client.1.smithi165.stdout:8/218: mkdir dd/d13/d4c 0 2024-09-16T02:05:45.334 INFO:tasks.workunit.client.1.smithi165.stdout:0/208: creat d0/d1e/d39/f4f x:0 0 0 2024-09-16T02:05:45.335 INFO:tasks.workunit.client.1.smithi165.stdout:2/254: rmdir df/d10/d1a 39 2024-09-16T02:05:45.337 INFO:tasks.workunit.client.1.smithi165.stdout:6/210: write d7/f23 [4062546,121308] 0 2024-09-16T02:05:45.338 INFO:tasks.workunit.client.1.smithi165.stdout:7/209: creat d0/d2c/f3b x:0 0 0 2024-09-16T02:05:45.338 INFO:tasks.workunit.client.1.smithi165.stdout:9/217: mknod d7/df/c4b 0 2024-09-16T02:05:45.339 INFO:tasks.workunit.client.1.smithi165.stdout:3/293: mkdir da/d20/d26/d6e 0 2024-09-16T02:05:45.341 INFO:tasks.workunit.client.1.smithi165.stdout:8/219: creat dd/d34/f4d x:0 0 0 2024-09-16T02:05:45.346 INFO:tasks.workunit.client.1.smithi165.stdout:5/172: getdents de/d19 0 2024-09-16T02:05:45.346 INFO:tasks.workunit.client.1.smithi165.stdout:0/209: dread d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:45.348 INFO:tasks.workunit.client.1.smithi165.stdout:9/218: fsync d7/d14/f16 0 2024-09-16T02:05:45.350 INFO:tasks.workunit.client.1.smithi165.stdout:6/211: symlink d7/d17/d24/l35 0 2024-09-16T02:05:45.351 INFO:tasks.workunit.client.1.smithi165.stdout:2/255: dwrite df/d23/d2a/f41 [0,4194304] 0 2024-09-16T02:05:45.352 INFO:tasks.workunit.client.1.smithi165.stdout:0/210: write d0/ff [2952038,11589] 0 2024-09-16T02:05:45.354 INFO:tasks.workunit.client.1.smithi165.stdout:8/220: mknod dd/d13/c4e 0 2024-09-16T02:05:45.357 INFO:tasks.workunit.client.1.smithi165.stdout:2/256: chown df/c1f 439 1 2024-09-16T02:05:45.357 INFO:tasks.workunit.client.1.smithi165.stdout:4/132: dread d4/fb [0,4194304] 0 2024-09-16T02:05:45.357 INFO:tasks.workunit.client.1.smithi165.stdout:7/210: dwrite d0/df/f27 [0,4194304] 0 2024-09-16T02:05:45.357 INFO:tasks.workunit.client.1.smithi165.stdout:1/194: rename d1/d22/f31 to d1/dd/f36 0 2024-09-16T02:05:45.359 INFO:tasks.workunit.client.1.smithi165.stdout:3/294: mknod da/d20/d26/d52/d6b/c6f 0 2024-09-16T02:05:45.361 INFO:tasks.workunit.client.1.smithi165.stdout:5/173: dread de/f14 [4194304,4194304] 0 2024-09-16T02:05:45.362 INFO:tasks.workunit.client.1.smithi165.stdout:6/212: rename d7/d17/d24/l2a to d7/d1f/l36 0 2024-09-16T02:05:45.363 INFO:tasks.workunit.client.1.smithi165.stdout:7/211: read d0/df/d7/f23 [674434,73845] 0 2024-09-16T02:05:45.365 INFO:tasks.workunit.client.1.smithi165.stdout:8/221: mkdir dd/d11/d14/d3f/d25/d36/d4f 0 2024-09-16T02:05:45.365 INFO:tasks.workunit.client.1.smithi165.stdout:9/219: truncate d7/d14/f16 1922704 0 2024-09-16T02:05:45.366 INFO:tasks.workunit.client.1.smithi165.stdout:7/212: dread - d0/df/d33/f34 zero size 2024-09-16T02:05:45.367 INFO:tasks.workunit.client.1.smithi165.stdout:3/295: fdatasync da/de/f24 0 2024-09-16T02:05:45.368 INFO:tasks.workunit.client.1.smithi165.stdout:8/222: chown dd/l1b 11 1 2024-09-16T02:05:45.368 INFO:tasks.workunit.client.1.smithi165.stdout:9/220: readlink d7/l2f 0 2024-09-16T02:05:45.372 INFO:tasks.workunit.client.1.smithi165.stdout:6/213: mknod d7/c37 0 2024-09-16T02:05:45.373 INFO:tasks.workunit.client.1.smithi165.stdout:1/195: creat d1/dd/f37 x:0 0 0 2024-09-16T02:05:45.374 INFO:tasks.workunit.client.1.smithi165.stdout:9/221: creat d7/df/d37/d41/f4c x:0 0 0 2024-09-16T02:05:45.374 INFO:tasks.workunit.client.1.smithi165.stdout:4/133: dwrite d4/dc/d20/f27 [0,4194304] 0 2024-09-16T02:05:45.375 INFO:tasks.workunit.client.1.smithi165.stdout:8/223: unlink dd/d11/f2f 0 2024-09-16T02:05:45.376 INFO:tasks.workunit.client.1.smithi165.stdout:7/213: dread d0/df/f27 [0,4194304] 0 2024-09-16T02:05:45.378 INFO:tasks.workunit.client.1.smithi165.stdout:8/224: read dd/d11/d14/f40 [6719091,3379] 0 2024-09-16T02:05:45.379 INFO:tasks.workunit.client.1.smithi165.stdout:4/134: mknod d4/dc/d18/c2f 0 2024-09-16T02:05:45.379 INFO:tasks.workunit.client.1.smithi165.stdout:7/214: chown d0/df/d7/f23 1926246 1 2024-09-16T02:05:45.379 INFO:tasks.workunit.client.1.smithi165.stdout:9/222: creat d7/d32/d4a/f4d x:0 0 0 2024-09-16T02:05:45.380 INFO:tasks.workunit.client.1.smithi165.stdout:8/225: chown dd/d11/d14/d3f/d25/d36 7439 1 2024-09-16T02:05:45.381 INFO:tasks.workunit.client.1.smithi165.stdout:6/214: dread d7/fe [0,4194304] 0 2024-09-16T02:05:45.382 INFO:tasks.workunit.client.1.smithi165.stdout:4/135: write d4/f9 [3148797,44880] 0 2024-09-16T02:05:45.383 INFO:tasks.workunit.client.1.smithi165.stdout:3/296: dread da/de/d1e/f34 [0,4194304] 0 2024-09-16T02:05:45.384 INFO:tasks.workunit.client.1.smithi165.stdout:7/215: chown d0/df/d7/l9 465859 1 2024-09-16T02:05:45.386 INFO:tasks.workunit.client.1.smithi165.stdout:1/196: dread d1/dd/f36 [0,4194304] 0 2024-09-16T02:05:45.386 INFO:tasks.workunit.client.1.smithi165.stdout:4/136: mkdir d4/dc/d28/d30 0 2024-09-16T02:05:45.386 INFO:tasks.workunit.client.1.smithi165.stdout:7/216: chown d0/df/d33/f34 8554549 1 2024-09-16T02:05:45.387 INFO:tasks.workunit.client.1.smithi165.stdout:8/226: symlink dd/l50 0 2024-09-16T02:05:45.388 INFO:tasks.workunit.client.1.smithi165.stdout:3/297: creat da/de/d1e/d2c/f70 x:0 0 0 2024-09-16T02:05:45.389 INFO:tasks.workunit.client.1.smithi165.stdout:4/137: write f2 [1865699,87543] 0 2024-09-16T02:05:45.390 INFO:tasks.workunit.client.1.smithi165.stdout:4/138: fdatasync d4/fa 0 2024-09-16T02:05:45.391 INFO:tasks.workunit.client.1.smithi165.stdout:6/215: dread d7/f9 [0,4194304] 0 2024-09-16T02:05:45.392 INFO:tasks.workunit.client.1.smithi165.stdout:2/257: truncate df/f16 2002415 0 2024-09-16T02:05:45.394 INFO:tasks.workunit.client.1.smithi165.stdout:7/217: unlink d0/c25 0 2024-09-16T02:05:45.398 INFO:tasks.workunit.client.1.smithi165.stdout:5/174: truncate fc 2175202 0 2024-09-16T02:05:45.399 INFO:tasks.workunit.client.1.smithi165.stdout:4/139: mkdir d4/dc/d28/d30/d31 0 2024-09-16T02:05:45.401 INFO:tasks.workunit.client.1.smithi165.stdout:7/218: rmdir d0/df/d33/d2a 39 2024-09-16T02:05:45.401 INFO:tasks.workunit.client.1.smithi165.stdout:5/175: chown de/d19/l1a 90965 1 2024-09-16T02:05:45.401 INFO:tasks.workunit.client.1.smithi165.stdout:3/298: dwrite da/d20/d26/d52/f6d [0,4194304] 0 2024-09-16T02:05:45.402 INFO:tasks.workunit.client.1.smithi165.stdout:2/258: creat df/d10/d1a/d2d/f4e x:0 0 0 2024-09-16T02:05:45.402 INFO:tasks.workunit.client.1.smithi165.stdout:1/197: dwrite d1/dd/d11/f15 [4194304,4194304] 0 2024-09-16T02:05:45.403 INFO:tasks.workunit.client.1.smithi165.stdout:9/223: rmdir d7/d32 39 2024-09-16T02:05:45.412 INFO:tasks.workunit.client.1.smithi165.stdout:6/216: rename d7/dc/df/l1d to d7/l38 0 2024-09-16T02:05:45.412 INFO:tasks.workunit.client.1.smithi165.stdout:3/299: rmdir da/de/d1e/d2c 39 2024-09-16T02:05:45.412 INFO:tasks.workunit.client.1.smithi165.stdout:7/219: symlink d0/df/d33/l3c 0 2024-09-16T02:05:45.413 INFO:tasks.workunit.client.1.smithi165.stdout:9/224: write d7/d14/f24 [3074673,53068] 0 2024-09-16T02:05:45.414 INFO:tasks.workunit.client.1.smithi165.stdout:4/140: dread d4/f9 [0,4194304] 0 2024-09-16T02:05:45.416 INFO:tasks.workunit.client.1.smithi165.stdout:3/300: creat da/de/f71 x:0 0 0 2024-09-16T02:05:45.417 INFO:tasks.workunit.client.1.smithi165.stdout:6/217: unlink d7/dc/df/f19 0 2024-09-16T02:05:45.418 INFO:tasks.workunit.client.1.smithi165.stdout:4/141: mknod d4/dc/d28/d2b/c32 0 2024-09-16T02:05:45.420 INFO:tasks.workunit.client.1.smithi165.stdout:6/218: chown d7/fe 2597 1 2024-09-16T02:05:45.421 INFO:tasks.workunit.client.1.smithi165.stdout:8/227: dwrite dd/d11/f30 [0,4194304] 0 2024-09-16T02:05:45.421 INFO:tasks.workunit.client.1.smithi165.stdout:9/225: creat d7/d1d/f4e x:0 0 0 2024-09-16T02:05:45.421 INFO:tasks.workunit.client.1.smithi165.stdout:4/142: write d4/f1b [803755,70525] 0 2024-09-16T02:05:45.421 INFO:tasks.workunit.client.1.smithi165.stdout:5/176: link c0 de/d21/d26/c39 0 2024-09-16T02:05:45.423 INFO:tasks.workunit.client.1.smithi165.stdout:5/177: fsync de/f18 0 2024-09-16T02:05:45.424 INFO:tasks.workunit.client.1.smithi165.stdout:9/226: rmdir d7/d32 39 2024-09-16T02:05:45.427 INFO:tasks.workunit.client.1.smithi165.stdout:5/178: write de/d19/f2e [579152,69119] 0 2024-09-16T02:05:45.431 INFO:tasks.workunit.client.1.smithi165.stdout:4/143: truncate d4/fa 861328 0 2024-09-16T02:05:45.431 INFO:tasks.workunit.client.0.smithi110.stdout:3/3: sync 2024-09-16T02:05:45.431 INFO:tasks.workunit.client.0.smithi110.stdout:3/4: stat - no entries 2024-09-16T02:05:45.431 INFO:tasks.workunit.client.0.smithi110.stdout:3/5: fdatasync - no filename 2024-09-16T02:05:45.431 INFO:tasks.workunit.client.0.smithi110.stdout:3/6: stat - no entries 2024-09-16T02:05:45.432 INFO:tasks.workunit.client.0.smithi110.stdout:3/7: unlink - no file 2024-09-16T02:05:45.432 INFO:tasks.workunit.client.0.smithi110.stdout:0/0: sync 2024-09-16T02:05:45.432 INFO:tasks.workunit.client.0.smithi110.stdout:0/1: chown . 2180 1 2024-09-16T02:05:45.432 INFO:tasks.workunit.client.0.smithi110.stdout:0/2: rename - no filename 2024-09-16T02:05:45.432 INFO:tasks.workunit.client.0.smithi110.stdout:9/3: sync 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:1/19: sync 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/2: sync 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/3: stat - no entries 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/4: truncate - no filename 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/5: unlink - no file 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/6: rmdir - no directory 2024-09-16T02:05:45.433 INFO:tasks.workunit.client.0.smithi110.stdout:1/20: chown d0/d2 172849913 1 2024-09-16T02:05:45.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/21: write - no filename 2024-09-16T02:05:45.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/22: fsync - no filename 2024-09-16T02:05:45.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/23: dread - no filename 2024-09-16T02:05:45.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/24: stat d0/d1 0 2024-09-16T02:05:45.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/25: chown d0/d1 3441 1 2024-09-16T02:05:45.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/26: chown d0/d2 2414 1 2024-09-16T02:05:45.435 INFO:tasks.workunit.client.0.smithi110.stdout:1/27: dwrite - no filename 2024-09-16T02:05:45.435 INFO:tasks.workunit.client.1.smithi165.stdout:5/179: mkdir de/d21/d26/d3a 0 2024-09-16T02:05:45.435 INFO:tasks.workunit.client.1.smithi165.stdout:8/228: dwrite dd/ff [4194304,4194304] 0 2024-09-16T02:05:45.436 INFO:tasks.workunit.client.1.smithi165.stdout:5/180: stat de/f18 0 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:3/8: mknod c0 0 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:3/9: chown c0 785885532 1 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:3/10: truncate - no filename 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:3/11: dwrite - no filename 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:3/12: dwrite - no filename 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:3/13: chown c0 129426 1 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:0/3: symlink l0 0 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:0/4: dread - no filename 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:0/5: write - no filename 2024-09-16T02:05:45.438 INFO:tasks.workunit.client.0.smithi110.stdout:0/6: dwrite - no filename 2024-09-16T02:05:45.439 INFO:tasks.workunit.client.0.smithi110.stdout:0/7: chown l0 916311 1 2024-09-16T02:05:45.439 INFO:tasks.workunit.client.0.smithi110.stdout:0/8: dwrite - no filename 2024-09-16T02:05:45.439 INFO:tasks.workunit.client.0.smithi110.stdout:5/7: creat f0 x:0 0 0 2024-09-16T02:05:45.439 INFO:tasks.workunit.client.0.smithi110.stdout:5/8: readlink - no filename 2024-09-16T02:05:45.440 INFO:tasks.workunit.client.1.smithi165.stdout:8/229: chown dd/d34/f48 11012 1 2024-09-16T02:05:45.440 INFO:tasks.workunit.client.0.smithi110.stdout:9/4: creat f0 x:0 0 0 2024-09-16T02:05:45.441 INFO:tasks.workunit.client.1.smithi165.stdout:3/301: dread da/de/f24 [0,4194304] 0 2024-09-16T02:05:45.442 INFO:tasks.workunit.client.0.smithi110.stdout:1/28: symlink d0/d2/l3 0 2024-09-16T02:05:45.443 INFO:tasks.workunit.client.1.smithi165.stdout:2/259: dwrite df/d10/d1a/f27 [4194304,4194304] 0 2024-09-16T02:05:45.447 INFO:tasks.workunit.client.1.smithi165.stdout:5/181: dread de/d19/f1f [0,4194304] 0 2024-09-16T02:05:45.447 INFO:tasks.workunit.client.0.smithi110.stdout:3/14: creat f1 x:0 0 0 2024-09-16T02:05:45.449 INFO:tasks.workunit.client.1.smithi165.stdout:7/220: dwrite d0/df/f18 [4194304,4194304] 0 2024-09-16T02:05:45.449 INFO:tasks.workunit.client.1.smithi165.stdout:4/144: dwrite f1 [0,4194304] 0 2024-09-16T02:05:45.450 INFO:tasks.workunit.client.0.smithi110.stdout:0/9: mknod c1 0 2024-09-16T02:05:45.450 INFO:tasks.workunit.client.0.smithi110.stdout:0/10: dwrite - no filename 2024-09-16T02:05:45.450 INFO:tasks.workunit.client.0.smithi110.stdout:3/15: write f1 [713104,28363] 0 2024-09-16T02:05:45.451 INFO:tasks.workunit.client.0.smithi110.stdout:9/5: dwrite f0 [0,4194304] 0 2024-09-16T02:05:45.452 INFO:tasks.workunit.client.0.smithi110.stdout:5/9: creat f1 x:0 0 0 2024-09-16T02:05:45.452 INFO:tasks.workunit.client.0.smithi110.stdout:5/10: rmdir - no directory 2024-09-16T02:05:45.453 INFO:tasks.workunit.client.1.smithi165.stdout:9/227: getdents d7/d1d 0 2024-09-16T02:05:45.454 INFO:tasks.workunit.client.1.smithi165.stdout:9/228: read d7/df/f25 [1397995,33708] 0 2024-09-16T02:05:45.455 INFO:tasks.workunit.client.1.smithi165.stdout:8/230: write dd/d13/f21 [345839,14492] 0 2024-09-16T02:05:45.458 INFO:tasks.workunit.client.1.smithi165.stdout:3/302: chown da/d20/d26/l42 12653 1 2024-09-16T02:05:45.463 INFO:tasks.workunit.client.0.smithi110.stdout:0/11: rename c1 to c2 0 2024-09-16T02:05:45.464 INFO:tasks.workunit.client.1.smithi165.stdout:2/260: readlink df/l4d 0 2024-09-16T02:05:45.465 INFO:tasks.workunit.client.0.smithi110.stdout:3/16: creat f2 x:0 0 0 2024-09-16T02:05:45.465 INFO:tasks.workunit.client.1.smithi165.stdout:2/261: truncate df/d10/d1a/d2d/f4e 1019755 0 2024-09-16T02:05:45.466 INFO:tasks.workunit.client.0.smithi110.stdout:3/17: write f2 [998423,59480] 0 2024-09-16T02:05:45.467 INFO:tasks.workunit.client.0.smithi110.stdout:3/18: write f1 [1522025,4285] 0 2024-09-16T02:05:45.468 INFO:tasks.workunit.client.0.smithi110.stdout:9/6: mkdir d1 0 2024-09-16T02:05:45.468 INFO:tasks.workunit.client.0.smithi110.stdout:9/7: chown d1 1 1 2024-09-16T02:05:45.469 INFO:tasks.workunit.client.1.smithi165.stdout:4/145: mknod d4/dc/d28/d30/c33 0 2024-09-16T02:05:45.471 INFO:tasks.workunit.client.1.smithi165.stdout:7/221: unlink d0/df/d7/f14 0 2024-09-16T02:05:45.473 INFO:tasks.workunit.client.0.smithi110.stdout:1/29: rename d0/d2 to d0/d1/d4 0 2024-09-16T02:05:45.473 INFO:tasks.workunit.client.0.smithi110.stdout:1/30: dwrite - no filename 2024-09-16T02:05:45.473 INFO:tasks.workunit.client.1.smithi165.stdout:5/182: dwrite de/d19/f25 [0,4194304] 0 2024-09-16T02:05:45.474 INFO:tasks.workunit.client.0.smithi110.stdout:1/31: chown d0/d1/d4/l3 33835434 1 2024-09-16T02:05:45.474 INFO:tasks.workunit.client.0.smithi110.stdout:1/32: stat d0/d1/d4/l3 0 2024-09-16T02:05:45.474 INFO:tasks.workunit.client.0.smithi110.stdout:1/33: rename d0/d1/d4 to d0/d1/d4/d5 22 2024-09-16T02:05:45.475 INFO:tasks.workunit.client.0.smithi110.stdout:1/34: read - no filename 2024-09-16T02:05:45.475 INFO:tasks.workunit.client.0.smithi110.stdout:0/12: mkdir d3 0 2024-09-16T02:05:45.475 INFO:tasks.workunit.client.0.smithi110.stdout:0/13: dread - no filename 2024-09-16T02:05:45.475 INFO:tasks.workunit.client.0.smithi110.stdout:0/14: dread - no filename 2024-09-16T02:05:45.475 INFO:tasks.workunit.client.0.smithi110.stdout:0/15: dwrite - no filename 2024-09-16T02:05:45.478 INFO:tasks.workunit.client.1.smithi165.stdout:9/229: mkdir d7/d14/d4f 0 2024-09-16T02:05:45.478 INFO:tasks.workunit.client.0.smithi110.stdout:3/19: creat f3 x:0 0 0 2024-09-16T02:05:45.479 INFO:tasks.workunit.client.0.smithi110.stdout:3/20: dread - f3 zero size 2024-09-16T02:05:45.481 INFO:tasks.workunit.client.0.smithi110.stdout:5/11: link f0 f2 0 2024-09-16T02:05:45.481 INFO:tasks.workunit.client.0.smithi110.stdout:5/12: chown f2 234 1 2024-09-16T02:05:45.482 INFO:tasks.workunit.client.1.smithi165.stdout:2/262: creat df/f4f x:0 0 0 2024-09-16T02:05:45.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/35: creat d0/f6 x:0 0 0 2024-09-16T02:05:45.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/36: dread - d0/f6 zero size 2024-09-16T02:05:45.485 INFO:tasks.workunit.client.1.smithi165.stdout:4/146: creat d4/dc/d18/f34 x:0 0 0 2024-09-16T02:05:45.486 INFO:tasks.workunit.client.0.smithi110.stdout:9/8: mknod d1/c2 0 2024-09-16T02:05:45.486 INFO:tasks.workunit.client.1.smithi165.stdout:4/147: write d4/dc/d20/f27 [3907563,76189] 0 2024-09-16T02:05:45.487 INFO:tasks.workunit.client.1.smithi165.stdout:7/222: write d0/f12 [5847158,65604] 0 2024-09-16T02:05:45.490 INFO:tasks.workunit.client.0.smithi110.stdout:5/13: mknod c3 0 2024-09-16T02:05:45.493 INFO:tasks.workunit.client.0.smithi110.stdout:0/16: mkdir d3/d4 0 2024-09-16T02:05:45.493 INFO:tasks.workunit.client.0.smithi110.stdout:1/37: mknod d0/c7 0 2024-09-16T02:05:45.494 INFO:tasks.workunit.client.1.smithi165.stdout:8/231: mknod dd/d13/d4c/c51 0 2024-09-16T02:05:45.495 INFO:tasks.workunit.client.0.smithi110.stdout:9/9: creat d1/f3 x:0 0 0 2024-09-16T02:05:45.495 INFO:tasks.workunit.client.0.smithi110.stdout:9/10: readlink - no filename 2024-09-16T02:05:45.497 INFO:tasks.workunit.client.0.smithi110.stdout:9/11: chown d1/c2 3369287 1 2024-09-16T02:05:45.497 INFO:tasks.workunit.client.0.smithi110.stdout:5/14: dwrite f1 [0,4194304] 0 2024-09-16T02:05:45.497 INFO:tasks.workunit.client.0.smithi110.stdout:9/12: chown d1 196936 1 2024-09-16T02:05:45.497 INFO:tasks.workunit.client.0.smithi110.stdout:3/21: link f1 f4 0 2024-09-16T02:05:45.498 INFO:tasks.workunit.client.1.smithi165.stdout:2/263: chown cd 1959 1 2024-09-16T02:05:45.498 INFO:tasks.workunit.client.0.smithi110.stdout:3/22: chown f1 67736801 1 2024-09-16T02:05:45.499 INFO:tasks.workunit.client.0.smithi110.stdout:0/17: stat c2 0 2024-09-16T02:05:45.499 INFO:tasks.workunit.client.0.smithi110.stdout:0/18: chown c2 1120078 1 2024-09-16T02:05:45.500 INFO:tasks.workunit.client.0.smithi110.stdout:0/19: chown d3/d4 45 1 2024-09-16T02:05:45.500 INFO:tasks.workunit.client.0.smithi110.stdout:0/20: write - no filename 2024-09-16T02:05:45.502 INFO:tasks.workunit.client.0.smithi110.stdout:7/15: sync 2024-09-16T02:05:45.502 INFO:tasks.workunit.client.0.smithi110.stdout:8/27: sync 2024-09-16T02:05:45.502 INFO:tasks.workunit.client.0.smithi110.stdout:6/60: sync 2024-09-16T02:05:45.502 INFO:tasks.workunit.client.0.smithi110.stdout:2/23: sync 2024-09-16T02:05:45.502 INFO:tasks.workunit.client.0.smithi110.stdout:4/10: sync 2024-09-16T02:05:45.503 INFO:tasks.workunit.client.1.smithi165.stdout:4/148: unlink d4/l21 0 2024-09-16T02:05:45.503 INFO:tasks.workunit.client.0.smithi110.stdout:7/16: rename d3 to d3/d5 22 2024-09-16T02:05:45.504 INFO:tasks.workunit.client.0.smithi110.stdout:2/24: read d0/f3 [3610331,67737] 0 2024-09-16T02:05:45.506 INFO:tasks.workunit.client.0.smithi110.stdout:5/15: unlink f1 0 2024-09-16T02:05:45.507 INFO:tasks.workunit.client.1.smithi165.stdout:5/183: write f7 [220258,62977] 0 2024-09-16T02:05:45.508 INFO:tasks.workunit.client.0.smithi110.stdout:3/23: dwrite f2 [0,4194304] 0 2024-09-16T02:05:45.508 INFO:tasks.workunit.client.0.smithi110.stdout:3/24: dread - f3 zero size 2024-09-16T02:05:45.509 INFO:tasks.workunit.client.0.smithi110.stdout:3/25: fdatasync f3 0 2024-09-16T02:05:45.509 INFO:tasks.workunit.client.0.smithi110.stdout:3/26: rmdir - no directory 2024-09-16T02:05:45.510 INFO:tasks.workunit.client.0.smithi110.stdout:3/27: dread - f3 zero size 2024-09-16T02:05:45.510 INFO:tasks.workunit.client.0.smithi110.stdout:1/38: rmdir d0 39 2024-09-16T02:05:45.511 INFO:tasks.workunit.client.1.smithi165.stdout:8/232: symlink dd/d11/d14/l52 0 2024-09-16T02:05:45.515 INFO:tasks.workunit.client.1.smithi165.stdout:3/303: rename da/de/d1e to da/d72 0 2024-09-16T02:05:45.516 INFO:tasks.workunit.client.1.smithi165.stdout:3/304: dread - da/d17/f5b zero size 2024-09-16T02:05:45.517 INFO:tasks.workunit.client.1.smithi165.stdout:2/264: creat df/d23/f50 x:0 0 0 2024-09-16T02:05:45.518 INFO:tasks.workunit.client.1.smithi165.stdout:4/149: mknod d4/dc/d28/d30/c35 0 2024-09-16T02:05:45.519 INFO:tasks.workunit.client.1.smithi165.stdout:4/150: chown f1 7715334 1 2024-09-16T02:05:45.520 INFO:tasks.workunit.client.0.smithi110.stdout:8/28: creat d3/f6 x:0 0 0 2024-09-16T02:05:45.521 INFO:tasks.workunit.client.0.smithi110.stdout:8/29: write d3/f6 [557667,45557] 0 2024-09-16T02:05:45.523 INFO:tasks.workunit.client.0.smithi110.stdout:6/61: rmdir d0/d2 39 2024-09-16T02:05:45.525 INFO:tasks.workunit.client.0.smithi110.stdout:8/30: dread d3/f6 [0,4194304] 0 2024-09-16T02:05:45.525 INFO:tasks.workunit.client.0.smithi110.stdout:7/17: unlink f0 0 2024-09-16T02:05:45.528 INFO:tasks.workunit.client.1.smithi165.stdout:8/233: mkdir dd/d13/d53 0 2024-09-16T02:05:45.528 INFO:tasks.workunit.client.1.smithi165.stdout:8/234: dread - dd/d34/f4d zero size 2024-09-16T02:05:45.529 INFO:tasks.workunit.client.1.smithi165.stdout:9/230: rename d7/df/f25 to d7/d1f/d27/d49/f50 0 2024-09-16T02:05:45.530 INFO:tasks.workunit.client.1.smithi165.stdout:8/235: read dd/d11/d38/f39 [3317095,7532] 0 2024-09-16T02:05:45.530 INFO:tasks.workunit.client.1.smithi165.stdout:7/223: truncate d0/df/f18 3737767 0 2024-09-16T02:05:45.530 INFO:tasks.workunit.client.1.smithi165.stdout:8/236: dread - dd/d11/f47 zero size 2024-09-16T02:05:45.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/16: rename f2 to f4 0 2024-09-16T02:05:45.532 INFO:tasks.workunit.client.0.smithi110.stdout:9/13: link d1/f3 d1/f4 0 2024-09-16T02:05:45.532 INFO:tasks.workunit.client.0.smithi110.stdout:9/14: fdatasync f0 0 2024-09-16T02:05:45.533 INFO:tasks.workunit.client.1.smithi165.stdout:0/211: sync 2024-09-16T02:05:45.533 INFO:tasks.workunit.client.0.smithi110.stdout:9/15: chown d1/f4 199988385 1 2024-09-16T02:05:45.534 INFO:tasks.workunit.client.1.smithi165.stdout:3/305: write da/d72/f34 [718400,62931] 0 2024-09-16T02:05:45.534 INFO:tasks.workunit.client.1.smithi165.stdout:2/265: creat df/d23/f51 x:0 0 0 2024-09-16T02:05:45.535 INFO:tasks.workunit.client.0.smithi110.stdout:0/21: creat d3/d4/f5 x:0 0 0 2024-09-16T02:05:45.537 INFO:tasks.workunit.client.1.smithi165.stdout:4/151: rename d4/l1f to d4/l36 0 2024-09-16T02:05:45.539 INFO:tasks.workunit.client.0.smithi110.stdout:4/11: symlink d4/l5 0 2024-09-16T02:05:45.543 INFO:tasks.workunit.client.0.smithi110.stdout:0/22: dwrite d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.547 INFO:tasks.workunit.client.0.smithi110.stdout:0/23: dread d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.548 INFO:tasks.workunit.client.1.smithi165.stdout:9/231: rename d7/df/l11 to d7/df/l51 0 2024-09-16T02:05:45.550 INFO:tasks.workunit.client.0.smithi110.stdout:8/31: symlink d3/l7 0 2024-09-16T02:05:45.551 INFO:tasks.workunit.client.1.smithi165.stdout:8/237: creat dd/d11/d14/f54 x:0 0 0 2024-09-16T02:05:45.552 INFO:tasks.workunit.client.0.smithi110.stdout:7/18: rename d3/c4 to d3/c6 0 2024-09-16T02:05:45.554 INFO:tasks.workunit.client.1.smithi165.stdout:4/152: mkdir d4/dc/d18/d37 0 2024-09-16T02:05:45.554 INFO:tasks.workunit.client.1.smithi165.stdout:9/232: dwrite d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:45.555 INFO:tasks.workunit.client.1.smithi165.stdout:5/184: rmdir de/d19/d2f 0 2024-09-16T02:05:45.556 INFO:tasks.workunit.client.0.smithi110.stdout:5/17: mkdir d5 0 2024-09-16T02:05:45.557 INFO:tasks.workunit.client.1.smithi165.stdout:7/224: mkdir d0/d3d 0 2024-09-16T02:05:45.560 INFO:tasks.workunit.client.0.smithi110.stdout:9/16: mkdir d1/d5 0 2024-09-16T02:05:45.561 INFO:tasks.workunit.client.0.smithi110.stdout:1/39: mkdir d0/d1/d8 0 2024-09-16T02:05:45.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/28: truncate f4 1013428 0 2024-09-16T02:05:45.563 INFO:tasks.workunit.client.1.smithi165.stdout:9/233: stat d7/d1f/c26 0 2024-09-16T02:05:45.564 INFO:tasks.workunit.client.1.smithi165.stdout:9/234: stat d7/fa 0 2024-09-16T02:05:45.564 INFO:tasks.workunit.client.1.smithi165.stdout:9/235: dread - d7/d1f/d27/f3c zero size 2024-09-16T02:05:45.564 INFO:tasks.workunit.client.1.smithi165.stdout:9/236: chown d7/d14 0 1 2024-09-16T02:05:45.565 INFO:tasks.workunit.client.1.smithi165.stdout:5/185: mknod de/d19/c3b 0 2024-09-16T02:05:45.566 INFO:tasks.workunit.client.1.smithi165.stdout:5/186: dread de/d19/f32 [0,4194304] 0 2024-09-16T02:05:45.567 INFO:tasks.workunit.client.0.smithi110.stdout:6/62: unlink d0/d2/f7 0 2024-09-16T02:05:45.568 INFO:tasks.workunit.client.1.smithi165.stdout:2/266: link df/d10/d37/l40 df/d23/d28/d3b/l52 0 2024-09-16T02:05:45.568 INFO:tasks.workunit.client.0.smithi110.stdout:1/40: dwrite d0/f6 [0,4194304] 0 2024-09-16T02:05:45.569 INFO:tasks.workunit.client.0.smithi110.stdout:0/24: mkdir d3/d6 0 2024-09-16T02:05:45.569 INFO:tasks.workunit.client.0.smithi110.stdout:0/25: chown d3 2 1 2024-09-16T02:05:45.569 INFO:tasks.workunit.client.1.smithi165.stdout:4/153: truncate d4/fa 1062619 0 2024-09-16T02:05:45.570 INFO:tasks.workunit.client.0.smithi110.stdout:6/63: write d0/d2/d5/fa [1293774,66708] 0 2024-09-16T02:05:45.570 INFO:tasks.workunit.client.1.smithi165.stdout:9/237: dwrite d7/d1f/f2a [0,4194304] 0 2024-09-16T02:05:45.571 INFO:tasks.workunit.client.0.smithi110.stdout:8/32: unlink d3/f6 0 2024-09-16T02:05:45.571 INFO:tasks.workunit.client.0.smithi110.stdout:8/33: write - no filename 2024-09-16T02:05:45.572 INFO:tasks.workunit.client.1.smithi165.stdout:4/154: dread d4/dc/d28/d2b/f2d [0,4194304] 0 2024-09-16T02:05:45.574 INFO:tasks.workunit.client.1.smithi165.stdout:7/225: mknod d0/df/d33/c3e 0 2024-09-16T02:05:45.576 INFO:tasks.workunit.client.1.smithi165.stdout:8/238: creat dd/d11/f55 x:0 0 0 2024-09-16T02:05:45.577 INFO:tasks.workunit.client.1.smithi165.stdout:8/239: write dd/d11/f30 [1950222,38332] 0 2024-09-16T02:05:45.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/29: mknod c5 0 2024-09-16T02:05:45.579 INFO:tasks.workunit.client.1.smithi165.stdout:2/267: creat df/d23/d28/f53 x:0 0 0 2024-09-16T02:05:45.581 INFO:tasks.workunit.client.1.smithi165.stdout:9/238: symlink d7/df/d37/d41/l52 0 2024-09-16T02:05:45.584 INFO:tasks.workunit.client.1.smithi165.stdout:4/155: rename d4/dc/l2a to d4/dc/d28/d30/l38 0 2024-09-16T02:05:45.585 INFO:tasks.workunit.client.0.smithi110.stdout:1/41: symlink d0/d1/d4/l9 0 2024-09-16T02:05:45.585 INFO:tasks.workunit.client.0.smithi110.stdout:1/42: chown d0/d1/d4/l9 10325 1 2024-09-16T02:05:45.587 INFO:tasks.workunit.client.0.smithi110.stdout:0/26: mknod d3/d4/c7 0 2024-09-16T02:05:45.589 INFO:tasks.workunit.client.1.smithi165.stdout:5/187: creat de/d21/d26/d3a/f3c x:0 0 0 2024-09-16T02:05:45.589 INFO:tasks.workunit.client.0.smithi110.stdout:6/64: mknod d0/d2/d5/cd 0 2024-09-16T02:05:45.591 INFO:tasks.workunit.client.0.smithi110.stdout:2/25: truncate d0/f5 3227617 0 2024-09-16T02:05:45.591 INFO:tasks.workunit.client.1.smithi165.stdout:9/239: dwrite d7/d1f/f46 [0,4194304] 0 2024-09-16T02:05:45.591 INFO:tasks.workunit.client.1.smithi165.stdout:5/188: truncate de/f18 287138 0 2024-09-16T02:05:45.591 INFO:tasks.workunit.client.1.smithi165.stdout:5/189: stat de/d19/f1f 0 2024-09-16T02:05:45.592 INFO:tasks.workunit.client.0.smithi110.stdout:9/17: mknod d1/d5/c6 0 2024-09-16T02:05:45.593 INFO:tasks.workunit.client.0.smithi110.stdout:9/18: chown d1/d5/c6 229060 1 2024-09-16T02:05:45.594 INFO:tasks.workunit.client.1.smithi165.stdout:7/226: symlink d0/df/d33/l3f 0 2024-09-16T02:05:45.595 INFO:tasks.workunit.client.1.smithi165.stdout:4/156: mkdir d4/dc/d39 0 2024-09-16T02:05:45.597 INFO:tasks.workunit.client.1.smithi165.stdout:4/157: write d4/dc/d18/f23 [1188999,75987] 0 2024-09-16T02:05:45.599 INFO:tasks.workunit.client.1.smithi165.stdout:8/240: link dd/ff dd/d13/f56 0 2024-09-16T02:05:45.601 INFO:tasks.workunit.client.0.smithi110.stdout:1/43: mkdir d0/da 0 2024-09-16T02:05:45.601 INFO:tasks.workunit.client.0.smithi110.stdout:7/19: dread f1 [0,4194304] 0 2024-09-16T02:05:45.603 INFO:tasks.workunit.client.0.smithi110.stdout:0/27: fsync d3/d4/f5 0 2024-09-16T02:05:45.604 INFO:tasks.workunit.client.0.smithi110.stdout:0/28: stat c2 0 2024-09-16T02:05:45.604 INFO:tasks.workunit.client.0.smithi110.stdout:0/29: chown d3 52772 1 2024-09-16T02:05:45.604 INFO:tasks.workunit.client.1.smithi165.stdout:2/268: symlink df/d10/l54 0 2024-09-16T02:05:45.605 INFO:tasks.workunit.client.1.smithi165.stdout:5/190: fdatasync de/f1d 0 2024-09-16T02:05:45.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/65: dwrite d0/d2/d5/fb [0,4194304] 0 2024-09-16T02:05:45.612 INFO:tasks.workunit.client.0.smithi110.stdout:9/19: creat d1/f7 x:0 0 0 2024-09-16T02:05:45.613 INFO:tasks.workunit.client.1.smithi165.stdout:4/158: creat d4/dc/d28/d2b/f3a x:0 0 0 2024-09-16T02:05:45.613 INFO:tasks.workunit.client.1.smithi165.stdout:4/159: write f1 [894839,58615] 0 2024-09-16T02:05:45.615 INFO:tasks.workunit.client.1.smithi165.stdout:8/241: rename dd/d13/d4c/c51 to dd/d13/c57 0 2024-09-16T02:05:45.616 INFO:tasks.workunit.client.1.smithi165.stdout:8/242: write dd/d13/f2c [367055,2497] 0 2024-09-16T02:05:45.619 INFO:tasks.workunit.client.0.smithi110.stdout:4/12: getdents d4 0 2024-09-16T02:05:45.620 INFO:tasks.workunit.client.0.smithi110.stdout:4/13: chown f3 63065 1 2024-09-16T02:05:45.620 INFO:tasks.workunit.client.0.smithi110.stdout:5/18: dwrite f4 [0,4194304] 0 2024-09-16T02:05:45.620 INFO:tasks.workunit.client.0.smithi110.stdout:4/14: dread - f3 zero size 2024-09-16T02:05:45.624 INFO:tasks.workunit.client.1.smithi165.stdout:7/227: creat d0/df/d33/d2a/f40 x:0 0 0 2024-09-16T02:05:45.624 INFO:tasks.workunit.client.1.smithi165.stdout:8/243: dwrite dd/d11/d14/f1e [0,4194304] 0 2024-09-16T02:05:45.624 INFO:tasks.workunit.client.1.smithi165.stdout:1/198: sync 2024-09-16T02:05:45.624 INFO:tasks.workunit.client.1.smithi165.stdout:6/219: sync 2024-09-16T02:05:45.624 INFO:tasks.workunit.client.1.smithi165.stdout:1/199: readlink d1/d19/l1c 0 2024-09-16T02:05:45.625 INFO:tasks.workunit.client.0.smithi110.stdout:1/44: symlink d0/d1/d4/lb 0 2024-09-16T02:05:45.625 INFO:tasks.workunit.client.0.smithi110.stdout:1/45: write d0/f6 [1942926,129168] 0 2024-09-16T02:05:45.625 INFO:tasks.workunit.client.0.smithi110.stdout:0/30: mknod d3/d4/c8 0 2024-09-16T02:05:45.626 INFO:tasks.workunit.client.0.smithi110.stdout:1/46: chown d0/d1/d4/l3 146918252 1 2024-09-16T02:05:45.628 INFO:tasks.workunit.client.0.smithi110.stdout:8/34: link c1 d3/c8 0 2024-09-16T02:05:45.628 INFO:tasks.workunit.client.0.smithi110.stdout:8/35: chown d3 901640 1 2024-09-16T02:05:45.628 INFO:tasks.workunit.client.0.smithi110.stdout:8/36: dread - no filename 2024-09-16T02:05:45.631 INFO:tasks.workunit.client.1.smithi165.stdout:4/160: rmdir d4/dc/d18 39 2024-09-16T02:05:45.631 INFO:tasks.workunit.client.1.smithi165.stdout:1/200: read d1/fc [543826,118472] 0 2024-09-16T02:05:45.633 INFO:tasks.workunit.client.1.smithi165.stdout:9/240: rename d7/df/d37/d41/d42 to d7/d32/d38/d53 0 2024-09-16T02:05:45.634 INFO:tasks.workunit.client.1.smithi165.stdout:4/161: write d4/dc/f19 [295553,94698] 0 2024-09-16T02:05:45.634 INFO:tasks.workunit.client.0.smithi110.stdout:6/66: unlink d0/d2/l6 0 2024-09-16T02:05:45.637 INFO:tasks.workunit.client.0.smithi110.stdout:9/20: mkdir d1/d5/d8 0 2024-09-16T02:05:45.637 INFO:tasks.workunit.client.1.smithi165.stdout:1/201: dread d1/dd/d11/f15 [4194304,4194304] 0 2024-09-16T02:05:45.641 INFO:tasks.workunit.client.1.smithi165.stdout:1/202: dread d1/fc [0,4194304] 0 2024-09-16T02:05:45.642 INFO:tasks.workunit.client.1.smithi165.stdout:1/203: read d1/dd/f10 [749958,100951] 0 2024-09-16T02:05:45.643 INFO:tasks.workunit.client.0.smithi110.stdout:4/15: creat d4/f6 x:0 0 0 2024-09-16T02:05:45.643 INFO:tasks.workunit.client.1.smithi165.stdout:1/204: read - d1/d32/f34 zero size 2024-09-16T02:05:45.648 INFO:tasks.workunit.client.0.smithi110.stdout:0/31: dwrite d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.649 INFO:tasks.workunit.client.1.smithi165.stdout:9/241: write d7/fd [1921754,93535] 0 2024-09-16T02:05:45.649 INFO:tasks.workunit.client.0.smithi110.stdout:0/32: stat d3/d6 0 2024-09-16T02:05:45.651 INFO:tasks.workunit.client.0.smithi110.stdout:8/37: rmdir d3 39 2024-09-16T02:05:45.651 INFO:tasks.workunit.client.0.smithi110.stdout:8/38: truncate - no filename 2024-09-16T02:05:45.651 INFO:tasks.workunit.client.0.smithi110.stdout:8/39: truncate - no filename 2024-09-16T02:05:45.653 INFO:tasks.workunit.client.0.smithi110.stdout:2/26: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:45.655 INFO:tasks.workunit.client.0.smithi110.stdout:6/67: unlink d0/l4 0 2024-09-16T02:05:45.655 INFO:tasks.workunit.client.0.smithi110.stdout:6/68: readlink - no filename 2024-09-16T02:05:45.657 INFO:tasks.workunit.client.1.smithi165.stdout:5/191: link de/d19/d1c/l20 de/d21/d26/d3a/l3d 0 2024-09-16T02:05:45.658 INFO:tasks.workunit.client.1.smithi165.stdout:0/212: sync 2024-09-16T02:05:45.658 INFO:tasks.workunit.client.1.smithi165.stdout:3/306: sync 2024-09-16T02:05:45.659 INFO:tasks.workunit.client.0.smithi110.stdout:0/33: dread d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.660 INFO:tasks.workunit.client.1.smithi165.stdout:8/244: dread dd/d11/d38/f39 [0,4194304] 0 2024-09-16T02:05:45.661 INFO:tasks.workunit.client.0.smithi110.stdout:0/34: chown d3/d4 4027 1 2024-09-16T02:05:45.664 INFO:tasks.workunit.client.0.smithi110.stdout:5/19: creat d5/f6 x:0 0 0 2024-09-16T02:05:45.665 INFO:tasks.workunit.client.0.smithi110.stdout:5/20: readlink - no filename 2024-09-16T02:05:45.665 INFO:tasks.workunit.client.0.smithi110.stdout:5/21: readlink - no filename 2024-09-16T02:05:45.665 INFO:tasks.workunit.client.1.smithi165.stdout:5/192: dwrite f7 [0,4194304] 0 2024-09-16T02:05:45.666 INFO:tasks.workunit.client.0.smithi110.stdout:2/27: dwrite d0/f7 [4194304,4194304] 0 2024-09-16T02:05:45.666 INFO:tasks.workunit.client.1.smithi165.stdout:1/205: mknod d1/c38 0 2024-09-16T02:05:45.667 INFO:tasks.workunit.client.0.smithi110.stdout:3/30: dread f4 [0,4194304] 0 2024-09-16T02:05:45.668 INFO:tasks.workunit.client.0.smithi110.stdout:3/31: fsync f3 0 2024-09-16T02:05:45.669 INFO:tasks.workunit.client.1.smithi165.stdout:3/307: dwrite da/d20/d26/f2a [0,4194304] 0 2024-09-16T02:05:45.671 INFO:tasks.workunit.client.0.smithi110.stdout:6/69: dwrite d0/d2/d5/fb [0,4194304] 0 2024-09-16T02:05:45.671 INFO:tasks.workunit.client.1.smithi165.stdout:2/269: write df/f19 [278113,91324] 0 2024-09-16T02:05:45.673 INFO:tasks.workunit.client.1.smithi165.stdout:9/242: mkdir d7/d1f/d54 0 2024-09-16T02:05:45.674 INFO:tasks.workunit.client.1.smithi165.stdout:9/243: read f2 [3719588,125561] 0 2024-09-16T02:05:45.676 INFO:tasks.workunit.client.1.smithi165.stdout:4/162: truncate d4/fa 1863134 0 2024-09-16T02:05:45.677 INFO:tasks.workunit.client.0.smithi110.stdout:4/16: rmdir d4 39 2024-09-16T02:05:45.677 INFO:tasks.workunit.client.0.smithi110.stdout:2/28: dwrite d0/f7 [4194304,4194304] 0 2024-09-16T02:05:45.680 INFO:tasks.workunit.client.0.smithi110.stdout:4/17: write f3 [854892,8190] 0 2024-09-16T02:05:45.681 INFO:tasks.workunit.client.0.smithi110.stdout:4/18: chown l1 18752 1 2024-09-16T02:05:45.683 INFO:tasks.workunit.client.1.smithi165.stdout:2/270: dread df/f19 [0,4194304] 0 2024-09-16T02:05:45.683 INFO:tasks.workunit.client.1.smithi165.stdout:2/271: fsync df/d23/d2a/f41 0 2024-09-16T02:05:45.684 INFO:tasks.workunit.client.1.smithi165.stdout:7/228: creat d0/f41 x:0 0 0 2024-09-16T02:05:45.688 INFO:tasks.workunit.client.1.smithi165.stdout:0/213: rmdir d0/d1e/d20/d28 39 2024-09-16T02:05:45.690 INFO:tasks.workunit.client.0.smithi110.stdout:9/21: truncate f0 691619 0 2024-09-16T02:05:45.691 INFO:tasks.workunit.client.0.smithi110.stdout:0/35: creat d3/f9 x:0 0 0 2024-09-16T02:05:45.693 INFO:tasks.workunit.client.0.smithi110.stdout:5/22: symlink d5/l7 0 2024-09-16T02:05:45.694 INFO:tasks.workunit.client.1.smithi165.stdout:2/272: dwrite df/d10/d1a/d2d/f4e [0,4194304] 0 2024-09-16T02:05:45.695 INFO:tasks.workunit.client.1.smithi165.stdout:2/273: dread - df/f4f zero size 2024-09-16T02:05:45.696 INFO:tasks.workunit.client.1.smithi165.stdout:5/193: rename de/f18 to de/d19/d1c/f3e 0 2024-09-16T02:05:45.697 INFO:tasks.workunit.client.0.smithi110.stdout:3/32: mknod c6 0 2024-09-16T02:05:45.699 INFO:tasks.workunit.client.0.smithi110.stdout:1/47: link d0/d1/d4/l9 d0/lc 0 2024-09-16T02:05:45.701 INFO:tasks.workunit.client.0.smithi110.stdout:1/48: chown d0/d1 6487 1 2024-09-16T02:05:45.702 INFO:tasks.workunit.client.0.smithi110.stdout:6/70: mkdir d0/d2/de 0 2024-09-16T02:05:45.702 INFO:tasks.workunit.client.0.smithi110.stdout:0/36: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:45.704 INFO:tasks.workunit.client.1.smithi165.stdout:4/163: chown d4/dc/d18/d37 16402784 1 2024-09-16T02:05:45.704 INFO:tasks.workunit.client.0.smithi110.stdout:5/23: dread f0 [0,4194304] 0 2024-09-16T02:05:45.715 INFO:tasks.workunit.client.0.smithi110.stdout:4/19: write d4/f6 [498803,112614] 0 2024-09-16T02:05:45.715 INFO:tasks.workunit.client.0.smithi110.stdout:8/40: creat d3/f9 x:0 0 0 2024-09-16T02:05:45.716 INFO:tasks.workunit.client.0.smithi110.stdout:3/33: dwrite f3 [0,4194304] 0 2024-09-16T02:05:45.717 INFO:tasks.workunit.client.1.smithi165.stdout:6/220: getdents d7/d17 0 2024-09-16T02:05:45.719 INFO:tasks.workunit.client.1.smithi165.stdout:6/221: write d7/d1f/f32 [582893,27206] 0 2024-09-16T02:05:45.720 INFO:tasks.workunit.client.1.smithi165.stdout:1/206: dwrite d1/fc [0,4194304] 0 2024-09-16T02:05:45.720 INFO:tasks.workunit.client.0.smithi110.stdout:1/49: dwrite d0/f6 [0,4194304] 0 2024-09-16T02:05:45.720 INFO:tasks.workunit.client.0.smithi110.stdout:8/41: dread - d3/f9 zero size 2024-09-16T02:05:45.721 INFO:tasks.workunit.client.1.smithi165.stdout:0/214: mknod d0/d1e/d39/d48/d45/c50 0 2024-09-16T02:05:45.722 INFO:tasks.workunit.client.0.smithi110.stdout:7/20: getdents d3 0 2024-09-16T02:05:45.723 INFO:tasks.workunit.client.1.smithi165.stdout:8/245: creat dd/d13/d53/f58 x:0 0 0 2024-09-16T02:05:45.726 INFO:tasks.workunit.client.1.smithi165.stdout:3/308: creat da/d20/d26/d6e/f73 x:0 0 0 2024-09-16T02:05:45.727 INFO:tasks.workunit.client.1.smithi165.stdout:6/222: dread d7/d1f/f32 [0,4194304] 0 2024-09-16T02:05:45.730 INFO:tasks.workunit.client.1.smithi165.stdout:2/274: rename c6 to df/d10/d37/d45/c55 0 2024-09-16T02:05:45.730 INFO:tasks.workunit.client.1.smithi165.stdout:2/275: fdatasync df/f34 0 2024-09-16T02:05:45.731 INFO:tasks.workunit.client.0.smithi110.stdout:5/24: creat d5/f8 x:0 0 0 2024-09-16T02:05:45.732 INFO:tasks.workunit.client.1.smithi165.stdout:5/194: symlink de/d21/d26/l3f 0 2024-09-16T02:05:45.736 INFO:tasks.workunit.client.0.smithi110.stdout:6/71: unlink d0/d2/d5/cd 0 2024-09-16T02:05:45.738 INFO:tasks.workunit.client.0.smithi110.stdout:6/72: truncate d0/d2/d5/fb 4978747 0 2024-09-16T02:05:45.738 INFO:tasks.workunit.client.0.smithi110.stdout:4/20: mknod d4/c7 0 2024-09-16T02:05:45.738 INFO:tasks.workunit.client.1.smithi165.stdout:5/195: dwrite de/f1d [4194304,4194304] 0 2024-09-16T02:05:45.739 INFO:tasks.workunit.client.1.smithi165.stdout:7/229: mkdir d0/df/d42 0 2024-09-16T02:05:45.739 INFO:tasks.workunit.client.0.smithi110.stdout:9/22: mknod d1/d5/d8/c9 0 2024-09-16T02:05:45.741 INFO:tasks.workunit.client.0.smithi110.stdout:3/34: unlink c0 0 2024-09-16T02:05:45.743 INFO:tasks.workunit.client.0.smithi110.stdout:4/21: dread f3 [0,4194304] 0 2024-09-16T02:05:45.743 INFO:tasks.workunit.client.1.smithi165.stdout:0/215: mknod d0/d1e/d39/c51 0 2024-09-16T02:05:45.745 INFO:tasks.workunit.client.0.smithi110.stdout:8/42: creat d3/fa x:0 0 0 2024-09-16T02:05:45.746 INFO:tasks.workunit.client.0.smithi110.stdout:3/35: dread f4 [0,4194304] 0 2024-09-16T02:05:45.747 INFO:tasks.workunit.client.0.smithi110.stdout:8/43: dread - d3/f9 zero size 2024-09-16T02:05:45.747 INFO:tasks.workunit.client.1.smithi165.stdout:3/309: write da/d72/d2c/f70 [33882,103991] 0 2024-09-16T02:05:45.749 INFO:tasks.workunit.client.1.smithi165.stdout:1/207: dwrite d1/dd/f18 [0,4194304] 0 2024-09-16T02:05:45.749 INFO:tasks.workunit.client.1.smithi165.stdout:3/310: truncate da/d20/d26/f4f 941372 0 2024-09-16T02:05:45.750 INFO:tasks.workunit.client.1.smithi165.stdout:1/208: read - d1/dd/f37 zero size 2024-09-16T02:05:45.750 INFO:tasks.workunit.client.0.smithi110.stdout:4/22: dread f3 [0,4194304] 0 2024-09-16T02:05:45.751 INFO:tasks.workunit.client.0.smithi110.stdout:6/73: dwrite d0/d2/d5/fb [0,4194304] 0 2024-09-16T02:05:45.751 INFO:tasks.workunit.client.1.smithi165.stdout:4/164: rename d4/dc/d39 to d4/dc/d28/d3b 0 2024-09-16T02:05:45.753 INFO:tasks.workunit.client.0.smithi110.stdout:5/25: rmdir d5 39 2024-09-16T02:05:45.755 INFO:tasks.workunit.client.1.smithi165.stdout:2/276: creat df/d23/d28/d3b/f56 x:0 0 0 2024-09-16T02:05:45.757 INFO:tasks.workunit.client.0.smithi110.stdout:2/29: truncate d0/f7 4851081 0 2024-09-16T02:05:45.757 INFO:tasks.workunit.client.1.smithi165.stdout:4/165: dread f1 [0,4194304] 0 2024-09-16T02:05:45.759 INFO:tasks.workunit.client.1.smithi165.stdout:4/166: stat d4/c10 0 2024-09-16T02:05:45.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/196: write de/d19/f1f [1448865,94139] 0 2024-09-16T02:05:45.760 INFO:tasks.workunit.client.1.smithi165.stdout:9/244: write d7/d1f/d27/d49/f50 [1669338,48523] 0 2024-09-16T02:05:45.762 INFO:tasks.workunit.client.1.smithi165.stdout:5/197: chown de/d21/d36 92 1 2024-09-16T02:05:45.762 INFO:tasks.workunit.client.1.smithi165.stdout:7/230: symlink d0/df/d33/d2a/l43 0 2024-09-16T02:05:45.764 INFO:tasks.workunit.client.1.smithi165.stdout:9/245: write d7/d14/f24 [687073,95416] 0 2024-09-16T02:05:45.764 INFO:tasks.workunit.client.1.smithi165.stdout:7/231: chown d0/f41 166869730 1 2024-09-16T02:05:45.764 INFO:tasks.workunit.client.1.smithi165.stdout:4/167: dread f2 [0,4194304] 0 2024-09-16T02:05:45.764 INFO:tasks.workunit.client.1.smithi165.stdout:7/232: chown d0/f12 62355396 1 2024-09-16T02:05:45.765 INFO:tasks.workunit.client.0.smithi110.stdout:9/23: unlink d1/f4 0 2024-09-16T02:05:45.765 INFO:tasks.workunit.client.1.smithi165.stdout:0/216: symlink d0/d1e/d39/l52 0 2024-09-16T02:05:45.766 INFO:tasks.workunit.client.0.smithi110.stdout:0/37: dwrite d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.767 INFO:tasks.workunit.client.0.smithi110.stdout:3/36: creat f7 x:0 0 0 2024-09-16T02:05:45.767 INFO:tasks.workunit.client.0.smithi110.stdout:8/44: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:45.771 INFO:tasks.workunit.client.0.smithi110.stdout:1/50: rename d0/d1/d4/l9 to d0/d1/d8/ld 0 2024-09-16T02:05:45.771 INFO:tasks.workunit.client.1.smithi165.stdout:6/223: symlink d7/dc/df/l39 0 2024-09-16T02:05:45.771 INFO:tasks.workunit.client.1.smithi165.stdout:6/224: stat d7/fe 0 2024-09-16T02:05:45.771 INFO:tasks.workunit.client.1.smithi165.stdout:4/168: dwrite d4/dc/fe [0,4194304] 0 2024-09-16T02:05:45.772 INFO:tasks.workunit.client.0.smithi110.stdout:4/23: dwrite f3 [0,4194304] 0 2024-09-16T02:05:45.772 INFO:tasks.workunit.client.1.smithi165.stdout:4/169: readlink d4/l6 0 2024-09-16T02:05:45.775 INFO:tasks.workunit.client.0.smithi110.stdout:5/26: dread - d5/f8 zero size 2024-09-16T02:05:45.775 INFO:tasks.workunit.client.0.smithi110.stdout:8/45: read d3/f9 [3763972,100922] 0 2024-09-16T02:05:45.775 INFO:tasks.workunit.client.1.smithi165.stdout:3/311: creat da/d72/d2c/f74 x:0 0 0 2024-09-16T02:05:45.778 INFO:tasks.workunit.client.1.smithi165.stdout:4/170: dread d4/dc/d20/f27 [0,4194304] 0 2024-09-16T02:05:45.778 INFO:tasks.workunit.client.0.smithi110.stdout:1/51: readlink d0/d1/d4/lb 0 2024-09-16T02:05:45.779 INFO:tasks.workunit.client.0.smithi110.stdout:1/52: stat d0 0 2024-09-16T02:05:45.783 INFO:tasks.workunit.client.0.smithi110.stdout:2/30: creat d0/f8 x:0 0 0 2024-09-16T02:05:45.785 INFO:tasks.workunit.client.0.smithi110.stdout:0/38: dread d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.786 INFO:tasks.workunit.client.0.smithi110.stdout:0/39: read d3/f9 [4090881,3922] 0 2024-09-16T02:05:45.787 INFO:tasks.workunit.client.1.smithi165.stdout:8/246: rename dd/d13/c1a to dd/d11/d38/c59 0 2024-09-16T02:05:45.793 INFO:tasks.workunit.client.0.smithi110.stdout:3/37: mkdir d8 0 2024-09-16T02:05:45.793 INFO:tasks.workunit.client.1.smithi165.stdout:8/247: dwrite dd/d11/d14/f1e [0,4194304] 0 2024-09-16T02:05:45.795 INFO:tasks.workunit.client.1.smithi165.stdout:5/198: creat de/d21/f40 x:0 0 0 2024-09-16T02:05:45.796 INFO:tasks.workunit.client.1.smithi165.stdout:5/199: stat de/d21/d26 0 2024-09-16T02:05:45.797 INFO:tasks.workunit.client.1.smithi165.stdout:5/200: chown de/d21/l24 1639 1 2024-09-16T02:05:45.797 INFO:tasks.workunit.client.0.smithi110.stdout:7/21: write f2 [1001318,61651] 0 2024-09-16T02:05:45.798 INFO:tasks.workunit.client.1.smithi165.stdout:5/201: dread - de/d21/d26/d3a/f3c zero size 2024-09-16T02:05:45.801 INFO:tasks.workunit.client.0.smithi110.stdout:2/31: dwrite d0/f8 [0,4194304] 0 2024-09-16T02:05:45.803 INFO:tasks.workunit.client.0.smithi110.stdout:5/27: write f0 [558269,690] 0 2024-09-16T02:05:45.803 INFO:tasks.workunit.client.1.smithi165.stdout:5/202: dread de/d19/f2e [0,4194304] 0 2024-09-16T02:05:45.804 INFO:tasks.workunit.client.1.smithi165.stdout:5/203: chown de/l13 411 1 2024-09-16T02:05:45.805 INFO:tasks.workunit.client.1.smithi165.stdout:5/204: dread de/d19/d1c/f3e [0,4194304] 0 2024-09-16T02:05:45.806 INFO:tasks.workunit.client.0.smithi110.stdout:6/74: creat d0/d2/dc/ff x:0 0 0 2024-09-16T02:05:45.806 INFO:tasks.workunit.client.1.smithi165.stdout:6/225: write d7/f9 [1215166,115904] 0 2024-09-16T02:05:45.807 INFO:tasks.workunit.client.0.smithi110.stdout:0/40: dwrite d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:45.810 INFO:tasks.workunit.client.0.smithi110.stdout:6/75: chown d0/d2 0 1 2024-09-16T02:05:45.811 INFO:tasks.workunit.client.0.smithi110.stdout:4/24: write f3 [3817414,17116] 0 2024-09-16T02:05:45.811 INFO:tasks.workunit.client.1.smithi165.stdout:6/226: dwrite d7/f9 [0,4194304] 0 2024-09-16T02:05:45.813 INFO:tasks.workunit.client.0.smithi110.stdout:6/76: dread - d0/d2/dc/ff zero size 2024-09-16T02:05:45.816 INFO:tasks.workunit.client.0.smithi110.stdout:1/53: rmdir d0 39 2024-09-16T02:05:45.816 INFO:tasks.workunit.client.0.smithi110.stdout:3/38: dwrite f7 [0,4194304] 0 2024-09-16T02:05:45.822 INFO:tasks.workunit.client.0.smithi110.stdout:6/77: dread d0/d2/d5/fb [4194304,4194304] 0 2024-09-16T02:05:45.823 INFO:tasks.workunit.client.1.smithi165.stdout:4/171: stat d4/dc/d28/d30/l38 0 2024-09-16T02:05:45.823 INFO:tasks.workunit.client.1.smithi165.stdout:2/277: rename df/l4d to df/d10/d1a/l57 0 2024-09-16T02:05:45.824 INFO:tasks.workunit.client.1.smithi165.stdout:8/248: mknod dd/d34/c5a 0 2024-09-16T02:05:45.824 INFO:tasks.workunit.client.0.smithi110.stdout:0/41: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:45.824 INFO:tasks.workunit.client.1.smithi165.stdout:4/172: dread - d4/dc/d18/f34 zero size 2024-09-16T02:05:45.825 INFO:tasks.workunit.client.1.smithi165.stdout:8/249: chown dd/l50 401 1 2024-09-16T02:05:45.825 INFO:tasks.workunit.client.1.smithi165.stdout:9/246: getdents d7/d1f/d54 0 2024-09-16T02:05:45.826 INFO:tasks.workunit.client.1.smithi165.stdout:8/250: write dd/d13/f21 [1839166,111120] 0 2024-09-16T02:05:45.827 INFO:tasks.workunit.client.0.smithi110.stdout:5/28: symlink d5/l9 0 2024-09-16T02:05:45.828 INFO:tasks.workunit.client.0.smithi110.stdout:5/29: stat d5/f6 0 2024-09-16T02:05:45.830 INFO:tasks.workunit.client.1.smithi165.stdout:0/217: mkdir d0/d1e/d20/d53 0 2024-09-16T02:05:45.831 INFO:tasks.workunit.client.0.smithi110.stdout:9/24: write d1/f3 [66937,110366] 0 2024-09-16T02:05:45.834 INFO:tasks.workunit.client.0.smithi110.stdout:4/25: mkdir d4/d8 0 2024-09-16T02:05:45.835 INFO:tasks.workunit.client.1.smithi165.stdout:3/312: dwrite da/f14 [0,4194304] 0 2024-09-16T02:05:45.836 INFO:tasks.workunit.client.0.smithi110.stdout:8/46: rename c1 to d3/cb 0 2024-09-16T02:05:45.838 INFO:tasks.workunit.client.1.smithi165.stdout:5/205: creat de/d21/f41 x:0 0 0 2024-09-16T02:05:45.840 INFO:tasks.workunit.client.1.smithi165.stdout:7/233: truncate d0/df/d33/f29 291924 0 2024-09-16T02:05:45.841 INFO:tasks.workunit.client.1.smithi165.stdout:7/234: readlink d0/df/l2b 0 2024-09-16T02:05:45.843 INFO:tasks.workunit.client.1.smithi165.stdout:6/227: mkdir d7/d17/d28/d3a 0 2024-09-16T02:05:45.844 INFO:tasks.workunit.client.1.smithi165.stdout:2/278: creat df/d10/d1a/d2d/f58 x:0 0 0 2024-09-16T02:05:45.845 INFO:tasks.workunit.client.1.smithi165.stdout:2/279: write df/f4f [972774,54030] 0 2024-09-16T02:05:45.845 INFO:tasks.workunit.client.1.smithi165.stdout:4/173: creat d4/f3c x:0 0 0 2024-09-16T02:05:45.846 INFO:tasks.workunit.client.0.smithi110.stdout:7/22: getdents d3 0 2024-09-16T02:05:45.846 INFO:tasks.workunit.client.1.smithi165.stdout:2/280: dread - df/d23/f50 zero size 2024-09-16T02:05:45.847 INFO:tasks.workunit.client.0.smithi110.stdout:2/32: truncate d0/f5 2939072 0 2024-09-16T02:05:45.847 INFO:tasks.workunit.client.1.smithi165.stdout:2/281: dread - df/d10/d1a/d2d/f58 zero size 2024-09-16T02:05:45.848 INFO:tasks.workunit.client.1.smithi165.stdout:8/251: mknod dd/d13/c5b 0 2024-09-16T02:05:45.849 INFO:tasks.workunit.client.1.smithi165.stdout:8/252: stat dd/d11/d14/d3f/c3b 0 2024-09-16T02:05:45.849 INFO:tasks.workunit.client.0.smithi110.stdout:9/25: chown f0 848 1 2024-09-16T02:05:45.850 INFO:tasks.workunit.client.0.smithi110.stdout:9/26: fsync d1/f7 0 2024-09-16T02:05:45.851 INFO:tasks.workunit.client.0.smithi110.stdout:8/47: symlink d3/lc 0 2024-09-16T02:05:45.852 INFO:tasks.workunit.client.0.smithi110.stdout:9/27: chown d1/d5/d8/c9 1 1 2024-09-16T02:05:45.852 INFO:tasks.workunit.client.1.smithi165.stdout:0/218: unlink d0/d1e/f25 0 2024-09-16T02:05:45.852 INFO:tasks.workunit.client.1.smithi165.stdout:0/219: chown d0/c4a 0 1 2024-09-16T02:05:45.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/26: rename l1 to d4/l9 0 2024-09-16T02:05:45.854 INFO:tasks.workunit.client.0.smithi110.stdout:9/28: dread d1/f3 [0,4194304] 0 2024-09-16T02:05:45.854 INFO:tasks.workunit.client.1.smithi165.stdout:3/313: mkdir da/de/d75 0 2024-09-16T02:05:45.856 INFO:tasks.workunit.client.0.smithi110.stdout:3/39: link f7 d8/f9 0 2024-09-16T02:05:45.857 INFO:tasks.workunit.client.1.smithi165.stdout:1/209: getdents d1/d19/d24 0 2024-09-16T02:05:45.858 INFO:tasks.workunit.client.0.smithi110.stdout:6/78: unlink d0/d2/d5/fb 0 2024-09-16T02:05:45.859 INFO:tasks.workunit.client.1.smithi165.stdout:6/228: stat d7/fd 0 2024-09-16T02:05:45.860 INFO:tasks.workunit.client.0.smithi110.stdout:0/42: mknod d3/d6/ca 0 2024-09-16T02:05:45.860 INFO:tasks.workunit.client.1.smithi165.stdout:6/229: write d7/d1f/f33 [406167,46570] 0 2024-09-16T02:05:45.860 INFO:tasks.workunit.client.1.smithi165.stdout:4/174: truncate f1 565248 0 2024-09-16T02:05:45.861 INFO:tasks.workunit.client.0.smithi110.stdout:7/23: creat d3/f7 x:0 0 0 2024-09-16T02:05:45.863 INFO:tasks.workunit.client.1.smithi165.stdout:2/282: rmdir df/d10/d37 39 2024-09-16T02:05:45.864 INFO:tasks.workunit.client.0.smithi110.stdout:2/33: symlink d0/l9 0 2024-09-16T02:05:45.866 INFO:tasks.workunit.client.0.smithi110.stdout:8/48: creat d3/fd x:0 0 0 2024-09-16T02:05:45.867 INFO:tasks.workunit.client.0.smithi110.stdout:8/49: write d3/fa [546636,89495] 0 2024-09-16T02:05:45.869 INFO:tasks.workunit.client.1.smithi165.stdout:5/206: dread f6 [0,4194304] 0 2024-09-16T02:05:45.871 INFO:tasks.workunit.client.0.smithi110.stdout:4/27: fdatasync f3 0 2024-09-16T02:05:45.873 INFO:tasks.workunit.client.0.smithi110.stdout:1/54: symlink d0/da/le 0 2024-09-16T02:05:45.875 INFO:tasks.workunit.client.0.smithi110.stdout:9/29: truncate f0 524732 0 2024-09-16T02:05:45.876 INFO:tasks.workunit.client.0.smithi110.stdout:9/30: truncate d1/f7 728985 0 2024-09-16T02:05:45.876 INFO:tasks.workunit.client.1.smithi165.stdout:1/210: creat d1/f39 x:0 0 0 2024-09-16T02:05:45.881 INFO:tasks.workunit.client.1.smithi165.stdout:9/247: rename d7/df/d37/d41 to d7/d55 0 2024-09-16T02:05:45.884 INFO:tasks.workunit.client.0.smithi110.stdout:0/43: symlink d3/lb 0 2024-09-16T02:05:45.886 INFO:tasks.workunit.client.1.smithi165.stdout:9/248: dwrite d7/df/f40 [0,4194304] 0 2024-09-16T02:05:45.887 INFO:tasks.workunit.client.0.smithi110.stdout:7/24: creat d3/f8 x:0 0 0 2024-09-16T02:05:45.888 INFO:tasks.workunit.client.0.smithi110.stdout:7/25: stat d3 0 2024-09-16T02:05:45.890 INFO:tasks.workunit.client.0.smithi110.stdout:2/34: mkdir d0/da 0 2024-09-16T02:05:45.890 INFO:tasks.workunit.client.0.smithi110.stdout:2/35: readlink d0/l9 0 2024-09-16T02:05:45.892 INFO:tasks.workunit.client.0.smithi110.stdout:8/50: creat d3/fe x:0 0 0 2024-09-16T02:05:45.892 INFO:tasks.workunit.client.1.smithi165.stdout:9/249: dwrite d7/f22 [0,4194304] 0 2024-09-16T02:05:45.893 INFO:tasks.workunit.client.1.smithi165.stdout:9/250: dread - d7/df/d37/d43/f45 zero size 2024-09-16T02:05:45.896 INFO:tasks.workunit.client.0.smithi110.stdout:4/28: rmdir d4 39 2024-09-16T02:05:45.898 INFO:tasks.workunit.client.0.smithi110.stdout:2/36: dwrite d0/f8 [0,4194304] 0 2024-09-16T02:05:45.901 INFO:tasks.workunit.client.1.smithi165.stdout:3/314: rename da/d20/f58 to da/de/d75/f76 0 2024-09-16T02:05:45.905 INFO:tasks.workunit.client.0.smithi110.stdout:3/40: creat d8/fa x:0 0 0 2024-09-16T02:05:45.910 INFO:tasks.workunit.client.1.smithi165.stdout:8/253: rmdir dd/d13/d4c 0 2024-09-16T02:05:45.910 INFO:tasks.workunit.client.0.smithi110.stdout:5/30: getdents d5 0 2024-09-16T02:05:45.911 INFO:tasks.workunit.client.0.smithi110.stdout:5/31: fsync f4 0 2024-09-16T02:05:45.911 INFO:tasks.workunit.client.1.smithi165.stdout:0/220: rmdir d0/d1e/d20/d53 0 2024-09-16T02:05:45.912 INFO:tasks.workunit.client.0.smithi110.stdout:7/26: rmdir d3 39 2024-09-16T02:05:45.914 INFO:tasks.workunit.client.0.smithi110.stdout:8/51: fsync d3/f9 0 2024-09-16T02:05:45.916 INFO:tasks.workunit.client.1.smithi165.stdout:9/251: mkdir d7/d32/d38/d53/d56 0 2024-09-16T02:05:45.917 INFO:tasks.workunit.client.1.smithi165.stdout:7/235: read d0/df/d33/f29 [112878,19784] 0 2024-09-16T02:05:45.919 INFO:tasks.workunit.client.1.smithi165.stdout:0/221: dwrite d0/f13 [0,4194304] 0 2024-09-16T02:05:45.920 INFO:tasks.workunit.client.0.smithi110.stdout:2/37: mkdir d0/db 0 2024-09-16T02:05:45.922 INFO:tasks.workunit.client.1.smithi165.stdout:3/315: creat da/de/f77 x:0 0 0 2024-09-16T02:05:45.924 INFO:tasks.workunit.client.0.smithi110.stdout:6/79: creat d0/f10 x:0 0 0 2024-09-16T02:05:45.926 INFO:tasks.workunit.client.0.smithi110.stdout:8/52: dwrite d3/fe [0,4194304] 0 2024-09-16T02:05:45.927 INFO:tasks.workunit.client.0.smithi110.stdout:6/80: dread - d0/f10 zero size 2024-09-16T02:05:45.929 INFO:tasks.workunit.client.0.smithi110.stdout:6/81: read - d0/f10 zero size 2024-09-16T02:05:45.929 INFO:tasks.workunit.client.1.smithi165.stdout:5/207: truncate de/d19/f33 5487352 0 2024-09-16T02:05:45.930 INFO:tasks.workunit.client.0.smithi110.stdout:4/29: dwrite d4/f6 [0,4194304] 0 2024-09-16T02:05:45.931 INFO:tasks.workunit.client.0.smithi110.stdout:5/32: creat d5/fa x:0 0 0 2024-09-16T02:05:45.932 INFO:tasks.workunit.client.0.smithi110.stdout:4/30: write f3 [3566189,103387] 0 2024-09-16T02:05:45.932 INFO:tasks.workunit.client.0.smithi110.stdout:5/33: write f4 [2663268,111523] 0 2024-09-16T02:05:45.934 INFO:tasks.workunit.client.0.smithi110.stdout:7/27: truncate d3/f7 41337 0 2024-09-16T02:05:45.935 INFO:tasks.workunit.client.1.smithi165.stdout:8/254: dwrite dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:45.936 INFO:tasks.workunit.client.1.smithi165.stdout:8/255: chown dd/le 821969 1 2024-09-16T02:05:45.939 INFO:tasks.workunit.client.1.smithi165.stdout:9/252: symlink d7/d32/d38/d53/l57 0 2024-09-16T02:05:45.939 INFO:tasks.workunit.client.1.smithi165.stdout:4/175: dread f1 [0,4194304] 0 2024-09-16T02:05:45.940 INFO:tasks.workunit.client.1.smithi165.stdout:0/222: rmdir d0 39 2024-09-16T02:05:45.942 INFO:tasks.workunit.client.0.smithi110.stdout:2/38: mkdir d0/d1/dc 0 2024-09-16T02:05:45.943 INFO:tasks.workunit.client.1.smithi165.stdout:2/283: getdents df/d23/d28 0 2024-09-16T02:05:45.943 INFO:tasks.workunit.client.0.smithi110.stdout:9/31: dread f0 [0,4194304] 0 2024-09-16T02:05:45.944 INFO:tasks.workunit.client.1.smithi165.stdout:5/208: symlink de/d19/d1c/l42 0 2024-09-16T02:05:45.944 INFO:tasks.workunit.client.0.smithi110.stdout:3/41: dwrite f1 [0,4194304] 0 2024-09-16T02:05:45.948 INFO:tasks.workunit.client.1.smithi165.stdout:9/253: rmdir d7/d32/d4a 39 2024-09-16T02:05:45.949 INFO:tasks.workunit.client.0.smithi110.stdout:7/28: write f1 [523026,85618] 0 2024-09-16T02:05:45.949 INFO:tasks.workunit.client.0.smithi110.stdout:5/34: mknod d5/cb 0 2024-09-16T02:05:45.951 INFO:tasks.workunit.client.0.smithi110.stdout:0/44: getdents d3/d4 0 2024-09-16T02:05:45.955 INFO:tasks.workunit.client.0.smithi110.stdout:8/53: link d3/fa d3/ff 0 2024-09-16T02:05:45.956 INFO:tasks.workunit.client.1.smithi165.stdout:6/230: rename d7/d17/d28 to d7/dc/d3b 0 2024-09-16T02:05:45.956 INFO:tasks.workunit.client.1.smithi165.stdout:5/209: mknod de/d19/d1c/c43 0 2024-09-16T02:05:45.958 INFO:tasks.workunit.client.0.smithi110.stdout:3/42: creat d8/fb x:0 0 0 2024-09-16T02:05:45.959 INFO:tasks.workunit.client.1.smithi165.stdout:2/284: dwrite df/d10/d1a/d2d/f2f [0,4194304] 0 2024-09-16T02:05:45.960 INFO:tasks.workunit.client.0.smithi110.stdout:7/29: creat d3/f9 x:0 0 0 2024-09-16T02:05:45.961 INFO:tasks.workunit.client.0.smithi110.stdout:7/30: write d3/f8 [730799,27415] 0 2024-09-16T02:05:45.961 INFO:tasks.workunit.client.0.smithi110.stdout:5/35: creat d5/fc x:0 0 0 2024-09-16T02:05:45.962 INFO:tasks.workunit.client.0.smithi110.stdout:2/39: creat d0/db/fd x:0 0 0 2024-09-16T02:05:45.963 INFO:tasks.workunit.client.0.smithi110.stdout:7/31: truncate d3/f9 862093 0 2024-09-16T02:05:45.963 INFO:tasks.workunit.client.0.smithi110.stdout:7/32: stat d3/f7 0 2024-09-16T02:05:45.964 INFO:tasks.workunit.client.1.smithi165.stdout:1/211: rename d1/dd/f18 to d1/f3a 0 2024-09-16T02:05:45.964 INFO:tasks.workunit.client.0.smithi110.stdout:3/43: dread f7 [0,4194304] 0 2024-09-16T02:05:45.965 INFO:tasks.workunit.client.1.smithi165.stdout:8/256: link dd/d11/d14/c33 dd/d13/d53/c5c 0 2024-09-16T02:05:45.968 INFO:tasks.workunit.client.0.smithi110.stdout:3/44: mkdir d8/dc 0 2024-09-16T02:05:45.968 INFO:tasks.workunit.client.1.smithi165.stdout:8/257: write f6 [5007669,30876] 0 2024-09-16T02:05:45.968 INFO:tasks.workunit.client.1.smithi165.stdout:7/236: link d0/f3 d0/df/f44 0 2024-09-16T02:05:45.969 INFO:tasks.workunit.client.0.smithi110.stdout:3/45: stat f4 0 2024-09-16T02:05:45.970 INFO:tasks.workunit.client.0.smithi110.stdout:3/46: write f3 [4984755,89708] 0 2024-09-16T02:05:45.972 INFO:tasks.workunit.client.0.smithi110.stdout:2/40: dwrite d0/db/fd [0,4194304] 0 2024-09-16T02:05:45.973 INFO:tasks.workunit.client.0.smithi110.stdout:2/41: chown d0/d1/dc 24012163 1 2024-09-16T02:05:45.979 INFO:tasks.workunit.client.0.smithi110.stdout:3/47: mknod d8/dc/cd 0 2024-09-16T02:05:45.982 INFO:tasks.workunit.client.0.smithi110.stdout:2/42: rename d0/f5 to d0/d1/dc/fe 0 2024-09-16T02:05:45.982 INFO:tasks.workunit.client.0.smithi110.stdout:4/31: fdatasync d4/f6 0 2024-09-16T02:05:45.982 INFO:tasks.workunit.client.0.smithi110.stdout:2/43: truncate d0/f8 5117546 0 2024-09-16T02:05:45.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/32: chown d4/d8 7 1 2024-09-16T02:05:45.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/33: readlink l2 0 2024-09-16T02:05:45.983 INFO:tasks.workunit.client.0.smithi110.stdout:3/48: fdatasync d8/f9 0 2024-09-16T02:05:45.983 INFO:tasks.workunit.client.0.smithi110.stdout:3/49: readlink - no filename 2024-09-16T02:05:45.984 INFO:tasks.workunit.client.1.smithi165.stdout:7/237: mknod d0/df/d33/d2a/c45 0 2024-09-16T02:05:45.987 INFO:tasks.workunit.client.0.smithi110.stdout:3/50: creat d8/dc/fe x:0 0 0 2024-09-16T02:05:45.988 INFO:tasks.workunit.client.1.smithi165.stdout:2/285: creat df/d10/d37/f59 x:0 0 0 2024-09-16T02:05:45.989 INFO:tasks.workunit.client.1.smithi165.stdout:0/223: dread d0/f1d [0,4194304] 0 2024-09-16T02:05:45.989 INFO:tasks.workunit.client.1.smithi165.stdout:2/286: chown df/d10/l54 6041105 1 2024-09-16T02:05:45.989 INFO:tasks.workunit.client.0.smithi110.stdout:2/44: dread d0/f8 [0,4194304] 0 2024-09-16T02:05:45.990 INFO:tasks.workunit.client.1.smithi165.stdout:4/176: getdents d4/dc/d18 0 2024-09-16T02:05:45.990 INFO:tasks.workunit.client.1.smithi165.stdout:2/287: fdatasync df/d23/f38 0 2024-09-16T02:05:45.990 INFO:tasks.workunit.client.0.smithi110.stdout:9/32: write d1/f3 [335447,66823] 0 2024-09-16T02:05:45.991 INFO:tasks.workunit.client.1.smithi165.stdout:2/288: chown df/d10 4994630 1 2024-09-16T02:05:45.991 INFO:tasks.workunit.client.0.smithi110.stdout:4/34: dwrite d4/f6 [0,4194304] 0 2024-09-16T02:05:45.993 INFO:tasks.workunit.client.1.smithi165.stdout:0/224: dread d0/f1d [0,4194304] 0 2024-09-16T02:05:45.994 INFO:tasks.workunit.client.1.smithi165.stdout:7/238: symlink d0/df/d33/d2a/l46 0 2024-09-16T02:05:45.995 INFO:tasks.workunit.client.0.smithi110.stdout:9/33: write f0 [475789,37723] 0 2024-09-16T02:05:45.995 INFO:tasks.workunit.client.1.smithi165.stdout:8/258: truncate dd/d13/f56 5017842 0 2024-09-16T02:05:45.997 INFO:tasks.workunit.client.0.smithi110.stdout:5/36: rmdir d5 39 2024-09-16T02:05:45.997 INFO:tasks.workunit.client.0.smithi110.stdout:2/45: dread d0/db/fd [0,4194304] 0 2024-09-16T02:05:45.997 INFO:tasks.workunit.client.0.smithi110.stdout:2/46: readlink d0/l9 0 2024-09-16T02:05:45.997 INFO:tasks.workunit.client.0.smithi110.stdout:9/34: fsync f0 0 2024-09-16T02:05:46.002 INFO:tasks.workunit.client.1.smithi165.stdout:2/289: rmdir df/d23 39 2024-09-16T02:05:46.005 INFO:tasks.workunit.client.0.smithi110.stdout:5/37: read - d5/f8 zero size 2024-09-16T02:05:46.007 INFO:tasks.workunit.client.1.smithi165.stdout:0/225: write d0/d1e/f24 [2828381,88153] 0 2024-09-16T02:05:46.007 INFO:tasks.workunit.client.1.smithi165.stdout:8/259: fsync dd/d11/d38/f39 0 2024-09-16T02:05:46.008 INFO:tasks.workunit.client.0.smithi110.stdout:9/35: symlink d1/d5/d8/la 0 2024-09-16T02:05:46.009 INFO:tasks.workunit.client.1.smithi165.stdout:6/231: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T02:05:46.010 INFO:tasks.workunit.client.0.smithi110.stdout:4/35: creat d4/d8/fa x:0 0 0 2024-09-16T02:05:46.010 INFO:tasks.workunit.client.1.smithi165.stdout:1/212: getdents d1/d22 0 2024-09-16T02:05:46.010 INFO:tasks.workunit.client.1.smithi165.stdout:8/260: stat dd/le 0 2024-09-16T02:05:46.011 INFO:tasks.workunit.client.0.smithi110.stdout:2/47: rename d0/d1 to d0/da/df 0 2024-09-16T02:05:46.011 INFO:tasks.workunit.client.0.smithi110.stdout:2/48: stat d0/da 0 2024-09-16T02:05:46.011 INFO:tasks.workunit.client.1.smithi165.stdout:4/177: dwrite d4/f9 [0,4194304] 0 2024-09-16T02:05:46.011 INFO:tasks.workunit.client.1.smithi165.stdout:8/261: fdatasync f9 0 2024-09-16T02:05:46.014 INFO:tasks.workunit.client.1.smithi165.stdout:9/254: truncate d7/d1f/d27/d49/f50 146814 0 2024-09-16T02:05:46.014 INFO:tasks.workunit.client.0.smithi110.stdout:5/38: mkdir d5/dd 0 2024-09-16T02:05:46.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/255: chown d7/d55/f4c 1966422 1 2024-09-16T02:05:46.016 INFO:tasks.workunit.client.0.smithi110.stdout:5/39: write f4 [3225113,106354] 0 2024-09-16T02:05:46.017 INFO:tasks.workunit.client.0.smithi110.stdout:5/40: fdatasync d5/fc 0 2024-09-16T02:05:46.019 INFO:tasks.workunit.client.0.smithi110.stdout:3/51: rmdir d8 39 2024-09-16T02:05:46.021 INFO:tasks.workunit.client.0.smithi110.stdout:9/36: creat d1/d5/fb x:0 0 0 2024-09-16T02:05:46.022 INFO:tasks.workunit.client.0.smithi110.stdout:9/37: chown d1/d5/d8 863 1 2024-09-16T02:05:46.023 INFO:tasks.workunit.client.0.smithi110.stdout:9/38: truncate d1/f3 421517 0 2024-09-16T02:05:46.025 INFO:tasks.workunit.client.0.smithi110.stdout:4/36: creat d4/fb x:0 0 0 2024-09-16T02:05:46.026 INFO:tasks.workunit.client.0.smithi110.stdout:4/37: write d4/fb [268376,41396] 0 2024-09-16T02:05:46.028 INFO:tasks.workunit.client.0.smithi110.stdout:2/49: creat d0/da/df/f10 x:0 0 0 2024-09-16T02:05:46.030 INFO:tasks.workunit.client.1.smithi165.stdout:6/232: mkdir d7/dc/d3b/d3c 0 2024-09-16T02:05:46.030 INFO:tasks.workunit.client.0.smithi110.stdout:5/41: symlink d5/le 0 2024-09-16T02:05:46.031 INFO:tasks.workunit.client.0.smithi110.stdout:5/42: write f4 [1968597,51369] 0 2024-09-16T02:05:46.031 INFO:tasks.workunit.client.1.smithi165.stdout:1/213: creat d1/dd/d11/d33/f3b x:0 0 0 2024-09-16T02:05:46.032 INFO:tasks.workunit.client.1.smithi165.stdout:8/262: chown dd/d11/d14/c33 385852 1 2024-09-16T02:05:46.033 INFO:tasks.workunit.client.1.smithi165.stdout:1/214: chown d1/c38 81789 1 2024-09-16T02:05:46.033 INFO:tasks.workunit.client.1.smithi165.stdout:7/239: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:05:46.034 INFO:tasks.workunit.client.1.smithi165.stdout:2/290: mknod df/c5a 0 2024-09-16T02:05:46.035 INFO:tasks.workunit.client.1.smithi165.stdout:1/215: readlink d1/d19/l1c 0 2024-09-16T02:05:46.035 INFO:tasks.workunit.client.1.smithi165.stdout:0/226: dread d0/ff [0,4194304] 0 2024-09-16T02:05:46.036 INFO:tasks.workunit.client.0.smithi110.stdout:4/38: rename d4/d8/fa to d4/fc 0 2024-09-16T02:05:46.037 INFO:tasks.workunit.client.1.smithi165.stdout:1/216: truncate d1/dd/d11/d33/f3b 364488 0 2024-09-16T02:05:46.037 INFO:tasks.workunit.client.1.smithi165.stdout:9/256: mkdir d7/d32/d38/d58 0 2024-09-16T02:05:46.039 INFO:tasks.workunit.client.0.smithi110.stdout:2/50: write d0/f7 [3921466,65376] 0 2024-09-16T02:05:46.043 INFO:tasks.workunit.client.1.smithi165.stdout:0/227: dwrite d0/d1e/d39/d48/f4e [0,4194304] 0 2024-09-16T02:05:46.043 INFO:tasks.workunit.client.0.smithi110.stdout:9/39: rmdir d1 39 2024-09-16T02:05:46.045 INFO:tasks.workunit.client.1.smithi165.stdout:4/178: creat d4/dc/d28/d30/d31/f3d x:0 0 0 2024-09-16T02:05:46.045 INFO:tasks.workunit.client.1.smithi165.stdout:0/228: truncate d0/d1e/d20/f46 705213 0 2024-09-16T02:05:46.046 INFO:tasks.workunit.client.0.smithi110.stdout:3/52: symlink d8/lf 0 2024-09-16T02:05:46.046 INFO:tasks.workunit.client.0.smithi110.stdout:3/53: fsync f7 0 2024-09-16T02:05:46.049 INFO:tasks.workunit.client.0.smithi110.stdout:4/39: fdatasync d4/fc 0 2024-09-16T02:05:46.052 INFO:tasks.workunit.client.0.smithi110.stdout:9/40: dwrite f0 [0,4194304] 0 2024-09-16T02:05:46.053 INFO:tasks.workunit.client.1.smithi165.stdout:5/210: sync 2024-09-16T02:05:46.053 INFO:tasks.workunit.client.1.smithi165.stdout:3/316: sync 2024-09-16T02:05:46.053 INFO:tasks.workunit.client.0.smithi110.stdout:2/51: symlink d0/da/df/l11 0 2024-09-16T02:05:46.054 INFO:tasks.workunit.client.0.smithi110.stdout:2/52: readlink d0/l4 0 2024-09-16T02:05:46.054 INFO:tasks.workunit.client.1.smithi165.stdout:9/257: mknod d7/df/d37/c59 0 2024-09-16T02:05:46.056 INFO:tasks.workunit.client.0.smithi110.stdout:5/43: mkdir d5/dd/df 0 2024-09-16T02:05:46.056 INFO:tasks.workunit.client.0.smithi110.stdout:4/40: dread d4/fb [0,4194304] 0 2024-09-16T02:05:46.056 INFO:tasks.workunit.client.0.smithi110.stdout:3/54: dread f1 [0,4194304] 0 2024-09-16T02:05:46.062 INFO:tasks.workunit.client.1.smithi165.stdout:6/233: mkdir d7/dc/d3b/d3a/d3d 0 2024-09-16T02:05:46.063 INFO:tasks.workunit.client.1.smithi165.stdout:7/240: fdatasync d0/f3 0 2024-09-16T02:05:46.065 INFO:tasks.workunit.client.0.smithi110.stdout:2/53: dwrite d0/da/df/f10 [0,4194304] 0 2024-09-16T02:05:46.066 INFO:tasks.workunit.client.1.smithi165.stdout:4/179: chown d4/fa 0 1 2024-09-16T02:05:46.066 INFO:tasks.workunit.client.0.smithi110.stdout:5/44: write d5/f6 [2518,91488] 0 2024-09-16T02:05:46.066 INFO:tasks.workunit.client.0.smithi110.stdout:9/41: write d1/f7 [516711,89402] 0 2024-09-16T02:05:46.066 INFO:tasks.workunit.client.0.smithi110.stdout:2/54: chown d0/da/df/f10 18507110 1 2024-09-16T02:05:46.067 INFO:tasks.workunit.client.0.smithi110.stdout:4/41: mknod d4/d8/cd 0 2024-09-16T02:05:46.069 INFO:tasks.workunit.client.1.smithi165.stdout:7/241: dwrite d0/f41 [0,4194304] 0 2024-09-16T02:05:46.070 INFO:tasks.workunit.client.1.smithi165.stdout:0/229: unlink d0/f1d 0 2024-09-16T02:05:46.072 INFO:tasks.workunit.client.0.smithi110.stdout:2/55: dread d0/db/fd [0,4194304] 0 2024-09-16T02:05:46.072 INFO:tasks.workunit.client.1.smithi165.stdout:8/263: mknod dd/d11/c5d 0 2024-09-16T02:05:46.073 INFO:tasks.workunit.client.1.smithi165.stdout:8/264: dread - dd/d13/d53/f58 zero size 2024-09-16T02:05:46.074 INFO:tasks.workunit.client.0.smithi110.stdout:3/55: mknod d8/dc/c10 0 2024-09-16T02:05:46.076 INFO:tasks.workunit.client.1.smithi165.stdout:2/291: creat df/d23/d28/d3b/f5b x:0 0 0 2024-09-16T02:05:46.077 INFO:tasks.workunit.client.1.smithi165.stdout:2/292: chown df/d10/d1a/f27 3078 1 2024-09-16T02:05:46.080 INFO:tasks.workunit.client.1.smithi165.stdout:8/265: dwrite dd/d11/f30 [0,4194304] 0 2024-09-16T02:05:46.082 INFO:tasks.workunit.client.1.smithi165.stdout:8/266: chown dd/d13/f32 15176542 1 2024-09-16T02:05:46.082 INFO:tasks.workunit.client.0.smithi110.stdout:5/45: unlink d5/fa 0 2024-09-16T02:05:46.083 INFO:tasks.workunit.client.0.smithi110.stdout:3/56: dwrite d8/fb [0,4194304] 0 2024-09-16T02:05:46.088 INFO:tasks.workunit.client.0.smithi110.stdout:2/56: creat d0/db/f12 x:0 0 0 2024-09-16T02:05:46.090 INFO:tasks.workunit.client.0.smithi110.stdout:2/57: write d0/f3 [5891731,8776] 0 2024-09-16T02:05:46.092 INFO:tasks.workunit.client.1.smithi165.stdout:4/180: readlink d4/l36 0 2024-09-16T02:05:46.092 INFO:tasks.workunit.client.0.smithi110.stdout:5/46: dwrite f0 [0,4194304] 0 2024-09-16T02:05:46.096 INFO:tasks.workunit.client.1.smithi165.stdout:5/211: dread fc [0,4194304] 0 2024-09-16T02:05:46.097 INFO:tasks.workunit.client.0.smithi110.stdout:3/57: rename d8/dc/fe to d8/dc/f11 0 2024-09-16T02:05:46.098 INFO:tasks.workunit.client.0.smithi110.stdout:3/58: stat d8/dc/f11 0 2024-09-16T02:05:46.099 INFO:tasks.workunit.client.1.smithi165.stdout:1/217: truncate d1/dd/d11/f1b 3124385 0 2024-09-16T02:05:46.100 INFO:tasks.workunit.client.0.smithi110.stdout:3/59: chown c6 868271 1 2024-09-16T02:05:46.100 INFO:tasks.workunit.client.0.smithi110.stdout:5/47: dwrite f0 [0,4194304] 0 2024-09-16T02:05:46.102 INFO:tasks.workunit.client.0.smithi110.stdout:2/58: symlink d0/da/l13 0 2024-09-16T02:05:46.103 INFO:tasks.workunit.client.0.smithi110.stdout:2/59: readlink d0/l9 0 2024-09-16T02:05:46.104 INFO:tasks.workunit.client.1.smithi165.stdout:3/317: dwrite da/d72/f23 [4194304,4194304] 0 2024-09-16T02:05:46.106 INFO:tasks.workunit.client.1.smithi165.stdout:8/267: unlink dd/d13/l15 0 2024-09-16T02:05:46.107 INFO:tasks.workunit.client.1.smithi165.stdout:5/212: dread f7 [0,4194304] 0 2024-09-16T02:05:46.108 INFO:tasks.workunit.client.1.smithi165.stdout:3/318: write da/d20/d26/f4f [130879,96201] 0 2024-09-16T02:05:46.108 INFO:tasks.workunit.client.0.smithi110.stdout:3/60: rename d8/lf to d8/dc/l12 0 2024-09-16T02:05:46.110 INFO:tasks.workunit.client.1.smithi165.stdout:7/242: symlink d0/d3d/l47 0 2024-09-16T02:05:46.110 INFO:tasks.workunit.client.1.smithi165.stdout:6/234: dwrite d7/fd [0,4194304] 0 2024-09-16T02:05:46.112 INFO:tasks.workunit.client.0.smithi110.stdout:5/48: creat d5/dd/f10 x:0 0 0 2024-09-16T02:05:46.113 INFO:tasks.workunit.client.0.smithi110.stdout:5/49: dread - d5/dd/f10 zero size 2024-09-16T02:05:46.113 INFO:tasks.workunit.client.0.smithi110.stdout:5/50: dread - d5/f8 zero size 2024-09-16T02:05:46.114 INFO:tasks.workunit.client.1.smithi165.stdout:6/235: fsync d7/f1e 0 2024-09-16T02:05:46.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/51: truncate d5/fc 661413 0 2024-09-16T02:05:46.116 INFO:tasks.workunit.client.0.smithi110.stdout:2/60: fdatasync d0/f8 0 2024-09-16T02:05:46.118 INFO:tasks.workunit.client.0.smithi110.stdout:9/42: getdents d1/d5/d8 0 2024-09-16T02:05:46.119 INFO:tasks.workunit.client.1.smithi165.stdout:0/230: mknod d0/d1e/d20/d28/c54 0 2024-09-16T02:05:46.119 INFO:tasks.workunit.client.0.smithi110.stdout:3/61: creat d8/dc/f13 x:0 0 0 2024-09-16T02:05:46.120 INFO:tasks.workunit.client.1.smithi165.stdout:2/293: write df/f19 [158386,122322] 0 2024-09-16T02:05:46.121 INFO:tasks.workunit.client.1.smithi165.stdout:5/213: dwrite de/d19/f25 [4194304,4194304] 0 2024-09-16T02:05:46.122 INFO:tasks.workunit.client.1.smithi165.stdout:6/236: write d7/dc/df/d1a/f2d [262626,66846] 0 2024-09-16T02:05:46.123 INFO:tasks.workunit.client.1.smithi165.stdout:5/214: read - de/d21/d26/d3a/f3c zero size 2024-09-16T02:05:46.123 INFO:tasks.workunit.client.1.smithi165.stdout:9/258: rename c3 to d7/d32/c5a 0 2024-09-16T02:05:46.124 INFO:tasks.workunit.client.0.smithi110.stdout:5/52: mkdir d5/dd/df/d11 0 2024-09-16T02:05:46.126 INFO:tasks.workunit.client.0.smithi110.stdout:3/62: mknod d8/c14 0 2024-09-16T02:05:46.127 INFO:tasks.workunit.client.1.smithi165.stdout:8/268: truncate dd/d11/d14/f40 2330644 0 2024-09-16T02:05:46.128 INFO:tasks.workunit.client.0.smithi110.stdout:5/53: creat d5/dd/f12 x:0 0 0 2024-09-16T02:05:46.129 INFO:tasks.workunit.client.0.smithi110.stdout:3/63: rmdir d8 39 2024-09-16T02:05:46.132 INFO:tasks.workunit.client.0.smithi110.stdout:5/54: creat d5/f13 x:0 0 0 2024-09-16T02:05:46.133 INFO:tasks.workunit.client.1.smithi165.stdout:7/243: unlink d0/df/d33/d2a/l43 0 2024-09-16T02:05:46.133 INFO:tasks.workunit.client.1.smithi165.stdout:7/244: chown d0/df/c21 17035 1 2024-09-16T02:05:46.134 INFO:tasks.workunit.client.1.smithi165.stdout:7/245: readlink d0/df/d7/lb 0 2024-09-16T02:05:46.134 INFO:tasks.workunit.client.1.smithi165.stdout:7/246: readlink d0/df/d33/l3c 0 2024-09-16T02:05:46.139 INFO:tasks.workunit.client.1.smithi165.stdout:7/247: dread d0/f41 [0,4194304] 0 2024-09-16T02:05:46.139 INFO:tasks.workunit.client.0.smithi110.stdout:5/55: creat d5/dd/df/d11/f14 x:0 0 0 2024-09-16T02:05:46.140 INFO:tasks.workunit.client.0.smithi110.stdout:3/64: link d8/f9 d8/f15 0 2024-09-16T02:05:46.141 INFO:tasks.workunit.client.1.smithi165.stdout:4/181: rename d4/l6 to d4/dc/d20/l3e 0 2024-09-16T02:05:46.143 INFO:tasks.workunit.client.0.smithi110.stdout:5/56: rename d5/l7 to d5/dd/df/d11/l15 0 2024-09-16T02:05:46.143 INFO:tasks.workunit.client.0.smithi110.stdout:5/57: write d5/dd/f10 [415417,131033] 0 2024-09-16T02:05:46.144 INFO:tasks.workunit.client.0.smithi110.stdout:3/65: unlink d8/dc/f13 0 2024-09-16T02:05:46.144 INFO:tasks.workunit.client.0.smithi110.stdout:2/61: write d0/f8 [1609379,120848] 0 2024-09-16T02:05:46.145 INFO:tasks.workunit.client.1.smithi165.stdout:2/294: dread df/d10/f13 [0,4194304] 0 2024-09-16T02:05:46.145 INFO:tasks.workunit.client.1.smithi165.stdout:2/295: read df/f16 [1392179,76550] 0 2024-09-16T02:05:46.146 INFO:tasks.workunit.client.0.smithi110.stdout:2/62: chown d0/l4 139585076 1 2024-09-16T02:05:46.146 INFO:tasks.workunit.client.0.smithi110.stdout:5/58: write d5/f6 [1130681,119112] 0 2024-09-16T02:05:46.146 INFO:tasks.workunit.client.1.smithi165.stdout:8/269: creat dd/d11/d38/f5e x:0 0 0 2024-09-16T02:05:46.146 INFO:tasks.workunit.client.1.smithi165.stdout:2/296: dread - df/d23/f38 zero size 2024-09-16T02:05:46.147 INFO:tasks.workunit.client.0.smithi110.stdout:2/63: chown d0/db/f12 18606261 1 2024-09-16T02:05:46.151 INFO:tasks.workunit.client.0.smithi110.stdout:5/59: creat d5/f16 x:0 0 0 2024-09-16T02:05:46.152 INFO:tasks.workunit.client.1.smithi165.stdout:6/237: mknod d7/dc/c3e 0 2024-09-16T02:05:46.153 INFO:tasks.workunit.client.0.smithi110.stdout:2/64: stat d0/da/df/dc/fe 0 2024-09-16T02:05:46.154 INFO:tasks.workunit.client.1.smithi165.stdout:6/238: write d7/f23 [1160861,113026] 0 2024-09-16T02:05:46.154 INFO:tasks.workunit.client.1.smithi165.stdout:6/239: dread - d7/d1f/f27 zero size 2024-09-16T02:05:46.154 INFO:tasks.workunit.client.1.smithi165.stdout:5/215: mknod de/c44 0 2024-09-16T02:05:46.157 INFO:tasks.workunit.client.1.smithi165.stdout:4/182: unlink d4/fb 0 2024-09-16T02:05:46.158 INFO:tasks.workunit.client.0.smithi110.stdout:2/65: mknod d0/c14 0 2024-09-16T02:05:46.159 INFO:tasks.workunit.client.1.smithi165.stdout:7/248: dread d0/df/d7/f23 [0,4194304] 0 2024-09-16T02:05:46.159 INFO:tasks.workunit.client.0.smithi110.stdout:2/66: write d0/db/f12 [11393,124014] 0 2024-09-16T02:05:46.159 INFO:tasks.workunit.client.1.smithi165.stdout:7/249: chown d0/df/d33/d2a 6067 1 2024-09-16T02:05:46.160 INFO:tasks.workunit.client.1.smithi165.stdout:7/250: stat d0/df/d33/l1f 0 2024-09-16T02:05:46.160 INFO:tasks.workunit.client.1.smithi165.stdout:3/319: rename da/d72 to da/d17/d78 0 2024-09-16T02:05:46.162 INFO:tasks.workunit.client.1.smithi165.stdout:1/218: write d1/dd/f14 [3101789,129703] 0 2024-09-16T02:05:46.162 INFO:tasks.workunit.client.1.smithi165.stdout:9/259: symlink d7/d1f/d54/l5b 0 2024-09-16T02:05:46.163 INFO:tasks.workunit.client.1.smithi165.stdout:9/260: fsync d7/d1f/f46 0 2024-09-16T02:05:46.164 INFO:tasks.workunit.client.0.smithi110.stdout:2/67: mknod d0/da/df/c15 0 2024-09-16T02:05:46.165 INFO:tasks.workunit.client.1.smithi165.stdout:2/297: chown df/d10/d1a/l57 4 1 2024-09-16T02:05:46.166 INFO:tasks.workunit.client.1.smithi165.stdout:2/298: chown df/d23/d28/f46 476622 1 2024-09-16T02:05:46.166 INFO:tasks.workunit.client.1.smithi165.stdout:2/299: chown df/d10/l1e 732091382 1 2024-09-16T02:05:46.167 INFO:tasks.workunit.client.0.smithi110.stdout:2/68: dread d0/f7 [0,4194304] 0 2024-09-16T02:05:46.171 INFO:tasks.workunit.client.0.smithi110.stdout:2/69: dread d0/da/df/f10 [0,4194304] 0 2024-09-16T02:05:46.172 INFO:tasks.workunit.client.0.smithi110.stdout:2/70: read d0/da/df/dc/fe [2831334,24279] 0 2024-09-16T02:05:46.172 INFO:tasks.workunit.client.1.smithi165.stdout:4/183: mknod d4/dc/d18/c3f 0 2024-09-16T02:05:46.172 INFO:tasks.workunit.client.1.smithi165.stdout:2/300: dwrite df/d10/d1a/f27 [4194304,4194304] 0 2024-09-16T02:05:46.174 INFO:tasks.workunit.client.1.smithi165.stdout:6/240: dread d7/f1e [4194304,4194304] 0 2024-09-16T02:05:46.176 INFO:tasks.workunit.client.1.smithi165.stdout:6/241: chown d7/d1f/f33 3318273 1 2024-09-16T02:05:46.176 INFO:tasks.workunit.client.0.smithi110.stdout:3/66: dwrite f4 [0,4194304] 0 2024-09-16T02:05:46.176 INFO:tasks.workunit.client.1.smithi165.stdout:3/320: rename da/d17/d78/c64 to da/d17/d78/d2c/d2d/d6c/c79 0 2024-09-16T02:05:46.178 INFO:tasks.workunit.client.1.smithi165.stdout:1/219: creat d1/d32/f3c x:0 0 0 2024-09-16T02:05:46.180 INFO:tasks.workunit.client.0.smithi110.stdout:2/71: rename d0/da/df/dc/fe to d0/f16 0 2024-09-16T02:05:46.182 INFO:tasks.workunit.client.1.smithi165.stdout:6/242: dwrite d7/f1e [0,4194304] 0 2024-09-16T02:05:46.187 INFO:tasks.workunit.client.1.smithi165.stdout:9/261: mkdir d7/d32/d38/d53/d5c 0 2024-09-16T02:05:46.188 INFO:tasks.workunit.client.1.smithi165.stdout:9/262: write d7/d1f/d27/f3c [394827,29381] 0 2024-09-16T02:05:46.189 INFO:tasks.workunit.client.0.smithi110.stdout:2/72: creat d0/da/df/dc/f17 x:0 0 0 2024-09-16T02:05:46.190 INFO:tasks.workunit.client.0.smithi110.stdout:5/60: truncate d5/dd/f10 98155 0 2024-09-16T02:05:46.191 INFO:tasks.workunit.client.0.smithi110.stdout:5/61: dread - d5/dd/df/d11/f14 zero size 2024-09-16T02:05:46.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/67: truncate f7 497332 0 2024-09-16T02:05:46.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/68: chown d8 55 1 2024-09-16T02:05:46.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/69: stat f4 0 2024-09-16T02:05:46.193 INFO:tasks.workunit.client.1.smithi165.stdout:0/231: sync 2024-09-16T02:05:46.194 INFO:tasks.workunit.client.1.smithi165.stdout:0/232: readlink d0/la 0 2024-09-16T02:05:46.194 INFO:tasks.workunit.client.1.smithi165.stdout:0/233: readlink d0/l14 0 2024-09-16T02:05:46.197 INFO:tasks.workunit.client.0.smithi110.stdout:5/62: dread f0 [0,4194304] 0 2024-09-16T02:05:46.197 INFO:tasks.workunit.client.1.smithi165.stdout:4/184: mkdir d4/d40 0 2024-09-16T02:05:46.198 INFO:tasks.workunit.client.0.smithi110.stdout:5/63: write d5/f16 [49207,93011] 0 2024-09-16T02:05:46.199 INFO:tasks.workunit.client.0.smithi110.stdout:3/70: dread f3 [4194304,4194304] 0 2024-09-16T02:05:46.199 INFO:tasks.workunit.client.1.smithi165.stdout:0/234: dread d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:46.200 INFO:tasks.workunit.client.0.smithi110.stdout:3/71: write f2 [1042291,128009] 0 2024-09-16T02:05:46.200 INFO:tasks.workunit.client.1.smithi165.stdout:2/301: rmdir df 39 2024-09-16T02:05:46.205 INFO:tasks.workunit.client.1.smithi165.stdout:3/321: mkdir da/d17/d7a 0 2024-09-16T02:05:46.207 INFO:tasks.workunit.client.1.smithi165.stdout:1/220: creat d1/d22/f3d x:0 0 0 2024-09-16T02:05:46.208 INFO:tasks.workunit.client.0.smithi110.stdout:5/64: rename d5/fc to d5/dd/f17 0 2024-09-16T02:05:46.209 INFO:tasks.workunit.client.1.smithi165.stdout:8/270: creat dd/d11/f5f x:0 0 0 2024-09-16T02:05:46.209 INFO:tasks.workunit.client.0.smithi110.stdout:5/65: read - d5/f8 zero size 2024-09-16T02:05:46.214 INFO:tasks.workunit.client.1.smithi165.stdout:6/243: chown d7/dc/c16 21 1 2024-09-16T02:05:46.216 INFO:tasks.workunit.client.1.smithi165.stdout:9/263: creat d7/d1f/f5d x:0 0 0 2024-09-16T02:05:46.218 INFO:tasks.workunit.client.1.smithi165.stdout:5/216: write de/d19/f33 [404440,43999] 0 2024-09-16T02:05:46.219 INFO:tasks.workunit.client.1.smithi165.stdout:4/185: rename d4/fa to d4/dc/d28/d2b/f41 0 2024-09-16T02:05:46.221 INFO:tasks.workunit.client.1.smithi165.stdout:0/235: symlink d0/d1e/d20/d28/l55 0 2024-09-16T02:05:46.222 INFO:tasks.workunit.client.1.smithi165.stdout:6/244: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T02:05:46.222 INFO:tasks.workunit.client.1.smithi165.stdout:7/251: link d0/df/d7/l2f d0/df/d7/l48 0 2024-09-16T02:05:46.223 INFO:tasks.workunit.client.0.smithi110.stdout:5/66: dwrite d5/dd/f17 [0,4194304] 0 2024-09-16T02:05:46.224 INFO:tasks.workunit.client.1.smithi165.stdout:3/322: mknod da/d20/d26/d52/d6b/c7b 0 2024-09-16T02:05:46.224 INFO:tasks.workunit.client.1.smithi165.stdout:6/245: read d7/f9 [2194839,51008] 0 2024-09-16T02:05:46.225 INFO:tasks.workunit.client.1.smithi165.stdout:1/221: write d1/f3a [3460254,25662] 0 2024-09-16T02:05:46.226 INFO:tasks.workunit.client.0.smithi110.stdout:5/67: symlink d5/l18 0 2024-09-16T02:05:46.230 INFO:tasks.workunit.client.1.smithi165.stdout:9/264: creat d7/d1f/d27/d49/f5e x:0 0 0 2024-09-16T02:05:46.232 INFO:tasks.workunit.client.1.smithi165.stdout:5/217: mknod de/d19/d1c/c45 0 2024-09-16T02:05:46.232 INFO:tasks.workunit.client.0.smithi110.stdout:2/73: truncate d0/f7 1112848 0 2024-09-16T02:05:46.234 INFO:tasks.workunit.client.1.smithi165.stdout:5/218: readlink de/l35 0 2024-09-16T02:05:46.234 INFO:tasks.workunit.client.1.smithi165.stdout:9/265: write d7/d32/f39 [685824,124187] 0 2024-09-16T02:05:46.234 INFO:tasks.workunit.client.1.smithi165.stdout:3/323: dwrite da/d17/f4a [0,4194304] 0 2024-09-16T02:05:46.234 INFO:tasks.workunit.client.1.smithi165.stdout:4/186: mkdir d4/dc/d28/d2b/d42 0 2024-09-16T02:05:46.236 INFO:tasks.workunit.client.1.smithi165.stdout:0/236: symlink d0/l56 0 2024-09-16T02:05:46.237 INFO:tasks.workunit.client.1.smithi165.stdout:1/222: dwrite d1/d32/f3c [0,4194304] 0 2024-09-16T02:05:46.237 INFO:tasks.workunit.client.0.smithi110.stdout:2/74: rename d0/da/df to d0/da/d18 0 2024-09-16T02:05:46.239 INFO:tasks.workunit.client.1.smithi165.stdout:9/266: stat d7/c19 0 2024-09-16T02:05:46.239 INFO:tasks.workunit.client.1.smithi165.stdout:0/237: chown d0/l5 7 1 2024-09-16T02:05:46.239 INFO:tasks.workunit.client.1.smithi165.stdout:1/223: chown d1/d22/l27 344249708 1 2024-09-16T02:05:46.239 INFO:tasks.workunit.client.1.smithi165.stdout:2/302: unlink df/d23/d28/f39 0 2024-09-16T02:05:46.240 INFO:tasks.workunit.client.1.smithi165.stdout:7/252: rename d0/df/d7/l3a to d0/d2c/l49 0 2024-09-16T02:05:46.241 INFO:tasks.workunit.client.1.smithi165.stdout:1/224: write d1/d32/f34 [368504,101767] 0 2024-09-16T02:05:46.242 INFO:tasks.workunit.client.0.smithi110.stdout:2/75: creat d0/da/d18/f19 x:0 0 0 2024-09-16T02:05:46.243 INFO:tasks.workunit.client.1.smithi165.stdout:6/246: rmdir d7/d1f 39 2024-09-16T02:05:46.245 INFO:tasks.workunit.client.0.smithi110.stdout:2/76: symlink d0/da/l1a 0 2024-09-16T02:05:46.247 INFO:tasks.workunit.client.0.smithi110.stdout:2/77: write d0/da/d18/f19 [363401,105821] 0 2024-09-16T02:05:46.251 INFO:tasks.workunit.client.1.smithi165.stdout:1/225: dwrite d1/dd/f2e [0,4194304] 0 2024-09-16T02:05:46.251 INFO:tasks.workunit.client.1.smithi165.stdout:5/219: symlink de/d21/d36/l46 0 2024-09-16T02:05:46.253 INFO:tasks.workunit.client.1.smithi165.stdout:3/324: creat da/d57/f7c x:0 0 0 2024-09-16T02:05:46.254 INFO:tasks.workunit.client.1.smithi165.stdout:5/220: chown de/l13 209421841 1 2024-09-16T02:05:46.254 INFO:tasks.workunit.client.0.smithi110.stdout:3/72: truncate f3 2298190 0 2024-09-16T02:05:46.255 INFO:tasks.workunit.client.0.smithi110.stdout:3/73: chown d8 1314529 1 2024-09-16T02:05:46.256 INFO:tasks.workunit.client.1.smithi165.stdout:5/221: dread - de/d21/f40 zero size 2024-09-16T02:05:46.257 INFO:tasks.workunit.client.0.smithi110.stdout:2/78: creat d0/da/f1b x:0 0 0 2024-09-16T02:05:46.257 INFO:tasks.workunit.client.1.smithi165.stdout:5/222: readlink de/d19/l1a 0 2024-09-16T02:05:46.257 INFO:tasks.workunit.client.0.smithi110.stdout:2/79: write d0/f8 [4477864,114508] 0 2024-09-16T02:05:46.258 INFO:tasks.workunit.client.0.smithi110.stdout:2/80: chown d0/db 33831173 1 2024-09-16T02:05:46.259 INFO:tasks.workunit.client.1.smithi165.stdout:9/267: symlink d7/df/d37/d43/l5f 0 2024-09-16T02:05:46.259 INFO:tasks.workunit.client.0.smithi110.stdout:2/81: read d0/db/fd [3630262,36624] 0 2024-09-16T02:05:46.260 INFO:tasks.workunit.client.0.smithi110.stdout:5/68: write d5/dd/f10 [258458,35330] 0 2024-09-16T02:05:46.261 INFO:tasks.workunit.client.1.smithi165.stdout:5/223: write de/f10 [3872743,76042] 0 2024-09-16T02:05:46.261 INFO:tasks.workunit.client.0.smithi110.stdout:5/69: dread - d5/f13 zero size 2024-09-16T02:05:46.261 INFO:tasks.workunit.client.1.smithi165.stdout:9/268: chown d7/l2f 1686 1 2024-09-16T02:05:46.262 INFO:tasks.workunit.client.1.smithi165.stdout:5/224: stat de/f14 0 2024-09-16T02:05:46.263 INFO:tasks.workunit.client.1.smithi165.stdout:5/225: readlink de/l15 0 2024-09-16T02:05:46.263 INFO:tasks.workunit.client.1.smithi165.stdout:1/226: dread d1/dd/f2e [0,4194304] 0 2024-09-16T02:05:46.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/269: readlink d7/df/l48 0 2024-09-16T02:05:46.265 INFO:tasks.workunit.client.1.smithi165.stdout:0/238: dwrite d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:46.267 INFO:tasks.workunit.client.0.smithi110.stdout:2/82: unlink d0/da/l1a 0 2024-09-16T02:05:46.269 INFO:tasks.workunit.client.1.smithi165.stdout:5/226: write de/d21/f41 [744095,20828] 0 2024-09-16T02:05:46.269 INFO:tasks.workunit.client.1.smithi165.stdout:5/227: chown de/d19/d1c 339055582 1 2024-09-16T02:05:46.270 INFO:tasks.workunit.client.0.smithi110.stdout:5/70: unlink d5/dd/df/d11/f14 0 2024-09-16T02:05:46.272 INFO:tasks.workunit.client.1.smithi165.stdout:2/303: dread df/f34 [0,4194304] 0 2024-09-16T02:05:46.276 INFO:tasks.workunit.client.0.smithi110.stdout:2/83: rename d0/db/f12 to d0/da/d18/dc/f1c 0 2024-09-16T02:05:46.280 INFO:tasks.workunit.client.1.smithi165.stdout:8/271: dwrite dd/ff [0,4194304] 0 2024-09-16T02:05:46.280 INFO:tasks.workunit.client.0.smithi110.stdout:5/71: read f0 [3878594,52622] 0 2024-09-16T02:05:46.281 INFO:tasks.workunit.client.0.smithi110.stdout:5/72: chown d5/dd/df/d11 5606852 1 2024-09-16T02:05:46.282 INFO:tasks.workunit.client.0.smithi110.stdout:5/73: write d5/f16 [81410,45893] 0 2024-09-16T02:05:46.282 INFO:tasks.workunit.client.1.smithi165.stdout:1/227: mknod d1/dd/d11/c3e 0 2024-09-16T02:05:46.283 INFO:tasks.workunit.client.1.smithi165.stdout:3/325: dread da/d20/f3d [0,4194304] 0 2024-09-16T02:05:46.289 INFO:tasks.workunit.client.0.smithi110.stdout:3/74: dread f3 [0,4194304] 0 2024-09-16T02:05:46.293 INFO:tasks.workunit.client.1.smithi165.stdout:2/304: creat df/d23/d2a/f5c x:0 0 0 2024-09-16T02:05:46.293 INFO:tasks.workunit.client.1.smithi165.stdout:2/305: stat df/d10/d37/f3d 0 2024-09-16T02:05:46.293 INFO:tasks.workunit.client.0.smithi110.stdout:3/75: creat d8/f16 x:0 0 0 2024-09-16T02:05:46.295 INFO:tasks.workunit.client.0.smithi110.stdout:2/84: link d0/c14 d0/da/d18/dc/c1d 0 2024-09-16T02:05:46.296 INFO:tasks.workunit.client.0.smithi110.stdout:5/74: rmdir d5/dd 39 2024-09-16T02:05:46.298 INFO:tasks.workunit.client.1.smithi165.stdout:9/270: mknod d7/c60 0 2024-09-16T02:05:46.298 INFO:tasks.workunit.client.1.smithi165.stdout:4/187: write d4/dc/d28/d2b/f41 [2587854,117541] 0 2024-09-16T02:05:46.299 INFO:tasks.workunit.client.1.smithi165.stdout:4/188: write d4/f26 [1669646,112105] 0 2024-09-16T02:05:46.301 INFO:tasks.workunit.client.1.smithi165.stdout:8/272: mknod dd/d11/d14/d3f/c60 0 2024-09-16T02:05:46.302 INFO:tasks.workunit.client.0.smithi110.stdout:2/85: mknod d0/da/d18/dc/c1e 0 2024-09-16T02:05:46.303 INFO:tasks.workunit.client.0.smithi110.stdout:5/75: dread d5/f6 [0,4194304] 0 2024-09-16T02:05:46.303 INFO:tasks.workunit.client.1.smithi165.stdout:1/228: mkdir d1/dd/d11/d33/d3f 0 2024-09-16T02:05:46.304 INFO:tasks.workunit.client.1.smithi165.stdout:6/247: link c4 d7/dc/d3b/c3f 0 2024-09-16T02:05:46.304 INFO:tasks.workunit.client.1.smithi165.stdout:6/248: stat d7/l15 0 2024-09-16T02:05:46.305 INFO:tasks.workunit.client.1.smithi165.stdout:6/249: write d7/f23 [4756253,93771] 0 2024-09-16T02:05:46.308 INFO:tasks.workunit.client.1.smithi165.stdout:2/306: mknod df/d10/d1a/d2d/c5d 0 2024-09-16T02:05:46.308 INFO:tasks.workunit.client.1.smithi165.stdout:2/307: readlink df/d10/d1a/d2d/l30 0 2024-09-16T02:05:46.310 INFO:tasks.workunit.client.0.smithi110.stdout:2/86: dread d0/da/d18/f10 [0,4194304] 0 2024-09-16T02:05:46.310 INFO:tasks.workunit.client.1.smithi165.stdout:7/253: getdents d0 0 2024-09-16T02:05:46.314 INFO:tasks.workunit.client.1.smithi165.stdout:4/189: creat d4/dc/d28/f43 x:0 0 0 2024-09-16T02:05:46.314 INFO:tasks.workunit.client.1.smithi165.stdout:4/190: write d4/f26 [2746449,110412] 0 2024-09-16T02:05:46.315 INFO:tasks.workunit.client.1.smithi165.stdout:4/191: fsync d4/dc/f19 0 2024-09-16T02:05:46.316 INFO:tasks.workunit.client.0.smithi110.stdout:5/76: creat d5/f19 x:0 0 0 2024-09-16T02:05:46.316 INFO:tasks.workunit.client.0.smithi110.stdout:2/87: dwrite d0/da/d18/dc/f17 [0,4194304] 0 2024-09-16T02:05:46.319 INFO:tasks.workunit.client.1.smithi165.stdout:0/239: creat d0/d1e/f57 x:0 0 0 2024-09-16T02:05:46.322 INFO:tasks.workunit.client.0.smithi110.stdout:2/88: unlink d0/da/d18/f10 0 2024-09-16T02:05:46.324 INFO:tasks.workunit.client.0.smithi110.stdout:2/89: fdatasync d0/da/f1b 0 2024-09-16T02:05:46.325 INFO:tasks.workunit.client.0.smithi110.stdout:3/76: dwrite f7 [0,4194304] 0 2024-09-16T02:05:46.325 INFO:tasks.workunit.client.0.smithi110.stdout:2/90: chown d0/db 216 1 2024-09-16T02:05:46.325 INFO:tasks.workunit.client.0.smithi110.stdout:3/77: chown f1 31888938 1 2024-09-16T02:05:46.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/271: mkdir d7/d32/d38/d53/d5c/d61 0 2024-09-16T02:05:46.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/272: dread - d7/d55/f4c zero size 2024-09-16T02:05:46.329 INFO:tasks.workunit.client.1.smithi165.stdout:1/229: link d1/f3a d1/d19/d24/d30/f40 0 2024-09-16T02:05:46.330 INFO:tasks.workunit.client.1.smithi165.stdout:9/273: dread d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:46.330 INFO:tasks.workunit.client.0.smithi110.stdout:3/78: creat d8/f17 x:0 0 0 2024-09-16T02:05:46.330 INFO:tasks.workunit.client.1.smithi165.stdout:9/274: fsync d7/d1f/d27/f2d 0 2024-09-16T02:05:46.331 INFO:tasks.workunit.client.1.smithi165.stdout:4/192: creat d4/f44 x:0 0 0 2024-09-16T02:05:46.331 INFO:tasks.workunit.client.1.smithi165.stdout:9/275: dread - d7/d1f/f5d zero size 2024-09-16T02:05:46.333 INFO:tasks.workunit.client.0.smithi110.stdout:3/79: unlink d8/fa 0 2024-09-16T02:05:46.333 INFO:tasks.workunit.client.0.smithi110.stdout:3/80: truncate f2 5139802 0 2024-09-16T02:05:46.334 INFO:tasks.workunit.client.0.smithi110.stdout:2/91: link d0/da/d18/dc/f17 d0/da/d18/dc/f1f 0 2024-09-16T02:05:46.336 INFO:tasks.workunit.client.1.smithi165.stdout:4/193: dwrite d4/dc/d18/f22 [0,4194304] 0 2024-09-16T02:05:46.337 INFO:tasks.workunit.client.1.smithi165.stdout:9/276: readlink d7/df/l51 0 2024-09-16T02:05:46.339 INFO:tasks.workunit.client.1.smithi165.stdout:4/194: mkdir d4/dc/d20/d45 0 2024-09-16T02:05:46.340 INFO:tasks.workunit.client.1.smithi165.stdout:2/308: getdents df/d10/d1a 0 2024-09-16T02:05:46.340 INFO:tasks.workunit.client.1.smithi165.stdout:4/195: chown d4/dc/d20/d45 2 1 2024-09-16T02:05:46.340 INFO:tasks.workunit.client.1.smithi165.stdout:9/277: mknod d7/df/d37/c62 0 2024-09-16T02:05:46.341 INFO:tasks.workunit.client.1.smithi165.stdout:4/196: chown d4/dc/d18/f22 873 1 2024-09-16T02:05:46.341 INFO:tasks.workunit.client.1.smithi165.stdout:9/278: unlink d7/c33 0 2024-09-16T02:05:46.342 INFO:tasks.workunit.client.1.smithi165.stdout:4/197: write d4/dc/d18/f34 [920209,49738] 0 2024-09-16T02:05:46.343 INFO:tasks.workunit.client.1.smithi165.stdout:2/309: mknod df/d10/d37/d45/c5e 0 2024-09-16T02:05:46.343 INFO:tasks.workunit.client.0.smithi110.stdout:2/92: dwrite d0/f8 [4194304,4194304] 0 2024-09-16T02:05:46.344 INFO:tasks.workunit.client.1.smithi165.stdout:2/310: truncate df/d23/d28/f53 228671 0 2024-09-16T02:05:46.345 INFO:tasks.workunit.client.1.smithi165.stdout:4/198: mknod d4/dc/d28/d30/c46 0 2024-09-16T02:05:46.346 INFO:tasks.workunit.client.1.smithi165.stdout:2/311: mknod df/d10/d37/c5f 0 2024-09-16T02:05:46.348 INFO:tasks.workunit.client.1.smithi165.stdout:2/312: write df/d10/d1a/d2d/f4b [852922,49061] 0 2024-09-16T02:05:46.349 INFO:tasks.workunit.client.1.smithi165.stdout:9/279: dwrite d7/d55/f4c [0,4194304] 0 2024-09-16T02:05:46.353 INFO:tasks.workunit.client.1.smithi165.stdout:2/313: mknod df/d10/d37/c60 0 2024-09-16T02:05:46.353 INFO:tasks.workunit.client.1.smithi165.stdout:9/280: mknod d7/d32/d38/d58/c63 0 2024-09-16T02:05:46.357 INFO:tasks.workunit.client.1.smithi165.stdout:9/281: creat d7/d32/f64 x:0 0 0 2024-09-16T02:05:46.362 INFO:tasks.workunit.client.1.smithi165.stdout:9/282: dread d7/d55/f4c [0,4194304] 0 2024-09-16T02:05:46.364 INFO:tasks.workunit.client.1.smithi165.stdout:9/283: mkdir d7/df/d37/d65 0 2024-09-16T02:05:46.368 INFO:tasks.workunit.client.1.smithi165.stdout:9/284: rename d7/d1f/d27/f2d to d7/d55/f66 0 2024-09-16T02:05:46.376 INFO:tasks.workunit.client.1.smithi165.stdout:0/240: getdents d0/d1e 0 2024-09-16T02:05:46.377 INFO:tasks.workunit.client.0.smithi110.stdout:5/77: truncate d5/dd/f17 3536543 0 2024-09-16T02:05:46.381 INFO:tasks.workunit.client.1.smithi165.stdout:9/285: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:46.382 INFO:tasks.workunit.client.1.smithi165.stdout:6/250: write d7/d1f/f32 [409430,6395] 0 2024-09-16T02:05:46.382 INFO:tasks.workunit.client.1.smithi165.stdout:9/286: write d7/fd [1092806,59868] 0 2024-09-16T02:05:46.383 INFO:tasks.workunit.client.1.smithi165.stdout:0/241: link d0/d1e/d39/d48/d45/c3b d0/d1e/d39/c58 0 2024-09-16T02:05:46.385 INFO:tasks.workunit.client.1.smithi165.stdout:7/254: write d0/f19 [4042745,65583] 0 2024-09-16T02:05:46.386 INFO:tasks.workunit.client.1.smithi165.stdout:9/287: unlink d7/cc 0 2024-09-16T02:05:46.389 INFO:tasks.workunit.client.0.smithi110.stdout:2/93: write d0/f3 [911193,53898] 0 2024-09-16T02:05:46.391 INFO:tasks.workunit.client.0.smithi110.stdout:2/94: truncate d0/da/f1b 528816 0 2024-09-16T02:05:46.392 INFO:tasks.workunit.client.0.smithi110.stdout:2/95: dread d0/da/f1b [0,4194304] 0 2024-09-16T02:05:46.394 INFO:tasks.workunit.client.0.smithi110.stdout:5/78: write f0 [1073066,26155] 0 2024-09-16T02:05:46.394 INFO:tasks.workunit.client.0.smithi110.stdout:2/96: mknod d0/db/c20 0 2024-09-16T02:05:46.395 INFO:tasks.workunit.client.0.smithi110.stdout:5/79: stat d5/dd/df/d11/l15 0 2024-09-16T02:05:46.396 INFO:tasks.workunit.client.0.smithi110.stdout:2/97: rmdir d0/da/d18/dc 39 2024-09-16T02:05:46.398 INFO:tasks.workunit.client.0.smithi110.stdout:2/98: truncate d0/da/d18/dc/f1c 440376 0 2024-09-16T02:05:46.399 INFO:tasks.workunit.client.0.smithi110.stdout:2/99: truncate d0/f7 1847988 0 2024-09-16T02:05:46.400 INFO:tasks.workunit.client.0.smithi110.stdout:5/80: fdatasync d5/dd/f17 0 2024-09-16T02:05:46.401 INFO:tasks.workunit.client.0.smithi110.stdout:2/100: symlink d0/l21 0 2024-09-16T02:05:46.402 INFO:tasks.workunit.client.0.smithi110.stdout:5/81: symlink d5/dd/l1a 0 2024-09-16T02:05:46.402 INFO:tasks.workunit.client.0.smithi110.stdout:2/101: symlink d0/da/l22 0 2024-09-16T02:05:46.404 INFO:tasks.workunit.client.0.smithi110.stdout:2/102: symlink d0/da/l23 0 2024-09-16T02:05:46.406 INFO:tasks.workunit.client.0.smithi110.stdout:5/82: getdents d5 0 2024-09-16T02:05:46.407 INFO:tasks.workunit.client.0.smithi110.stdout:2/103: rename d0/da/f1b to d0/da/f24 0 2024-09-16T02:05:46.409 INFO:tasks.workunit.client.0.smithi110.stdout:5/83: dread d5/dd/f17 [0,4194304] 0 2024-09-16T02:05:46.409 INFO:tasks.workunit.client.0.smithi110.stdout:2/104: mkdir d0/da/d18/d25 0 2024-09-16T02:05:46.410 INFO:tasks.workunit.client.0.smithi110.stdout:5/84: write d5/dd/f17 [3216331,67633] 0 2024-09-16T02:05:46.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/85: chown d5/dd/df 0 1 2024-09-16T02:05:46.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/86: chown d5/f13 100851456 1 2024-09-16T02:05:46.412 INFO:tasks.workunit.client.0.smithi110.stdout:5/87: chown d5/le 5 1 2024-09-16T02:05:46.415 INFO:tasks.workunit.client.0.smithi110.stdout:2/105: write d0/da/f24 [1242094,78375] 0 2024-09-16T02:05:46.415 INFO:tasks.workunit.client.0.smithi110.stdout:5/88: link d5/dd/df/d11/l15 d5/dd/l1b 0 2024-09-16T02:05:46.416 INFO:tasks.workunit.client.0.smithi110.stdout:5/89: readlink d5/le 0 2024-09-16T02:05:46.419 INFO:tasks.workunit.client.0.smithi110.stdout:2/106: link d0/da/f24 d0/da/f26 0 2024-09-16T02:05:46.421 INFO:tasks.workunit.client.1.smithi165.stdout:5/228: sync 2024-09-16T02:05:46.421 INFO:tasks.workunit.client.1.smithi165.stdout:6/251: mknod d7/dc/d3b/d3a/d3d/c40 0 2024-09-16T02:05:46.422 INFO:tasks.workunit.client.1.smithi165.stdout:0/242: creat d0/d47/f59 x:0 0 0 2024-09-16T02:05:46.422 INFO:tasks.workunit.client.0.smithi110.stdout:5/90: dwrite d5/dd/f12 [0,4194304] 0 2024-09-16T02:05:46.423 INFO:tasks.workunit.client.1.smithi165.stdout:4/199: write d4/dc/d20/f27 [4303027,120784] 0 2024-09-16T02:05:46.424 INFO:tasks.workunit.client.0.smithi110.stdout:5/91: write d5/f13 [253151,82862] 0 2024-09-16T02:05:46.424 INFO:tasks.workunit.client.1.smithi165.stdout:9/288: mkdir d7/df/d67 0 2024-09-16T02:05:46.425 INFO:tasks.workunit.client.1.smithi165.stdout:6/252: dread d7/d1f/f32 [0,4194304] 0 2024-09-16T02:05:46.426 INFO:tasks.workunit.client.1.smithi165.stdout:5/229: read de/d19/f32 [6239,1175] 0 2024-09-16T02:05:46.426 INFO:tasks.workunit.client.1.smithi165.stdout:0/243: creat d0/f5a x:0 0 0 2024-09-16T02:05:46.427 INFO:tasks.workunit.client.0.smithi110.stdout:5/92: fdatasync d5/f6 0 2024-09-16T02:05:46.428 INFO:tasks.workunit.client.0.smithi110.stdout:2/107: truncate d0/f8 6553958 0 2024-09-16T02:05:46.428 INFO:tasks.workunit.client.0.smithi110.stdout:5/93: write d5/dd/f10 [876921,112518] 0 2024-09-16T02:05:46.432 INFO:tasks.workunit.client.0.smithi110.stdout:5/94: creat d5/dd/df/f1c x:0 0 0 2024-09-16T02:05:46.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/95: dread - d5/f8 zero size 2024-09-16T02:05:46.434 INFO:tasks.workunit.client.0.smithi110.stdout:5/96: chown d5/l9 32392145 1 2024-09-16T02:05:46.435 INFO:tasks.workunit.client.0.smithi110.stdout:5/97: read d5/f13 [324113,117242] 0 2024-09-16T02:05:46.437 INFO:tasks.workunit.client.0.smithi110.stdout:5/98: dread - d5/dd/df/f1c zero size 2024-09-16T02:05:46.437 INFO:tasks.workunit.client.0.smithi110.stdout:2/108: dwrite d0/db/fd [0,4194304] 0 2024-09-16T02:05:46.439 INFO:tasks.workunit.client.0.smithi110.stdout:2/109: read d0/db/fd [2642715,86265] 0 2024-09-16T02:05:46.439 INFO:tasks.workunit.client.0.smithi110.stdout:5/99: creat d5/dd/df/f1d x:0 0 0 2024-09-16T02:05:46.440 INFO:tasks.workunit.client.0.smithi110.stdout:5/100: fsync d5/dd/f10 0 2024-09-16T02:05:46.449 INFO:tasks.workunit.client.0.smithi110.stdout:5/101: dwrite d5/dd/f10 [0,4194304] 0 2024-09-16T02:05:46.452 INFO:tasks.workunit.client.0.smithi110.stdout:5/102: creat d5/f1e x:0 0 0 2024-09-16T02:05:46.452 INFO:tasks.workunit.client.0.smithi110.stdout:2/110: dwrite d0/da/f24 [0,4194304] 0 2024-09-16T02:05:46.455 INFO:tasks.workunit.client.0.smithi110.stdout:2/111: link d0/da/d18/dc/f17 d0/db/f27 0 2024-09-16T02:05:46.456 INFO:tasks.workunit.client.1.smithi165.stdout:9/289: mkdir d7/d32/d38/d68 0 2024-09-16T02:05:46.456 INFO:tasks.workunit.client.1.smithi165.stdout:0/244: fsync d0/d1e/d39/d48/d45/f44 0 2024-09-16T02:05:46.460 INFO:tasks.workunit.client.0.smithi110.stdout:2/112: dread d0/da/f26 [0,4194304] 0 2024-09-16T02:05:46.462 INFO:tasks.workunit.client.1.smithi165.stdout:9/290: rmdir d7/df/d37/d43 39 2024-09-16T02:05:46.465 INFO:tasks.workunit.client.1.smithi165.stdout:4/200: dwrite d4/dc/d28/d2b/f41 [0,4194304] 0 2024-09-16T02:05:46.466 INFO:tasks.workunit.client.1.smithi165.stdout:9/291: truncate d7/d32/f47 879393 0 2024-09-16T02:05:46.467 INFO:tasks.workunit.client.1.smithi165.stdout:6/253: dwrite f3 [0,4194304] 0 2024-09-16T02:05:46.467 INFO:tasks.workunit.client.1.smithi165.stdout:9/292: write f4 [1413666,36454] 0 2024-09-16T02:05:46.468 INFO:tasks.workunit.client.1.smithi165.stdout:0/245: symlink d0/d1e/d39/d48/d45/l5b 0 2024-09-16T02:05:46.468 INFO:tasks.workunit.client.1.smithi165.stdout:5/230: rmdir de/d21/d36/d38 0 2024-09-16T02:05:46.469 INFO:tasks.workunit.client.0.smithi110.stdout:2/113: rmdir d0/da 39 2024-09-16T02:05:46.469 INFO:tasks.workunit.client.1.smithi165.stdout:4/201: write d4/dc/d18/f22 [481819,85645] 0 2024-09-16T02:05:46.475 INFO:tasks.workunit.client.0.smithi110.stdout:2/114: creat d0/da/f28 x:0 0 0 2024-09-16T02:05:46.475 INFO:tasks.workunit.client.1.smithi165.stdout:9/293: write d7/df/d37/f3b [777777,17150] 0 2024-09-16T02:05:46.477 INFO:tasks.workunit.client.0.smithi110.stdout:5/103: dwrite d5/dd/df/f1c [0,4194304] 0 2024-09-16T02:05:46.478 INFO:tasks.workunit.client.1.smithi165.stdout:3/326: sync 2024-09-16T02:05:46.478 INFO:tasks.workunit.client.0.smithi110.stdout:5/104: chown d5/dd 675608383 1 2024-09-16T02:05:46.479 INFO:tasks.workunit.client.1.smithi165.stdout:5/231: rename c9 to de/d21/c47 0 2024-09-16T02:05:46.481 INFO:tasks.workunit.client.1.smithi165.stdout:4/202: mkdir d4/dc/d18/d37/d47 0 2024-09-16T02:05:46.482 INFO:tasks.workunit.client.1.smithi165.stdout:0/246: dread d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:46.482 INFO:tasks.workunit.client.0.smithi110.stdout:2/115: dread d0/da/d18/dc/f1f [0,4194304] 0 2024-09-16T02:05:46.483 INFO:tasks.workunit.client.1.smithi165.stdout:6/254: dwrite d7/dc/df/d1a/f2d [0,4194304] 0 2024-09-16T02:05:46.483 INFO:tasks.workunit.client.0.smithi110.stdout:5/105: symlink d5/dd/l1f 0 2024-09-16T02:05:46.483 INFO:tasks.workunit.client.1.smithi165.stdout:5/232: mknod de/d19/d1c/c48 0 2024-09-16T02:05:46.484 INFO:tasks.workunit.client.1.smithi165.stdout:3/327: mkdir da/d17/d7a/d7d 0 2024-09-16T02:05:46.485 INFO:tasks.workunit.client.1.smithi165.stdout:6/255: write d7/f23 [37108,119661] 0 2024-09-16T02:05:46.487 INFO:tasks.workunit.client.1.smithi165.stdout:5/233: dread de/d19/d1c/f3e [0,4194304] 0 2024-09-16T02:05:46.487 INFO:tasks.workunit.client.1.smithi165.stdout:3/328: chown da/d17/d78/c49 103 1 2024-09-16T02:05:46.488 INFO:tasks.workunit.client.0.smithi110.stdout:5/106: read d5/f13 [11737,7301] 0 2024-09-16T02:05:46.489 INFO:tasks.workunit.client.1.smithi165.stdout:4/203: mknod d4/d40/c48 0 2024-09-16T02:05:46.489 INFO:tasks.workunit.client.1.smithi165.stdout:6/256: dread - d7/d1f/f27 zero size 2024-09-16T02:05:46.493 INFO:tasks.workunit.client.1.smithi165.stdout:5/234: mkdir de/d19/d1c/d49 0 2024-09-16T02:05:46.496 INFO:tasks.workunit.client.1.smithi165.stdout:0/247: dwrite d0/d47/f59 [0,4194304] 0 2024-09-16T02:05:46.497 INFO:tasks.workunit.client.1.smithi165.stdout:6/257: mknod d7/dc/df/d1a/c41 0 2024-09-16T02:05:46.498 INFO:tasks.workunit.client.1.smithi165.stdout:4/204: rename d4/dc/d18/c2f to d4/dc/d18/d37/d47/c49 0 2024-09-16T02:05:46.498 INFO:tasks.workunit.client.1.smithi165.stdout:0/248: chown d0/ff 0 1 2024-09-16T02:05:46.499 INFO:tasks.workunit.client.1.smithi165.stdout:5/235: truncate f6 606092 0 2024-09-16T02:05:46.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/205: readlink d4/dc/d28/d30/l38 0 2024-09-16T02:05:46.503 INFO:tasks.workunit.client.1.smithi165.stdout:6/258: read d7/fe [2160912,38592] 0 2024-09-16T02:05:46.503 INFO:tasks.workunit.client.1.smithi165.stdout:4/206: stat d4/l36 0 2024-09-16T02:05:46.503 INFO:tasks.workunit.client.1.smithi165.stdout:1/230: sync 2024-09-16T02:05:46.503 INFO:tasks.workunit.client.1.smithi165.stdout:8/273: sync 2024-09-16T02:05:46.503 INFO:tasks.workunit.client.1.smithi165.stdout:2/314: sync 2024-09-16T02:05:46.505 INFO:tasks.workunit.client.1.smithi165.stdout:6/259: write d7/fd [3789959,5697] 0 2024-09-16T02:05:46.506 INFO:tasks.workunit.client.0.smithi110.stdout:5/107: truncate d5/dd/f12 2066214 0 2024-09-16T02:05:46.507 INFO:tasks.workunit.client.1.smithi165.stdout:9/294: write d7/d1f/d27/d49/f50 [800373,85104] 0 2024-09-16T02:05:46.507 INFO:tasks.workunit.client.1.smithi165.stdout:8/274: write dd/d11/d38/f39 [374831,16922] 0 2024-09-16T02:05:46.507 INFO:tasks.workunit.client.1.smithi165.stdout:6/260: read d7/f9 [5784044,100525] 0 2024-09-16T02:05:46.507 INFO:tasks.workunit.client.1.smithi165.stdout:2/315: stat df/d10/d37/l40 0 2024-09-16T02:05:46.508 INFO:tasks.workunit.client.1.smithi165.stdout:4/207: creat d4/dc/d28/f4a x:0 0 0 2024-09-16T02:05:46.508 INFO:tasks.workunit.client.1.smithi165.stdout:8/275: readlink dd/d11/d14/l52 0 2024-09-16T02:05:46.509 INFO:tasks.workunit.client.0.smithi110.stdout:5/108: mknod d5/dd/c20 0 2024-09-16T02:05:46.509 INFO:tasks.workunit.client.1.smithi165.stdout:8/276: write dd/d13/f2c [1111557,89213] 0 2024-09-16T02:05:46.511 INFO:tasks.workunit.client.1.smithi165.stdout:6/261: chown c4 101897 1 2024-09-16T02:05:46.515 INFO:tasks.workunit.client.0.smithi110.stdout:5/109: dwrite d5/dd/f17 [0,4194304] 0 2024-09-16T02:05:46.515 INFO:tasks.workunit.client.1.smithi165.stdout:8/277: chown dd/d11/d14/d3f/c2e 5941706 1 2024-09-16T02:05:46.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/231: link d1/l21 d1/dd/d11/d33/d35/l41 0 2024-09-16T02:05:46.519 INFO:tasks.workunit.client.0.smithi110.stdout:5/110: creat d5/dd/f21 x:0 0 0 2024-09-16T02:05:46.520 INFO:tasks.workunit.client.1.smithi165.stdout:9/295: link d7/d32/d38/d58/c63 d7/d32/d38/d53/d5c/c69 0 2024-09-16T02:05:46.520 INFO:tasks.workunit.client.1.smithi165.stdout:2/316: dwrite df/d23/d28/f46 [0,4194304] 0 2024-09-16T02:05:46.520 INFO:tasks.workunit.client.1.smithi165.stdout:0/249: dread d0/d1e/d39/d48/d45/f4b [0,4194304] 0 2024-09-16T02:05:46.523 INFO:tasks.workunit.client.1.smithi165.stdout:1/232: mkdir d1/dd/d11/d42 0 2024-09-16T02:05:46.523 INFO:tasks.workunit.client.1.smithi165.stdout:9/296: fdatasync d7/f22 0 2024-09-16T02:05:46.524 INFO:tasks.workunit.client.0.smithi110.stdout:5/111: truncate d5/f8 1008764 0 2024-09-16T02:05:46.525 INFO:tasks.workunit.client.1.smithi165.stdout:3/329: dread da/de/f21 [0,4194304] 0 2024-09-16T02:05:46.527 INFO:tasks.workunit.client.1.smithi165.stdout:0/250: chown d0/c12 4 1 2024-09-16T02:05:46.527 INFO:tasks.workunit.client.1.smithi165.stdout:4/208: dread d4/f26 [0,4194304] 0 2024-09-16T02:05:46.527 INFO:tasks.workunit.client.1.smithi165.stdout:6/262: dwrite d7/d1f/f33 [0,4194304] 0 2024-09-16T02:05:46.528 INFO:tasks.workunit.client.1.smithi165.stdout:8/278: creat dd/d13/d53/f61 x:0 0 0 2024-09-16T02:05:46.528 INFO:tasks.workunit.client.1.smithi165.stdout:2/317: write df/f19 [406715,19796] 0 2024-09-16T02:05:46.532 INFO:tasks.workunit.client.1.smithi165.stdout:3/330: chown da/d20/d26/l38 0 1 2024-09-16T02:05:46.533 INFO:tasks.workunit.client.1.smithi165.stdout:0/251: creat d0/d2a/f5c x:0 0 0 2024-09-16T02:05:46.534 INFO:tasks.workunit.client.1.smithi165.stdout:9/297: readlink d7/d32/d38/d53/l57 0 2024-09-16T02:05:46.534 INFO:tasks.workunit.client.1.smithi165.stdout:6/263: creat d7/d1f/f42 x:0 0 0 2024-09-16T02:05:46.534 INFO:tasks.workunit.client.1.smithi165.stdout:4/209: mknod d4/c4b 0 2024-09-16T02:05:46.536 INFO:tasks.workunit.client.1.smithi165.stdout:3/331: write da/de/f77 [258536,61501] 0 2024-09-16T02:05:46.536 INFO:tasks.workunit.client.1.smithi165.stdout:0/252: readlink d0/d1e/d39/l52 0 2024-09-16T02:05:46.538 INFO:tasks.workunit.client.1.smithi165.stdout:6/264: write f2 [2225257,73085] 0 2024-09-16T02:05:46.538 INFO:tasks.workunit.client.1.smithi165.stdout:1/233: truncate d1/f3a 1468653 0 2024-09-16T02:05:46.539 INFO:tasks.workunit.client.1.smithi165.stdout:4/210: chown d4/dc/d28/d30/c35 56 1 2024-09-16T02:05:46.539 INFO:tasks.workunit.client.1.smithi165.stdout:0/253: chown d0/d1e/f24 230903753 1 2024-09-16T02:05:46.541 INFO:tasks.workunit.client.1.smithi165.stdout:5/236: dwrite f7 [0,4194304] 0 2024-09-16T02:05:46.542 INFO:tasks.workunit.client.1.smithi165.stdout:6/265: chown d7/dc/l21 6042 1 2024-09-16T02:05:46.543 INFO:tasks.workunit.client.1.smithi165.stdout:9/298: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:46.544 INFO:tasks.workunit.client.1.smithi165.stdout:8/279: getdents dd/d11/d14 0 2024-09-16T02:05:46.545 INFO:tasks.workunit.client.1.smithi165.stdout:4/211: rmdir d4/dc/d28/d30 39 2024-09-16T02:05:46.546 INFO:tasks.workunit.client.1.smithi165.stdout:1/234: rmdir d1/dd/d25 39 2024-09-16T02:05:46.549 INFO:tasks.workunit.client.1.smithi165.stdout:4/212: fdatasync f1 0 2024-09-16T02:05:46.550 INFO:tasks.workunit.client.1.smithi165.stdout:9/299: unlink d7/d1f/c26 0 2024-09-16T02:05:46.552 INFO:tasks.workunit.client.1.smithi165.stdout:6/266: creat d7/dc/d3b/d3c/f43 x:0 0 0 2024-09-16T02:05:46.552 INFO:tasks.workunit.client.1.smithi165.stdout:1/235: unlink d1/dd/d11/f1f 0 2024-09-16T02:05:46.553 INFO:tasks.workunit.client.1.smithi165.stdout:8/280: unlink dd/d11/d14/d3f/d25/d36/l42 0 2024-09-16T02:05:46.556 INFO:tasks.workunit.client.1.smithi165.stdout:9/300: creat d7/d1d/f6a x:0 0 0 2024-09-16T02:05:46.556 INFO:tasks.workunit.client.1.smithi165.stdout:3/332: dwrite da/d20/f3d [0,4194304] 0 2024-09-16T02:05:46.562 INFO:tasks.workunit.client.1.smithi165.stdout:8/281: write dd/d13/f32 [5159347,5808] 0 2024-09-16T02:05:46.562 INFO:tasks.workunit.client.1.smithi165.stdout:0/254: dwrite d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:46.566 INFO:tasks.workunit.client.1.smithi165.stdout:8/282: chown dd/ff 1621400 1 2024-09-16T02:05:46.567 INFO:tasks.workunit.client.1.smithi165.stdout:6/267: dwrite f3 [0,4194304] 0 2024-09-16T02:05:46.568 INFO:tasks.workunit.client.1.smithi165.stdout:4/213: getdents d4/dc/d28/d2b 0 2024-09-16T02:05:46.572 INFO:tasks.workunit.client.1.smithi165.stdout:4/214: fsync d4/dc/d28/d2b/f2d 0 2024-09-16T02:05:46.573 INFO:tasks.workunit.client.1.smithi165.stdout:6/268: chown d7/dc/d3b/d3c/f43 7 1 2024-09-16T02:05:46.574 INFO:tasks.workunit.client.1.smithi165.stdout:3/333: dread da/d20/f3d [0,4194304] 0 2024-09-16T02:05:46.574 INFO:tasks.workunit.client.1.smithi165.stdout:9/301: creat d7/df/d37/f6b x:0 0 0 2024-09-16T02:05:46.575 INFO:tasks.workunit.client.1.smithi165.stdout:3/334: fdatasync da/fc 0 2024-09-16T02:05:46.575 INFO:tasks.workunit.client.1.smithi165.stdout:8/283: mkdir dd/d62 0 2024-09-16T02:05:46.576 INFO:tasks.workunit.client.1.smithi165.stdout:4/215: symlink d4/d40/l4c 0 2024-09-16T02:05:46.577 INFO:tasks.workunit.client.1.smithi165.stdout:6/269: creat d7/dc/d3b/f44 x:0 0 0 2024-09-16T02:05:46.579 INFO:tasks.workunit.client.1.smithi165.stdout:8/284: write dd/d11/d14/f1e [3530833,108342] 0 2024-09-16T02:05:46.579 INFO:tasks.workunit.client.1.smithi165.stdout:6/270: stat d7/dc/d3b/d3a 0 2024-09-16T02:05:46.579 INFO:tasks.workunit.client.1.smithi165.stdout:4/216: fsync d4/dc/d28/f4a 0 2024-09-16T02:05:46.580 INFO:tasks.workunit.client.1.smithi165.stdout:3/335: symlink da/d20/d26/d52/d6b/l7e 0 2024-09-16T02:05:46.582 INFO:tasks.workunit.client.1.smithi165.stdout:9/302: creat d7/d14/f6c x:0 0 0 2024-09-16T02:05:46.583 INFO:tasks.workunit.client.1.smithi165.stdout:6/271: chown d7/dc/d3b/d3c 664 1 2024-09-16T02:05:46.584 INFO:tasks.workunit.client.1.smithi165.stdout:3/336: unlink da/d20/d26/d52/d6b/l7e 0 2024-09-16T02:05:46.584 INFO:tasks.workunit.client.1.smithi165.stdout:4/217: dread - d4/f3c zero size 2024-09-16T02:05:46.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/285: rmdir dd/d13/d53 39 2024-09-16T02:05:46.585 INFO:tasks.workunit.client.1.smithi165.stdout:5/237: dread de/d19/f25 [0,4194304] 0 2024-09-16T02:05:46.585 INFO:tasks.workunit.client.1.smithi165.stdout:1/236: dread d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:46.586 INFO:tasks.workunit.client.1.smithi165.stdout:5/238: chown de/d21 188766520 1 2024-09-16T02:05:46.588 INFO:tasks.workunit.client.1.smithi165.stdout:9/303: getdents d7/d1f 0 2024-09-16T02:05:46.589 INFO:tasks.workunit.client.1.smithi165.stdout:8/286: creat dd/d13/f63 x:0 0 0 2024-09-16T02:05:46.590 INFO:tasks.workunit.client.1.smithi165.stdout:1/237: write d1/dd/d11/d33/f3b [1348861,113184] 0 2024-09-16T02:05:46.590 INFO:tasks.workunit.client.1.smithi165.stdout:5/239: symlink de/d21/d26/d3a/l4a 0 2024-09-16T02:05:46.591 INFO:tasks.workunit.client.1.smithi165.stdout:3/337: link da/de/f1d da/d20/d26/f7f 0 2024-09-16T02:05:46.592 INFO:tasks.workunit.client.1.smithi165.stdout:8/287: dread - dd/d11/f55 zero size 2024-09-16T02:05:46.592 INFO:tasks.workunit.client.1.smithi165.stdout:5/240: write f7 [5122099,125543] 0 2024-09-16T02:05:46.592 INFO:tasks.workunit.client.1.smithi165.stdout:6/272: getdents d7/dc/d3b/d3a/d3d 0 2024-09-16T02:05:46.594 INFO:tasks.workunit.client.1.smithi165.stdout:9/304: symlink d7/d32/d38/d53/l6d 0 2024-09-16T02:05:46.597 INFO:tasks.workunit.client.1.smithi165.stdout:6/273: write d7/fe [241728,66583] 0 2024-09-16T02:05:46.597 INFO:tasks.workunit.client.1.smithi165.stdout:8/288: chown dd/d11/d14/f40 341591933 1 2024-09-16T02:05:46.598 INFO:tasks.workunit.client.1.smithi165.stdout:4/218: dwrite d4/f3c [0,4194304] 0 2024-09-16T02:05:46.601 INFO:tasks.workunit.client.1.smithi165.stdout:9/305: write d7/df/d37/f6b [320144,95234] 0 2024-09-16T02:05:46.603 INFO:tasks.workunit.client.1.smithi165.stdout:6/274: chown d7/l38 119404 1 2024-09-16T02:05:46.604 INFO:tasks.workunit.client.1.smithi165.stdout:5/241: link de/l35 de/d21/d26/l4b 0 2024-09-16T02:05:46.604 INFO:tasks.workunit.client.1.smithi165.stdout:1/238: truncate d1/dd/f10 1570257 0 2024-09-16T02:05:46.605 INFO:tasks.workunit.client.1.smithi165.stdout:8/289: chown dd/d11/d14/d3f/d25/d36/l49 1 1 2024-09-16T02:05:46.605 INFO:tasks.workunit.client.1.smithi165.stdout:4/219: symlink d4/dc/d18/d37/l4d 0 2024-09-16T02:05:46.607 INFO:tasks.workunit.client.1.smithi165.stdout:1/239: write d1/f9 [3148469,7429] 0 2024-09-16T02:05:46.609 INFO:tasks.workunit.client.1.smithi165.stdout:7/255: sync 2024-09-16T02:05:46.609 INFO:tasks.workunit.client.1.smithi165.stdout:5/242: rename de/f10 to de/d21/d36/f4c 0 2024-09-16T02:05:46.610 INFO:tasks.workunit.client.1.smithi165.stdout:3/338: dwrite da/d17/d78/f5e [0,4194304] 0 2024-09-16T02:05:46.611 INFO:tasks.workunit.client.1.smithi165.stdout:5/243: chown de/l15 43 1 2024-09-16T02:05:46.611 INFO:tasks.workunit.client.1.smithi165.stdout:3/339: fdatasync da/de/f71 0 2024-09-16T02:05:46.612 INFO:tasks.workunit.client.1.smithi165.stdout:5/244: stat de/f14 0 2024-09-16T02:05:46.617 INFO:tasks.workunit.client.1.smithi165.stdout:5/245: fsync de/d19/f1f 0 2024-09-16T02:05:46.619 INFO:tasks.workunit.client.1.smithi165.stdout:8/290: getdents dd/d11 0 2024-09-16T02:05:46.620 INFO:tasks.workunit.client.1.smithi165.stdout:1/240: getdents d1/d19/d24 0 2024-09-16T02:05:46.621 INFO:tasks.workunit.client.1.smithi165.stdout:7/256: rename d0/df/f18 to d0/df/d33/f4a 0 2024-09-16T02:05:46.623 INFO:tasks.workunit.client.1.smithi165.stdout:8/291: write dd/d13/f56 [1074692,37619] 0 2024-09-16T02:05:46.630 INFO:tasks.workunit.client.1.smithi165.stdout:9/306: dwrite d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:46.630 INFO:tasks.workunit.client.1.smithi165.stdout:4/220: dwrite d4/dc/d28/d30/d31/f3d [0,4194304] 0 2024-09-16T02:05:46.631 INFO:tasks.workunit.client.1.smithi165.stdout:8/292: chown dd/d13/d53/c5c 8 1 2024-09-16T02:05:46.635 INFO:tasks.workunit.client.1.smithi165.stdout:9/307: chown d7/d1f/f2a 1 1 2024-09-16T02:05:46.636 INFO:tasks.workunit.client.1.smithi165.stdout:3/340: dwrite da/d17/d78/d2c/d2d/d6c/f61 [0,4194304] 0 2024-09-16T02:05:46.636 INFO:tasks.workunit.client.1.smithi165.stdout:5/246: dread de/d19/f33 [4194304,4194304] 0 2024-09-16T02:05:46.637 INFO:tasks.workunit.client.1.smithi165.stdout:1/241: link d1/dd/l23 d1/dd/d11/l43 0 2024-09-16T02:05:46.638 INFO:tasks.workunit.client.1.smithi165.stdout:4/221: mkdir d4/dc/d20/d4e 0 2024-09-16T02:05:46.638 INFO:tasks.workunit.client.1.smithi165.stdout:8/293: write dd/d13/d53/f58 [86958,74318] 0 2024-09-16T02:05:46.642 INFO:tasks.workunit.client.1.smithi165.stdout:9/308: unlink d7/c60 0 2024-09-16T02:05:46.643 INFO:tasks.workunit.client.1.smithi165.stdout:7/257: dwrite d0/d2c/f3b [0,4194304] 0 2024-09-16T02:05:46.643 INFO:tasks.workunit.client.1.smithi165.stdout:3/341: chown da/d17/d78/d2c/c3a 80 1 2024-09-16T02:05:46.646 INFO:tasks.workunit.client.1.smithi165.stdout:1/242: mkdir d1/d19/d44 0 2024-09-16T02:05:46.646 INFO:tasks.workunit.client.1.smithi165.stdout:8/294: creat dd/d11/d14/d3f/d25/d36/f64 x:0 0 0 2024-09-16T02:05:46.648 INFO:tasks.workunit.client.1.smithi165.stdout:7/258: mkdir d0/d4b 0 2024-09-16T02:05:46.650 INFO:tasks.workunit.client.1.smithi165.stdout:4/222: write d4/f26 [1027601,2117] 0 2024-09-16T02:05:46.651 INFO:tasks.workunit.client.1.smithi165.stdout:9/309: rmdir d7/df/d37/d43 39 2024-09-16T02:05:46.653 INFO:tasks.workunit.client.1.smithi165.stdout:3/342: unlink da/l18 0 2024-09-16T02:05:46.654 INFO:tasks.workunit.client.1.smithi165.stdout:7/259: mknod d0/c4c 0 2024-09-16T02:05:46.655 INFO:tasks.workunit.client.1.smithi165.stdout:9/310: chown d7/df/d37/d43 638499 1 2024-09-16T02:05:46.658 INFO:tasks.workunit.client.1.smithi165.stdout:8/295: rename dd/d13/f56 to dd/d13/f65 0 2024-09-16T02:05:46.659 INFO:tasks.workunit.client.1.smithi165.stdout:8/296: truncate dd/d11/f5f 465166 0 2024-09-16T02:05:46.659 INFO:tasks.workunit.client.1.smithi165.stdout:3/343: symlink da/d17/d7a/d7d/l80 0 2024-09-16T02:05:46.660 INFO:tasks.workunit.client.1.smithi165.stdout:4/223: dread d4/dc/d18/f23 [0,4194304] 0 2024-09-16T02:05:46.660 INFO:tasks.workunit.client.1.smithi165.stdout:7/260: getdents d0/df/d42 0 2024-09-16T02:05:46.661 INFO:tasks.workunit.client.1.smithi165.stdout:4/224: read d4/dc/d18/f22 [3410016,24410] 0 2024-09-16T02:05:46.661 INFO:tasks.workunit.client.1.smithi165.stdout:3/344: creat da/d17/d7a/f81 x:0 0 0 2024-09-16T02:05:46.662 INFO:tasks.workunit.client.1.smithi165.stdout:8/297: symlink dd/d11/d14/d3f/d25/d36/l66 0 2024-09-16T02:05:46.663 INFO:tasks.workunit.client.1.smithi165.stdout:5/247: write fa [768613,29144] 0 2024-09-16T02:05:46.663 INFO:tasks.workunit.client.1.smithi165.stdout:5/248: chown de/f1d 0 1 2024-09-16T02:05:46.665 INFO:tasks.workunit.client.1.smithi165.stdout:1/243: write d1/dd/d11/f15 [5308478,6812] 0 2024-09-16T02:05:46.665 INFO:tasks.workunit.client.1.smithi165.stdout:4/225: write d4/dc/f16 [4001098,15689] 0 2024-09-16T02:05:46.665 INFO:tasks.workunit.client.1.smithi165.stdout:7/261: dread d0/f22 [0,4194304] 0 2024-09-16T02:05:46.665 INFO:tasks.workunit.client.1.smithi165.stdout:3/345: mknod da/d20/d26/d52/d6b/c82 0 2024-09-16T02:05:46.667 INFO:tasks.workunit.client.1.smithi165.stdout:5/249: mkdir de/d19/d1c/d4d 0 2024-09-16T02:05:46.668 INFO:tasks.workunit.client.1.smithi165.stdout:5/250: chown de/d21/d26 45224825 1 2024-09-16T02:05:46.668 INFO:tasks.workunit.client.1.smithi165.stdout:4/226: write d4/dc/d18/f23 [85235,114208] 0 2024-09-16T02:05:46.669 INFO:tasks.workunit.client.1.smithi165.stdout:8/298: creat dd/f67 x:0 0 0 2024-09-16T02:05:46.669 INFO:tasks.workunit.client.1.smithi165.stdout:3/346: dread da/de/f77 [0,4194304] 0 2024-09-16T02:05:46.670 INFO:tasks.workunit.client.1.smithi165.stdout:4/227: unlink d4/f1b 0 2024-09-16T02:05:46.672 INFO:tasks.workunit.client.1.smithi165.stdout:8/299: mknod dd/d11/d14/c68 0 2024-09-16T02:05:46.672 INFO:tasks.workunit.client.1.smithi165.stdout:8/300: stat dd/d34 0 2024-09-16T02:05:46.672 INFO:tasks.workunit.client.1.smithi165.stdout:3/347: mknod da/d17/c83 0 2024-09-16T02:05:46.673 INFO:tasks.workunit.client.1.smithi165.stdout:4/228: mkdir d4/d40/d4f 0 2024-09-16T02:05:46.674 INFO:tasks.workunit.client.1.smithi165.stdout:4/229: chown d4/dc/d28/d30/d31 0 1 2024-09-16T02:05:46.674 INFO:tasks.workunit.client.1.smithi165.stdout:3/348: rmdir da/d20/d26/d6e 39 2024-09-16T02:05:46.676 INFO:tasks.workunit.client.1.smithi165.stdout:8/301: creat dd/d11/f69 x:0 0 0 2024-09-16T02:05:46.676 INFO:tasks.workunit.client.1.smithi165.stdout:4/230: mknod d4/dc/d28/d2b/c50 0 2024-09-16T02:05:46.677 INFO:tasks.workunit.client.1.smithi165.stdout:5/251: dwrite de/d19/f33 [0,4194304] 0 2024-09-16T02:05:46.677 INFO:tasks.workunit.client.1.smithi165.stdout:3/349: fsync da/d20/f3b 0 2024-09-16T02:05:46.678 INFO:tasks.workunit.client.1.smithi165.stdout:8/302: write dd/d13/f63 [1013650,27189] 0 2024-09-16T02:05:46.680 INFO:tasks.workunit.client.1.smithi165.stdout:5/252: mkdir de/d21/d4e 0 2024-09-16T02:05:46.686 INFO:tasks.workunit.client.1.smithi165.stdout:3/350: creat da/d20/d26/f84 x:0 0 0 2024-09-16T02:05:46.687 INFO:tasks.workunit.client.1.smithi165.stdout:5/253: dwrite de/d21/f40 [0,4194304] 0 2024-09-16T02:05:46.690 INFO:tasks.workunit.client.1.smithi165.stdout:4/231: getdents d4/dc/d28 0 2024-09-16T02:05:46.695 INFO:tasks.workunit.client.1.smithi165.stdout:3/351: mknod da/d20/d26/d52/c85 0 2024-09-16T02:05:46.698 INFO:tasks.workunit.client.1.smithi165.stdout:3/352: symlink da/d17/d7a/l86 0 2024-09-16T02:05:46.703 INFO:tasks.workunit.client.1.smithi165.stdout:3/353: symlink da/d20/d26/d52/l87 0 2024-09-16T02:05:46.703 INFO:tasks.workunit.client.1.smithi165.stdout:4/232: dwrite d4/f1e [0,4194304] 0 2024-09-16T02:05:46.704 INFO:tasks.workunit.client.1.smithi165.stdout:5/254: dwrite fc [0,4194304] 0 2024-09-16T02:05:46.707 INFO:tasks.workunit.client.1.smithi165.stdout:4/233: unlink d4/dc/d28/d2b/f3a 0 2024-09-16T02:05:46.710 INFO:tasks.workunit.client.1.smithi165.stdout:5/255: creat de/d19/d1c/f4f x:0 0 0 2024-09-16T02:05:46.712 INFO:tasks.workunit.client.1.smithi165.stdout:4/234: rename d4/dc/d28/d2b/f2d to d4/dc/d28/d30/d31/f51 0 2024-09-16T02:05:46.718 INFO:tasks.workunit.client.1.smithi165.stdout:5/256: dwrite de/f1d [4194304,4194304] 0 2024-09-16T02:05:46.722 INFO:tasks.workunit.client.1.smithi165.stdout:5/257: dread fc [0,4194304] 0 2024-09-16T02:05:46.729 INFO:tasks.workunit.client.1.smithi165.stdout:5/258: link c8 de/d19/d1c/c50 0 2024-09-16T02:05:46.730 INFO:tasks.workunit.client.1.smithi165.stdout:5/259: mkdir de/d21/d51 0 2024-09-16T02:05:46.733 INFO:tasks.workunit.client.1.smithi165.stdout:3/354: getdents da/d20/d26/d52 0 2024-09-16T02:05:46.736 INFO:tasks.workunit.client.1.smithi165.stdout:3/355: symlink da/d17/d7a/d7d/l88 0 2024-09-16T02:05:46.736 INFO:tasks.workunit.client.1.smithi165.stdout:5/260: dwrite fa [0,4194304] 0 2024-09-16T02:05:46.739 INFO:tasks.workunit.client.1.smithi165.stdout:3/356: mknod da/d17/d7a/d7d/c89 0 2024-09-16T02:05:46.739 INFO:tasks.workunit.client.1.smithi165.stdout:5/261: mknod de/d21/d51/c52 0 2024-09-16T02:05:46.740 INFO:tasks.workunit.client.1.smithi165.stdout:4/235: dread d4/dc/f16 [0,4194304] 0 2024-09-16T02:05:46.741 INFO:tasks.workunit.client.1.smithi165.stdout:3/357: dread - da/d20/d26/d6e/f73 zero size 2024-09-16T02:05:46.741 INFO:tasks.workunit.client.1.smithi165.stdout:2/318: sync 2024-09-16T02:05:46.742 INFO:tasks.workunit.client.1.smithi165.stdout:4/236: creat d4/dc/d28/d3b/f52 x:0 0 0 2024-09-16T02:05:46.748 INFO:tasks.workunit.client.1.smithi165.stdout:5/262: dread de/f1d [4194304,4194304] 0 2024-09-16T02:05:46.748 INFO:tasks.workunit.client.1.smithi165.stdout:4/237: rename d4/dc/d28/d30/d31 to d4/dc/d18/d37/d53 0 2024-09-16T02:05:46.752 INFO:tasks.workunit.client.1.smithi165.stdout:5/263: write de/d19/d1c/f3e [782179,46323] 0 2024-09-16T02:05:46.754 INFO:tasks.workunit.client.1.smithi165.stdout:2/319: dwrite df/d23/f51 [0,4194304] 0 2024-09-16T02:05:46.755 INFO:tasks.workunit.client.1.smithi165.stdout:3/358: dwrite da/d17/f4a [4194304,4194304] 0 2024-09-16T02:05:46.756 INFO:tasks.workunit.client.1.smithi165.stdout:5/264: symlink de/d21/d26/l53 0 2024-09-16T02:05:46.757 INFO:tasks.workunit.client.1.smithi165.stdout:3/359: symlink da/d17/l8a 0 2024-09-16T02:05:46.759 INFO:tasks.workunit.client.1.smithi165.stdout:4/238: dread d4/dc/f16 [0,4194304] 0 2024-09-16T02:05:46.760 INFO:tasks.workunit.client.1.smithi165.stdout:2/320: mknod df/c61 0 2024-09-16T02:05:46.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/265: unlink de/d19/c31 0 2024-09-16T02:05:46.822 INFO:tasks.workunit.client.1.smithi165.stdout:3/360: link da/d20/d26/f4f da/d17/f8b 0 2024-09-16T02:05:46.823 INFO:tasks.workunit.client.1.smithi165.stdout:2/321: unlink df/d10/d37/l40 0 2024-09-16T02:05:46.824 INFO:tasks.workunit.client.1.smithi165.stdout:4/239: dread d4/f9 [0,4194304] 0 2024-09-16T02:05:46.824 INFO:tasks.workunit.client.1.smithi165.stdout:5/266: rename de/d21/d36 to de/d21/d26/d3a/d54 0 2024-09-16T02:05:46.825 INFO:tasks.workunit.client.1.smithi165.stdout:4/240: readlink d4/d40/l4c 0 2024-09-16T02:05:46.828 INFO:tasks.workunit.client.1.smithi165.stdout:2/322: rename df/d10/d1a/d2d/f2f to df/f62 0 2024-09-16T02:05:46.829 INFO:tasks.workunit.client.1.smithi165.stdout:4/241: dread d4/f3c [0,4194304] 0 2024-09-16T02:05:46.831 INFO:tasks.workunit.client.1.smithi165.stdout:4/242: truncate d4/dc/d20/f27 4484057 0 2024-09-16T02:05:46.831 INFO:tasks.workunit.client.1.smithi165.stdout:3/361: rmdir da 39 2024-09-16T02:05:46.832 INFO:tasks.workunit.client.1.smithi165.stdout:4/243: chown d4/dc/d20/c29 696278943 1 2024-09-16T02:05:46.833 INFO:tasks.workunit.client.1.smithi165.stdout:4/244: chown d4/d40/c48 23543 1 2024-09-16T02:05:46.835 INFO:tasks.workunit.client.1.smithi165.stdout:4/245: write d4/dc/fe [1285522,91543] 0 2024-09-16T02:05:46.836 INFO:tasks.workunit.client.1.smithi165.stdout:2/323: dwrite df/d23/d28/f53 [0,4194304] 0 2024-09-16T02:05:46.837 INFO:tasks.workunit.client.1.smithi165.stdout:3/362: mkdir da/d20/d26/d8c 0 2024-09-16T02:05:46.839 INFO:tasks.workunit.client.1.smithi165.stdout:3/363: rmdir da/d57 39 2024-09-16T02:05:46.840 INFO:tasks.workunit.client.1.smithi165.stdout:2/324: symlink df/l63 0 2024-09-16T02:05:46.843 INFO:tasks.workunit.client.1.smithi165.stdout:2/325: write df/d10/d37/f59 [833482,67112] 0 2024-09-16T02:05:46.844 INFO:tasks.workunit.client.1.smithi165.stdout:2/326: write df/d23/d28/f46 [1049497,117301] 0 2024-09-16T02:05:46.845 INFO:tasks.workunit.client.1.smithi165.stdout:4/246: write f2 [1062874,39170] 0 2024-09-16T02:05:46.847 INFO:tasks.workunit.client.1.smithi165.stdout:0/255: sync 2024-09-16T02:05:46.848 INFO:tasks.workunit.client.1.smithi165.stdout:4/247: unlink d4/dc/d18/d37/d53/f3d 0 2024-09-16T02:05:46.849 INFO:tasks.workunit.client.1.smithi165.stdout:0/256: write d0/d1e/d39/d48/f4e [4021436,88767] 0 2024-09-16T02:05:46.851 INFO:tasks.workunit.client.1.smithi165.stdout:0/257: fsync d0/f30 0 2024-09-16T02:05:46.853 INFO:tasks.workunit.client.1.smithi165.stdout:4/248: creat d4/dc/d20/d4e/f54 x:0 0 0 2024-09-16T02:05:46.853 INFO:tasks.workunit.client.1.smithi165.stdout:3/364: dread da/d17/f1a [0,4194304] 0 2024-09-16T02:05:46.854 INFO:tasks.workunit.client.1.smithi165.stdout:2/327: dwrite df/d10/d37/f59 [0,4194304] 0 2024-09-16T02:05:46.855 INFO:tasks.workunit.client.1.smithi165.stdout:0/258: write d0/f5a [542627,45625] 0 2024-09-16T02:05:46.856 INFO:tasks.workunit.client.1.smithi165.stdout:0/259: dread - d0/d1e/d39/d48/f38 zero size 2024-09-16T02:05:46.857 INFO:tasks.workunit.client.1.smithi165.stdout:2/328: rmdir df/d10/d37/d45 39 2024-09-16T02:05:46.858 INFO:tasks.workunit.client.1.smithi165.stdout:3/365: unlink da/d17/d78/d2c/l3e 0 2024-09-16T02:05:46.859 INFO:tasks.workunit.client.1.smithi165.stdout:2/329: readlink df/d10/l15 0 2024-09-16T02:05:46.861 INFO:tasks.workunit.client.1.smithi165.stdout:0/260: mknod d0/d1e/d39/d48/d45/c5d 0 2024-09-16T02:05:46.863 INFO:tasks.workunit.client.1.smithi165.stdout:3/366: mkdir da/d57/d8d 0 2024-09-16T02:05:46.864 INFO:tasks.workunit.client.1.smithi165.stdout:4/249: dwrite d4/dc/d20/d4e/f54 [0,4194304] 0 2024-09-16T02:05:46.865 INFO:tasks.workunit.client.1.smithi165.stdout:0/261: mknod d0/d1e/d39/d48/c5e 0 2024-09-16T02:05:46.866 INFO:tasks.workunit.client.1.smithi165.stdout:3/367: mknod da/de/c8e 0 2024-09-16T02:05:46.871 INFO:tasks.workunit.client.1.smithi165.stdout:2/330: dwrite df/d23/d2a/f5c [0,4194304] 0 2024-09-16T02:05:46.871 INFO:tasks.workunit.client.1.smithi165.stdout:0/262: getdents d0/d2a 0 2024-09-16T02:05:46.873 INFO:tasks.workunit.client.1.smithi165.stdout:0/263: chown d0/d1e/d39/d48 1192507 1 2024-09-16T02:05:46.873 INFO:tasks.workunit.client.1.smithi165.stdout:3/368: unlink da/d17/d78/f5e 0 2024-09-16T02:05:46.875 INFO:tasks.workunit.client.1.smithi165.stdout:4/250: dread d4/dc/f16 [0,4194304] 0 2024-09-16T02:05:46.876 INFO:tasks.workunit.client.1.smithi165.stdout:0/264: write d0/d1e/d39/d48/f38 [568442,92435] 0 2024-09-16T02:05:46.877 INFO:tasks.workunit.client.1.smithi165.stdout:4/251: chown d4/dc/d28/d30 221702483 1 2024-09-16T02:05:46.878 INFO:tasks.workunit.client.1.smithi165.stdout:0/265: truncate d0/d1e/f57 611159 0 2024-09-16T02:05:46.880 INFO:tasks.workunit.client.1.smithi165.stdout:2/331: getdents df/d10/d37/d45 0 2024-09-16T02:05:46.883 INFO:tasks.workunit.client.1.smithi165.stdout:4/252: rename d4/d40/l4c to d4/dc/d18/d37/d53/l55 0 2024-09-16T02:05:46.884 INFO:tasks.workunit.client.1.smithi165.stdout:0/266: mkdir d0/d1e/d39/d48/d5f 0 2024-09-16T02:05:46.885 INFO:tasks.workunit.client.1.smithi165.stdout:0/267: chown d0/le 650 1 2024-09-16T02:05:46.886 INFO:tasks.workunit.client.1.smithi165.stdout:4/253: mknod d4/d40/c56 0 2024-09-16T02:05:46.888 INFO:tasks.workunit.client.1.smithi165.stdout:2/332: dwrite df/d23/d28/f53 [0,4194304] 0 2024-09-16T02:05:46.889 INFO:tasks.workunit.client.1.smithi165.stdout:2/333: fdatasync df/d10/d37/f59 0 2024-09-16T02:05:46.892 INFO:tasks.workunit.client.1.smithi165.stdout:0/268: getdents d0/d1e/d20/d28 0 2024-09-16T02:05:46.893 INFO:tasks.workunit.client.1.smithi165.stdout:3/369: truncate da/d17/d78/d2c/d2d/d6c/f5a 931282 0 2024-09-16T02:05:46.895 INFO:tasks.workunit.client.1.smithi165.stdout:2/334: mkdir df/d10/d64 0 2024-09-16T02:05:46.896 INFO:tasks.workunit.client.1.smithi165.stdout:4/254: dwrite d4/f44 [0,4194304] 0 2024-09-16T02:05:46.896 INFO:tasks.workunit.client.1.smithi165.stdout:0/269: write d0/ff [2841903,122852] 0 2024-09-16T02:05:46.899 INFO:tasks.workunit.client.1.smithi165.stdout:3/370: symlink da/l8f 0 2024-09-16T02:05:46.903 INFO:tasks.workunit.client.1.smithi165.stdout:6/275: sync 2024-09-16T02:05:46.903 INFO:tasks.workunit.client.1.smithi165.stdout:9/311: sync 2024-09-16T02:05:46.904 INFO:tasks.workunit.client.1.smithi165.stdout:6/276: stat d7/dc/c30 0 2024-09-16T02:05:46.907 INFO:tasks.workunit.client.1.smithi165.stdout:4/255: dread d4/f9 [0,4194304] 0 2024-09-16T02:05:46.907 INFO:tasks.workunit.client.1.smithi165.stdout:2/335: dwrite df/d23/f50 [0,4194304] 0 2024-09-16T02:05:46.908 INFO:tasks.workunit.client.1.smithi165.stdout:3/371: link da/d17/d78/d2c/f36 da/d20/d26/d52/d6b/f90 0 2024-09-16T02:05:46.910 INFO:tasks.workunit.client.1.smithi165.stdout:3/372: read da/d20/d26/f2a [826001,69237] 0 2024-09-16T02:05:46.911 INFO:tasks.workunit.client.1.smithi165.stdout:6/277: creat d7/dc/df/d1a/f45 x:0 0 0 2024-09-16T02:05:46.913 INFO:tasks.workunit.client.1.smithi165.stdout:2/336: creat df/d23/d28/f65 x:0 0 0 2024-09-16T02:05:46.915 INFO:tasks.workunit.client.1.smithi165.stdout:4/256: mknod d4/dc/d20/d4e/c57 0 2024-09-16T02:05:46.920 INFO:tasks.workunit.client.1.smithi165.stdout:6/278: creat d7/dc/df/d1a/f46 x:0 0 0 2024-09-16T02:05:46.920 INFO:tasks.workunit.client.1.smithi165.stdout:2/337: mkdir df/d23/d66 0 2024-09-16T02:05:46.921 INFO:tasks.workunit.client.1.smithi165.stdout:6/279: chown d7/dc/df/d1a 1480 1 2024-09-16T02:05:46.922 INFO:tasks.workunit.client.1.smithi165.stdout:9/312: getdents d7/d1d 0 2024-09-16T02:05:46.922 INFO:tasks.workunit.client.1.smithi165.stdout:0/270: dwrite d0/d1e/d39/d48/d45/f4b [0,4194304] 0 2024-09-16T02:05:46.923 INFO:tasks.workunit.client.1.smithi165.stdout:3/373: mkdir da/d17/d78/d91 0 2024-09-16T02:05:46.925 INFO:tasks.workunit.client.1.smithi165.stdout:0/271: fdatasync d0/d1e/d39/d48/d45/f37 0 2024-09-16T02:05:46.928 INFO:tasks.workunit.client.1.smithi165.stdout:4/257: creat d4/dc/f58 x:0 0 0 2024-09-16T02:05:46.929 INFO:tasks.workunit.client.1.smithi165.stdout:9/313: creat d7/d14/d4f/f6e x:0 0 0 2024-09-16T02:05:46.930 INFO:tasks.workunit.client.1.smithi165.stdout:3/374: mknod da/d17/d78/d91/c92 0 2024-09-16T02:05:46.931 INFO:tasks.workunit.client.1.smithi165.stdout:2/338: mkdir df/d23/d28/d3b/d67 0 2024-09-16T02:05:46.932 INFO:tasks.workunit.client.1.smithi165.stdout:3/375: chown da/d17/d78/d91 4345598 1 2024-09-16T02:05:46.932 INFO:tasks.workunit.client.1.smithi165.stdout:0/272: creat d0/d1e/d39/d48/d45/f60 x:0 0 0 2024-09-16T02:05:46.933 INFO:tasks.workunit.client.1.smithi165.stdout:4/258: rmdir d4/dc/d20 39 2024-09-16T02:05:46.933 INFO:tasks.workunit.client.1.smithi165.stdout:3/376: readlink da/d20/l35 0 2024-09-16T02:05:46.933 INFO:tasks.workunit.client.1.smithi165.stdout:9/314: symlink d7/d1f/l6f 0 2024-09-16T02:05:46.934 INFO:tasks.workunit.client.1.smithi165.stdout:9/315: fdatasync f4 0 2024-09-16T02:05:46.935 INFO:tasks.workunit.client.1.smithi165.stdout:6/280: dwrite d7/dc/df/d1a/f46 [0,4194304] 0 2024-09-16T02:05:46.936 INFO:tasks.workunit.client.1.smithi165.stdout:4/259: chown d4/dc/d28/d2b/c50 221 1 2024-09-16T02:05:46.936 INFO:tasks.workunit.client.1.smithi165.stdout:0/273: write d0/d1e/d39/d48/d45/f37 [2011247,21012] 0 2024-09-16T02:05:46.937 INFO:tasks.workunit.client.1.smithi165.stdout:2/339: rename df/d10/d37/d45 to df/d10/d1a/d68 0 2024-09-16T02:05:46.937 INFO:tasks.workunit.client.1.smithi165.stdout:3/377: write da/d17/d78/f34 [697662,18388] 0 2024-09-16T02:05:46.937 INFO:tasks.workunit.client.1.smithi165.stdout:9/316: chown d7/d32/d38/d53/d5c/d61 9218 1 2024-09-16T02:05:46.943 INFO:tasks.workunit.client.1.smithi165.stdout:3/378: readlink da/d20/d26/d52/l87 0 2024-09-16T02:05:46.943 INFO:tasks.workunit.client.1.smithi165.stdout:4/260: write d4/dc/d18/f23 [1168931,8870] 0 2024-09-16T02:05:46.944 INFO:tasks.workunit.client.1.smithi165.stdout:9/317: creat d7/d14/d4f/f70 x:0 0 0 2024-09-16T02:05:46.945 INFO:tasks.workunit.client.1.smithi165.stdout:0/274: truncate d0/d1e/d39/d48/d45/f44 2026119 0 2024-09-16T02:05:46.946 INFO:tasks.workunit.client.1.smithi165.stdout:3/379: readlink da/d17/d7a/d7d/l80 0 2024-09-16T02:05:46.947 INFO:tasks.workunit.client.1.smithi165.stdout:1/244: sync 2024-09-16T02:05:46.947 INFO:tasks.workunit.client.1.smithi165.stdout:7/262: sync 2024-09-16T02:05:46.947 INFO:tasks.workunit.client.1.smithi165.stdout:8/303: sync 2024-09-16T02:05:46.947 INFO:tasks.workunit.client.1.smithi165.stdout:5/267: sync 2024-09-16T02:05:46.949 INFO:tasks.workunit.client.1.smithi165.stdout:6/281: dwrite d7/d1f/f42 [0,4194304] 0 2024-09-16T02:05:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:46 smithi165 ceph-mon[34621]: pgmap v17: 65 pgs: 65 active+clean; 443 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 3.4 MiB/s rd, 44 MiB/s wr, 422 op/s 2024-09-16T02:05:46.951 INFO:tasks.workunit.client.1.smithi165.stdout:9/318: rmdir d7/d32/d38/d53/d5c 39 2024-09-16T02:05:46.953 INFO:tasks.workunit.client.1.smithi165.stdout:3/380: fdatasync da/d20/d26/f2a 0 2024-09-16T02:05:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:46 smithi110 ceph-mon[27634]: pgmap v17: 65 pgs: 65 active+clean; 443 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 3.4 MiB/s rd, 44 MiB/s wr, 422 op/s 2024-09-16T02:05:46.959 INFO:tasks.workunit.client.1.smithi165.stdout:6/282: write f2 [3274280,123815] 0 2024-09-16T02:05:46.961 INFO:tasks.workunit.client.1.smithi165.stdout:5/268: unlink de/d21/d26/c39 0 2024-09-16T02:05:46.963 INFO:tasks.workunit.client.1.smithi165.stdout:5/269: fdatasync de/d19/d1c/f4f 0 2024-09-16T02:05:46.964 INFO:tasks.workunit.client.1.smithi165.stdout:3/381: rmdir da/d17/d78/d2c 39 2024-09-16T02:05:46.965 INFO:tasks.workunit.client.1.smithi165.stdout:1/245: creat d1/d19/d24/d30/f45 x:0 0 0 2024-09-16T02:05:46.966 INFO:tasks.workunit.client.1.smithi165.stdout:4/261: link d4/dc/d18/d37/d47/c49 d4/dc/d18/d37/d53/c59 0 2024-09-16T02:05:46.968 INFO:tasks.workunit.client.1.smithi165.stdout:8/304: rename dd/d11/d38/f5e to dd/d11/d14/d3f/f6a 0 2024-09-16T02:05:46.968 INFO:tasks.workunit.client.1.smithi165.stdout:3/382: read da/d20/f3d [3130543,6322] 0 2024-09-16T02:05:46.969 INFO:tasks.workunit.client.1.smithi165.stdout:5/270: chown de/d19/f1f 1576691102 1 2024-09-16T02:05:46.970 INFO:tasks.workunit.client.1.smithi165.stdout:1/246: mkdir d1/dd/d11/d46 0 2024-09-16T02:05:46.973 INFO:tasks.workunit.client.1.smithi165.stdout:4/262: write d4/dc/d28/d3b/f52 [585432,106520] 0 2024-09-16T02:05:46.976 INFO:tasks.workunit.client.1.smithi165.stdout:9/319: dwrite d7/d1d/f6a [0,4194304] 0 2024-09-16T02:05:46.976 INFO:tasks.workunit.client.1.smithi165.stdout:3/383: chown da/de/d75/f76 229058341 1 2024-09-16T02:05:46.978 INFO:tasks.workunit.client.1.smithi165.stdout:8/305: creat dd/d13/f6b x:0 0 0 2024-09-16T02:05:46.978 INFO:tasks.workunit.client.1.smithi165.stdout:9/320: chown d7/d1d 247 1 2024-09-16T02:05:46.979 INFO:tasks.workunit.client.1.smithi165.stdout:6/283: dwrite d7/d1f/f27 [0,4194304] 0 2024-09-16T02:05:46.980 INFO:tasks.workunit.client.1.smithi165.stdout:7/263: dread d0/f12 [4194304,4194304] 0 2024-09-16T02:05:46.980 INFO:tasks.workunit.client.1.smithi165.stdout:2/340: dread df/d10/d1a/f27 [0,4194304] 0 2024-09-16T02:05:46.985 INFO:tasks.workunit.client.1.smithi165.stdout:8/306: write dd/d13/f6b [766441,76531] 0 2024-09-16T02:05:46.985 INFO:tasks.workunit.client.1.smithi165.stdout:2/341: mkdir df/d10/d1a/d68/d69 0 2024-09-16T02:05:46.985 INFO:tasks.workunit.client.1.smithi165.stdout:4/263: dread d4/dc/d18/d37/d53/f51 [0,4194304] 0 2024-09-16T02:05:46.985 INFO:tasks.workunit.client.1.smithi165.stdout:9/321: rename d7/c34 to d7/d1f/d54/c71 0 2024-09-16T02:05:46.987 INFO:tasks.workunit.client.1.smithi165.stdout:7/264: creat d0/df/d33/d2a/f4d x:0 0 0 2024-09-16T02:05:46.987 INFO:tasks.workunit.client.1.smithi165.stdout:3/384: truncate da/d20/d26/f2a 2588123 0 2024-09-16T02:05:46.989 INFO:tasks.workunit.client.1.smithi165.stdout:8/307: fsync dd/d34/f48 0 2024-09-16T02:05:46.992 INFO:tasks.workunit.client.1.smithi165.stdout:9/322: creat d7/d1d/f72 x:0 0 0 2024-09-16T02:05:46.993 INFO:tasks.workunit.client.1.smithi165.stdout:5/271: dwrite de/d19/f2e [0,4194304] 0 2024-09-16T02:05:46.994 INFO:tasks.workunit.client.1.smithi165.stdout:4/264: creat d4/dc/d18/d37/d53/f5a x:0 0 0 2024-09-16T02:05:46.998 INFO:tasks.workunit.client.1.smithi165.stdout:4/265: fdatasync d4/dc/d18/f34 0 2024-09-16T02:05:46.999 INFO:tasks.workunit.client.1.smithi165.stdout:3/385: creat da/d20/d26/d52/f93 x:0 0 0 2024-09-16T02:05:46.999 INFO:tasks.workunit.client.1.smithi165.stdout:8/308: truncate dd/d13/d53/f61 118407 0 2024-09-16T02:05:46.999 INFO:tasks.workunit.client.1.smithi165.stdout:4/266: stat d4/cf 0 2024-09-16T02:05:47.003 INFO:tasks.workunit.client.1.smithi165.stdout:1/247: dread d1/fc [0,4194304] 0 2024-09-16T02:05:47.003 INFO:tasks.workunit.client.1.smithi165.stdout:2/342: dwrite df/f62 [0,4194304] 0 2024-09-16T02:05:47.004 INFO:tasks.workunit.client.1.smithi165.stdout:8/309: write dd/d11/d14/f1d [1849782,122467] 0 2024-09-16T02:05:47.011 INFO:tasks.workunit.client.1.smithi165.stdout:5/272: fdatasync f6 0 2024-09-16T02:05:47.011 INFO:tasks.workunit.client.1.smithi165.stdout:7/265: link d0/f22 d0/df/d42/f4e 0 2024-09-16T02:05:47.011 INFO:tasks.workunit.client.1.smithi165.stdout:2/343: read - df/d23/d28/f65 zero size 2024-09-16T02:05:47.012 INFO:tasks.workunit.client.1.smithi165.stdout:8/310: truncate dd/f41 592007 0 2024-09-16T02:05:47.015 INFO:tasks.workunit.client.1.smithi165.stdout:1/248: mkdir d1/dd/d11/d33/d3f/d47 0 2024-09-16T02:05:47.020 INFO:tasks.workunit.client.1.smithi165.stdout:5/273: creat de/d21/d4e/f55 x:0 0 0 2024-09-16T02:05:47.021 INFO:tasks.workunit.client.1.smithi165.stdout:2/344: symlink df/d23/d66/l6a 0 2024-09-16T02:05:47.023 INFO:tasks.workunit.client.1.smithi165.stdout:1/249: write d1/d22/f3d [199185,117812] 0 2024-09-16T02:05:47.023 INFO:tasks.workunit.client.1.smithi165.stdout:3/386: dwrite da/d17/d7a/f81 [0,4194304] 0 2024-09-16T02:05:47.024 INFO:tasks.workunit.client.1.smithi165.stdout:9/323: dwrite d7/d55/f4c [0,4194304] 0 2024-09-16T02:05:47.024 INFO:tasks.workunit.client.1.smithi165.stdout:4/267: dwrite d4/dc/f19 [0,4194304] 0 2024-09-16T02:05:47.025 INFO:tasks.workunit.client.1.smithi165.stdout:8/311: truncate dd/d11/d14/d3f/f6a 654032 0 2024-09-16T02:05:47.026 INFO:tasks.workunit.client.1.smithi165.stdout:2/345: chown df/d23/f38 6 1 2024-09-16T02:05:47.027 INFO:tasks.workunit.client.1.smithi165.stdout:1/250: dread - d1/f39 zero size 2024-09-16T02:05:47.030 INFO:tasks.workunit.client.1.smithi165.stdout:5/274: creat de/d19/d1c/f56 x:0 0 0 2024-09-16T02:05:47.030 INFO:tasks.workunit.client.1.smithi165.stdout:3/387: chown da/de/f1d 734 1 2024-09-16T02:05:47.032 INFO:tasks.workunit.client.1.smithi165.stdout:1/251: readlink d1/d22/l2d 0 2024-09-16T02:05:47.033 INFO:tasks.workunit.client.1.smithi165.stdout:2/346: mknod df/d23/c6b 0 2024-09-16T02:05:47.034 INFO:tasks.workunit.client.1.smithi165.stdout:5/275: stat de/l35 0 2024-09-16T02:05:47.034 INFO:tasks.workunit.client.1.smithi165.stdout:1/252: chown d1/d32/f34 5796951 1 2024-09-16T02:05:47.034 INFO:tasks.workunit.client.1.smithi165.stdout:2/347: chown df/d10/d1a/c4a 15 1 2024-09-16T02:05:47.036 INFO:tasks.workunit.client.1.smithi165.stdout:5/276: write de/d19/d1c/f56 [758895,1136] 0 2024-09-16T02:05:47.037 INFO:tasks.workunit.client.1.smithi165.stdout:1/253: write d1/d32/f34 [532520,65705] 0 2024-09-16T02:05:47.040 INFO:tasks.workunit.client.1.smithi165.stdout:8/312: link dd/d11/f55 dd/f6c 0 2024-09-16T02:05:47.041 INFO:tasks.workunit.client.1.smithi165.stdout:4/268: dread d4/dc/d18/f22 [0,4194304] 0 2024-09-16T02:05:47.042 INFO:tasks.workunit.client.1.smithi165.stdout:1/254: chown d1/dd/d11/f1b 365 1 2024-09-16T02:05:47.043 INFO:tasks.workunit.client.1.smithi165.stdout:5/277: mknod de/d21/d26/c57 0 2024-09-16T02:05:47.043 INFO:tasks.workunit.client.1.smithi165.stdout:4/269: mknod d4/dc/d18/d37/d53/c5b 0 2024-09-16T02:05:47.044 INFO:tasks.workunit.client.1.smithi165.stdout:1/255: chown d1/c1a 80363300 1 2024-09-16T02:05:47.046 INFO:tasks.workunit.client.1.smithi165.stdout:5/278: creat de/d21/d51/f58 x:0 0 0 2024-09-16T02:05:47.046 INFO:tasks.workunit.client.1.smithi165.stdout:7/266: truncate d0/df/d7/fe 4008890 0 2024-09-16T02:05:47.047 INFO:tasks.workunit.client.1.smithi165.stdout:9/324: write d7/d14/f24 [101107,101111] 0 2024-09-16T02:05:47.048 INFO:tasks.workunit.client.1.smithi165.stdout:4/270: mkdir d4/dc/d18/d5c 0 2024-09-16T02:05:47.048 INFO:tasks.workunit.client.1.smithi165.stdout:1/256: symlink d1/dd/d11/d46/l48 0 2024-09-16T02:05:47.049 INFO:tasks.workunit.client.1.smithi165.stdout:4/271: chown d4/dc/d18/d37/d47 240 1 2024-09-16T02:05:47.050 INFO:tasks.workunit.client.1.smithi165.stdout:8/313: getdents dd/d11/d14 0 2024-09-16T02:05:47.051 INFO:tasks.workunit.client.1.smithi165.stdout:7/267: creat d0/d3d/f4f x:0 0 0 2024-09-16T02:05:47.051 INFO:tasks.workunit.client.1.smithi165.stdout:2/348: truncate fa 2402569 0 2024-09-16T02:05:47.053 INFO:tasks.workunit.client.1.smithi165.stdout:9/325: creat d7/d32/d38/f73 x:0 0 0 2024-09-16T02:05:47.055 INFO:tasks.workunit.client.1.smithi165.stdout:8/314: mknod dd/d11/d14/d3f/d25/c6d 0 2024-09-16T02:05:47.056 INFO:tasks.workunit.client.1.smithi165.stdout:5/279: creat de/d19/d1c/d49/f59 x:0 0 0 2024-09-16T02:05:47.058 INFO:tasks.workunit.client.1.smithi165.stdout:2/349: chown df/d23/d28/d3b 0 1 2024-09-16T02:05:47.058 INFO:tasks.workunit.client.1.smithi165.stdout:9/326: mknod d7/df/c74 0 2024-09-16T02:05:47.061 INFO:tasks.workunit.client.1.smithi165.stdout:3/388: dwrite da/d17/d78/d2c/d2d/d6c/f5a [0,4194304] 0 2024-09-16T02:05:47.062 INFO:tasks.workunit.client.1.smithi165.stdout:2/350: write df/d23/f48 [387919,38268] 0 2024-09-16T02:05:47.062 INFO:tasks.workunit.client.1.smithi165.stdout:4/272: symlink d4/dc/d20/d45/l5d 0 2024-09-16T02:05:47.087 INFO:tasks.workunit.client.1.smithi165.stdout:0/275: sync 2024-09-16T02:05:47.107 INFO:tasks.workunit.client.1.smithi165.stdout:1/257: dread d1/d32/f3c [0,4194304] 0 2024-09-16T02:05:47.109 INFO:tasks.workunit.client.1.smithi165.stdout:4/273: symlink d4/dc/d18/d37/d47/l5e 0 2024-09-16T02:05:47.111 INFO:tasks.workunit.client.1.smithi165.stdout:2/351: symlink df/l6c 0 2024-09-16T02:05:47.113 INFO:tasks.workunit.client.1.smithi165.stdout:3/389: getdents da 0 2024-09-16T02:05:47.114 INFO:tasks.workunit.client.1.smithi165.stdout:9/327: dwrite d7/fd [0,4194304] 0 2024-09-16T02:05:47.115 INFO:tasks.workunit.client.1.smithi165.stdout:1/258: chown d1/d19/l2b 251683 1 2024-09-16T02:05:47.115 INFO:tasks.workunit.client.1.smithi165.stdout:0/276: write d0/f13 [4983282,34531] 0 2024-09-16T02:05:47.117 INFO:tasks.workunit.client.1.smithi165.stdout:4/274: creat d4/dc/d28/f5f x:0 0 0 2024-09-16T02:05:47.119 INFO:tasks.workunit.client.1.smithi165.stdout:8/315: dwrite dd/d11/d38/f3c [0,4194304] 0 2024-09-16T02:05:47.122 INFO:tasks.workunit.client.1.smithi165.stdout:3/390: write da/de/f77 [1366094,83499] 0 2024-09-16T02:05:47.122 INFO:tasks.workunit.client.1.smithi165.stdout:7/268: dwrite d0/f22 [0,4194304] 0 2024-09-16T02:05:47.123 INFO:tasks.workunit.client.1.smithi165.stdout:0/277: mkdir d0/d61 0 2024-09-16T02:05:47.127 INFO:tasks.workunit.client.1.smithi165.stdout:8/316: mknod dd/d34/c6e 0 2024-09-16T02:05:47.128 INFO:tasks.workunit.client.1.smithi165.stdout:3/391: symlink da/d17/d7a/l94 0 2024-09-16T02:05:47.128 INFO:tasks.workunit.client.1.smithi165.stdout:7/269: chown d0/df/d33/c1c 3 1 2024-09-16T02:05:47.129 INFO:tasks.workunit.client.1.smithi165.stdout:3/392: chown da/l8f 11137 1 2024-09-16T02:05:47.130 INFO:tasks.workunit.client.1.smithi165.stdout:0/278: rename d0/d1e/d20/c2f to d0/d1e/d39/c62 0 2024-09-16T02:05:47.131 INFO:tasks.workunit.client.1.smithi165.stdout:4/275: chown d4/dc/d28/d30/l38 1277059529 1 2024-09-16T02:05:47.131 INFO:tasks.workunit.client.1.smithi165.stdout:0/279: chown d0/d1e/d39/f4f 224 1 2024-09-16T02:05:47.132 INFO:tasks.workunit.client.1.smithi165.stdout:8/317: creat dd/d11/d14/d3f/d25/f6f x:0 0 0 2024-09-16T02:05:47.133 INFO:tasks.workunit.client.1.smithi165.stdout:1/259: dread d1/dd/f36 [0,4194304] 0 2024-09-16T02:05:47.133 INFO:tasks.workunit.client.1.smithi165.stdout:7/270: write d0/df/f27 [4737632,25063] 0 2024-09-16T02:05:47.134 INFO:tasks.workunit.client.1.smithi165.stdout:4/276: rmdir d4/dc/d18 39 2024-09-16T02:05:47.135 INFO:tasks.workunit.client.1.smithi165.stdout:8/318: write dd/d11/d14/f1d [3185312,117448] 0 2024-09-16T02:05:47.139 INFO:tasks.workunit.client.1.smithi165.stdout:7/271: dread d0/df/d42/f4e [0,4194304] 0 2024-09-16T02:05:47.146 INFO:tasks.workunit.client.1.smithi165.stdout:7/272: dwrite d0/d2c/f3b [0,4194304] 0 2024-09-16T02:05:47.151 INFO:tasks.workunit.client.1.smithi165.stdout:6/284: sync 2024-09-16T02:05:47.187 INFO:tasks.workunit.client.1.smithi165.stdout:5/280: sync 2024-09-16T02:05:47.203 INFO:tasks.workunit.client.1.smithi165.stdout:0/280: creat d0/d1e/f63 x:0 0 0 2024-09-16T02:05:47.206 INFO:tasks.workunit.client.0.smithi110.stdout:1/55: sync 2024-09-16T02:05:47.207 INFO:tasks.workunit.client.1.smithi165.stdout:9/328: truncate f2 3849682 0 2024-09-16T02:05:47.208 INFO:tasks.workunit.client.1.smithi165.stdout:4/277: write d4/f3c [4798482,68014] 0 2024-09-16T02:05:47.209 INFO:tasks.workunit.client.1.smithi165.stdout:8/319: readlink dd/le 0 2024-09-16T02:05:47.209 INFO:tasks.workunit.client.1.smithi165.stdout:2/352: dwrite fa [0,4194304] 0 2024-09-16T02:05:47.210 INFO:tasks.workunit.client.0.smithi110.stdout:1/56: dread d0/f6 [0,4194304] 0 2024-09-16T02:05:47.212 INFO:tasks.workunit.client.1.smithi165.stdout:2/353: read df/d10/d37/f59 [2340368,87897] 0 2024-09-16T02:05:47.212 INFO:tasks.workunit.client.1.smithi165.stdout:3/393: truncate da/d17/d78/f23 4982704 0 2024-09-16T02:05:47.214 INFO:tasks.workunit.client.0.smithi110.stdout:1/57: readlink d0/lc 0 2024-09-16T02:05:47.214 INFO:tasks.workunit.client.1.smithi165.stdout:1/260: dwrite d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:47.214 INFO:tasks.workunit.client.1.smithi165.stdout:3/394: dread - da/d57/f7c zero size 2024-09-16T02:05:47.217 INFO:tasks.workunit.client.1.smithi165.stdout:4/278: dread d4/f44 [0,4194304] 0 2024-09-16T02:05:47.218 INFO:tasks.workunit.client.1.smithi165.stdout:3/395: write da/d20/d26/d52/f6d [2004442,60315] 0 2024-09-16T02:05:47.219 INFO:tasks.workunit.client.1.smithi165.stdout:4/279: chown d4 397777 1 2024-09-16T02:05:47.219 INFO:tasks.workunit.client.0.smithi110.stdout:1/58: unlink d0/lc 0 2024-09-16T02:05:47.222 INFO:tasks.workunit.client.1.smithi165.stdout:2/354: dwrite df/f3f [0,4194304] 0 2024-09-16T02:05:47.224 INFO:tasks.workunit.client.0.smithi110.stdout:1/59: mknod d0/d1/d8/cf 0 2024-09-16T02:05:47.226 INFO:tasks.workunit.client.1.smithi165.stdout:7/273: mkdir d0/d4b/d50 0 2024-09-16T02:05:47.228 INFO:tasks.workunit.client.0.smithi110.stdout:1/60: write d0/f6 [4642263,100388] 0 2024-09-16T02:05:47.232 INFO:tasks.workunit.client.1.smithi165.stdout:1/261: rename d1/dd/f36 to d1/f49 0 2024-09-16T02:05:47.234 INFO:tasks.workunit.client.1.smithi165.stdout:2/355: dwrite df/d23/f38 [0,4194304] 0 2024-09-16T02:05:47.239 INFO:tasks.workunit.client.1.smithi165.stdout:0/281: symlink d0/d1e/d39/d48/l64 0 2024-09-16T02:05:47.241 INFO:tasks.workunit.client.1.smithi165.stdout:7/274: stat d0/df/d7/fe 0 2024-09-16T02:05:47.242 INFO:tasks.workunit.client.0.smithi110.stdout:1/61: getdents d0/d1 0 2024-09-16T02:05:47.246 INFO:tasks.workunit.client.1.smithi165.stdout:2/356: dread df/f4f [0,4194304] 0 2024-09-16T02:05:47.247 INFO:tasks.workunit.client.1.smithi165.stdout:2/357: write df/d10/d37/f3d [3178028,109902] 0 2024-09-16T02:05:47.248 INFO:tasks.workunit.client.1.smithi165.stdout:9/329: fdatasync f2 0 2024-09-16T02:05:47.248 INFO:tasks.workunit.client.1.smithi165.stdout:6/285: truncate d7/f23 1458522 0 2024-09-16T02:05:47.249 INFO:tasks.workunit.client.1.smithi165.stdout:7/275: mknod d0/df/d7/c51 0 2024-09-16T02:05:47.250 INFO:tasks.workunit.client.1.smithi165.stdout:5/281: getdents de/d21/d26/d3a 0 2024-09-16T02:05:47.253 INFO:tasks.workunit.client.1.smithi165.stdout:0/282: getdents d0/d1e/d39/d48/d5f 0 2024-09-16T02:05:47.254 INFO:tasks.workunit.client.1.smithi165.stdout:6/286: creat d7/dc/df/d1a/f47 x:0 0 0 2024-09-16T02:05:47.255 INFO:tasks.workunit.client.0.smithi110.stdout:1/62: dwrite d0/f6 [4194304,4194304] 0 2024-09-16T02:05:47.257 INFO:tasks.workunit.client.1.smithi165.stdout:5/282: creat de/d21/d26/d3a/f5a x:0 0 0 2024-09-16T02:05:47.257 INFO:tasks.workunit.client.1.smithi165.stdout:3/396: link da/d17/c60 da/d20/c95 0 2024-09-16T02:05:47.257 INFO:tasks.workunit.client.1.smithi165.stdout:9/330: dwrite d7/d14/d4f/f70 [0,4194304] 0 2024-09-16T02:05:47.259 INFO:tasks.workunit.client.0.smithi110.stdout:1/63: mknod d0/d1/c10 0 2024-09-16T02:05:47.260 INFO:tasks.workunit.client.0.smithi110.stdout:1/64: chown d0/d1/d4 2042461 1 2024-09-16T02:05:47.260 INFO:tasks.workunit.client.1.smithi165.stdout:0/283: creat d0/d47/f65 x:0 0 0 2024-09-16T02:05:47.260 INFO:tasks.workunit.client.1.smithi165.stdout:3/397: dread - da/d17/f5b zero size 2024-09-16T02:05:47.262 INFO:tasks.workunit.client.0.smithi110.stdout:1/65: mknod d0/da/c11 0 2024-09-16T02:05:47.263 INFO:tasks.workunit.client.0.smithi110.stdout:1/66: chown d0/d1/d4 22 1 2024-09-16T02:05:47.265 INFO:tasks.workunit.client.1.smithi165.stdout:2/358: rename df/d23/d28/d3b/d67 to df/d23/d28/d3b/d6d 0 2024-09-16T02:05:47.267 INFO:tasks.workunit.client.1.smithi165.stdout:7/276: dread d0/df/d42/f4e [0,4194304] 0 2024-09-16T02:05:47.269 INFO:tasks.workunit.client.1.smithi165.stdout:3/398: fdatasync da/d20/d26/f2a 0 2024-09-16T02:05:47.269 INFO:tasks.workunit.client.1.smithi165.stdout:6/287: dread d7/f1e [4194304,4194304] 0 2024-09-16T02:05:47.270 INFO:tasks.workunit.client.1.smithi165.stdout:6/288: fdatasync d7/fd 0 2024-09-16T02:05:47.271 INFO:tasks.workunit.client.1.smithi165.stdout:5/283: creat de/f5b x:0 0 0 2024-09-16T02:05:47.273 INFO:tasks.workunit.client.1.smithi165.stdout:2/359: dread df/d23/f38 [0,4194304] 0 2024-09-16T02:05:47.279 INFO:tasks.workunit.client.1.smithi165.stdout:2/360: dread - df/d23/d28/d3b/f56 zero size 2024-09-16T02:05:47.279 INFO:tasks.workunit.client.1.smithi165.stdout:0/284: link d0/d1e/d39/d48/d45/l5b d0/d1e/d39/d48/d5f/l66 0 2024-09-16T02:05:47.280 INFO:tasks.workunit.client.0.smithi110.stdout:1/67: fdatasync d0/f6 0 2024-09-16T02:05:47.281 INFO:tasks.workunit.client.1.smithi165.stdout:2/361: chown df/d10/d37/c47 381 1 2024-09-16T02:05:47.281 INFO:tasks.workunit.client.1.smithi165.stdout:7/277: getdents d0/d4b 0 2024-09-16T02:05:47.283 INFO:tasks.workunit.client.1.smithi165.stdout:5/284: dwrite fc [0,4194304] 0 2024-09-16T02:05:47.284 INFO:tasks.workunit.client.1.smithi165.stdout:2/362: write df/d23/d28/f32 [3962561,89313] 0 2024-09-16T02:05:47.284 INFO:tasks.workunit.client.1.smithi165.stdout:3/399: getdents da/d17/d7a/d7d 0 2024-09-16T02:05:47.285 INFO:tasks.workunit.client.0.smithi110.stdout:1/68: link d0/da/c11 d0/da/c12 0 2024-09-16T02:05:47.285 INFO:tasks.workunit.client.1.smithi165.stdout:2/363: read df/d23/f38 [2460434,6121] 0 2024-09-16T02:05:47.286 INFO:tasks.workunit.client.1.smithi165.stdout:6/289: getdents d7/dc/d3b/d3a 0 2024-09-16T02:05:47.289 INFO:tasks.workunit.client.1.smithi165.stdout:7/278: rename d0/df/d33/c3e to d0/d2c/c52 0 2024-09-16T02:05:47.290 INFO:tasks.workunit.client.1.smithi165.stdout:2/364: dread df/d23/f50 [0,4194304] 0 2024-09-16T02:05:47.291 INFO:tasks.workunit.client.0.smithi110.stdout:1/69: chown d0/da/c11 109 1 2024-09-16T02:05:47.292 INFO:tasks.workunit.client.1.smithi165.stdout:3/400: unlink da/fc 0 2024-09-16T02:05:47.294 INFO:tasks.workunit.client.0.smithi110.stdout:1/70: chown d0/d1/d8/ld 10 1 2024-09-16T02:05:47.297 INFO:tasks.workunit.client.1.smithi165.stdout:5/285: rename de/d19/f2e to de/d21/d4e/f5c 0 2024-09-16T02:05:47.297 INFO:tasks.workunit.client.0.smithi110.stdout:1/71: mknod d0/d1/d4/c13 0 2024-09-16T02:05:47.298 INFO:tasks.workunit.client.1.smithi165.stdout:2/365: dwrite df/d23/d28/d3b/f56 [0,4194304] 0 2024-09-16T02:05:47.300 INFO:tasks.workunit.client.0.smithi110.stdout:1/72: creat d0/f14 x:0 0 0 2024-09-16T02:05:47.301 INFO:tasks.workunit.client.1.smithi165.stdout:0/285: link d0/d1e/d20/d28/c54 d0/d1e/d20/d28/c67 0 2024-09-16T02:05:47.302 INFO:tasks.workunit.client.0.smithi110.stdout:1/73: creat d0/da/f15 x:0 0 0 2024-09-16T02:05:47.303 INFO:tasks.workunit.client.1.smithi165.stdout:2/366: dread df/d23/f51 [0,4194304] 0 2024-09-16T02:05:47.304 INFO:tasks.workunit.client.1.smithi165.stdout:7/279: rename d0/c15 to d0/df/d42/c53 0 2024-09-16T02:05:47.306 INFO:tasks.workunit.client.0.smithi110.stdout:1/74: symlink d0/d1/d4/l16 0 2024-09-16T02:05:47.309 INFO:tasks.workunit.client.1.smithi165.stdout:6/290: creat d7/dc/f48 x:0 0 0 2024-09-16T02:05:47.310 INFO:tasks.workunit.client.1.smithi165.stdout:6/291: write d7/dc/df/d1a/f45 [713968,88587] 0 2024-09-16T02:05:47.312 INFO:tasks.workunit.client.1.smithi165.stdout:7/280: creat d0/df/d33/d2a/f54 x:0 0 0 2024-09-16T02:05:47.312 INFO:tasks.workunit.client.1.smithi165.stdout:6/292: chown d7/dc/d3b/c34 125 1 2024-09-16T02:05:47.313 INFO:tasks.workunit.client.1.smithi165.stdout:7/281: rename d0/d4b to d0/d4b/d55 22 2024-09-16T02:05:47.313 INFO:tasks.workunit.client.1.smithi165.stdout:6/293: chown d7/dc/c3e 474912824 1 2024-09-16T02:05:47.313 INFO:tasks.workunit.client.1.smithi165.stdout:6/294: dread - d7/dc/f48 zero size 2024-09-16T02:05:47.314 INFO:tasks.workunit.client.1.smithi165.stdout:3/401: creat da/d17/d7a/f96 x:0 0 0 2024-09-16T02:05:47.315 INFO:tasks.workunit.client.1.smithi165.stdout:0/286: dread d0/d1e/f26 [0,4194304] 0 2024-09-16T02:05:47.315 INFO:tasks.workunit.client.1.smithi165.stdout:8/320: sync 2024-09-16T02:05:47.316 INFO:tasks.workunit.client.1.smithi165.stdout:2/367: link df/d23/d2a/f41 df/d23/f6e 0 2024-09-16T02:05:47.316 INFO:tasks.workunit.client.1.smithi165.stdout:2/368: stat fa 0 2024-09-16T02:05:47.318 INFO:tasks.workunit.client.1.smithi165.stdout:8/321: unlink dd/d13/f2c 0 2024-09-16T02:05:47.319 INFO:tasks.workunit.client.1.smithi165.stdout:5/286: link de/d21/d26/d3a/l3d de/d21/d26/l5d 0 2024-09-16T02:05:47.322 INFO:tasks.workunit.client.1.smithi165.stdout:8/322: mkdir dd/d11/d14/d70 0 2024-09-16T02:05:47.323 INFO:tasks.workunit.client.1.smithi165.stdout:6/295: getdents d7/dc/df/d1a 0 2024-09-16T02:05:47.323 INFO:tasks.workunit.client.1.smithi165.stdout:3/402: rename da/de/d75 to da/d57/d8d/d97 0 2024-09-16T02:05:47.324 INFO:tasks.workunit.client.1.smithi165.stdout:8/323: write dd/d13/f63 [60329,43770] 0 2024-09-16T02:05:47.325 INFO:tasks.workunit.client.1.smithi165.stdout:3/403: fdatasync da/d57/f7c 0 2024-09-16T02:05:47.327 INFO:tasks.workunit.client.1.smithi165.stdout:6/296: creat d7/dc/d3b/d3a/f49 x:0 0 0 2024-09-16T02:05:47.328 INFO:tasks.workunit.client.1.smithi165.stdout:2/369: link df/d10/d37/c42 df/d10/d1a/c6f 0 2024-09-16T02:05:47.328 INFO:tasks.workunit.client.1.smithi165.stdout:0/287: dread d0/f15 [0,4194304] 0 2024-09-16T02:05:47.330 INFO:tasks.workunit.client.1.smithi165.stdout:6/297: mknod d7/dc/d3b/d3c/c4a 0 2024-09-16T02:05:47.330 INFO:tasks.workunit.client.1.smithi165.stdout:3/404: write da/d20/d26/d52/f93 [713568,88080] 0 2024-09-16T02:05:47.332 INFO:tasks.workunit.client.1.smithi165.stdout:0/288: creat d0/d1e/d20/d28/f68 x:0 0 0 2024-09-16T02:05:47.334 INFO:tasks.workunit.client.1.smithi165.stdout:2/370: symlink df/l70 0 2024-09-16T02:05:47.334 INFO:tasks.workunit.client.1.smithi165.stdout:5/287: truncate de/f1d 5420137 0 2024-09-16T02:05:47.335 INFO:tasks.workunit.client.1.smithi165.stdout:0/289: creat d0/d47/f69 x:0 0 0 2024-09-16T02:05:47.335 INFO:tasks.workunit.client.1.smithi165.stdout:2/371: fdatasync df/d23/f38 0 2024-09-16T02:05:47.336 INFO:tasks.workunit.client.1.smithi165.stdout:3/405: truncate da/d20/f3b 1861314 0 2024-09-16T02:05:47.337 INFO:tasks.workunit.client.1.smithi165.stdout:5/288: creat de/d21/d51/f5e x:0 0 0 2024-09-16T02:05:47.338 INFO:tasks.workunit.client.1.smithi165.stdout:5/289: chown de/c44 23 1 2024-09-16T02:05:47.340 INFO:tasks.workunit.client.1.smithi165.stdout:8/324: dread dd/d11/d38/f39 [0,4194304] 0 2024-09-16T02:05:47.340 INFO:tasks.workunit.client.1.smithi165.stdout:3/406: creat da/d57/d8d/f98 x:0 0 0 2024-09-16T02:05:47.341 INFO:tasks.workunit.client.1.smithi165.stdout:0/290: rename d0/d1e/d39/d48/f4e to d0/d1e/d39/f6a 0 2024-09-16T02:05:47.344 INFO:tasks.workunit.client.1.smithi165.stdout:3/407: mknod da/d17/d78/d2c/d2d/c99 0 2024-09-16T02:05:47.348 INFO:tasks.workunit.client.1.smithi165.stdout:6/298: dread d7/fe [0,4194304] 0 2024-09-16T02:05:47.349 INFO:tasks.workunit.client.1.smithi165.stdout:8/325: creat dd/d13/f71 x:0 0 0 2024-09-16T02:05:47.349 INFO:tasks.workunit.client.1.smithi165.stdout:8/326: fsync dd/d34/f4d 0 2024-09-16T02:05:47.349 INFO:tasks.workunit.client.1.smithi165.stdout:6/299: dread - d7/dc/df/d1a/f47 zero size 2024-09-16T02:05:47.350 INFO:tasks.workunit.client.1.smithi165.stdout:6/300: chown d7/d17 3773901 1 2024-09-16T02:05:47.350 INFO:tasks.workunit.client.1.smithi165.stdout:2/372: truncate df/f62 2144943 0 2024-09-16T02:05:47.351 INFO:tasks.workunit.client.1.smithi165.stdout:2/373: chown df/d10/d37 108 1 2024-09-16T02:05:47.353 INFO:tasks.workunit.client.1.smithi165.stdout:0/291: link d0/d1e/d20/d28/c42 d0/d1e/c6b 0 2024-09-16T02:05:47.354 INFO:tasks.workunit.client.1.smithi165.stdout:5/290: truncate de/d21/f40 1461798 0 2024-09-16T02:05:47.354 INFO:tasks.workunit.client.1.smithi165.stdout:6/301: symlink d7/d17/l4b 0 2024-09-16T02:05:47.354 INFO:tasks.workunit.client.1.smithi165.stdout:5/291: stat de/f2a 0 2024-09-16T02:05:47.357 INFO:tasks.workunit.client.1.smithi165.stdout:0/292: creat d0/d1e/d39/f6c x:0 0 0 2024-09-16T02:05:47.358 INFO:tasks.workunit.client.1.smithi165.stdout:6/302: stat d7/dc/df/d1a/c41 0 2024-09-16T02:05:47.358 INFO:tasks.workunit.client.1.smithi165.stdout:8/327: dwrite dd/d13/f6b [0,4194304] 0 2024-09-16T02:05:47.361 INFO:tasks.workunit.client.1.smithi165.stdout:2/374: rename df/f62 to df/d10/d1a/d68/d69/f71 0 2024-09-16T02:05:47.361 INFO:tasks.workunit.client.1.smithi165.stdout:5/292: creat de/d21/d51/f5f x:0 0 0 2024-09-16T02:05:47.362 INFO:tasks.workunit.client.1.smithi165.stdout:3/408: truncate da/d20/d26/f30 1694556 0 2024-09-16T02:05:47.362 INFO:tasks.workunit.client.1.smithi165.stdout:0/293: mkdir d0/d1e/d20/d28/d6d 0 2024-09-16T02:05:47.363 INFO:tasks.workunit.client.1.smithi165.stdout:8/328: mkdir dd/d11/d14/d3f/d72 0 2024-09-16T02:05:47.367 INFO:tasks.workunit.client.1.smithi165.stdout:0/294: unlink d0/l56 0 2024-09-16T02:05:47.368 INFO:tasks.workunit.client.1.smithi165.stdout:2/375: mknod df/d10/d1a/d68/c72 0 2024-09-16T02:05:47.369 INFO:tasks.workunit.client.1.smithi165.stdout:2/376: readlink l8 0 2024-09-16T02:05:47.371 INFO:tasks.workunit.client.1.smithi165.stdout:6/303: dwrite d7/dc/df/d1a/f45 [0,4194304] 0 2024-09-16T02:05:47.372 INFO:tasks.workunit.client.1.smithi165.stdout:8/329: link dd/d11/d14/d3f/d25/d36/f64 dd/d11/d14/d70/f73 0 2024-09-16T02:05:47.375 INFO:tasks.workunit.client.1.smithi165.stdout:0/295: mkdir d0/d1e/d39/d48/d6e 0 2024-09-16T02:05:47.377 INFO:tasks.workunit.client.1.smithi165.stdout:5/293: dwrite de/d19/d1c/f3e [0,4194304] 0 2024-09-16T02:05:47.378 INFO:tasks.workunit.client.1.smithi165.stdout:2/377: fsync df/d10/d1a/f27 0 2024-09-16T02:05:47.379 INFO:tasks.workunit.client.1.smithi165.stdout:6/304: rmdir d7/dc/d3b/d3a 39 2024-09-16T02:05:47.379 INFO:tasks.workunit.client.1.smithi165.stdout:8/330: chown dd/d11/d38/l4a 101 1 2024-09-16T02:05:47.380 INFO:tasks.workunit.client.1.smithi165.stdout:2/378: chown df/d23/f51 38 1 2024-09-16T02:05:47.380 INFO:tasks.workunit.client.1.smithi165.stdout:3/409: dwrite da/d20/d26/d52/f93 [0,4194304] 0 2024-09-16T02:05:47.380 INFO:tasks.workunit.client.1.smithi165.stdout:0/296: creat d0/d47/f6f x:0 0 0 2024-09-16T02:05:47.384 INFO:tasks.workunit.client.1.smithi165.stdout:5/294: mkdir de/d60 0 2024-09-16T02:05:47.385 INFO:tasks.workunit.client.1.smithi165.stdout:2/379: read df/d23/d2a/f41 [3802876,67187] 0 2024-09-16T02:05:47.385 INFO:tasks.workunit.client.1.smithi165.stdout:8/331: mkdir dd/d11/d38/d74 0 2024-09-16T02:05:47.388 INFO:tasks.workunit.client.1.smithi165.stdout:0/297: mkdir d0/d2a/d70 0 2024-09-16T02:05:47.389 INFO:tasks.workunit.client.1.smithi165.stdout:5/295: mknod de/d21/d26/c61 0 2024-09-16T02:05:47.390 INFO:tasks.workunit.client.1.smithi165.stdout:6/305: symlink d7/dc/d3b/l4c 0 2024-09-16T02:05:47.392 INFO:tasks.workunit.client.1.smithi165.stdout:8/332: unlink dd/d11/d14/d3f/c60 0 2024-09-16T02:05:47.393 INFO:tasks.workunit.client.1.smithi165.stdout:3/410: getdents da/d20/d26/d8c 0 2024-09-16T02:05:47.393 INFO:tasks.workunit.client.1.smithi165.stdout:8/333: chown dd 0 1 2024-09-16T02:05:47.394 INFO:tasks.workunit.client.1.smithi165.stdout:5/296: creat de/d21/f62 x:0 0 0 2024-09-16T02:05:47.395 INFO:tasks.workunit.client.1.smithi165.stdout:4/280: sync 2024-09-16T02:05:47.395 INFO:tasks.workunit.client.1.smithi165.stdout:2/380: mkdir df/d73 0 2024-09-16T02:05:47.396 INFO:tasks.workunit.client.1.smithi165.stdout:6/306: mkdir d7/dc/df/d1a/d4d 0 2024-09-16T02:05:47.400 INFO:tasks.workunit.client.1.smithi165.stdout:0/298: dwrite d0/d1e/d20/f46 [0,4194304] 0 2024-09-16T02:05:47.400 INFO:tasks.workunit.client.1.smithi165.stdout:6/307: chown d7/fe 6 1 2024-09-16T02:05:47.400 INFO:tasks.workunit.client.1.smithi165.stdout:3/411: write da/de/f16 [977245,128297] 0 2024-09-16T02:05:47.403 INFO:tasks.workunit.client.1.smithi165.stdout:4/281: truncate d4/f44 561793 0 2024-09-16T02:05:47.404 INFO:tasks.workunit.client.1.smithi165.stdout:0/299: mknod d0/d1e/d39/d48/c71 0 2024-09-16T02:05:47.404 INFO:tasks.workunit.client.1.smithi165.stdout:8/334: mkdir dd/d11/d14/d3f/d25/d36/d4f/d75 0 2024-09-16T02:05:47.405 INFO:tasks.workunit.client.1.smithi165.stdout:3/412: fsync da/d20/d26/f31 0 2024-09-16T02:05:47.406 INFO:tasks.workunit.client.1.smithi165.stdout:5/297: rename de/d21/f40 to de/d21/f63 0 2024-09-16T02:05:47.406 INFO:tasks.workunit.client.1.smithi165.stdout:4/282: chown d4/dc/c25 60740 1 2024-09-16T02:05:47.407 INFO:tasks.workunit.client.1.smithi165.stdout:0/300: write d0/f30 [1032455,87771] 0 2024-09-16T02:05:47.408 INFO:tasks.workunit.client.0.smithi110.stdout:6/82: sync 2024-09-16T02:05:47.409 INFO:tasks.workunit.client.1.smithi165.stdout:2/381: creat df/d10/d37/f74 x:0 0 0 2024-09-16T02:05:47.409 INFO:tasks.workunit.client.1.smithi165.stdout:8/335: mknod dd/d13/c76 0 2024-09-16T02:05:47.410 INFO:tasks.workunit.client.1.smithi165.stdout:6/308: dwrite f3 [0,4194304] 0 2024-09-16T02:05:47.410 INFO:tasks.workunit.client.1.smithi165.stdout:5/298: mknod de/d21/d51/c64 0 2024-09-16T02:05:47.411 INFO:tasks.workunit.client.1.smithi165.stdout:3/413: truncate da/d17/d78/d2c/f4e 723484 0 2024-09-16T02:05:47.412 INFO:tasks.workunit.client.0.smithi110.stdout:6/83: creat d0/f11 x:0 0 0 2024-09-16T02:05:47.413 INFO:tasks.workunit.client.1.smithi165.stdout:2/382: fdatasync df/d23/f51 0 2024-09-16T02:05:47.416 INFO:tasks.workunit.client.0.smithi110.stdout:6/84: getdents d0/d2/dc 0 2024-09-16T02:05:47.417 INFO:tasks.workunit.client.1.smithi165.stdout:6/309: write d7/dc/d3b/d3c/f43 [448323,95979] 0 2024-09-16T02:05:47.417 INFO:tasks.workunit.client.1.smithi165.stdout:1/262: sync 2024-09-16T02:05:47.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/282: sync 2024-09-16T02:05:47.417 INFO:tasks.workunit.client.1.smithi165.stdout:9/331: sync 2024-09-16T02:05:47.417 INFO:tasks.workunit.client.1.smithi165.stdout:0/301: getdents d0/d1e/d39/d48/d6e 0 2024-09-16T02:05:47.418 INFO:tasks.workunit.client.0.smithi110.stdout:6/85: write d0/d2/d5/fa [1944266,92364] 0 2024-09-16T02:05:47.418 INFO:tasks.workunit.client.0.smithi110.stdout:6/86: chown d0 101 1 2024-09-16T02:05:47.420 INFO:tasks.workunit.client.1.smithi165.stdout:2/383: dread - df/d23/d28/f65 zero size 2024-09-16T02:05:47.420 INFO:tasks.workunit.client.1.smithi165.stdout:4/283: rmdir d4/dc/d18/d5c 0 2024-09-16T02:05:47.424 INFO:tasks.workunit.client.1.smithi165.stdout:0/302: dread - d0/d2a/f5c zero size 2024-09-16T02:05:47.424 INFO:tasks.workunit.client.1.smithi165.stdout:9/332: chown d7/d32/f39 9 1 2024-09-16T02:05:47.426 INFO:tasks.workunit.client.1.smithi165.stdout:2/384: dread df/f4f [0,4194304] 0 2024-09-16T02:05:47.426 INFO:tasks.workunit.client.1.smithi165.stdout:1/263: symlink d1/dd/l4a 0 2024-09-16T02:05:47.427 INFO:tasks.workunit.client.1.smithi165.stdout:5/299: dwrite f7 [4194304,4194304] 0 2024-09-16T02:05:47.429 INFO:tasks.workunit.client.1.smithi165.stdout:9/333: readlink d7/d14/l1a 0 2024-09-16T02:05:47.429 INFO:tasks.workunit.client.1.smithi165.stdout:6/310: rename d7/fd to d7/dc/df/d1a/d4d/f4e 0 2024-09-16T02:05:47.430 INFO:tasks.workunit.client.0.smithi110.stdout:6/87: dread d0/d2/d5/fa [0,4194304] 0 2024-09-16T02:05:47.432 INFO:tasks.workunit.client.1.smithi165.stdout:0/303: fsync d0/d1e/d39/d48/d45/f60 0 2024-09-16T02:05:47.433 INFO:tasks.workunit.client.1.smithi165.stdout:4/284: creat d4/dc/d28/d2b/f60 x:0 0 0 2024-09-16T02:05:47.433 INFO:tasks.workunit.client.1.smithi165.stdout:5/300: read - de/d21/d4e/f55 zero size 2024-09-16T02:05:47.433 INFO:tasks.workunit.client.0.smithi110.stdout:6/88: rename d0/f11 to d0/d2/f12 0 2024-09-16T02:05:47.436 INFO:tasks.workunit.client.1.smithi165.stdout:1/264: creat d1/dd/d11/d33/f4b x:0 0 0 2024-09-16T02:05:47.436 INFO:tasks.workunit.client.0.smithi110.stdout:6/89: dread d0/d2/d5/fa [0,4194304] 0 2024-09-16T02:05:47.436 INFO:tasks.workunit.client.0.smithi110.stdout:6/90: fdatasync d0/f10 0 2024-09-16T02:05:47.436 INFO:tasks.workunit.client.1.smithi165.stdout:2/385: symlink df/d23/d28/d3b/d6d/l75 0 2024-09-16T02:05:47.437 INFO:tasks.workunit.client.1.smithi165.stdout:3/414: dread da/d20/d26/f2a [0,4194304] 0 2024-09-16T02:05:47.437 INFO:tasks.workunit.client.1.smithi165.stdout:8/336: dread f9 [0,4194304] 0 2024-09-16T02:05:47.438 INFO:tasks.workunit.client.1.smithi165.stdout:9/334: symlink d7/d1f/d27/l75 0 2024-09-16T02:05:47.438 INFO:tasks.workunit.client.1.smithi165.stdout:4/285: readlink d4/dc/d28/d30/l38 0 2024-09-16T02:05:47.439 INFO:tasks.workunit.client.1.smithi165.stdout:6/311: creat d7/dc/df/d1a/f4f x:0 0 0 2024-09-16T02:05:47.440 INFO:tasks.workunit.client.1.smithi165.stdout:7/283: dwrite d0/df/d33/d2a/f36 [0,4194304] 0 2024-09-16T02:05:47.440 INFO:tasks.workunit.client.1.smithi165.stdout:2/386: chown df/d10/d1a/c4a 395 1 2024-09-16T02:05:47.441 INFO:tasks.workunit.client.1.smithi165.stdout:5/301: readlink de/d21/d26/d3a/l3d 0 2024-09-16T02:05:47.441 INFO:tasks.workunit.client.1.smithi165.stdout:6/312: dread - d7/dc/d3b/f44 zero size 2024-09-16T02:05:47.442 INFO:tasks.workunit.client.0.smithi110.stdout:6/91: creat d0/d2/de/f13 x:0 0 0 2024-09-16T02:05:47.443 INFO:tasks.workunit.client.1.smithi165.stdout:8/337: truncate dd/d11/f47 667950 0 2024-09-16T02:05:47.444 INFO:tasks.workunit.client.1.smithi165.stdout:1/265: chown d1/dd/d11/d33/d35/l41 2167 1 2024-09-16T02:05:47.447 INFO:tasks.workunit.client.1.smithi165.stdout:3/415: rmdir da/d17/d78/d2c/d2d/d6c 39 2024-09-16T02:05:47.450 INFO:tasks.workunit.client.0.smithi110.stdout:6/92: link d0/d2/d5/fa d0/d2/f14 0 2024-09-16T02:05:47.451 INFO:tasks.workunit.client.1.smithi165.stdout:2/387: mkdir df/d23/d28/d3b/d6d/d76 0 2024-09-16T02:05:47.451 INFO:tasks.workunit.client.1.smithi165.stdout:3/416: dread da/d17/d78/d2c/f70 [0,4194304] 0 2024-09-16T02:05:47.452 INFO:tasks.workunit.client.1.smithi165.stdout:7/284: rename d0/df/d7/lb to d0/d4b/l56 0 2024-09-16T02:05:47.452 INFO:tasks.workunit.client.1.smithi165.stdout:2/388: write df/d10/d1a/d2d/f58 [496627,123235] 0 2024-09-16T02:05:47.453 INFO:tasks.workunit.client.0.smithi110.stdout:6/93: write d0/d2/f14 [829687,50926] 0 2024-09-16T02:05:47.454 INFO:tasks.workunit.client.1.smithi165.stdout:1/266: symlink d1/d22/l4c 0 2024-09-16T02:05:47.454 INFO:tasks.workunit.client.0.smithi110.stdout:6/94: write d0/d2/f14 [2862013,66395] 0 2024-09-16T02:05:47.455 INFO:tasks.workunit.client.1.smithi165.stdout:0/304: symlink d0/d1e/d20/d28/d6d/l72 0 2024-09-16T02:05:47.455 INFO:tasks.workunit.client.1.smithi165.stdout:0/305: chown d0/d1e/d39 11930519 1 2024-09-16T02:05:47.456 INFO:tasks.workunit.client.1.smithi165.stdout:9/335: mknod d7/df/d37/c76 0 2024-09-16T02:05:47.457 INFO:tasks.workunit.client.1.smithi165.stdout:9/336: readlink d7/d14/l1a 0 2024-09-16T02:05:47.458 INFO:tasks.workunit.client.1.smithi165.stdout:9/337: dread - d7/d32/f64 zero size 2024-09-16T02:05:47.458 INFO:tasks.workunit.client.1.smithi165.stdout:5/302: mkdir de/d60/d65 0 2024-09-16T02:05:47.459 INFO:tasks.workunit.client.0.smithi110.stdout:6/95: creat d0/d2/d5/f15 x:0 0 0 2024-09-16T02:05:47.463 INFO:tasks.workunit.client.0.smithi110.stdout:6/96: write d0/d2/d5/fa [592240,24555] 0 2024-09-16T02:05:47.463 INFO:tasks.workunit.client.0.smithi110.stdout:6/97: chown d0/d2/d5/c8 4123 1 2024-09-16T02:05:47.464 INFO:tasks.workunit.client.1.smithi165.stdout:1/267: mkdir d1/d19/d4d 0 2024-09-16T02:05:47.465 INFO:tasks.workunit.client.0.smithi110.stdout:6/98: chown d0/d2/d5/f15 2 1 2024-09-16T02:05:47.467 INFO:tasks.workunit.client.0.smithi110.stdout:6/99: rename d0/d2/de to d0/d2/dc/d16 0 2024-09-16T02:05:47.468 INFO:tasks.workunit.client.0.smithi110.stdout:6/100: truncate d0/d2/dc/ff 481952 0 2024-09-16T02:05:47.469 INFO:tasks.workunit.client.1.smithi165.stdout:7/285: mknod d0/df/d33/c57 0 2024-09-16T02:05:47.470 INFO:tasks.workunit.client.1.smithi165.stdout:8/338: link dd/d13/d53/c5c dd/d11/d14/d3f/c77 0 2024-09-16T02:05:47.471 INFO:tasks.workunit.client.0.smithi110.stdout:6/101: mknod d0/d2/c17 0 2024-09-16T02:05:47.472 INFO:tasks.workunit.client.1.smithi165.stdout:6/313: truncate d7/d1f/f27 588990 0 2024-09-16T02:05:47.473 INFO:tasks.workunit.client.1.smithi165.stdout:1/268: creat d1/d22/f4e x:0 0 0 2024-09-16T02:05:47.474 INFO:tasks.workunit.client.0.smithi110.stdout:6/102: mkdir d0/d2/d18 0 2024-09-16T02:05:47.475 INFO:tasks.workunit.client.1.smithi165.stdout:6/314: write f3 [1638497,21679] 0 2024-09-16T02:05:47.475 INFO:tasks.workunit.client.1.smithi165.stdout:3/417: dwrite da/d20/d26/f7f [0,4194304] 0 2024-09-16T02:05:47.475 INFO:tasks.workunit.client.1.smithi165.stdout:2/389: truncate df/d10/d37/f59 1415022 0 2024-09-16T02:05:47.476 INFO:tasks.workunit.client.0.smithi110.stdout:6/103: write d0/d2/f12 [248917,8218] 0 2024-09-16T02:05:47.479 INFO:tasks.workunit.client.1.smithi165.stdout:9/338: link d7/df/f10 d7/d32/d38/f77 0 2024-09-16T02:05:47.480 INFO:tasks.workunit.client.1.smithi165.stdout:7/286: mkdir d0/d4b/d58 0 2024-09-16T02:05:47.482 INFO:tasks.workunit.client.0.smithi110.stdout:6/104: rename d0/d2/d5/f15 to d0/d2/d18/f19 0 2024-09-16T02:05:47.483 INFO:tasks.workunit.client.0.smithi110.stdout:6/105: write d0/d2/f14 [1586096,37022] 0 2024-09-16T02:05:47.486 INFO:tasks.workunit.client.1.smithi165.stdout:6/315: symlink d7/dc/d3b/d3c/l50 0 2024-09-16T02:05:47.487 INFO:tasks.workunit.client.1.smithi165.stdout:9/339: dwrite d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:47.489 INFO:tasks.workunit.client.1.smithi165.stdout:9/340: write d7/df/f1c [1519406,67115] 0 2024-09-16T02:05:47.491 INFO:tasks.workunit.client.0.smithi110.stdout:6/106: dwrite d0/f10 [0,4194304] 0 2024-09-16T02:05:47.491 INFO:tasks.workunit.client.0.smithi110.stdout:6/107: chown d0/d2 3 1 2024-09-16T02:05:47.492 INFO:tasks.workunit.client.1.smithi165.stdout:7/287: creat d0/f59 x:0 0 0 2024-09-16T02:05:47.494 INFO:tasks.workunit.client.1.smithi165.stdout:5/303: dwrite de/d21/f63 [0,4194304] 0 2024-09-16T02:05:47.494 INFO:tasks.workunit.client.1.smithi165.stdout:6/316: write d7/dc/df/d1a/d4d/f4e [2407956,3174] 0 2024-09-16T02:05:47.497 INFO:tasks.workunit.client.1.smithi165.stdout:5/304: read - de/d21/d4e/f55 zero size 2024-09-16T02:05:47.497 INFO:tasks.workunit.client.1.smithi165.stdout:6/317: fsync d7/d1f/f42 0 2024-09-16T02:05:47.502 INFO:tasks.workunit.client.1.smithi165.stdout:8/339: rename dd/d34/c37 to dd/c78 0 2024-09-16T02:05:47.505 INFO:tasks.workunit.client.1.smithi165.stdout:3/418: creat da/d20/d26/f9a x:0 0 0 2024-09-16T02:05:47.505 INFO:tasks.workunit.client.1.smithi165.stdout:1/269: rename d1/d19/d24 to d1/d19/d24/d4f 22 2024-09-16T02:05:47.507 INFO:tasks.workunit.client.1.smithi165.stdout:9/341: dwrite d7/df/d37/f3b [0,4194304] 0 2024-09-16T02:05:47.508 INFO:tasks.workunit.client.1.smithi165.stdout:5/305: read de/f14 [3697951,93255] 0 2024-09-16T02:05:47.509 INFO:tasks.workunit.client.1.smithi165.stdout:1/270: write d1/f39 [1009134,110663] 0 2024-09-16T02:05:47.513 INFO:tasks.workunit.client.1.smithi165.stdout:8/340: rename dd/d11/d14/c33 to dd/d34/c79 0 2024-09-16T02:05:47.513 INFO:tasks.workunit.client.1.smithi165.stdout:1/271: read d1/dd/f14 [2559270,113223] 0 2024-09-16T02:05:47.516 INFO:tasks.workunit.client.1.smithi165.stdout:6/318: dwrite d7/d1f/f42 [0,4194304] 0 2024-09-16T02:05:47.516 INFO:tasks.workunit.client.1.smithi165.stdout:8/341: write dd/d11/d38/f45 [280547,87335] 0 2024-09-16T02:05:47.519 INFO:tasks.workunit.client.1.smithi165.stdout:5/306: rename de/d21/d4e/f5c to de/d21/d26/f66 0 2024-09-16T02:05:47.521 INFO:tasks.workunit.client.1.smithi165.stdout:8/342: mknod dd/d11/d14/d3f/d25/d36/d4f/d75/c7a 0 2024-09-16T02:05:47.524 INFO:tasks.workunit.client.1.smithi165.stdout:6/319: rename d7/dc/d3b/d3c/f43 to d7/d17/d24/f51 0 2024-09-16T02:05:47.527 INFO:tasks.workunit.client.1.smithi165.stdout:8/343: mkdir dd/d11/d14/d70/d7b 0 2024-09-16T02:05:47.529 INFO:tasks.workunit.client.1.smithi165.stdout:1/272: dwrite d1/dd/f37 [0,4194304] 0 2024-09-16T02:05:47.531 INFO:tasks.workunit.client.1.smithi165.stdout:6/320: symlink d7/dc/d3b/l52 0 2024-09-16T02:05:47.531 INFO:tasks.workunit.client.1.smithi165.stdout:9/342: dread f2 [0,4194304] 0 2024-09-16T02:05:47.533 INFO:tasks.workunit.client.0.smithi110.stdout:6/108: truncate d0/d2/f14 1489157 0 2024-09-16T02:05:47.535 INFO:tasks.workunit.client.0.smithi110.stdout:6/109: truncate d0/d2/dc/ff 721854 0 2024-09-16T02:05:47.535 INFO:tasks.workunit.client.0.smithi110.stdout:6/110: fsync d0/d2/f12 0 2024-09-16T02:05:47.536 INFO:tasks.workunit.client.0.smithi110.stdout:6/111: chown d0/f10 1035350 1 2024-09-16T02:05:47.537 INFO:tasks.workunit.client.1.smithi165.stdout:5/307: dwrite de/f2a [0,4194304] 0 2024-09-16T02:05:47.542 INFO:tasks.workunit.client.1.smithi165.stdout:7/288: dread d0/df/f27 [0,4194304] 0 2024-09-16T02:05:47.543 INFO:tasks.workunit.client.0.smithi110.stdout:6/112: mknod d0/c1a 0 2024-09-16T02:05:47.544 INFO:tasks.workunit.client.1.smithi165.stdout:3/419: truncate da/d17/f4a 834919 0 2024-09-16T02:05:47.546 INFO:tasks.workunit.client.1.smithi165.stdout:5/308: rmdir de/d21/d26/d3a/d54 39 2024-09-16T02:05:47.547 INFO:tasks.workunit.client.1.smithi165.stdout:9/343: dwrite d7/d32/f47 [0,4194304] 0 2024-09-16T02:05:47.547 INFO:tasks.workunit.client.1.smithi165.stdout:6/321: dwrite f3 [0,4194304] 0 2024-09-16T02:05:47.547 INFO:tasks.workunit.client.1.smithi165.stdout:1/273: link d1/c38 d1/d22/c50 0 2024-09-16T02:05:47.548 INFO:tasks.workunit.client.1.smithi165.stdout:8/344: getdents dd/d11/d14/d3f/d25 0 2024-09-16T02:05:47.550 INFO:tasks.workunit.client.1.smithi165.stdout:9/344: fdatasync d7/d1f/d27/f3e 0 2024-09-16T02:05:47.550 INFO:tasks.workunit.client.1.smithi165.stdout:6/322: fdatasync d7/dc/d3b/f44 0 2024-09-16T02:05:47.551 INFO:tasks.workunit.client.0.smithi110.stdout:6/113: getdents d0/d2/dc/d16 0 2024-09-16T02:05:47.551 INFO:tasks.workunit.client.0.smithi110.stdout:6/114: chown d0/d2/f12 839380 1 2024-09-16T02:05:47.553 INFO:tasks.workunit.client.0.smithi110.stdout:6/115: symlink d0/d2/l1b 0 2024-09-16T02:05:47.554 INFO:tasks.workunit.client.0.smithi110.stdout:6/116: truncate d0/d2/d18/f19 682449 0 2024-09-16T02:05:47.556 INFO:tasks.workunit.client.1.smithi165.stdout:3/420: truncate da/f67 242436 0 2024-09-16T02:05:47.556 INFO:tasks.workunit.client.0.smithi110.stdout:6/117: creat d0/d2/f1c x:0 0 0 2024-09-16T02:05:47.557 INFO:tasks.workunit.client.1.smithi165.stdout:5/309: chown de/c37 27428 1 2024-09-16T02:05:47.557 INFO:tasks.workunit.client.1.smithi165.stdout:1/274: chown d1/dd/l23 280 1 2024-09-16T02:05:47.557 INFO:tasks.workunit.client.1.smithi165.stdout:4/286: sync 2024-09-16T02:05:47.558 INFO:tasks.workunit.client.1.smithi165.stdout:7/289: dread d0/d2c/f3b [0,4194304] 0 2024-09-16T02:05:47.558 INFO:tasks.workunit.client.0.smithi110.stdout:6/118: unlink d0/d2/d18/f19 0 2024-09-16T02:05:47.559 INFO:tasks.workunit.client.1.smithi165.stdout:6/323: write d7/d1f/f32 [1290046,42404] 0 2024-09-16T02:05:47.560 INFO:tasks.workunit.client.1.smithi165.stdout:5/310: readlink de/d21/d26/l4b 0 2024-09-16T02:05:47.561 INFO:tasks.workunit.client.1.smithi165.stdout:1/275: mknod d1/d19/c51 0 2024-09-16T02:05:47.563 INFO:tasks.workunit.client.1.smithi165.stdout:3/421: rmdir da/d17/d7a/d7d 39 2024-09-16T02:05:47.563 INFO:tasks.workunit.client.1.smithi165.stdout:4/287: write d4/dc/d18/f23 [457565,10101] 0 2024-09-16T02:05:47.565 INFO:tasks.workunit.client.1.smithi165.stdout:1/276: chown d1/d19/l2b 113057149 1 2024-09-16T02:05:47.565 INFO:tasks.workunit.client.1.smithi165.stdout:5/311: write de/f14 [12486058,103244] 0 2024-09-16T02:05:47.566 INFO:tasks.workunit.client.1.smithi165.stdout:3/422: mkdir da/d9b 0 2024-09-16T02:05:47.566 INFO:tasks.workunit.client.1.smithi165.stdout:9/345: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:47.567 INFO:tasks.workunit.client.1.smithi165.stdout:8/345: dwrite dd/d11/d14/f1e [0,4194304] 0 2024-09-16T02:05:47.567 INFO:tasks.workunit.client.1.smithi165.stdout:5/312: fsync de/f5b 0 2024-09-16T02:05:47.569 INFO:tasks.workunit.client.1.smithi165.stdout:4/288: rmdir d4/dc/d28/d2b 39 2024-09-16T02:05:47.570 INFO:tasks.workunit.client.1.smithi165.stdout:9/346: dread - d7/d1f/f5d zero size 2024-09-16T02:05:47.573 INFO:tasks.workunit.client.1.smithi165.stdout:2/390: sync 2024-09-16T02:05:47.573 INFO:tasks.workunit.client.1.smithi165.stdout:0/306: sync 2024-09-16T02:05:47.574 INFO:tasks.workunit.client.0.smithi110.stdout:6/119: dread d0/d2/d5/fa [0,4194304] 0 2024-09-16T02:05:47.574 INFO:tasks.workunit.client.1.smithi165.stdout:5/313: mkdir de/d19/d67 0 2024-09-16T02:05:47.574 INFO:tasks.workunit.client.1.smithi165.stdout:3/423: dread - da/d20/d26/f9a zero size 2024-09-16T02:05:47.574 INFO:tasks.workunit.client.1.smithi165.stdout:7/290: dread d0/df/d42/f4e [0,4194304] 0 2024-09-16T02:05:47.575 INFO:tasks.workunit.client.1.smithi165.stdout:1/277: rename d1/d32/f3c to d1/dd/d11/f52 0 2024-09-16T02:05:47.577 INFO:tasks.workunit.client.1.smithi165.stdout:7/291: write d0/d3d/f4f [126693,97985] 0 2024-09-16T02:05:47.577 INFO:tasks.workunit.client.1.smithi165.stdout:8/346: mknod dd/d11/d14/d3f/d25/d36/c7c 0 2024-09-16T02:05:47.579 INFO:tasks.workunit.client.1.smithi165.stdout:8/347: write dd/d13/f21 [710175,92238] 0 2024-09-16T02:05:47.580 INFO:tasks.workunit.client.0.smithi110.stdout:7/33: sync 2024-09-16T02:05:47.580 INFO:tasks.workunit.client.0.smithi110.stdout:0/45: sync 2024-09-16T02:05:47.580 INFO:tasks.workunit.client.0.smithi110.stdout:8/54: sync 2024-09-16T02:05:47.581 INFO:tasks.workunit.client.0.smithi110.stdout:7/34: fsync f2 0 2024-09-16T02:05:47.581 INFO:tasks.workunit.client.1.smithi165.stdout:8/348: truncate dd/d11/f47 1684049 0 2024-09-16T02:05:47.581 INFO:tasks.workunit.client.1.smithi165.stdout:9/347: fsync d7/d1f/d27/d49/f50 0 2024-09-16T02:05:47.582 INFO:tasks.workunit.client.0.smithi110.stdout:8/55: write d3/fd [182759,30602] 0 2024-09-16T02:05:47.583 INFO:tasks.workunit.client.1.smithi165.stdout:8/349: chown dd/d11/d14/d3f/d72 0 1 2024-09-16T02:05:47.584 INFO:tasks.workunit.client.1.smithi165.stdout:9/348: write d7/d32/f64 [874678,7675] 0 2024-09-16T02:05:47.585 INFO:tasks.workunit.client.0.smithi110.stdout:0/46: write d3/f9 [4155659,24899] 0 2024-09-16T02:05:47.585 INFO:tasks.workunit.client.1.smithi165.stdout:4/289: truncate d4/dc/d28/d3b/f52 1465846 0 2024-09-16T02:05:47.587 INFO:tasks.workunit.client.1.smithi165.stdout:3/424: dread da/d17/f1a [0,4194304] 0 2024-09-16T02:05:47.588 INFO:tasks.workunit.client.0.smithi110.stdout:7/35: unlink f2 0 2024-09-16T02:05:47.588 INFO:tasks.workunit.client.1.smithi165.stdout:5/314: rename de/d21/d26/d3a/l4a to de/d21/d4e/l68 0 2024-09-16T02:05:47.588 INFO:tasks.workunit.client.1.smithi165.stdout:9/349: write d7/df/f40 [2068402,103645] 0 2024-09-16T02:05:47.589 INFO:tasks.workunit.client.0.smithi110.stdout:7/36: dread d3/f7 [0,4194304] 0 2024-09-16T02:05:47.589 INFO:tasks.workunit.client.0.smithi110.stdout:7/37: chown d3 12702018 1 2024-09-16T02:05:47.589 INFO:tasks.workunit.client.0.smithi110.stdout:8/56: creat d3/f10 x:0 0 0 2024-09-16T02:05:47.590 INFO:tasks.workunit.client.0.smithi110.stdout:7/38: write d3/f8 [258180,97396] 0 2024-09-16T02:05:47.591 INFO:tasks.workunit.client.1.smithi165.stdout:7/292: creat d0/df/d33/d2a/f5a x:0 0 0 2024-09-16T02:05:47.592 INFO:tasks.workunit.client.1.smithi165.stdout:3/425: write da/d17/d78/d2c/f74 [1016703,35298] 0 2024-09-16T02:05:47.592 INFO:tasks.workunit.client.0.smithi110.stdout:0/47: mkdir d3/d4/dc 0 2024-09-16T02:05:47.594 INFO:tasks.workunit.client.1.smithi165.stdout:1/278: dwrite d1/dd/f2e [0,4194304] 0 2024-09-16T02:05:47.596 INFO:tasks.workunit.client.0.smithi110.stdout:0/48: dread d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:47.596 INFO:tasks.workunit.client.1.smithi165.stdout:1/279: write d1/dd/d11/d33/f4b [477001,83095] 0 2024-09-16T02:05:47.596 INFO:tasks.workunit.client.1.smithi165.stdout:0/307: unlink d0/d1e/d39/d48/d45/l5b 0 2024-09-16T02:05:47.597 INFO:tasks.workunit.client.1.smithi165.stdout:1/280: chown d1/dd/d11/d33/d3f/d47 137640 1 2024-09-16T02:05:47.597 INFO:tasks.workunit.client.1.smithi165.stdout:0/308: truncate d0/d47/f65 612327 0 2024-09-16T02:05:47.600 INFO:tasks.workunit.client.0.smithi110.stdout:7/39: dread d3/f8 [0,4194304] 0 2024-09-16T02:05:47.600 INFO:tasks.workunit.client.1.smithi165.stdout:6/324: dread d7/dc/df/d1a/d4d/f4e [0,4194304] 0 2024-09-16T02:05:47.601 INFO:tasks.workunit.client.1.smithi165.stdout:0/309: read d0/d1e/d39/d48/d45/f4b [1166235,20906] 0 2024-09-16T02:05:47.601 INFO:tasks.workunit.client.1.smithi165.stdout:6/325: dread - d7/dc/f48 zero size 2024-09-16T02:05:47.604 INFO:tasks.workunit.client.1.smithi165.stdout:2/391: rename df/d10/d1a/d68/d69 to df/d23/d2a/d77 0 2024-09-16T02:05:47.605 INFO:tasks.workunit.client.1.smithi165.stdout:9/350: stat d7/d32/c5a 0 2024-09-16T02:05:47.606 INFO:tasks.workunit.client.0.smithi110.stdout:6/120: dwrite d0/d2/f14 [0,4194304] 0 2024-09-16T02:05:47.607 INFO:tasks.workunit.client.1.smithi165.stdout:7/293: creat d0/d3d/f5b x:0 0 0 2024-09-16T02:05:47.608 INFO:tasks.workunit.client.1.smithi165.stdout:6/326: dwrite d7/dc/df/d1a/f47 [0,4194304] 0 2024-09-16T02:05:47.610 INFO:tasks.workunit.client.1.smithi165.stdout:3/426: mkdir da/d20/d26/d52/d9c 0 2024-09-16T02:05:47.614 INFO:tasks.workunit.client.1.smithi165.stdout:8/350: mkdir dd/d11/d38/d74/d7d 0 2024-09-16T02:05:47.617 INFO:tasks.workunit.client.1.smithi165.stdout:1/281: fsync d1/fc 0 2024-09-16T02:05:47.617 INFO:tasks.workunit.client.1.smithi165.stdout:6/327: dread d7/d17/d24/f51 [0,4194304] 0 2024-09-16T02:05:47.618 INFO:tasks.workunit.client.1.smithi165.stdout:8/351: read - dd/d11/d14/d70/f73 zero size 2024-09-16T02:05:47.620 INFO:tasks.workunit.client.1.smithi165.stdout:7/294: dwrite d0/df/d33/d2a/f5a [0,4194304] 0 2024-09-16T02:05:47.621 INFO:tasks.workunit.client.0.smithi110.stdout:7/40: mkdir d3/da 0 2024-09-16T02:05:47.621 INFO:tasks.workunit.client.1.smithi165.stdout:8/352: dread - dd/d11/d14/f54 zero size 2024-09-16T02:05:47.623 INFO:tasks.workunit.client.1.smithi165.stdout:8/353: chown dd/d11/d14/d3f/f6a 12269 1 2024-09-16T02:05:47.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/121: mkdir d0/d2/d18/d1d 0 2024-09-16T02:05:47.625 INFO:tasks.workunit.client.1.smithi165.stdout:8/354: truncate dd/d13/f63 1464430 0 2024-09-16T02:05:47.625 INFO:tasks.workunit.client.1.smithi165.stdout:2/392: creat df/d10/d1a/d2d/f78 x:0 0 0 2024-09-16T02:05:47.631 INFO:tasks.workunit.client.1.smithi165.stdout:8/355: stat dd/d11/d14/d3f/d25/c6d 0 2024-09-16T02:05:47.632 INFO:tasks.workunit.client.0.smithi110.stdout:8/57: truncate d3/fe 3931696 0 2024-09-16T02:05:47.632 INFO:tasks.workunit.client.1.smithi165.stdout:9/351: dread f4 [0,4194304] 0 2024-09-16T02:05:47.632 INFO:tasks.workunit.client.1.smithi165.stdout:7/295: dwrite d0/df/d33/d2a/f5a [0,4194304] 0 2024-09-16T02:05:47.633 INFO:tasks.workunit.client.1.smithi165.stdout:9/352: read f4 [2054384,64472] 0 2024-09-16T02:05:47.634 INFO:tasks.workunit.client.0.smithi110.stdout:6/122: dwrite d0/d2/dc/ff [0,4194304] 0 2024-09-16T02:05:47.635 INFO:tasks.workunit.client.0.smithi110.stdout:6/123: readlink d0/d2/l1b 0 2024-09-16T02:05:47.635 INFO:tasks.workunit.client.1.smithi165.stdout:7/296: write d0/df/f44 [1985415,127405] 0 2024-09-16T02:05:47.635 INFO:tasks.workunit.client.1.smithi165.stdout:9/353: dread - d7/d14/d4f/f6e zero size 2024-09-16T02:05:47.636 INFO:tasks.workunit.client.0.smithi110.stdout:0/49: link l0 d3/ld 0 2024-09-16T02:05:47.636 INFO:tasks.workunit.client.0.smithi110.stdout:0/50: write d3/f9 [4027290,1364] 0 2024-09-16T02:05:47.639 INFO:tasks.workunit.client.1.smithi165.stdout:9/354: write d7/df/d37/d43/f45 [17466,78201] 0 2024-09-16T02:05:47.640 INFO:tasks.workunit.client.0.smithi110.stdout:8/58: symlink d3/l11 0 2024-09-16T02:05:47.642 INFO:tasks.workunit.client.1.smithi165.stdout:8/356: dwrite dd/d11/d38/f4b [0,4194304] 0 2024-09-16T02:05:47.643 INFO:tasks.workunit.client.0.smithi110.stdout:7/41: dread d3/f7 [0,4194304] 0 2024-09-16T02:05:47.644 INFO:tasks.workunit.client.1.smithi165.stdout:7/297: dread d0/df/f27 [0,4194304] 0 2024-09-16T02:05:47.644 INFO:tasks.workunit.client.1.smithi165.stdout:7/298: fdatasync d0/df/d33/d2a/f4d 0 2024-09-16T02:05:47.645 INFO:tasks.workunit.client.1.smithi165.stdout:6/328: unlink d7/d17/l4b 0 2024-09-16T02:05:47.646 INFO:tasks.workunit.client.1.smithi165.stdout:6/329: chown d7/l15 952 1 2024-09-16T02:05:47.646 INFO:tasks.workunit.client.0.smithi110.stdout:7/42: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:47.647 INFO:tasks.workunit.client.1.smithi165.stdout:5/315: rename de/d19/l22 to de/d60/d65/l69 0 2024-09-16T02:05:47.652 INFO:tasks.workunit.client.0.smithi110.stdout:8/59: mkdir d3/d12 0 2024-09-16T02:05:47.654 INFO:tasks.workunit.client.0.smithi110.stdout:9/43: sync 2024-09-16T02:05:47.654 INFO:tasks.workunit.client.0.smithi110.stdout:1/75: sync 2024-09-16T02:05:47.654 INFO:tasks.workunit.client.0.smithi110.stdout:5/112: sync 2024-09-16T02:05:47.654 INFO:tasks.workunit.client.0.smithi110.stdout:3/81: sync 2024-09-16T02:05:47.654 INFO:tasks.workunit.client.0.smithi110.stdout:2/116: sync 2024-09-16T02:05:47.654 INFO:tasks.workunit.client.0.smithi110.stdout:4/42: sync 2024-09-16T02:05:47.655 INFO:tasks.workunit.client.1.smithi165.stdout:5/316: dwrite de/f14 [8388608,4194304] 0 2024-09-16T02:05:47.655 INFO:tasks.workunit.client.0.smithi110.stdout:4/43: fsync d4/fc 0 2024-09-16T02:05:47.663 INFO:tasks.workunit.client.1.smithi165.stdout:9/355: mknod d7/d55/c78 0 2024-09-16T02:05:47.664 INFO:tasks.workunit.client.1.smithi165.stdout:3/427: dwrite da/d20/d26/f4f [0,4194304] 0 2024-09-16T02:05:47.666 INFO:tasks.workunit.client.1.smithi165.stdout:8/357: symlink dd/d11/d14/d3f/d25/l7e 0 2024-09-16T02:05:47.666 INFO:tasks.workunit.client.0.smithi110.stdout:2/117: dwrite d0/f7 [0,4194304] 0 2024-09-16T02:05:47.669 INFO:tasks.workunit.client.1.smithi165.stdout:9/356: dwrite d7/d1d/f72 [0,4194304] 0 2024-09-16T02:05:47.669 INFO:tasks.workunit.client.1.smithi165.stdout:9/357: readlink d7/l36 0 2024-09-16T02:05:47.673 INFO:tasks.workunit.client.0.smithi110.stdout:2/118: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:47.674 INFO:tasks.workunit.client.1.smithi165.stdout:7/299: symlink d0/d4b/l5c 0 2024-09-16T02:05:47.677 INFO:tasks.workunit.client.1.smithi165.stdout:6/330: rmdir d7/dc/d3b/d3c 39 2024-09-16T02:05:47.679 INFO:tasks.workunit.client.1.smithi165.stdout:6/331: chown d7/dc/df/d1a/d4d/f4e 251 1 2024-09-16T02:05:47.679 INFO:tasks.workunit.client.1.smithi165.stdout:7/300: dread d0/df/d33/d2a/f5a [0,4194304] 0 2024-09-16T02:05:47.683 INFO:tasks.workunit.client.0.smithi110.stdout:6/124: truncate d0/f10 387892 0 2024-09-16T02:05:47.685 INFO:tasks.workunit.client.0.smithi110.stdout:1/76: creat d0/da/f17 x:0 0 0 2024-09-16T02:05:47.685 INFO:tasks.workunit.client.0.smithi110.stdout:6/125: write d0/d2/dc/d16/f13 [289638,95173] 0 2024-09-16T02:05:47.686 INFO:tasks.workunit.client.0.smithi110.stdout:7/43: write d3/f7 [524196,39900] 0 2024-09-16T02:05:47.687 INFO:tasks.workunit.client.0.smithi110.stdout:6/126: chown d0/d2/l1b 0 1 2024-09-16T02:05:47.687 INFO:tasks.workunit.client.0.smithi110.stdout:1/77: write d0/da/f15 [471369,49505] 0 2024-09-16T02:05:47.688 INFO:tasks.workunit.client.1.smithi165.stdout:1/282: dwrite d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:47.689 INFO:tasks.workunit.client.1.smithi165.stdout:1/283: fsync d1/d19/d24/d30/f45 0 2024-09-16T02:05:47.690 INFO:tasks.workunit.client.0.smithi110.stdout:0/51: truncate d3/f9 1705039 0 2024-09-16T02:05:47.692 INFO:tasks.workunit.client.0.smithi110.stdout:1/78: read d0/da/f15 [363612,61668] 0 2024-09-16T02:05:47.693 INFO:tasks.workunit.client.0.smithi110.stdout:8/60: symlink d3/d12/l13 0 2024-09-16T02:05:47.693 INFO:tasks.workunit.client.1.smithi165.stdout:1/284: dread d1/d22/f20 [0,4194304] 0 2024-09-16T02:05:47.693 INFO:tasks.workunit.client.1.smithi165.stdout:8/358: fsync dd/d11/d14/d70/f73 0 2024-09-16T02:05:47.694 INFO:tasks.workunit.client.1.smithi165.stdout:1/285: fsync d1/d32/f34 0 2024-09-16T02:05:47.695 INFO:tasks.workunit.client.1.smithi165.stdout:1/286: chown d1/c1a 1797 1 2024-09-16T02:05:47.696 INFO:tasks.workunit.client.0.smithi110.stdout:9/44: link d1/f3 d1/fc 0 2024-09-16T02:05:47.696 INFO:tasks.workunit.client.0.smithi110.stdout:1/79: dread d0/da/f15 [0,4194304] 0 2024-09-16T02:05:47.700 INFO:tasks.workunit.client.1.smithi165.stdout:9/358: creat d7/d32/d38/d58/f79 x:0 0 0 2024-09-16T02:05:47.700 INFO:tasks.workunit.client.1.smithi165.stdout:9/359: fsync d7/df/f40 0 2024-09-16T02:05:47.702 INFO:tasks.workunit.client.0.smithi110.stdout:6/127: rmdir d0/d2/dc 39 2024-09-16T02:05:47.707 INFO:tasks.workunit.client.1.smithi165.stdout:7/301: unlink d0/df/d33/f37 0 2024-09-16T02:05:47.709 INFO:tasks.workunit.client.1.smithi165.stdout:2/393: rmdir df/d23/d28/d3b/d6d/d76 0 2024-09-16T02:05:47.713 INFO:tasks.workunit.client.1.smithi165.stdout:5/317: mknod de/d21/d26/d3a/d54/c6a 0 2024-09-16T02:05:47.715 INFO:tasks.workunit.client.0.smithi110.stdout:1/80: creat d0/d1/d4/f18 x:0 0 0 2024-09-16T02:05:47.715 INFO:tasks.workunit.client.0.smithi110.stdout:8/61: dread d3/fe [0,4194304] 0 2024-09-16T02:05:47.717 INFO:tasks.workunit.client.0.smithi110.stdout:7/44: mknod d3/da/cb 0 2024-09-16T02:05:47.719 INFO:tasks.workunit.client.1.smithi165.stdout:8/359: unlink dd/d11/d14/d3f/c2e 0 2024-09-16T02:05:47.722 INFO:tasks.workunit.client.0.smithi110.stdout:8/62: dwrite d3/fd [0,4194304] 0 2024-09-16T02:05:47.722 INFO:tasks.workunit.client.1.smithi165.stdout:1/287: mknod d1/d19/d24/d30/c53 0 2024-09-16T02:05:47.722 INFO:tasks.workunit.client.1.smithi165.stdout:1/288: chown d1/dd/d11/l43 7452953 1 2024-09-16T02:05:47.729 INFO:tasks.workunit.client.0.smithi110.stdout:2/119: dwrite d0/f16 [0,4194304] 0 2024-09-16T02:05:47.730 INFO:tasks.workunit.client.1.smithi165.stdout:6/332: symlink d7/dc/d3b/d3a/d3d/l53 0 2024-09-16T02:05:47.731 INFO:tasks.workunit.client.1.smithi165.stdout:6/333: truncate d7/dc/d3b/f44 713146 0 2024-09-16T02:05:47.733 INFO:tasks.workunit.client.1.smithi165.stdout:0/310: rename d0/d47/f69 to d0/d1e/d39/d48/d5f/f73 0 2024-09-16T02:05:47.735 INFO:tasks.workunit.client.1.smithi165.stdout:4/290: sync 2024-09-16T02:05:47.735 INFO:tasks.workunit.client.1.smithi165.stdout:7/302: creat d0/d4b/f5d x:0 0 0 2024-09-16T02:05:47.736 INFO:tasks.workunit.client.0.smithi110.stdout:7/45: creat d3/da/fc x:0 0 0 2024-09-16T02:05:47.737 INFO:tasks.workunit.client.0.smithi110.stdout:7/46: readlink - no filename 2024-09-16T02:05:47.737 INFO:tasks.workunit.client.0.smithi110.stdout:6/128: dwrite d0/d2/d5/fa [4194304,4194304] 0 2024-09-16T02:05:47.737 INFO:tasks.workunit.client.0.smithi110.stdout:8/63: rmdir d3/d12 39 2024-09-16T02:05:47.740 INFO:tasks.workunit.client.1.smithi165.stdout:9/360: dwrite d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:47.741 INFO:tasks.workunit.client.0.smithi110.stdout:2/120: chown d0/da/d18/dc/c1d 443 1 2024-09-16T02:05:47.747 INFO:tasks.workunit.client.0.smithi110.stdout:6/129: write d0/d2/dc/ff [3138288,111966] 0 2024-09-16T02:05:47.748 INFO:tasks.workunit.client.1.smithi165.stdout:2/394: dwrite df/d23/f50 [0,4194304] 0 2024-09-16T02:05:47.748 INFO:tasks.workunit.client.0.smithi110.stdout:6/130: read - d0/d2/f1c zero size 2024-09-16T02:05:47.749 INFO:tasks.workunit.client.1.smithi165.stdout:6/334: write d7/dc/df/d1a/d4d/f4e [3219854,53686] 0 2024-09-16T02:05:47.750 INFO:tasks.workunit.client.0.smithi110.stdout:6/131: write d0/d2/dc/d16/f13 [7011,129658] 0 2024-09-16T02:05:47.750 INFO:tasks.workunit.client.0.smithi110.stdout:2/121: rmdir d0/da/d18 39 2024-09-16T02:05:47.751 INFO:tasks.workunit.client.1.smithi165.stdout:5/318: write de/d19/d1c/f3e [4280130,72392] 0 2024-09-16T02:05:47.751 INFO:tasks.workunit.client.1.smithi165.stdout:5/319: fdatasync f7 0 2024-09-16T02:05:47.755 INFO:tasks.workunit.client.1.smithi165.stdout:4/291: creat d4/dc/d18/d37/d47/f61 x:0 0 0 2024-09-16T02:05:47.757 INFO:tasks.workunit.client.0.smithi110.stdout:8/64: rename d3/d12/l13 to d3/d12/l14 0 2024-09-16T02:05:47.757 INFO:tasks.workunit.client.1.smithi165.stdout:2/395: dread df/d10/d1a/d2d/f4b [0,4194304] 0 2024-09-16T02:05:47.758 INFO:tasks.workunit.client.0.smithi110.stdout:0/52: write d3/f9 [2003695,50058] 0 2024-09-16T02:05:47.760 INFO:tasks.workunit.client.1.smithi165.stdout:9/361: mkdir d7/d14/d7a 0 2024-09-16T02:05:47.761 INFO:tasks.workunit.client.1.smithi165.stdout:8/360: mkdir dd/d7f 0 2024-09-16T02:05:47.762 INFO:tasks.workunit.client.0.smithi110.stdout:7/47: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:47.762 INFO:tasks.workunit.client.0.smithi110.stdout:6/132: mkdir d0/d2/d5/d1e 0 2024-09-16T02:05:47.763 INFO:tasks.workunit.client.1.smithi165.stdout:1/289: mkdir d1/dd/d25/d54 0 2024-09-16T02:05:47.767 INFO:tasks.workunit.client.1.smithi165.stdout:9/362: dwrite d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:47.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/53: creat d3/fe x:0 0 0 2024-09-16T02:05:47.772 INFO:tasks.workunit.client.0.smithi110.stdout:7/48: creat d3/da/fd x:0 0 0 2024-09-16T02:05:47.773 INFO:tasks.workunit.client.1.smithi165.stdout:2/396: dread df/f19 [0,4194304] 0 2024-09-16T02:05:47.773 INFO:tasks.workunit.client.1.smithi165.stdout:6/335: symlink d7/d1f/l54 0 2024-09-16T02:05:47.776 INFO:tasks.workunit.client.1.smithi165.stdout:5/320: chown de/d19/d1c/c50 356016 1 2024-09-16T02:05:47.777 INFO:tasks.workunit.client.1.smithi165.stdout:7/303: link d0/df/f27 d0/df/d42/f5e 0 2024-09-16T02:05:47.777 INFO:tasks.workunit.client.0.smithi110.stdout:0/54: creat d3/d6/ff x:0 0 0 2024-09-16T02:05:47.778 INFO:tasks.workunit.client.1.smithi165.stdout:4/292: truncate d4/dc/d28/f43 861827 0 2024-09-16T02:05:47.779 INFO:tasks.workunit.client.1.smithi165.stdout:7/304: stat d0/df/d33/c24 0 2024-09-16T02:05:47.780 INFO:tasks.workunit.client.1.smithi165.stdout:4/293: dread - d4/dc/d28/f5f zero size 2024-09-16T02:05:47.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/363: dwrite d7/d14/d4f/f6e [0,4194304] 0 2024-09-16T02:05:47.781 INFO:tasks.workunit.client.1.smithi165.stdout:4/294: chown d4/dc/d18/d37/l4d 357223835 1 2024-09-16T02:05:47.783 INFO:tasks.workunit.client.0.smithi110.stdout:7/49: rmdir d3 39 2024-09-16T02:05:47.783 INFO:tasks.workunit.client.0.smithi110.stdout:2/122: write d0/da/d18/dc/f1f [123397,103935] 0 2024-09-16T02:05:47.784 INFO:tasks.workunit.client.0.smithi110.stdout:8/65: creat d3/f15 x:0 0 0 2024-09-16T02:05:47.785 INFO:tasks.workunit.client.0.smithi110.stdout:8/66: stat d3/c5 0 2024-09-16T02:05:47.785 INFO:tasks.workunit.client.1.smithi165.stdout:4/295: dread d4/dc/d20/f27 [4194304,4194304] 0 2024-09-16T02:05:47.786 INFO:tasks.workunit.client.0.smithi110.stdout:8/67: chown d3/f10 259594825 1 2024-09-16T02:05:47.786 INFO:tasks.workunit.client.0.smithi110.stdout:8/68: fsync d3/f9 0 2024-09-16T02:05:47.787 INFO:tasks.workunit.client.1.smithi165.stdout:0/311: write d0/d1e/d39/d48/d5f/f73 [734800,39828] 0 2024-09-16T02:05:47.789 INFO:tasks.workunit.client.0.smithi110.stdout:0/55: truncate d3/d4/f5 2199842 0 2024-09-16T02:05:47.789 INFO:tasks.workunit.client.1.smithi165.stdout:0/312: fdatasync d0/d1e/f63 0 2024-09-16T02:05:47.790 INFO:tasks.workunit.client.1.smithi165.stdout:4/296: chown d4/dc/d18/d37/d47/f61 423502 1 2024-09-16T02:05:47.790 INFO:tasks.workunit.client.1.smithi165.stdout:4/297: readlink d4/l7 0 2024-09-16T02:05:47.791 INFO:tasks.workunit.client.0.smithi110.stdout:6/133: write d0/f10 [1269240,4837] 0 2024-09-16T02:05:47.791 INFO:tasks.workunit.client.1.smithi165.stdout:6/336: symlink d7/dc/df/d1a/l55 0 2024-09-16T02:05:47.792 INFO:tasks.workunit.client.1.smithi165.stdout:1/290: dwrite d1/dd/d11/f52 [0,4194304] 0 2024-09-16T02:05:47.794 INFO:tasks.workunit.client.1.smithi165.stdout:6/337: dread d7/dc/d3b/f31 [0,4194304] 0 2024-09-16T02:05:47.795 INFO:tasks.workunit.client.0.smithi110.stdout:7/50: write d3/f7 [826465,87026] 0 2024-09-16T02:05:47.801 INFO:tasks.workunit.client.0.smithi110.stdout:8/69: dwrite d3/f10 [0,4194304] 0 2024-09-16T02:05:47.802 INFO:tasks.workunit.client.1.smithi165.stdout:6/338: dwrite d7/d1f/f42 [0,4194304] 0 2024-09-16T02:05:47.803 INFO:tasks.workunit.client.1.smithi165.stdout:8/361: dread dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:47.804 INFO:tasks.workunit.client.1.smithi165.stdout:8/362: readlink dd/l27 0 2024-09-16T02:05:47.806 INFO:tasks.workunit.client.1.smithi165.stdout:2/397: unlink cd 0 2024-09-16T02:05:47.807 INFO:tasks.workunit.client.1.smithi165.stdout:3/428: sync 2024-09-16T02:05:47.807 INFO:tasks.workunit.client.0.smithi110.stdout:7/51: creat d3/da/fe x:0 0 0 2024-09-16T02:05:47.808 INFO:tasks.workunit.client.0.smithi110.stdout:6/134: dwrite d0/d2/f12 [0,4194304] 0 2024-09-16T02:05:47.810 INFO:tasks.workunit.client.1.smithi165.stdout:4/298: creat d4/dc/d20/f62 x:0 0 0 2024-09-16T02:05:47.811 INFO:tasks.workunit.client.1.smithi165.stdout:4/299: fsync d4/dc/f58 0 2024-09-16T02:05:47.812 INFO:tasks.workunit.client.0.smithi110.stdout:8/70: mkdir d3/d12/d16 0 2024-09-16T02:05:47.812 INFO:tasks.workunit.client.1.smithi165.stdout:0/313: dread d0/d47/f59 [0,4194304] 0 2024-09-16T02:05:47.813 INFO:tasks.workunit.client.0.smithi110.stdout:8/71: fdatasync d3/f9 0 2024-09-16T02:05:47.813 INFO:tasks.workunit.client.1.smithi165.stdout:1/291: creat d1/dd/d11/d33/d3f/f55 x:0 0 0 2024-09-16T02:05:47.818 INFO:tasks.workunit.client.0.smithi110.stdout:7/52: read f1 [482517,30692] 0 2024-09-16T02:05:47.818 INFO:tasks.workunit.client.0.smithi110.stdout:2/123: rename d0/f8 to d0/da/d18/f29 0 2024-09-16T02:05:47.820 INFO:tasks.workunit.client.1.smithi165.stdout:9/364: creat d7/df/d67/f7b x:0 0 0 2024-09-16T02:05:47.821 INFO:tasks.workunit.client.0.smithi110.stdout:7/53: chown d3/c6 27 1 2024-09-16T02:05:47.821 INFO:tasks.workunit.client.0.smithi110.stdout:6/135: creat d0/d2/dc/f1f x:0 0 0 2024-09-16T02:05:47.821 INFO:tasks.workunit.client.1.smithi165.stdout:9/365: read - d7/d32/d38/d58/f79 zero size 2024-09-16T02:05:47.821 INFO:tasks.workunit.client.1.smithi165.stdout:9/366: chown d7/l36 414538 1 2024-09-16T02:05:47.822 INFO:tasks.workunit.client.0.smithi110.stdout:6/136: chown d0 241843 1 2024-09-16T02:05:47.824 INFO:tasks.workunit.client.0.smithi110.stdout:8/72: dwrite d3/f15 [0,4194304] 0 2024-09-16T02:05:47.825 INFO:tasks.workunit.client.1.smithi165.stdout:8/363: unlink dd/d13/f6b 0 2024-09-16T02:05:47.826 INFO:tasks.workunit.client.0.smithi110.stdout:6/137: chown d0/d2/dc/d16/f13 1444 1 2024-09-16T02:05:47.826 INFO:tasks.workunit.client.0.smithi110.stdout:0/56: dread d3/d4/f5 [0,4194304] 0 2024-09-16T02:05:47.827 INFO:tasks.workunit.client.1.smithi165.stdout:9/367: dwrite d7/df/d37/f3b [0,4194304] 0 2024-09-16T02:05:47.827 INFO:tasks.workunit.client.1.smithi165.stdout:3/429: fsync da/fb 0 2024-09-16T02:05:47.828 INFO:tasks.workunit.client.0.smithi110.stdout:0/57: read d3/f9 [1855614,109971] 0 2024-09-16T02:05:47.829 INFO:tasks.workunit.client.1.smithi165.stdout:9/368: read d7/d32/d38/f77 [300895,70400] 0 2024-09-16T02:05:47.830 INFO:tasks.workunit.client.0.smithi110.stdout:7/54: symlink d3/lf 0 2024-09-16T02:05:47.835 INFO:tasks.workunit.client.1.smithi165.stdout:8/364: dwrite dd/d13/f32 [0,4194304] 0 2024-09-16T02:05:47.835 INFO:tasks.workunit.client.0.smithi110.stdout:8/73: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:47.836 INFO:tasks.workunit.client.1.smithi165.stdout:4/300: creat d4/dc/d18/d37/d47/f63 x:0 0 0 2024-09-16T02:05:47.837 INFO:tasks.workunit.client.1.smithi165.stdout:4/301: chown d4/f1e 0 1 2024-09-16T02:05:47.837 INFO:tasks.workunit.client.1.smithi165.stdout:9/369: dread d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:47.837 INFO:tasks.workunit.client.0.smithi110.stdout:7/55: mkdir d3/da/d10 0 2024-09-16T02:05:47.838 INFO:tasks.workunit.client.1.smithi165.stdout:4/302: write d4/dc/d18/d37/d47/f63 [730968,90906] 0 2024-09-16T02:05:47.839 INFO:tasks.workunit.client.0.smithi110.stdout:7/56: chown d3/da/fd 9741 1 2024-09-16T02:05:47.840 INFO:tasks.workunit.client.1.smithi165.stdout:0/314: write d0/f15 [2476980,103261] 0 2024-09-16T02:05:47.842 INFO:tasks.workunit.client.0.smithi110.stdout:2/124: creat d0/da/d18/f2a x:0 0 0 2024-09-16T02:05:47.843 INFO:tasks.workunit.client.0.smithi110.stdout:0/58: mkdir d3/d4/dc/d10 0 2024-09-16T02:05:47.846 INFO:tasks.workunit.client.1.smithi165.stdout:9/370: dwrite d7/d14/d4f/f6e [0,4194304] 0 2024-09-16T02:05:47.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/57: dread d3/f8 [0,4194304] 0 2024-09-16T02:05:47.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/58: fsync d3/da/fc 0 2024-09-16T02:05:47.849 INFO:tasks.workunit.client.0.smithi110.stdout:0/59: creat d3/d4/f11 x:0 0 0 2024-09-16T02:05:47.850 INFO:tasks.workunit.client.0.smithi110.stdout:7/59: fsync d3/da/fe 0 2024-09-16T02:05:47.850 INFO:tasks.workunit.client.0.smithi110.stdout:0/60: fdatasync d3/d6/ff 0 2024-09-16T02:05:47.851 INFO:tasks.workunit.client.0.smithi110.stdout:7/60: dread d3/f8 [0,4194304] 0 2024-09-16T02:05:47.858 INFO:tasks.workunit.client.0.smithi110.stdout:0/61: creat d3/d6/f12 x:0 0 0 2024-09-16T02:05:47.858 INFO:tasks.workunit.client.0.smithi110.stdout:0/62: chown d3/f9 53 1 2024-09-16T02:05:47.859 INFO:tasks.workunit.client.0.smithi110.stdout:0/63: write d3/d4/f11 [486332,81696] 0 2024-09-16T02:05:47.861 INFO:tasks.workunit.client.0.smithi110.stdout:8/74: write d3/fa [1038440,60299] 0 2024-09-16T02:05:47.864 INFO:tasks.workunit.client.0.smithi110.stdout:2/125: getdents d0/da/d18/dc 0 2024-09-16T02:05:47.866 INFO:tasks.workunit.client.0.smithi110.stdout:8/75: unlink d3/ff 0 2024-09-16T02:05:47.868 INFO:tasks.workunit.client.0.smithi110.stdout:8/76: read d3/fd [3768968,78565] 0 2024-09-16T02:05:47.868 INFO:tasks.workunit.client.1.smithi165.stdout:1/292: link d1/f9 d1/dd/d11/d33/f56 0 2024-09-16T02:05:47.869 INFO:tasks.workunit.client.0.smithi110.stdout:0/64: dwrite d3/d6/f12 [0,4194304] 0 2024-09-16T02:05:47.869 INFO:tasks.workunit.client.1.smithi165.stdout:1/293: readlink d1/dd/d11/d46/l48 0 2024-09-16T02:05:47.870 INFO:tasks.workunit.client.0.smithi110.stdout:8/77: write d3/f10 [1846937,66276] 0 2024-09-16T02:05:47.871 INFO:tasks.workunit.client.0.smithi110.stdout:7/61: mkdir d3/da/d10/d11 0 2024-09-16T02:05:47.872 INFO:tasks.workunit.client.1.smithi165.stdout:4/303: mkdir d4/dc/d18/d37/d53/d64 0 2024-09-16T02:05:47.873 INFO:tasks.workunit.client.1.smithi165.stdout:2/398: truncate df/d10/d37/f3d 1132747 0 2024-09-16T02:05:47.875 INFO:tasks.workunit.client.1.smithi165.stdout:0/315: mkdir d0/d1e/d39/d48/d74 0 2024-09-16T02:05:47.879 INFO:tasks.workunit.client.1.smithi165.stdout:5/321: rename de/d60/d65/l69 to de/l6b 0 2024-09-16T02:05:47.880 INFO:tasks.workunit.client.1.smithi165.stdout:7/305: link d0/df/d7/f23 d0/df/f5f 0 2024-09-16T02:05:47.883 INFO:tasks.workunit.client.1.smithi165.stdout:9/371: mknod d7/d55/c7c 0 2024-09-16T02:05:47.889 INFO:tasks.workunit.client.0.smithi110.stdout:0/65: rename d3/fe to d3/d4/dc/d10/f13 0 2024-09-16T02:05:47.890 INFO:tasks.workunit.client.0.smithi110.stdout:8/78: unlink d3/l11 0 2024-09-16T02:05:47.891 INFO:tasks.workunit.client.1.smithi165.stdout:1/294: mkdir d1/dd/d11/d46/d57 0 2024-09-16T02:05:47.891 INFO:tasks.workunit.client.1.smithi165.stdout:2/399: dread df/f3f [0,4194304] 0 2024-09-16T02:05:47.892 INFO:tasks.workunit.client.1.smithi165.stdout:4/304: unlink d4/dc/d18/f24 0 2024-09-16T02:05:47.893 INFO:tasks.workunit.client.1.smithi165.stdout:2/400: dread - df/d23/d28/f65 zero size 2024-09-16T02:05:47.896 INFO:tasks.workunit.client.0.smithi110.stdout:0/66: mkdir d3/d4/dc/d14 0 2024-09-16T02:05:47.896 INFO:tasks.workunit.client.1.smithi165.stdout:2/401: write df/d10/d1a/d2d/f78 [341028,111091] 0 2024-09-16T02:05:47.896 INFO:tasks.workunit.client.1.smithi165.stdout:0/316: write d0/d1e/f2c [388895,91107] 0 2024-09-16T02:05:47.897 INFO:tasks.workunit.client.0.smithi110.stdout:8/79: symlink d3/d12/l17 0 2024-09-16T02:05:47.898 INFO:tasks.workunit.client.1.smithi165.stdout:2/402: chown df/d10/l54 540105 1 2024-09-16T02:05:47.900 INFO:tasks.workunit.client.1.smithi165.stdout:7/306: creat d0/f60 x:0 0 0 2024-09-16T02:05:47.900 INFO:tasks.workunit.client.1.smithi165.stdout:0/317: write d0/ff [5753461,86448] 0 2024-09-16T02:05:47.900 INFO:tasks.workunit.client.0.smithi110.stdout:7/62: symlink d3/da/d10/d11/l12 0 2024-09-16T02:05:47.900 INFO:tasks.workunit.client.0.smithi110.stdout:7/63: chown d3/lf 156121 1 2024-09-16T02:05:47.901 INFO:tasks.workunit.client.0.smithi110.stdout:7/64: stat d3 0 2024-09-16T02:05:47.901 INFO:tasks.workunit.client.0.smithi110.stdout:7/65: dread - d3/da/fd zero size 2024-09-16T02:05:47.902 INFO:tasks.workunit.client.1.smithi165.stdout:1/295: dwrite d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:47.902 INFO:tasks.workunit.client.1.smithi165.stdout:2/403: read df/d23/f48 [167043,8750] 0 2024-09-16T02:05:47.903 INFO:tasks.workunit.client.1.smithi165.stdout:4/305: dwrite d4/dc/d18/d37/d47/f61 [0,4194304] 0 2024-09-16T02:05:47.966 INFO:tasks.workunit.client.1.smithi165.stdout:9/372: symlink d7/df/d37/d43/l7d 0 2024-09-16T02:05:47.967 INFO:tasks.workunit.client.0.smithi110.stdout:2/126: truncate d0/da/d18/dc/f1c 67837 0 2024-09-16T02:05:47.970 INFO:tasks.workunit.client.1.smithi165.stdout:3/430: creat da/f9d x:0 0 0 2024-09-16T02:05:47.972 INFO:tasks.workunit.client.0.smithi110.stdout:7/66: truncate f1 1216410 0 2024-09-16T02:05:47.972 INFO:tasks.workunit.client.1.smithi165.stdout:3/431: fdatasync da/d20/d26/d52/f6d 0 2024-09-16T02:05:47.973 INFO:tasks.workunit.client.0.smithi110.stdout:2/127: dread d0/da/d18/dc/f1f [0,4194304] 0 2024-09-16T02:05:47.974 INFO:tasks.workunit.client.1.smithi165.stdout:9/373: dwrite d7/d1f/f5d [0,4194304] 0 2024-09-16T02:05:47.974 INFO:tasks.workunit.client.1.smithi165.stdout:3/432: chown da/d17/d78/d2c/d2d/c45 15146560 1 2024-09-16T02:05:47.976 INFO:tasks.workunit.client.1.smithi165.stdout:9/374: truncate d7/d32/d38/f73 57896 0 2024-09-16T02:05:47.976 INFO:tasks.workunit.client.1.smithi165.stdout:9/375: chown d7/d14/d7a 614493694 1 2024-09-16T02:05:47.977 INFO:tasks.workunit.client.1.smithi165.stdout:9/376: dread - d7/d14/f6c zero size 2024-09-16T02:05:47.982 INFO:tasks.workunit.client.1.smithi165.stdout:1/296: dread d1/d22/f2c [0,4194304] 0 2024-09-16T02:05:47.986 INFO:tasks.workunit.client.1.smithi165.stdout:1/297: dread d1/dd/d11/d33/f4b [0,4194304] 0 2024-09-16T02:05:47.989 INFO:tasks.workunit.client.0.smithi110.stdout:8/80: mknod d3/d12/d16/c18 0 2024-09-16T02:05:47.990 INFO:tasks.workunit.client.0.smithi110.stdout:7/67: creat d3/f13 x:0 0 0 2024-09-16T02:05:47.991 INFO:tasks.workunit.client.0.smithi110.stdout:7/68: dread - d3/da/fc zero size 2024-09-16T02:05:47.992 INFO:tasks.workunit.client.0.smithi110.stdout:7/69: read d3/f9 [1250396,93260] 0 2024-09-16T02:05:47.993 INFO:tasks.workunit.client.0.smithi110.stdout:7/70: write d3/f13 [636249,120189] 0 2024-09-16T02:05:47.993 INFO:tasks.workunit.client.0.smithi110.stdout:2/128: unlink d0/da/d18/f2a 0 2024-09-16T02:05:47.994 INFO:tasks.workunit.client.1.smithi165.stdout:5/322: symlink de/d19/d67/l6c 0 2024-09-16T02:05:47.994 INFO:tasks.workunit.client.0.smithi110.stdout:7/71: dread - d3/da/fc zero size 2024-09-16T02:05:47.995 INFO:tasks.workunit.client.0.smithi110.stdout:7/72: stat d3/da/fe 0 2024-09-16T02:05:47.998 INFO:tasks.workunit.client.1.smithi165.stdout:7/307: symlink d0/df/d33/d2a/l61 0 2024-09-16T02:05:48.000 INFO:tasks.workunit.client.0.smithi110.stdout:0/67: getdents d3/d4/dc/d10 0 2024-09-16T02:05:48.000 INFO:tasks.workunit.client.0.smithi110.stdout:0/68: stat c2 0 2024-09-16T02:05:48.000 INFO:tasks.workunit.client.1.smithi165.stdout:7/308: stat d0/df/d42/f4e 0 2024-09-16T02:05:48.000 INFO:tasks.workunit.client.1.smithi165.stdout:7/309: chown d0/df/c21 98762 1 2024-09-16T02:05:48.001 INFO:tasks.workunit.client.0.smithi110.stdout:2/129: fsync d0/da/d18/dc/f1f 0 2024-09-16T02:05:48.003 INFO:tasks.workunit.client.1.smithi165.stdout:4/306: mkdir d4/dc/d20/d65 0 2024-09-16T02:05:48.005 INFO:tasks.workunit.client.1.smithi165.stdout:7/310: dwrite d0/d3d/f5b [0,4194304] 0 2024-09-16T02:05:48.005 INFO:tasks.workunit.client.1.smithi165.stdout:7/311: truncate d0/f60 729874 0 2024-09-16T02:05:48.006 INFO:tasks.workunit.client.0.smithi110.stdout:8/81: mknod d3/c19 0 2024-09-16T02:05:48.014 INFO:tasks.workunit.client.0.smithi110.stdout:2/130: creat d0/da/d18/dc/f2b x:0 0 0 2024-09-16T02:05:48.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/377: fdatasync d7/d1f/d27/d49/f50 0 2024-09-16T02:05:48.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/378: write f2 [4262196,66901] 0 2024-09-16T02:05:48.018 INFO:tasks.workunit.client.0.smithi110.stdout:8/82: fsync d3/fe 0 2024-09-16T02:05:48.019 INFO:tasks.workunit.client.1.smithi165.stdout:8/365: link dd/c78 dd/d11/d14/d3f/d25/d36/d4f/d75/c80 0 2024-09-16T02:05:48.019 INFO:tasks.workunit.client.1.smithi165.stdout:9/379: dread d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:48.022 INFO:tasks.workunit.client.1.smithi165.stdout:6/339: rename d7/dc/df/l2e to d7/dc/l56 0 2024-09-16T02:05:48.023 INFO:tasks.workunit.client.0.smithi110.stdout:0/69: mknod d3/d4/dc/d14/c15 0 2024-09-16T02:05:48.026 INFO:tasks.workunit.client.1.smithi165.stdout:0/318: link d0/fb d0/d1e/d39/d48/f75 0 2024-09-16T02:05:48.027 INFO:tasks.workunit.client.0.smithi110.stdout:7/73: dread f1 [0,4194304] 0 2024-09-16T02:05:48.027 INFO:tasks.workunit.client.1.smithi165.stdout:0/319: stat d0/d1e/d39/d48/c5e 0 2024-09-16T02:05:48.029 INFO:tasks.workunit.client.0.smithi110.stdout:8/83: mkdir d3/d12/d1a 0 2024-09-16T02:05:48.031 INFO:tasks.workunit.client.0.smithi110.stdout:0/70: unlink d3/d4/dc/d10/f13 0 2024-09-16T02:05:48.035 INFO:tasks.workunit.client.1.smithi165.stdout:8/366: mkdir dd/d11/d14/d3f/d25/d36/d81 0 2024-09-16T02:05:48.035 INFO:tasks.workunit.client.1.smithi165.stdout:8/367: fdatasync dd/d34/f4d 0 2024-09-16T02:05:48.037 INFO:tasks.workunit.client.1.smithi165.stdout:2/404: rename df/d23/d2a/d77 to df/d73/d79 0 2024-09-16T02:05:48.038 INFO:tasks.workunit.client.0.smithi110.stdout:0/71: creat d3/f16 x:0 0 0 2024-09-16T02:05:48.038 INFO:tasks.workunit.client.0.smithi110.stdout:0/72: fsync d3/d6/ff 0 2024-09-16T02:05:48.040 INFO:tasks.workunit.client.0.smithi110.stdout:0/73: write d3/f16 [128492,41808] 0 2024-09-16T02:05:48.040 INFO:tasks.workunit.client.0.smithi110.stdout:2/131: creat d0/da/f2c x:0 0 0 2024-09-16T02:05:48.040 INFO:tasks.workunit.client.1.smithi165.stdout:5/323: mkdir de/d21/d26/d3a/d6d 0 2024-09-16T02:05:48.042 INFO:tasks.workunit.client.0.smithi110.stdout:7/74: link d3/f7 d3/f14 0 2024-09-16T02:05:48.045 INFO:tasks.workunit.client.1.smithi165.stdout:7/312: mknod d0/d4b/d58/c62 0 2024-09-16T02:05:48.045 INFO:tasks.workunit.client.0.smithi110.stdout:7/75: truncate d3/da/fe 531435 0 2024-09-16T02:05:48.045 INFO:tasks.workunit.client.0.smithi110.stdout:0/74: creat d3/f17 x:0 0 0 2024-09-16T02:05:48.047 INFO:tasks.workunit.client.0.smithi110.stdout:2/132: dwrite d0/da/d18/dc/f2b [0,4194304] 0 2024-09-16T02:05:48.048 INFO:tasks.workunit.client.1.smithi165.stdout:8/368: symlink dd/d34/l82 0 2024-09-16T02:05:48.049 INFO:tasks.workunit.client.0.smithi110.stdout:7/76: mkdir d3/d15 0 2024-09-16T02:05:48.049 INFO:tasks.workunit.client.1.smithi165.stdout:0/320: dwrite d0/d1e/d39/f6a [4194304,4194304] 0 2024-09-16T02:05:48.050 INFO:tasks.workunit.client.0.smithi110.stdout:7/77: chown d3/da/fc 894253477 1 2024-09-16T02:05:48.051 INFO:tasks.workunit.client.1.smithi165.stdout:3/433: dwrite da/d17/f5b [0,4194304] 0 2024-09-16T02:05:48.051 INFO:tasks.workunit.client.0.smithi110.stdout:7/78: chown d3/f14 26 1 2024-09-16T02:05:48.052 INFO:tasks.workunit.client.1.smithi165.stdout:0/321: read - d0/d1e/f63 zero size 2024-09-16T02:05:48.053 INFO:tasks.workunit.client.1.smithi165.stdout:1/298: rename d1/l21 to d1/dd/d11/d46/l58 0 2024-09-16T02:05:48.055 INFO:tasks.workunit.client.0.smithi110.stdout:8/84: link c0 d3/c1b 0 2024-09-16T02:05:48.055 INFO:tasks.workunit.client.0.smithi110.stdout:8/85: readlink d3/lc 0 2024-09-16T02:05:48.059 INFO:tasks.workunit.client.0.smithi110.stdout:0/75: unlink l0 0 2024-09-16T02:05:48.060 INFO:tasks.workunit.client.0.smithi110.stdout:7/79: dwrite d3/f13 [0,4194304] 0 2024-09-16T02:05:48.060 INFO:tasks.workunit.client.1.smithi165.stdout:0/322: dread d0/d47/f59 [0,4194304] 0 2024-09-16T02:05:48.064 INFO:tasks.workunit.client.0.smithi110.stdout:8/86: creat d3/d12/f1c x:0 0 0 2024-09-16T02:05:48.071 INFO:tasks.workunit.client.0.smithi110.stdout:7/80: fsync d3/f8 0 2024-09-16T02:05:48.074 INFO:tasks.workunit.client.0.smithi110.stdout:0/76: mknod d3/d4/dc/d10/c18 0 2024-09-16T02:05:48.075 INFO:tasks.workunit.client.0.smithi110.stdout:2/133: truncate d0/da/d18/dc/f2b 3081997 0 2024-09-16T02:05:48.077 INFO:tasks.workunit.client.0.smithi110.stdout:8/87: mkdir d3/d12/d1d 0 2024-09-16T02:05:48.079 INFO:tasks.workunit.client.0.smithi110.stdout:7/81: mknod d3/da/d10/d11/c16 0 2024-09-16T02:05:48.079 INFO:tasks.workunit.client.0.smithi110.stdout:7/82: stat d3/f8 0 2024-09-16T02:05:48.086 INFO:tasks.workunit.client.1.smithi165.stdout:0/323: rmdir d0/d1e/d20/d28/d6d 39 2024-09-16T02:05:48.087 INFO:tasks.workunit.client.1.smithi165.stdout:9/380: getdents d7/d1f/d27/d49 0 2024-09-16T02:05:48.088 INFO:tasks.workunit.client.1.smithi165.stdout:7/313: truncate d0/df/d42/f5e 1353032 0 2024-09-16T02:05:48.089 INFO:tasks.workunit.client.1.smithi165.stdout:1/299: dwrite d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:48.090 INFO:tasks.workunit.client.1.smithi165.stdout:4/307: rename d4/dc/d20/l3e to d4/dc/d20/d45/l66 0 2024-09-16T02:05:48.093 INFO:tasks.workunit.client.0.smithi110.stdout:2/134: truncate d0/db/f27 1495447 0 2024-09-16T02:05:48.093 INFO:tasks.workunit.client.1.smithi165.stdout:0/324: read d0/ff [3847033,15521] 0 2024-09-16T02:05:48.094 INFO:tasks.workunit.client.1.smithi165.stdout:2/405: creat df/d23/d28/d3b/f7a x:0 0 0 2024-09-16T02:05:48.096 INFO:tasks.workunit.client.1.smithi165.stdout:6/340: getdents d7/d17 0 2024-09-16T02:05:48.097 INFO:tasks.workunit.client.1.smithi165.stdout:2/406: write df/d10/d37/f74 [276294,23291] 0 2024-09-16T02:05:48.099 INFO:tasks.workunit.client.0.smithi110.stdout:8/88: getdents d3/d12/d1a 0 2024-09-16T02:05:48.100 INFO:tasks.workunit.client.0.smithi110.stdout:7/83: dwrite d3/f13 [4194304,4194304] 0 2024-09-16T02:05:48.100 INFO:tasks.workunit.client.1.smithi165.stdout:4/308: dwrite d4/dc/d18/f34 [0,4194304] 0 2024-09-16T02:05:48.101 INFO:tasks.workunit.client.0.smithi110.stdout:2/135: dread d0/f7 [0,4194304] 0 2024-09-16T02:05:48.102 INFO:tasks.workunit.client.0.smithi110.stdout:0/77: truncate d3/f16 422951 0 2024-09-16T02:05:48.102 INFO:tasks.workunit.client.0.smithi110.stdout:8/89: dread - d3/d12/f1c zero size 2024-09-16T02:05:48.102 INFO:tasks.workunit.client.0.smithi110.stdout:8/90: stat d3/fd 0 2024-09-16T02:05:48.103 INFO:tasks.workunit.client.0.smithi110.stdout:8/91: write d3/f15 [389183,60554] 0 2024-09-16T02:05:48.105 INFO:tasks.workunit.client.0.smithi110.stdout:8/92: write d3/f9 [4517924,95059] 0 2024-09-16T02:05:48.106 INFO:tasks.workunit.client.0.smithi110.stdout:0/78: dread d3/f16 [0,4194304] 0 2024-09-16T02:05:48.107 INFO:tasks.workunit.client.1.smithi165.stdout:2/407: dwrite df/d10/d1a/f27 [4194304,4194304] 0 2024-09-16T02:05:48.109 INFO:tasks.workunit.client.1.smithi165.stdout:3/434: rename da/d17/d7a/d7d/c89 to da/d20/d26/d52/d9c/c9e 0 2024-09-16T02:05:48.113 INFO:tasks.workunit.client.1.smithi165.stdout:1/300: mkdir d1/dd/d11/d33/d3f/d59 0 2024-09-16T02:05:48.114 INFO:tasks.workunit.client.1.smithi165.stdout:4/309: dwrite d4/dc/f19 [0,4194304] 0 2024-09-16T02:05:48.115 INFO:tasks.workunit.client.1.smithi165.stdout:1/301: chown d1/dd/f37 1 1 2024-09-16T02:05:48.115 INFO:tasks.workunit.client.1.smithi165.stdout:4/310: readlink d4/dc/d18/d37/l4d 0 2024-09-16T02:05:48.116 INFO:tasks.workunit.client.1.smithi165.stdout:1/302: chown d1/d22/f4e 2 1 2024-09-16T02:05:48.117 INFO:tasks.workunit.client.1.smithi165.stdout:5/324: getdents de/d21/d26/d3a 0 2024-09-16T02:05:48.125 INFO:tasks.workunit.client.1.smithi165.stdout:0/325: truncate d0/d1e/d39/d48/d45/f4b 4663332 0 2024-09-16T02:05:48.126 INFO:tasks.workunit.client.0.smithi110.stdout:7/84: dwrite f1 [0,4194304] 0 2024-09-16T02:05:48.127 INFO:tasks.workunit.client.0.smithi110.stdout:2/136: mkdir d0/da/d18/d2d 0 2024-09-16T02:05:48.128 INFO:tasks.workunit.client.0.smithi110.stdout:7/85: write f1 [1275826,124266] 0 2024-09-16T02:05:48.131 INFO:tasks.workunit.client.1.smithi165.stdout:6/341: write d7/dc/df/d1a/f45 [4249525,116827] 0 2024-09-16T02:05:48.131 INFO:tasks.workunit.client.1.smithi165.stdout:8/369: getdents dd/d11/d14/d3f/d25/d36/d4f 0 2024-09-16T02:05:48.132 INFO:tasks.workunit.client.1.smithi165.stdout:9/381: rmdir d7/d32/d38/d53/d5c 39 2024-09-16T02:05:48.133 INFO:tasks.workunit.client.1.smithi165.stdout:9/382: write d7/d1f/f5d [1972745,106555] 0 2024-09-16T02:05:48.133 INFO:tasks.workunit.client.1.smithi165.stdout:9/383: readlink d7/d55/l52 0 2024-09-16T02:05:48.135 INFO:tasks.workunit.client.0.smithi110.stdout:0/79: creat d3/d4/dc/d14/f19 x:0 0 0 2024-09-16T02:05:48.136 INFO:tasks.workunit.client.1.smithi165.stdout:7/314: getdents d0/d4b/d50 0 2024-09-16T02:05:48.138 INFO:tasks.workunit.client.1.smithi165.stdout:2/408: dread fa [0,4194304] 0 2024-09-16T02:05:48.139 INFO:tasks.workunit.client.1.smithi165.stdout:3/435: rename da/d17/d7a/f81 to da/d17/f9f 0 2024-09-16T02:05:48.139 INFO:tasks.workunit.client.0.smithi110.stdout:8/93: dwrite d3/fa [0,4194304] 0 2024-09-16T02:05:48.143 INFO:tasks.workunit.client.0.smithi110.stdout:0/80: fsync d3/f17 0 2024-09-16T02:05:48.144 INFO:tasks.workunit.client.0.smithi110.stdout:8/94: dread d3/f10 [0,4194304] 0 2024-09-16T02:05:48.145 INFO:tasks.workunit.client.0.smithi110.stdout:8/95: chown d3/fa 983 1 2024-09-16T02:05:48.147 INFO:tasks.workunit.client.0.smithi110.stdout:7/86: mknod d3/d15/c17 0 2024-09-16T02:05:48.148 INFO:tasks.workunit.client.1.smithi165.stdout:0/326: write d0/d47/f59 [2167191,121486] 0 2024-09-16T02:05:48.150 INFO:tasks.workunit.client.0.smithi110.stdout:2/137: truncate d0/da/d18/dc/f17 1960874 0 2024-09-16T02:05:48.150 INFO:tasks.workunit.client.0.smithi110.stdout:0/81: readlink d3/lb 0 2024-09-16T02:05:48.154 INFO:tasks.workunit.client.0.smithi110.stdout:7/87: creat d3/da/f18 x:0 0 0 2024-09-16T02:05:48.155 INFO:tasks.workunit.client.0.smithi110.stdout:7/88: write d3/da/fe [86646,3312] 0 2024-09-16T02:05:48.155 INFO:tasks.workunit.client.1.smithi165.stdout:7/315: mkdir d0/d4b/d63 0 2024-09-16T02:05:48.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/303: dwrite d1/f9 [0,4194304] 0 2024-09-16T02:05:48.159 INFO:tasks.workunit.client.1.smithi165.stdout:7/316: write d0/df/d33/d2a/f40 [238313,109683] 0 2024-09-16T02:05:48.160 INFO:tasks.workunit.client.0.smithi110.stdout:2/138: creat d0/db/f2e x:0 0 0 2024-09-16T02:05:48.161 INFO:tasks.workunit.client.0.smithi110.stdout:8/96: link d3/fa d3/d12/d16/f1e 0 2024-09-16T02:05:48.161 INFO:tasks.workunit.client.1.smithi165.stdout:8/370: dwrite dd/d11/f30 [0,4194304] 0 2024-09-16T02:05:48.161 INFO:tasks.workunit.client.1.smithi165.stdout:3/436: write da/de/f71 [712371,123898] 0 2024-09-16T02:05:48.162 INFO:tasks.workunit.client.1.smithi165.stdout:8/371: stat dd/d34 0 2024-09-16T02:05:48.164 INFO:tasks.workunit.client.1.smithi165.stdout:7/317: write d0/df/d33/d2a/f36 [1053383,45898] 0 2024-09-16T02:05:48.165 INFO:tasks.workunit.client.0.smithi110.stdout:2/139: read d0/da/d18/f29 [3939989,113541] 0 2024-09-16T02:05:48.166 INFO:tasks.workunit.client.0.smithi110.stdout:2/140: stat d0/c14 0 2024-09-16T02:05:48.167 INFO:tasks.workunit.client.1.smithi165.stdout:9/384: creat d7/d32/d4a/f7e x:0 0 0 2024-09-16T02:05:48.169 INFO:tasks.workunit.client.1.smithi165.stdout:2/409: symlink df/l7b 0 2024-09-16T02:05:48.172 INFO:tasks.workunit.client.0.smithi110.stdout:8/97: rename d3/fa to d3/d12/d1d/f1f 0 2024-09-16T02:05:48.172 INFO:tasks.workunit.client.1.smithi165.stdout:1/304: dwrite d1/f39 [0,4194304] 0 2024-09-16T02:05:48.173 INFO:tasks.workunit.client.1.smithi165.stdout:8/372: dread dd/d11/d14/f1e [0,4194304] 0 2024-09-16T02:05:48.174 INFO:tasks.workunit.client.1.smithi165.stdout:8/373: readlink dd/le 0 2024-09-16T02:05:48.174 INFO:tasks.workunit.client.0.smithi110.stdout:0/82: write d3/d4/f5 [3064071,17284] 0 2024-09-16T02:05:48.176 INFO:tasks.workunit.client.0.smithi110.stdout:8/98: dread d3/fe [0,4194304] 0 2024-09-16T02:05:48.178 INFO:tasks.workunit.client.0.smithi110.stdout:7/89: write d3/f8 [42727,84792] 0 2024-09-16T02:05:48.180 INFO:tasks.workunit.client.1.smithi165.stdout:5/325: link de/d21/d26/c61 de/d60/c6e 0 2024-09-16T02:05:48.180 INFO:tasks.workunit.client.0.smithi110.stdout:2/141: mknod d0/da/d18/d25/c2f 0 2024-09-16T02:05:48.181 INFO:tasks.workunit.client.1.smithi165.stdout:0/327: creat d0/d1e/d39/d48/d6e/f76 x:0 0 0 2024-09-16T02:05:48.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/99: symlink d3/d12/l20 0 2024-09-16T02:05:48.185 INFO:tasks.workunit.client.0.smithi110.stdout:7/90: dwrite d3/f13 [4194304,4194304] 0 2024-09-16T02:05:48.186 INFO:tasks.workunit.client.0.smithi110.stdout:0/83: unlink d3/d6/f12 0 2024-09-16T02:05:48.187 INFO:tasks.workunit.client.1.smithi165.stdout:9/385: rmdir d7/d1d 39 2024-09-16T02:05:48.188 INFO:tasks.workunit.client.1.smithi165.stdout:0/328: dwrite d0/d47/f59 [0,4194304] 0 2024-09-16T02:05:48.188 INFO:tasks.workunit.client.0.smithi110.stdout:2/142: creat d0/da/d18/dc/f30 x:0 0 0 2024-09-16T02:05:48.189 INFO:tasks.workunit.client.1.smithi165.stdout:2/410: creat df/d73/f7c x:0 0 0 2024-09-16T02:05:48.190 INFO:tasks.workunit.client.0.smithi110.stdout:8/100: mknod d3/d12/c21 0 2024-09-16T02:05:48.192 INFO:tasks.workunit.client.0.smithi110.stdout:2/143: dread d0/da/f24 [0,4194304] 0 2024-09-16T02:05:48.194 INFO:tasks.workunit.client.1.smithi165.stdout:4/311: getdents d4/dc/d20/d45 0 2024-09-16T02:05:48.194 INFO:tasks.workunit.client.0.smithi110.stdout:7/91: creat d3/f19 x:0 0 0 2024-09-16T02:05:48.196 INFO:tasks.workunit.client.1.smithi165.stdout:1/305: read d1/d19/d24/d30/f40 [606807,70193] 0 2024-09-16T02:05:48.197 INFO:tasks.workunit.client.0.smithi110.stdout:8/101: rename d3/d12/d16 to d3/d12/d1d/d22 0 2024-09-16T02:05:48.198 INFO:tasks.workunit.client.1.smithi165.stdout:3/437: symlink da/d20/d26/la0 0 2024-09-16T02:05:48.198 INFO:tasks.workunit.client.1.smithi165.stdout:8/374: chown dd/d13/d53/c5c 3853244 1 2024-09-16T02:05:48.198 INFO:tasks.workunit.client.1.smithi165.stdout:4/312: dread d4/dc/d28/f43 [0,4194304] 0 2024-09-16T02:05:48.199 INFO:tasks.workunit.client.1.smithi165.stdout:5/326: mknod de/d21/d4e/c6f 0 2024-09-16T02:05:48.199 INFO:tasks.workunit.client.1.smithi165.stdout:4/313: write d4/dc/d28/f43 [1186085,6244] 0 2024-09-16T02:05:48.200 INFO:tasks.workunit.client.1.smithi165.stdout:5/327: read - de/d19/d1c/f4f zero size 2024-09-16T02:05:48.200 INFO:tasks.workunit.client.1.smithi165.stdout:4/314: chown d4/f1e 27149 1 2024-09-16T02:05:48.201 INFO:tasks.workunit.client.1.smithi165.stdout:5/328: fsync de/f14 0 2024-09-16T02:05:48.201 INFO:tasks.workunit.client.0.smithi110.stdout:7/92: symlink d3/l1a 0 2024-09-16T02:05:48.202 INFO:tasks.workunit.client.0.smithi110.stdout:7/93: write d3/da/fe [831386,52378] 0 2024-09-16T02:05:48.202 INFO:tasks.workunit.client.1.smithi165.stdout:7/318: mknod d0/df/d33/c64 0 2024-09-16T02:05:48.203 INFO:tasks.workunit.client.0.smithi110.stdout:7/94: chown d3/f7 148 1 2024-09-16T02:05:48.204 INFO:tasks.workunit.client.1.smithi165.stdout:0/329: readlink d0/d1e/l2b 0 2024-09-16T02:05:48.205 INFO:tasks.workunit.client.1.smithi165.stdout:2/411: truncate df/d10/f13 1778657 0 2024-09-16T02:05:48.207 INFO:tasks.workunit.client.0.smithi110.stdout:7/95: dread f1 [0,4194304] 0 2024-09-16T02:05:48.208 INFO:tasks.workunit.client.1.smithi165.stdout:4/315: fsync d4/dc/d28/f43 0 2024-09-16T02:05:48.208 INFO:tasks.workunit.client.0.smithi110.stdout:0/84: creat d3/f1a x:0 0 0 2024-09-16T02:05:48.209 INFO:tasks.workunit.client.1.smithi165.stdout:1/306: write d1/f49 [1749612,28098] 0 2024-09-16T02:05:48.211 INFO:tasks.workunit.client.1.smithi165.stdout:8/375: symlink dd/d11/d14/d70/l83 0 2024-09-16T02:05:48.211 INFO:tasks.workunit.client.1.smithi165.stdout:0/330: dwrite d0/d1e/d39/f6c [0,4194304] 0 2024-09-16T02:05:48.211 INFO:tasks.workunit.client.1.smithi165.stdout:8/376: stat l8 0 2024-09-16T02:05:48.212 INFO:tasks.workunit.client.1.smithi165.stdout:8/377: stat dd/l27 0 2024-09-16T02:05:48.216 INFO:tasks.workunit.client.0.smithi110.stdout:2/144: creat d0/da/d18/f31 x:0 0 0 2024-09-16T02:05:48.216 INFO:tasks.workunit.client.0.smithi110.stdout:7/96: rmdir d3/da/d10 39 2024-09-16T02:05:48.217 INFO:tasks.workunit.client.1.smithi165.stdout:5/329: mknod de/d60/d65/c70 0 2024-09-16T02:05:48.221 INFO:tasks.workunit.client.1.smithi165.stdout:5/330: truncate de/d21/d51/f58 186476 0 2024-09-16T02:05:48.221 INFO:tasks.workunit.client.1.smithi165.stdout:8/378: dwrite f6 [0,4194304] 0 2024-09-16T02:05:48.221 INFO:tasks.workunit.client.0.smithi110.stdout:2/145: dwrite d0/da/f28 [0,4194304] 0 2024-09-16T02:05:48.221 INFO:tasks.workunit.client.1.smithi165.stdout:9/386: dread d7/d1f/f46 [0,4194304] 0 2024-09-16T02:05:48.222 INFO:tasks.workunit.client.1.smithi165.stdout:5/331: readlink de/d21/d26/l2d 0 2024-09-16T02:05:48.222 INFO:tasks.workunit.client.1.smithi165.stdout:8/379: chown dd/d11/d14/d3f/d25/d36/l49 45235 1 2024-09-16T02:05:48.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/380: write dd/d13/d53/f58 [1110515,112439] 0 2024-09-16T02:05:48.229 INFO:tasks.workunit.client.1.smithi165.stdout:5/332: dwrite de/d21/d26/d3a/d54/f4c [0,4194304] 0 2024-09-16T02:05:48.230 INFO:tasks.workunit.client.1.smithi165.stdout:8/381: dread dd/d11/f30 [0,4194304] 0 2024-09-16T02:05:48.231 INFO:tasks.workunit.client.0.smithi110.stdout:8/102: truncate d3/f15 3943473 0 2024-09-16T02:05:48.233 INFO:tasks.workunit.client.1.smithi165.stdout:3/438: mknod da/d9b/ca1 0 2024-09-16T02:05:48.234 INFO:tasks.workunit.client.0.smithi110.stdout:7/97: rename d3/d15/c17 to d3/da/d10/c1b 0 2024-09-16T02:05:48.238 INFO:tasks.workunit.client.1.smithi165.stdout:4/316: dwrite d4/f9 [0,4194304] 0 2024-09-16T02:05:48.241 INFO:tasks.workunit.client.1.smithi165.stdout:6/342: sync 2024-09-16T02:05:48.244 INFO:tasks.workunit.client.1.smithi165.stdout:6/343: write d7/dc/df/d1a/f47 [2893928,84911] 0 2024-09-16T02:05:48.245 INFO:tasks.workunit.client.1.smithi165.stdout:3/439: dwrite da/d20/d26/f51 [0,4194304] 0 2024-09-16T02:05:48.250 INFO:tasks.workunit.client.0.smithi110.stdout:8/103: creat d3/d12/d1a/f23 x:0 0 0 2024-09-16T02:05:48.251 INFO:tasks.workunit.client.1.smithi165.stdout:2/412: rename df/d10/d37/f59 to df/d23/d66/f7d 0 2024-09-16T02:05:48.251 INFO:tasks.workunit.client.1.smithi165.stdout:3/440: truncate da/de/f16 1969152 0 2024-09-16T02:05:48.252 INFO:tasks.workunit.client.0.smithi110.stdout:7/98: truncate d3/f14 185254 0 2024-09-16T02:05:48.253 INFO:tasks.workunit.client.1.smithi165.stdout:5/333: symlink de/d21/d51/l71 0 2024-09-16T02:05:48.254 INFO:tasks.workunit.client.0.smithi110.stdout:0/85: link d3/f9 d3/f1b 0 2024-09-16T02:05:48.254 INFO:tasks.workunit.client.0.smithi110.stdout:7/99: write d3/da/f18 [900329,7550] 0 2024-09-16T02:05:48.256 INFO:tasks.workunit.client.0.smithi110.stdout:8/104: mknod d3/d12/d1d/c24 0 2024-09-16T02:05:48.260 INFO:tasks.workunit.client.1.smithi165.stdout:1/307: mknod d1/dd/c5a 0 2024-09-16T02:05:48.261 INFO:tasks.workunit.client.1.smithi165.stdout:8/382: dwrite dd/ff [0,4194304] 0 2024-09-16T02:05:48.261 INFO:tasks.workunit.client.0.smithi110.stdout:8/105: dread d3/d12/d1d/d22/f1e [0,4194304] 0 2024-09-16T02:05:48.262 INFO:tasks.workunit.client.1.smithi165.stdout:1/308: write d1/dd/f14 [818725,127931] 0 2024-09-16T02:05:48.262 INFO:tasks.workunit.client.0.smithi110.stdout:7/100: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:48.263 INFO:tasks.workunit.client.0.smithi110.stdout:0/86: creat d3/d4/dc/f1c x:0 0 0 2024-09-16T02:05:48.264 INFO:tasks.workunit.client.1.smithi165.stdout:1/309: write d1/dd/f14 [5118333,102152] 0 2024-09-16T02:05:48.264 INFO:tasks.workunit.client.1.smithi165.stdout:4/317: rmdir d4/dc/d20/d4e 39 2024-09-16T02:05:48.266 INFO:tasks.workunit.client.1.smithi165.stdout:4/318: write d4/dc/fe [3589337,118665] 0 2024-09-16T02:05:48.266 INFO:tasks.workunit.client.0.smithi110.stdout:8/106: symlink d3/d12/d1a/l25 0 2024-09-16T02:05:48.267 INFO:tasks.workunit.client.1.smithi165.stdout:4/319: read - d4/dc/f58 zero size 2024-09-16T02:05:48.268 INFO:tasks.workunit.client.1.smithi165.stdout:0/331: rename d0/d1e/f63 to d0/d2a/f77 0 2024-09-16T02:05:48.273 INFO:tasks.workunit.client.0.smithi110.stdout:0/87: creat d3/d4/f1d x:0 0 0 2024-09-16T02:05:48.273 INFO:tasks.workunit.client.0.smithi110.stdout:8/107: chown d3/c1b 15938 1 2024-09-16T02:05:48.275 INFO:tasks.workunit.client.1.smithi165.stdout:9/387: dread d7/f35 [0,4194304] 0 2024-09-16T02:05:48.276 INFO:tasks.workunit.client.1.smithi165.stdout:5/334: write de/d19/f25 [2549073,101644] 0 2024-09-16T02:05:48.277 INFO:tasks.workunit.client.0.smithi110.stdout:0/88: creat d3/d4/dc/f1e x:0 0 0 2024-09-16T02:05:48.277 INFO:tasks.workunit.client.1.smithi165.stdout:3/441: dwrite da/d17/d78/d2c/d2d/d6c/f61 [0,4194304] 0 2024-09-16T02:05:48.278 INFO:tasks.workunit.client.0.smithi110.stdout:8/108: creat d3/d12/f26 x:0 0 0 2024-09-16T02:05:48.279 INFO:tasks.workunit.client.0.smithi110.stdout:2/146: truncate d0/da/f24 1011336 0 2024-09-16T02:05:48.280 INFO:tasks.workunit.client.0.smithi110.stdout:5/113: sync 2024-09-16T02:05:48.280 INFO:tasks.workunit.client.0.smithi110.stdout:5/114: chown d5/dd/f17 113128728 1 2024-09-16T02:05:48.281 INFO:tasks.workunit.client.1.smithi165.stdout:7/319: write d0/df/f27 [989721,66833] 0 2024-09-16T02:05:48.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/89: creat d3/d4/dc/d10/f1f x:0 0 0 2024-09-16T02:05:48.282 INFO:tasks.workunit.client.1.smithi165.stdout:7/320: dread - d0/df/d33/f34 zero size 2024-09-16T02:05:48.284 INFO:tasks.workunit.client.0.smithi110.stdout:0/90: rename d3/d4/dc to d3/d4/dc/d14/d20 22 2024-09-16T02:05:48.284 INFO:tasks.workunit.client.0.smithi110.stdout:8/109: mkdir d3/d12/d1d/d22/d27 0 2024-09-16T02:05:48.288 INFO:tasks.workunit.client.0.smithi110.stdout:2/147: dwrite d0/da/d18/f19 [0,4194304] 0 2024-09-16T02:05:48.289 INFO:tasks.workunit.client.0.smithi110.stdout:0/91: truncate d3/d4/dc/d14/f19 50573 0 2024-09-16T02:05:48.291 INFO:tasks.workunit.client.0.smithi110.stdout:0/92: truncate d3/d4/dc/f1c 256302 0 2024-09-16T02:05:48.292 INFO:tasks.workunit.client.0.smithi110.stdout:8/110: symlink d3/d12/d1a/l28 0 2024-09-16T02:05:48.328 INFO:tasks.workunit.client.1.smithi165.stdout:0/332: chown d0/d1e/d39/d48/d45/c3b 3676042 1 2024-09-16T02:05:48.328 INFO:tasks.workunit.client.1.smithi165.stdout:0/333: fsync d0/f23 0 2024-09-16T02:05:48.332 INFO:tasks.workunit.client.0.smithi110.stdout:3/82: sync 2024-09-16T02:05:48.332 INFO:tasks.workunit.client.0.smithi110.stdout:9/45: sync 2024-09-16T02:05:48.332 INFO:tasks.workunit.client.0.smithi110.stdout:4/44: sync 2024-09-16T02:05:48.332 INFO:tasks.workunit.client.0.smithi110.stdout:6/138: sync 2024-09-16T02:05:48.333 INFO:tasks.workunit.client.0.smithi110.stdout:1/81: sync 2024-09-16T02:05:48.335 INFO:tasks.workunit.client.0.smithi110.stdout:1/82: dread - d0/da/f17 zero size 2024-09-16T02:05:48.336 INFO:tasks.workunit.client.0.smithi110.stdout:0/93: read d3/f16 [411278,110211] 0 2024-09-16T02:05:48.339 INFO:tasks.workunit.client.1.smithi165.stdout:9/388: rename d7/d14/d4f to d7/d32/d38/d68/d7f 0 2024-09-16T02:05:48.341 INFO:tasks.workunit.client.1.smithi165.stdout:5/335: unlink de/d19/d1c/d49/f59 0 2024-09-16T02:05:48.342 INFO:tasks.workunit.client.0.smithi110.stdout:3/83: dwrite d8/f15 [0,4194304] 0 2024-09-16T02:05:48.342 INFO:tasks.workunit.client.0.smithi110.stdout:2/148: getdents d0/da/d18/d2d 0 2024-09-16T02:05:48.343 INFO:tasks.workunit.client.0.smithi110.stdout:4/45: dread f3 [0,4194304] 0 2024-09-16T02:05:48.344 INFO:tasks.workunit.client.0.smithi110.stdout:3/84: truncate f4 4380111 0 2024-09-16T02:05:48.346 INFO:tasks.workunit.client.0.smithi110.stdout:3/85: read f3 [1593003,43750] 0 2024-09-16T02:05:48.348 INFO:tasks.workunit.client.0.smithi110.stdout:3/86: write d8/f9 [4963573,32801] 0 2024-09-16T02:05:48.351 INFO:tasks.workunit.client.1.smithi165.stdout:4/320: rmdir d4/dc/d28/d2b 39 2024-09-16T02:05:48.352 INFO:tasks.workunit.client.0.smithi110.stdout:9/46: mkdir d1/dd 0 2024-09-16T02:05:48.356 INFO:tasks.workunit.client.1.smithi165.stdout:3/442: dread da/f14 [0,4194304] 0 2024-09-16T02:05:48.356 INFO:tasks.workunit.client.1.smithi165.stdout:1/310: write d1/f3a [1253313,119607] 0 2024-09-16T02:05:48.357 INFO:tasks.workunit.client.0.smithi110.stdout:9/47: dread f0 [0,4194304] 0 2024-09-16T02:05:48.357 INFO:tasks.workunit.client.1.smithi165.stdout:0/334: symlink d0/d1e/d39/d48/d45/l78 0 2024-09-16T02:05:48.357 INFO:tasks.workunit.client.1.smithi165.stdout:0/335: fdatasync d0/f30 0 2024-09-16T02:05:48.359 INFO:tasks.workunit.client.0.smithi110.stdout:1/83: unlink d0/d1/d4/l16 0 2024-09-16T02:05:48.360 INFO:tasks.workunit.client.0.smithi110.stdout:1/84: dread - d0/d1/d4/f18 zero size 2024-09-16T02:05:48.362 INFO:tasks.workunit.client.1.smithi165.stdout:9/389: mkdir d7/d14/d80 0 2024-09-16T02:05:48.362 INFO:tasks.workunit.client.0.smithi110.stdout:1/85: truncate d0/f14 1045205 0 2024-09-16T02:05:48.362 INFO:tasks.workunit.client.0.smithi110.stdout:1/86: fsync d0/d1/d4/f18 0 2024-09-16T02:05:48.363 INFO:tasks.workunit.client.1.smithi165.stdout:0/336: dwrite d0/f13 [0,4194304] 0 2024-09-16T02:05:48.364 INFO:tasks.workunit.client.0.smithi110.stdout:8/111: rename d3/d12/l14 to d3/d12/d1d/d22/d27/l29 0 2024-09-16T02:05:48.364 INFO:tasks.workunit.client.0.smithi110.stdout:1/87: dread d0/f14 [0,4194304] 0 2024-09-16T02:05:48.366 INFO:tasks.workunit.client.1.smithi165.stdout:0/337: dread d0/d1e/d39/d48/d5f/f73 [0,4194304] 0 2024-09-16T02:05:48.366 INFO:tasks.workunit.client.0.smithi110.stdout:2/149: symlink d0/db/l32 0 2024-09-16T02:05:48.367 INFO:tasks.workunit.client.1.smithi165.stdout:0/338: readlink d0/d1e/d39/d48/l64 0 2024-09-16T02:05:48.367 INFO:tasks.workunit.client.1.smithi165.stdout:0/339: stat d0/fb 0 2024-09-16T02:05:48.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/321: getdents d0/d4b/d50 0 2024-09-16T02:05:48.371 INFO:tasks.workunit.client.0.smithi110.stdout:4/46: creat d4/d8/fe x:0 0 0 2024-09-16T02:05:48.376 INFO:tasks.workunit.client.0.smithi110.stdout:3/87: truncate f3 1756808 0 2024-09-16T02:05:48.378 INFO:tasks.workunit.client.1.smithi165.stdout:1/311: truncate d1/dd/d11/d33/f4b 500617 0 2024-09-16T02:05:48.379 INFO:tasks.workunit.client.0.smithi110.stdout:9/48: mkdir d1/d5/d8/de 0 2024-09-16T02:05:48.386 INFO:tasks.workunit.client.0.smithi110.stdout:0/94: rename d3/d4/f5 to d3/d6/f21 0 2024-09-16T02:05:48.386 INFO:tasks.workunit.client.0.smithi110.stdout:0/95: chown d3/d4 2719 1 2024-09-16T02:05:48.387 INFO:tasks.workunit.client.1.smithi165.stdout:7/322: fdatasync d0/df/f5f 0 2024-09-16T02:05:48.389 INFO:tasks.workunit.client.0.smithi110.stdout:1/88: creat d0/d1/d8/f19 x:0 0 0 2024-09-16T02:05:48.391 INFO:tasks.workunit.client.0.smithi110.stdout:2/150: mkdir d0/db/d33 0 2024-09-16T02:05:48.392 INFO:tasks.workunit.client.1.smithi165.stdout:3/443: creat da/d20/d26/d8c/fa2 x:0 0 0 2024-09-16T02:05:48.393 INFO:tasks.workunit.client.0.smithi110.stdout:2/151: read - d0/da/f2c zero size 2024-09-16T02:05:48.393 INFO:tasks.workunit.client.0.smithi110.stdout:3/88: symlink d8/dc/l18 0 2024-09-16T02:05:48.395 INFO:tasks.workunit.client.0.smithi110.stdout:0/96: dwrite d3/d6/ff [0,4194304] 0 2024-09-16T02:05:48.397 INFO:tasks.workunit.client.1.smithi165.stdout:9/390: creat d7/d32/d38/d53/d5c/f81 x:0 0 0 2024-09-16T02:05:48.399 INFO:tasks.workunit.client.0.smithi110.stdout:3/89: dread f7 [0,4194304] 0 2024-09-16T02:05:48.403 INFO:tasks.workunit.client.1.smithi165.stdout:4/321: rename d4/dc/d20/d65 to d4/dc/d20/d67 0 2024-09-16T02:05:48.405 INFO:tasks.workunit.client.1.smithi165.stdout:3/444: rename da/de/f16 to da/d17/fa3 0 2024-09-16T02:05:48.406 INFO:tasks.workunit.client.1.smithi165.stdout:3/445: readlink da/d17/d78/l43 0 2024-09-16T02:05:48.406 INFO:tasks.workunit.client.0.smithi110.stdout:7/101: link d3/f14 d3/d15/f1c 0 2024-09-16T02:05:48.406 INFO:tasks.workunit.client.0.smithi110.stdout:5/115: dwrite d5/dd/f12 [0,4194304] 0 2024-09-16T02:05:48.409 INFO:tasks.workunit.client.1.smithi165.stdout:2/413: truncate df/d10/d1a/d2d/f4e 2052561 0 2024-09-16T02:05:48.410 INFO:tasks.workunit.client.1.smithi165.stdout:0/340: dread d0/ff [0,4194304] 0 2024-09-16T02:05:48.411 INFO:tasks.workunit.client.0.smithi110.stdout:2/152: mkdir d0/db/d34 0 2024-09-16T02:05:48.412 INFO:tasks.workunit.client.1.smithi165.stdout:9/391: mknod d7/df/d37/d43/c82 0 2024-09-16T02:05:48.413 INFO:tasks.workunit.client.0.smithi110.stdout:2/153: write d0/da/d18/dc/f30 [637949,122072] 0 2024-09-16T02:05:48.413 INFO:tasks.workunit.client.1.smithi165.stdout:9/392: readlink d7/df/d37/d43/l5f 0 2024-09-16T02:05:48.416 INFO:tasks.workunit.client.0.smithi110.stdout:2/154: fdatasync d0/da/d18/f31 0 2024-09-16T02:05:48.416 INFO:tasks.workunit.client.0.smithi110.stdout:9/49: mknod d1/dd/cf 0 2024-09-16T02:05:48.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/323: mkdir d0/df/d65 0 2024-09-16T02:05:48.417 INFO:tasks.workunit.client.0.smithi110.stdout:2/155: truncate d0/db/f2e 653104 0 2024-09-16T02:05:48.417 INFO:tasks.workunit.client.1.smithi165.stdout:4/322: unlink d4/c11 0 2024-09-16T02:05:48.419 INFO:tasks.workunit.client.1.smithi165.stdout:9/393: dwrite d7/d1f/f2a [0,4194304] 0 2024-09-16T02:05:48.420 INFO:tasks.workunit.client.1.smithi165.stdout:9/394: chown f4 1906902 1 2024-09-16T02:05:48.421 INFO:tasks.workunit.client.0.smithi110.stdout:7/102: mknod d3/da/d10/c1d 0 2024-09-16T02:05:48.423 INFO:tasks.workunit.client.1.smithi165.stdout:5/336: sync 2024-09-16T02:05:48.424 INFO:tasks.workunit.client.1.smithi165.stdout:6/344: sync 2024-09-16T02:05:48.424 INFO:tasks.workunit.client.1.smithi165.stdout:8/383: sync 2024-09-16T02:05:48.425 INFO:tasks.workunit.client.1.smithi165.stdout:3/446: dwrite da/d20/f3d [0,4194304] 0 2024-09-16T02:05:48.426 INFO:tasks.workunit.client.1.smithi165.stdout:8/384: stat dd/d11/d14/d3f/d25/d36/l66 0 2024-09-16T02:05:48.426 INFO:tasks.workunit.client.1.smithi165.stdout:1/312: rmdir d1/d19/d44 0 2024-09-16T02:05:48.427 INFO:tasks.workunit.client.1.smithi165.stdout:4/323: dread d4/dc/d28/d3b/f52 [0,4194304] 0 2024-09-16T02:05:48.428 INFO:tasks.workunit.client.1.smithi165.stdout:8/385: read dd/d11/d14/f1d [2555936,122120] 0 2024-09-16T02:05:48.430 INFO:tasks.workunit.client.0.smithi110.stdout:5/116: rename d5/dd/l1f to d5/dd/df/d11/l22 0 2024-09-16T02:05:48.432 INFO:tasks.workunit.client.1.smithi165.stdout:2/414: symlink df/d23/d28/d3b/d6d/l7e 0 2024-09-16T02:05:48.435 INFO:tasks.workunit.client.1.smithi165.stdout:0/341: mkdir d0/d1e/d39/d48/d79 0 2024-09-16T02:05:48.437 INFO:tasks.workunit.client.0.smithi110.stdout:0/97: fsync d3/f1b 0 2024-09-16T02:05:48.437 INFO:tasks.workunit.client.0.smithi110.stdout:0/98: chown d3/d6 38 1 2024-09-16T02:05:48.439 INFO:tasks.workunit.client.0.smithi110.stdout:9/50: creat d1/dd/f10 x:0 0 0 2024-09-16T02:05:48.440 INFO:tasks.workunit.client.0.smithi110.stdout:9/51: dread - d1/dd/f10 zero size 2024-09-16T02:05:48.443 INFO:tasks.workunit.client.1.smithi165.stdout:9/395: unlink d7/df/l2e 0 2024-09-16T02:05:48.444 INFO:tasks.workunit.client.1.smithi165.stdout:9/396: write f2 [4046978,22974] 0 2024-09-16T02:05:48.445 INFO:tasks.workunit.client.0.smithi110.stdout:7/103: symlink d3/d15/l1e 0 2024-09-16T02:05:48.445 INFO:tasks.workunit.client.1.smithi165.stdout:9/397: write d7/d1f/d27/f3e [516428,84967] 0 2024-09-16T02:05:48.447 INFO:tasks.workunit.client.0.smithi110.stdout:7/104: write d3/da/fe [916867,112557] 0 2024-09-16T02:05:48.448 INFO:tasks.workunit.client.1.smithi165.stdout:9/398: truncate d7/d1f/d27/d49/f5e 903415 0 2024-09-16T02:05:48.448 INFO:tasks.workunit.client.0.smithi110.stdout:5/117: chown d5/le 1410128 1 2024-09-16T02:05:48.449 INFO:tasks.workunit.client.1.smithi165.stdout:9/399: write f4 [4506366,118385] 0 2024-09-16T02:05:48.450 INFO:tasks.workunit.client.0.smithi110.stdout:5/118: write d5/dd/f21 [32279,85168] 0 2024-09-16T02:05:48.453 INFO:tasks.workunit.client.1.smithi165.stdout:1/313: symlink d1/dd/d11/d46/l5b 0 2024-09-16T02:05:48.455 INFO:tasks.workunit.client.0.smithi110.stdout:0/99: readlink d3/ld 0 2024-09-16T02:05:48.459 INFO:tasks.workunit.client.0.smithi110.stdout:9/52: mknod d1/d5/d8/c11 0 2024-09-16T02:05:48.466 INFO:tasks.workunit.client.0.smithi110.stdout:5/119: creat d5/dd/f23 x:0 0 0 2024-09-16T02:05:48.467 INFO:tasks.workunit.client.0.smithi110.stdout:5/120: dread - d5/f1e zero size 2024-09-16T02:05:48.468 INFO:tasks.workunit.client.0.smithi110.stdout:5/121: truncate d5/dd/df/f1d 740162 0 2024-09-16T02:05:48.472 INFO:tasks.workunit.client.1.smithi165.stdout:5/337: creat de/d19/d1c/d4d/f72 x:0 0 0 2024-09-16T02:05:48.474 INFO:tasks.workunit.client.1.smithi165.stdout:9/400: dread d7/d32/f47 [0,4194304] 0 2024-09-16T02:05:48.479 INFO:tasks.workunit.client.1.smithi165.stdout:5/338: dwrite de/f5b [0,4194304] 0 2024-09-16T02:05:48.480 INFO:tasks.workunit.client.0.smithi110.stdout:9/53: link d1/f7 d1/dd/f12 0 2024-09-16T02:05:48.481 INFO:tasks.workunit.client.1.smithi165.stdout:5/339: fsync de/d19/f33 0 2024-09-16T02:05:48.481 INFO:tasks.workunit.client.0.smithi110.stdout:0/100: link d3/d4/dc/d14/c15 d3/d4/dc/d14/c22 0 2024-09-16T02:05:48.482 INFO:tasks.workunit.client.1.smithi165.stdout:5/340: read de/f14 [2962502,14034] 0 2024-09-16T02:05:48.482 INFO:tasks.workunit.client.1.smithi165.stdout:9/401: dwrite d7/d32/d4a/f7e [0,4194304] 0 2024-09-16T02:05:48.483 INFO:tasks.workunit.client.1.smithi165.stdout:8/386: creat dd/d11/d14/d70/d7b/f84 x:0 0 0 2024-09-16T02:05:48.512 INFO:tasks.workunit.client.0.smithi110.stdout:5/122: symlink d5/l24 0 2024-09-16T02:05:48.513 INFO:tasks.workunit.client.0.smithi110.stdout:8/112: write d3/f10 [3754057,115883] 0 2024-09-16T02:05:48.514 INFO:tasks.workunit.client.1.smithi165.stdout:0/342: mknod d0/d1e/d39/d48/d74/c7a 0 2024-09-16T02:05:48.515 INFO:tasks.workunit.client.0.smithi110.stdout:0/101: creat d3/d4/f23 x:0 0 0 2024-09-16T02:05:48.516 INFO:tasks.workunit.client.0.smithi110.stdout:9/54: dread f0 [0,4194304] 0 2024-09-16T02:05:48.520 INFO:tasks.workunit.client.0.smithi110.stdout:5/123: dread d5/f13 [0,4194304] 0 2024-09-16T02:05:48.523 INFO:tasks.workunit.client.0.smithi110.stdout:9/55: mkdir d1/dd/d13 0 2024-09-16T02:05:48.524 INFO:tasks.workunit.client.0.smithi110.stdout:9/56: dread - d1/d5/fb zero size 2024-09-16T02:05:48.526 INFO:tasks.workunit.client.0.smithi110.stdout:3/90: getdents d8/dc 0 2024-09-16T02:05:48.526 INFO:tasks.workunit.client.0.smithi110.stdout:9/57: chown d1/d5/d8/c9 673746 1 2024-09-16T02:05:48.527 INFO:tasks.workunit.client.1.smithi165.stdout:4/324: rename d4/l36 to d4/dc/l68 0 2024-09-16T02:05:48.529 INFO:tasks.workunit.client.0.smithi110.stdout:9/58: dread d1/f3 [0,4194304] 0 2024-09-16T02:05:48.529 INFO:tasks.workunit.client.1.smithi165.stdout:6/345: creat d7/f57 x:0 0 0 2024-09-16T02:05:48.529 INFO:tasks.workunit.client.1.smithi165.stdout:6/346: chown d7/d1f 27 1 2024-09-16T02:05:48.531 INFO:tasks.workunit.client.0.smithi110.stdout:3/91: dread f2 [0,4194304] 0 2024-09-16T02:05:48.531 INFO:tasks.workunit.client.0.smithi110.stdout:0/102: symlink d3/l24 0 2024-09-16T02:05:48.531 INFO:tasks.workunit.client.0.smithi110.stdout:3/92: rename d8 to d8/dc/d19 22 2024-09-16T02:05:48.532 INFO:tasks.workunit.client.1.smithi165.stdout:5/341: creat de/d19/d1c/d49/f73 x:0 0 0 2024-09-16T02:05:48.534 INFO:tasks.workunit.client.1.smithi165.stdout:9/402: rmdir d7/d32/d38/d68/d7f 39 2024-09-16T02:05:48.535 INFO:tasks.workunit.client.0.smithi110.stdout:5/124: rename d5/dd/df to d5/dd/df/d11/d25 22 2024-09-16T02:05:48.536 INFO:tasks.workunit.client.1.smithi165.stdout:8/387: mkdir dd/d11/d14/d3f/d25/d36/d85 0 2024-09-16T02:05:48.537 INFO:tasks.workunit.client.1.smithi165.stdout:2/415: link df/d10/d37/c47 df/d23/d66/c7f 0 2024-09-16T02:05:48.538 INFO:tasks.workunit.client.0.smithi110.stdout:8/113: creat d3/f2a x:0 0 0 2024-09-16T02:05:48.539 INFO:tasks.workunit.client.1.smithi165.stdout:0/343: creat d0/d1e/d39/d48/d74/f7b x:0 0 0 2024-09-16T02:05:48.539 INFO:tasks.workunit.client.1.smithi165.stdout:0/344: fdatasync d0/d1e/d39/d48/d45/f44 0 2024-09-16T02:05:48.540 INFO:tasks.workunit.client.1.smithi165.stdout:0/345: stat d0/d61 0 2024-09-16T02:05:48.540 INFO:tasks.workunit.client.1.smithi165.stdout:0/346: chown d0/d1e/f26 885413 1 2024-09-16T02:05:48.541 INFO:tasks.workunit.client.1.smithi165.stdout:7/324: getdents d0/d3d 0 2024-09-16T02:05:48.544 INFO:tasks.workunit.client.1.smithi165.stdout:3/447: getdents da 0 2024-09-16T02:05:48.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/93: mknod d8/dc/c1a 0 2024-09-16T02:05:48.545 INFO:tasks.workunit.client.0.smithi110.stdout:1/89: write d0/da/f15 [744125,92725] 0 2024-09-16T02:05:48.546 INFO:tasks.workunit.client.0.smithi110.stdout:3/94: read - d8/f17 zero size 2024-09-16T02:05:48.547 INFO:tasks.workunit.client.1.smithi165.stdout:1/314: rename d1/dd/l23 to d1/dd/d25/l5c 0 2024-09-16T02:05:48.547 INFO:tasks.workunit.client.1.smithi165.stdout:3/448: dread da/d20/d26/f51 [0,4194304] 0 2024-09-16T02:05:48.551 INFO:tasks.workunit.client.1.smithi165.stdout:5/342: mkdir de/d19/d67/d74 0 2024-09-16T02:05:48.552 INFO:tasks.workunit.client.1.smithi165.stdout:5/343: dread - de/d19/d1c/f4f zero size 2024-09-16T02:05:48.552 INFO:tasks.workunit.client.1.smithi165.stdout:5/344: stat de/d19/c30 0 2024-09-16T02:05:48.556 INFO:tasks.workunit.client.0.smithi110.stdout:0/103: mknod d3/c25 0 2024-09-16T02:05:48.557 INFO:tasks.workunit.client.1.smithi165.stdout:2/416: rmdir df/d23/d2a 39 2024-09-16T02:05:48.559 INFO:tasks.workunit.client.0.smithi110.stdout:1/90: symlink d0/d1/d4/l1a 0 2024-09-16T02:05:48.568 INFO:tasks.workunit.client.0.smithi110.stdout:0/104: rename d3 to d3/d26 22 2024-09-16T02:05:48.570 INFO:tasks.workunit.client.1.smithi165.stdout:1/315: mknod d1/dd/d11/d33/d3f/c5d 0 2024-09-16T02:05:48.576 INFO:tasks.workunit.client.1.smithi165.stdout:5/345: unlink de/d21/d26/l53 0 2024-09-16T02:05:48.576 INFO:tasks.workunit.client.1.smithi165.stdout:5/346: write de/f14 [12808351,85767] 0 2024-09-16T02:05:48.577 INFO:tasks.workunit.client.1.smithi165.stdout:5/347: write fc [4093127,81970] 0 2024-09-16T02:05:48.582 INFO:tasks.workunit.client.0.smithi110.stdout:1/91: rename d0/d1/d4/lb to d0/da/l1b 0 2024-09-16T02:05:48.582 INFO:tasks.workunit.client.0.smithi110.stdout:1/92: chown d0/f6 19603582 1 2024-09-16T02:05:48.583 INFO:tasks.workunit.client.0.smithi110.stdout:1/93: stat d0/f6 0 2024-09-16T02:05:48.588 INFO:tasks.workunit.client.1.smithi165.stdout:0/347: link d0/d1e/f2c d0/d1e/d39/f7c 0 2024-09-16T02:05:48.590 INFO:tasks.workunit.client.0.smithi110.stdout:1/94: dwrite d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:48.592 INFO:tasks.workunit.client.0.smithi110.stdout:1/95: stat d0/f6 0 2024-09-16T02:05:48.593 INFO:tasks.workunit.client.1.smithi165.stdout:7/325: mknod d0/d4b/d63/c66 0 2024-09-16T02:05:48.593 INFO:tasks.workunit.client.1.smithi165.stdout:3/449: truncate da/d17/d78/f23 5765931 0 2024-09-16T02:05:48.594 INFO:tasks.workunit.client.0.smithi110.stdout:0/105: creat d3/d4/f27 x:0 0 0 2024-09-16T02:05:48.594 INFO:tasks.workunit.client.0.smithi110.stdout:2/156: truncate d0/da/f24 1782039 0 2024-09-16T02:05:48.594 INFO:tasks.workunit.client.0.smithi110.stdout:0/106: read d3/d4/f11 [560483,105990] 0 2024-09-16T02:05:48.598 INFO:tasks.workunit.client.0.smithi110.stdout:1/96: symlink d0/d1/l1c 0 2024-09-16T02:05:48.601 INFO:tasks.workunit.client.0.smithi110.stdout:1/97: dread d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:48.602 INFO:tasks.workunit.client.0.smithi110.stdout:1/98: write d0/da/f15 [597810,40994] 0 2024-09-16T02:05:48.604 INFO:tasks.workunit.client.1.smithi165.stdout:5/348: mknod de/d21/d26/c75 0 2024-09-16T02:05:48.606 INFO:tasks.workunit.client.0.smithi110.stdout:0/107: dread d3/d4/f11 [0,4194304] 0 2024-09-16T02:05:48.606 INFO:tasks.workunit.client.0.smithi110.stdout:0/108: stat d3/f9 0 2024-09-16T02:05:48.607 INFO:tasks.workunit.client.1.smithi165.stdout:4/325: sync 2024-09-16T02:05:48.607 INFO:tasks.workunit.client.1.smithi165.stdout:9/403: link d7/fa d7/df/d37/f83 0 2024-09-16T02:05:48.611 INFO:tasks.workunit.client.1.smithi165.stdout:8/388: link dd/d11/d38/l4a dd/d11/d14/d3f/d25/d36/d85/l86 0 2024-09-16T02:05:48.611 INFO:tasks.workunit.client.0.smithi110.stdout:0/109: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:48.611 INFO:tasks.workunit.client.1.smithi165.stdout:8/389: fsync dd/d11/d14/d70/d7b/f84 0 2024-09-16T02:05:48.612 INFO:tasks.workunit.client.1.smithi165.stdout:2/417: symlink df/d10/l80 0 2024-09-16T02:05:48.616 INFO:tasks.workunit.client.1.smithi165.stdout:0/348: rmdir d0/d1e/d39/d48/d45 39 2024-09-16T02:05:48.616 INFO:tasks.workunit.client.1.smithi165.stdout:0/349: chown d0/d1e/l2b 15424118 1 2024-09-16T02:05:48.617 INFO:tasks.workunit.client.0.smithi110.stdout:2/157: mknod d0/da/c35 0 2024-09-16T02:05:48.618 INFO:tasks.workunit.client.0.smithi110.stdout:2/158: stat d0/da/d18/dc 0 2024-09-16T02:05:48.618 INFO:tasks.workunit.client.1.smithi165.stdout:1/316: mknod d1/dd/d11/d33/d3f/d59/c5e 0 2024-09-16T02:05:48.619 INFO:tasks.workunit.client.1.smithi165.stdout:1/317: fdatasync d1/dd/f10 0 2024-09-16T02:05:48.619 INFO:tasks.workunit.client.0.smithi110.stdout:2/159: chown d0/da/d18/d25/c2f 3867160 1 2024-09-16T02:05:48.619 INFO:tasks.workunit.client.0.smithi110.stdout:1/99: mknod d0/da/c1d 0 2024-09-16T02:05:48.620 INFO:tasks.workunit.client.0.smithi110.stdout:1/100: fsync d0/da/f15 0 2024-09-16T02:05:48.620 INFO:tasks.workunit.client.1.smithi165.stdout:3/450: creat da/d57/fa4 x:0 0 0 2024-09-16T02:05:48.620 INFO:tasks.workunit.client.0.smithi110.stdout:9/59: write d1/fc [177534,113699] 0 2024-09-16T02:05:48.625 INFO:tasks.workunit.client.0.smithi110.stdout:1/101: dread d0/f6 [0,4194304] 0 2024-09-16T02:05:48.626 INFO:tasks.workunit.client.0.smithi110.stdout:0/110: unlink d3/d4/dc/d10/c18 0 2024-09-16T02:05:48.627 INFO:tasks.workunit.client.0.smithi110.stdout:1/102: chown d0/da/f15 32 1 2024-09-16T02:05:48.627 INFO:tasks.workunit.client.1.smithi165.stdout:6/347: rename d7/dc/d3b/d3c/l50 to d7/l58 0 2024-09-16T02:05:48.629 INFO:tasks.workunit.client.0.smithi110.stdout:2/160: write d0/db/fd [1192343,115325] 0 2024-09-16T02:05:48.630 INFO:tasks.workunit.client.0.smithi110.stdout:0/111: dread d3/d6/ff [0,4194304] 0 2024-09-16T02:05:48.632 INFO:tasks.workunit.client.1.smithi165.stdout:5/349: symlink de/d21/d51/l76 0 2024-09-16T02:05:48.633 INFO:tasks.workunit.client.0.smithi110.stdout:9/60: symlink d1/dd/l14 0 2024-09-16T02:05:48.636 INFO:tasks.workunit.client.1.smithi165.stdout:9/404: symlink d7/d1f/d27/l84 0 2024-09-16T02:05:48.637 INFO:tasks.workunit.client.0.smithi110.stdout:9/61: chown d1/dd/d13 893 1 2024-09-16T02:05:48.639 INFO:tasks.workunit.client.1.smithi165.stdout:8/390: rmdir dd/d11/d14/d3f/d25/d36/d4f 39 2024-09-16T02:05:48.642 INFO:tasks.workunit.client.0.smithi110.stdout:3/95: truncate d8/f9 2912264 0 2024-09-16T02:05:48.643 INFO:tasks.workunit.client.1.smithi165.stdout:2/418: creat df/d23/d28/f81 x:0 0 0 2024-09-16T02:05:48.645 INFO:tasks.workunit.client.1.smithi165.stdout:0/350: symlink d0/d47/l7d 0 2024-09-16T02:05:48.650 INFO:tasks.workunit.client.0.smithi110.stdout:0/112: dwrite d3/d4/f23 [0,4194304] 0 2024-09-16T02:05:48.651 INFO:tasks.workunit.client.0.smithi110.stdout:5/125: dwrite d5/f6 [0,4194304] 0 2024-09-16T02:05:48.654 INFO:tasks.workunit.client.1.smithi165.stdout:3/451: mknod da/d17/d78/d91/ca5 0 2024-09-16T02:05:48.654 INFO:tasks.workunit.client.1.smithi165.stdout:3/452: chown da/d57/d8d 0 1 2024-09-16T02:05:48.655 INFO:tasks.workunit.client.0.smithi110.stdout:8/114: dwrite d3/f15 [0,4194304] 0 2024-09-16T02:05:48.658 INFO:tasks.workunit.client.0.smithi110.stdout:3/96: mkdir d8/dc/d1b 0 2024-09-16T02:05:48.664 INFO:tasks.workunit.client.0.smithi110.stdout:9/62: dwrite d1/d5/fb [0,4194304] 0 2024-09-16T02:05:48.669 INFO:tasks.workunit.client.0.smithi110.stdout:9/63: chown d1/dd/l14 2 1 2024-09-16T02:05:48.671 INFO:tasks.workunit.client.0.smithi110.stdout:9/64: stat d1/dd/d13 0 2024-09-16T02:05:48.671 INFO:tasks.workunit.client.1.smithi165.stdout:9/405: chown d7/d1d/f6a 5 1 2024-09-16T02:05:48.673 INFO:tasks.workunit.client.1.smithi165.stdout:1/318: mknod d1/dd/d11/d42/c5f 0 2024-09-16T02:05:48.674 INFO:tasks.workunit.client.1.smithi165.stdout:1/319: write d1/fc [1794127,51521] 0 2024-09-16T02:05:48.674 INFO:tasks.workunit.client.1.smithi165.stdout:7/326: write d0/df/d33/d2a/f5a [990709,104944] 0 2024-09-16T02:05:48.675 INFO:tasks.workunit.client.0.smithi110.stdout:1/103: dwrite d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:48.677 INFO:tasks.workunit.client.0.smithi110.stdout:5/126: dwrite d5/dd/df/f1c [0,4194304] 0 2024-09-16T02:05:48.679 INFO:tasks.workunit.client.1.smithi165.stdout:7/327: read d0/df/d33/f4a [759663,65656] 0 2024-09-16T02:05:48.680 INFO:tasks.workunit.client.1.smithi165.stdout:5/350: mknod de/c77 0 2024-09-16T02:05:48.680 INFO:tasks.workunit.client.0.smithi110.stdout:8/115: write d3/fd [1016979,114751] 0 2024-09-16T02:05:48.681 INFO:tasks.workunit.client.1.smithi165.stdout:5/351: write de/d21/d51/f5e [815279,80109] 0 2024-09-16T02:05:48.681 INFO:tasks.workunit.client.1.smithi165.stdout:4/326: creat d4/dc/d28/d2b/d42/f69 x:0 0 0 2024-09-16T02:05:48.682 INFO:tasks.workunit.client.1.smithi165.stdout:5/352: write de/d21/f62 [196592,953] 0 2024-09-16T02:05:48.684 INFO:tasks.workunit.client.0.smithi110.stdout:2/161: getdents d0/da/d18/d25 0 2024-09-16T02:05:48.684 INFO:tasks.workunit.client.0.smithi110.stdout:5/127: creat d5/dd/df/d11/f26 x:0 0 0 2024-09-16T02:05:48.688 INFO:tasks.workunit.client.0.smithi110.stdout:1/104: chown d0/d1/d4/l3 102648 1 2024-09-16T02:05:48.688 INFO:tasks.workunit.client.0.smithi110.stdout:3/97: getdents d8/dc/d1b 0 2024-09-16T02:05:48.688 INFO:tasks.workunit.client.0.smithi110.stdout:0/113: dread d3/d6/ff [0,4194304] 0 2024-09-16T02:05:48.691 INFO:tasks.workunit.client.0.smithi110.stdout:3/98: write f4 [2178000,743] 0 2024-09-16T02:05:48.693 INFO:tasks.workunit.client.0.smithi110.stdout:3/99: write d8/fb [2183214,125123] 0 2024-09-16T02:05:48.696 INFO:tasks.workunit.client.1.smithi165.stdout:1/320: rmdir d1/dd/d11/d33/d35 39 2024-09-16T02:05:48.697 INFO:tasks.workunit.client.1.smithi165.stdout:1/321: truncate d1/d22/f4e 701414 0 2024-09-16T02:05:48.697 INFO:tasks.workunit.client.0.smithi110.stdout:9/65: dwrite d1/d5/fb [0,4194304] 0 2024-09-16T02:05:48.699 INFO:tasks.workunit.client.0.smithi110.stdout:2/162: creat d0/db/f36 x:0 0 0 2024-09-16T02:05:48.706 INFO:tasks.workunit.client.1.smithi165.stdout:4/327: unlink d4/f9 0 2024-09-16T02:05:48.707 INFO:tasks.workunit.client.0.smithi110.stdout:1/105: dwrite d0/da/f15 [0,4194304] 0 2024-09-16T02:05:48.709 INFO:tasks.workunit.client.1.smithi165.stdout:6/348: write d7/d1f/f27 [1287011,88271] 0 2024-09-16T02:05:48.709 INFO:tasks.workunit.client.1.smithi165.stdout:9/406: mkdir d7/d32/d85 0 2024-09-16T02:05:48.711 INFO:tasks.workunit.client.0.smithi110.stdout:3/100: dwrite d8/fb [4194304,4194304] 0 2024-09-16T02:05:48.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/101: chown d8 2052126 1 2024-09-16T02:05:48.714 INFO:tasks.workunit.client.1.smithi165.stdout:0/351: rename d0/d1e/d20/d28/l55 to d0/d1e/d39/d48/l7e 0 2024-09-16T02:05:48.716 INFO:tasks.workunit.client.1.smithi165.stdout:6/349: dwrite d7/d1f/f33 [0,4194304] 0 2024-09-16T02:05:48.716 INFO:tasks.workunit.client.1.smithi165.stdout:0/352: dread d0/d47/f65 [0,4194304] 0 2024-09-16T02:05:48.725 INFO:tasks.workunit.client.1.smithi165.stdout:7/328: dwrite d0/df/d42/f4e [0,4194304] 0 2024-09-16T02:05:48.726 INFO:tasks.workunit.client.0.smithi110.stdout:1/106: symlink d0/d1/l1e 0 2024-09-16T02:05:48.726 INFO:tasks.workunit.client.1.smithi165.stdout:7/329: chown d0/df/lc 10558833 1 2024-09-16T02:05:48.728 INFO:tasks.workunit.client.0.smithi110.stdout:6/139: sync 2024-09-16T02:05:48.730 INFO:tasks.workunit.client.1.smithi165.stdout:7/330: dread d0/f22 [0,4194304] 0 2024-09-16T02:05:48.730 INFO:tasks.workunit.client.0.smithi110.stdout:8/116: rename d3/d12/d1d/d22 to d3/d2b 0 2024-09-16T02:05:48.730 INFO:tasks.workunit.client.0.smithi110.stdout:9/66: rename d1/d5 to d1/d5/d8/de/d15 22 2024-09-16T02:05:48.731 INFO:tasks.workunit.client.0.smithi110.stdout:8/117: fdatasync d3/f15 0 2024-09-16T02:05:48.732 INFO:tasks.workunit.client.1.smithi165.stdout:4/328: dread d4/dc/d18/f22 [0,4194304] 0 2024-09-16T02:05:48.733 INFO:tasks.workunit.client.1.smithi165.stdout:2/419: write df/d10/d1a/d2d/f4e [3028279,55124] 0 2024-09-16T02:05:48.734 INFO:tasks.workunit.client.1.smithi165.stdout:2/420: dread - df/d73/f7c zero size 2024-09-16T02:05:48.734 INFO:tasks.workunit.client.1.smithi165.stdout:2/421: dread - df/d23/d28/d3b/f7a zero size 2024-09-16T02:05:48.736 INFO:tasks.workunit.client.1.smithi165.stdout:9/407: rename d7/df/d37/d43/l7d to d7/d32/d38/d53/d5c/d61/l86 0 2024-09-16T02:05:48.739 INFO:tasks.workunit.client.1.smithi165.stdout:3/453: getdents da/de 0 2024-09-16T02:05:48.741 INFO:tasks.workunit.client.0.smithi110.stdout:0/114: creat d3/f28 x:0 0 0 2024-09-16T02:05:48.742 INFO:tasks.workunit.client.1.smithi165.stdout:9/408: dread d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:48.742 INFO:tasks.workunit.client.0.smithi110.stdout:3/102: dread f3 [0,4194304] 0 2024-09-16T02:05:48.742 INFO:tasks.workunit.client.1.smithi165.stdout:9/409: read d7/d32/d4a/f7e [3407888,31518] 0 2024-09-16T02:05:48.743 INFO:tasks.workunit.client.1.smithi165.stdout:9/410: chown d7/df/d37/d43/f45 2394 1 2024-09-16T02:05:48.744 INFO:tasks.workunit.client.0.smithi110.stdout:1/107: mknod d0/d1/c1f 0 2024-09-16T02:05:48.745 INFO:tasks.workunit.client.0.smithi110.stdout:2/163: dwrite d0/da/d18/f29 [4194304,4194304] 0 2024-09-16T02:05:48.748 INFO:tasks.workunit.client.0.smithi110.stdout:5/128: getdents d5 0 2024-09-16T02:05:48.749 INFO:tasks.workunit.client.1.smithi165.stdout:9/411: dwrite f5 [4194304,4194304] 0 2024-09-16T02:05:48.750 INFO:tasks.workunit.client.0.smithi110.stdout:9/67: dwrite d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:48.750 INFO:tasks.workunit.client.0.smithi110.stdout:5/129: chown d5 15 1 2024-09-16T02:05:48.751 INFO:tasks.workunit.client.0.smithi110.stdout:6/140: mknod d0/d2/d5/d1e/c20 0 2024-09-16T02:05:48.751 INFO:tasks.workunit.client.1.smithi165.stdout:8/391: getdents dd/d11/d14/d3f/d25/d36/d4f/d75 0 2024-09-16T02:05:48.752 INFO:tasks.workunit.client.0.smithi110.stdout:6/141: write d0/d2/f12 [3750432,38548] 0 2024-09-16T02:05:48.754 INFO:tasks.workunit.client.0.smithi110.stdout:0/115: creat d3/d4/f29 x:0 0 0 2024-09-16T02:05:48.756 INFO:tasks.workunit.client.0.smithi110.stdout:1/108: dread d0/f14 [0,4194304] 0 2024-09-16T02:05:48.759 INFO:tasks.workunit.client.1.smithi165.stdout:1/322: truncate d1/f39 1847038 0 2024-09-16T02:05:48.760 INFO:tasks.workunit.client.1.smithi165.stdout:1/323: dread - d1/dd/d11/d33/d3f/f55 zero size 2024-09-16T02:05:48.764 INFO:tasks.workunit.client.0.smithi110.stdout:5/130: creat d5/dd/df/f27 x:0 0 0 2024-09-16T02:05:48.765 INFO:tasks.workunit.client.1.smithi165.stdout:3/454: mkdir da/d20/d26/d52/d9c/da6 0 2024-09-16T02:05:48.768 INFO:tasks.workunit.client.0.smithi110.stdout:6/142: mknod d0/d2/d18/c21 0 2024-09-16T02:05:48.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/116: mknod d3/d4/c2a 0 2024-09-16T02:05:48.770 INFO:tasks.workunit.client.0.smithi110.stdout:3/103: dwrite d8/dc/f11 [0,4194304] 0 2024-09-16T02:05:48.770 INFO:tasks.workunit.client.1.smithi165.stdout:9/412: dread d7/d55/f4c [0,4194304] 0 2024-09-16T02:05:48.770 INFO:tasks.workunit.client.1.smithi165.stdout:9/413: readlink d7/df/l23 0 2024-09-16T02:05:48.771 INFO:tasks.workunit.client.1.smithi165.stdout:9/414: write d7/d32/d4a/f4d [95120,19863] 0 2024-09-16T02:05:48.772 INFO:tasks.workunit.client.1.smithi165.stdout:9/415: chown d7/df/d37/c76 1 1 2024-09-16T02:05:48.775 INFO:tasks.workunit.client.1.smithi165.stdout:7/331: unlink d0/f22 0 2024-09-16T02:05:48.781 INFO:tasks.workunit.client.1.smithi165.stdout:8/392: dread dd/d11/d14/f1e [0,4194304] 0 2024-09-16T02:05:48.781 INFO:tasks.workunit.client.1.smithi165.stdout:2/422: mkdir df/d23/d28/d3b/d82 0 2024-09-16T02:05:48.783 INFO:tasks.workunit.client.1.smithi165.stdout:1/324: rename d1/dd/d11/f52 to d1/dd/d11/d33/d3f/d59/f60 0 2024-09-16T02:05:48.786 INFO:tasks.workunit.client.1.smithi165.stdout:0/353: creat d0/d1e/d20/f7f x:0 0 0 2024-09-16T02:05:48.787 INFO:tasks.workunit.client.1.smithi165.stdout:6/350: rename d7/dc/d3b/f31 to d7/dc/d3b/f59 0 2024-09-16T02:05:48.787 INFO:tasks.workunit.client.1.smithi165.stdout:2/423: dwrite df/d10/d1a/d2d/f58 [0,4194304] 0 2024-09-16T02:05:48.790 INFO:tasks.workunit.client.1.smithi165.stdout:5/353: sync 2024-09-16T02:05:48.791 INFO:tasks.workunit.client.1.smithi165.stdout:5/354: chown de/d21/d26/d3a/f5a 511318 1 2024-09-16T02:05:48.792 INFO:tasks.workunit.client.1.smithi165.stdout:7/332: mkdir d0/df/d7/d67 0 2024-09-16T02:05:48.793 INFO:tasks.workunit.client.1.smithi165.stdout:0/354: dwrite d0/f23 [0,4194304] 0 2024-09-16T02:05:48.794 INFO:tasks.workunit.client.1.smithi165.stdout:5/355: write de/d21/f41 [676554,83772] 0 2024-09-16T02:05:48.795 INFO:tasks.workunit.client.1.smithi165.stdout:5/356: chown de/c12 1900 1 2024-09-16T02:05:48.796 INFO:tasks.workunit.client.1.smithi165.stdout:7/333: read d0/d2c/f3b [3517676,57633] 0 2024-09-16T02:05:48.797 INFO:tasks.workunit.client.1.smithi165.stdout:4/329: creat d4/dc/d20/f6a x:0 0 0 2024-09-16T02:05:48.798 INFO:tasks.workunit.client.1.smithi165.stdout:1/325: creat d1/dd/d11/f61 x:0 0 0 2024-09-16T02:05:48.799 INFO:tasks.workunit.client.1.smithi165.stdout:3/455: write da/d20/d26/f51 [4711383,13156] 0 2024-09-16T02:05:48.801 INFO:tasks.workunit.client.1.smithi165.stdout:4/330: write d4/dc/d28/d2b/d42/f69 [977203,115842] 0 2024-09-16T02:05:48.802 INFO:tasks.workunit.client.1.smithi165.stdout:9/416: mkdir d7/d87 0 2024-09-16T02:05:48.802 INFO:tasks.workunit.client.1.smithi165.stdout:3/456: stat da/d20/d26/l38 0 2024-09-16T02:05:48.804 INFO:tasks.workunit.client.1.smithi165.stdout:4/331: chown d4/dc/d28/d2b/c50 2 1 2024-09-16T02:05:48.804 INFO:tasks.workunit.client.1.smithi165.stdout:0/355: dwrite d0/d47/f59 [0,4194304] 0 2024-09-16T02:05:48.806 INFO:tasks.workunit.client.1.smithi165.stdout:0/356: fdatasync d0/f9 0 2024-09-16T02:05:48.806 INFO:tasks.workunit.client.1.smithi165.stdout:8/393: creat dd/d11/d14/d3f/d72/f87 x:0 0 0 2024-09-16T02:05:48.807 INFO:tasks.workunit.client.1.smithi165.stdout:9/417: dread d7/df/d37/d43/f45 [0,4194304] 0 2024-09-16T02:05:48.808 INFO:tasks.workunit.client.1.smithi165.stdout:1/326: mknod d1/c62 0 2024-09-16T02:05:48.811 INFO:tasks.workunit.client.1.smithi165.stdout:8/394: read dd/d11/d38/f4b [1807043,99057] 0 2024-09-16T02:05:48.813 INFO:tasks.workunit.client.1.smithi165.stdout:8/395: chown dd/d11/d14/d3f/d25/d36/d4f 1 1 2024-09-16T02:05:48.813 INFO:tasks.workunit.client.1.smithi165.stdout:5/357: rename cd to de/d19/c78 0 2024-09-16T02:05:48.815 INFO:tasks.workunit.client.1.smithi165.stdout:4/332: mknod d4/d40/c6b 0 2024-09-16T02:05:48.816 INFO:tasks.workunit.client.1.smithi165.stdout:2/424: dread df/d10/d37/f3d [0,4194304] 0 2024-09-16T02:05:48.817 INFO:tasks.workunit.client.1.smithi165.stdout:2/425: chown df/d23/d66 1440609314 1 2024-09-16T02:05:48.818 INFO:tasks.workunit.client.1.smithi165.stdout:9/418: dwrite d7/d32/d38/d58/f79 [0,4194304] 0 2024-09-16T02:05:48.819 INFO:tasks.workunit.client.0.smithi110.stdout:6/143: fdatasync d0/d2/dc/f1f 0 2024-09-16T02:05:48.822 INFO:tasks.workunit.client.0.smithi110.stdout:2/164: symlink d0/da/l37 0 2024-09-16T02:05:48.823 INFO:tasks.workunit.client.0.smithi110.stdout:8/118: link d3/d12/d1a/l28 d3/d12/d1d/l2c 0 2024-09-16T02:05:48.825 INFO:tasks.workunit.client.1.smithi165.stdout:7/334: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:48.825 INFO:tasks.workunit.client.1.smithi165.stdout:7/335: stat d0/df/d33/c64 0 2024-09-16T02:05:48.825 INFO:tasks.workunit.client.1.smithi165.stdout:5/358: rmdir de/d19/d1c/d49 39 2024-09-16T02:05:48.828 INFO:tasks.workunit.client.0.smithi110.stdout:5/131: mkdir d5/dd/df/d28 0 2024-09-16T02:05:48.830 INFO:tasks.workunit.client.1.smithi165.stdout:8/396: creat dd/d11/d14/d3f/d25/d36/d4f/d75/f88 x:0 0 0 2024-09-16T02:05:48.831 INFO:tasks.workunit.client.0.smithi110.stdout:0/117: dwrite d3/d4/f29 [0,4194304] 0 2024-09-16T02:05:48.833 INFO:tasks.workunit.client.0.smithi110.stdout:9/68: truncate d1/fc 369461 0 2024-09-16T02:05:48.834 INFO:tasks.workunit.client.1.smithi165.stdout:8/397: dread dd/d13/d53/f58 [0,4194304] 0 2024-09-16T02:05:48.835 INFO:tasks.workunit.client.0.smithi110.stdout:6/144: creat d0/d2/d5/f22 x:0 0 0 2024-09-16T02:05:48.837 INFO:tasks.workunit.client.0.smithi110.stdout:2/165: dwrite d0/db/f2e [0,4194304] 0 2024-09-16T02:05:48.839 INFO:tasks.workunit.client.0.smithi110.stdout:8/119: dread d3/f15 [0,4194304] 0 2024-09-16T02:05:48.842 INFO:tasks.workunit.client.1.smithi165.stdout:6/351: getdents d7/dc/df/d1a 0 2024-09-16T02:05:48.842 INFO:tasks.workunit.client.0.smithi110.stdout:9/69: dread f0 [0,4194304] 0 2024-09-16T02:05:48.844 INFO:tasks.workunit.client.0.smithi110.stdout:8/120: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:48.845 INFO:tasks.workunit.client.1.smithi165.stdout:0/357: unlink d0/d1e/d20/d28/l31 0 2024-09-16T02:05:48.847 INFO:tasks.workunit.client.0.smithi110.stdout:9/70: dread d1/d5/fb [0,4194304] 0 2024-09-16T02:05:48.849 INFO:tasks.workunit.client.0.smithi110.stdout:0/118: fsync d3/f16 0 2024-09-16T02:05:48.850 INFO:tasks.workunit.client.1.smithi165.stdout:3/457: creat da/d20/d26/fa7 x:0 0 0 2024-09-16T02:05:48.851 INFO:tasks.workunit.client.0.smithi110.stdout:3/104: mkdir d8/dc/d1b/d1c 0 2024-09-16T02:05:48.851 INFO:tasks.workunit.client.1.smithi165.stdout:3/458: stat da/d17/d78/l46 0 2024-09-16T02:05:48.851 INFO:tasks.workunit.client.1.smithi165.stdout:1/327: symlink d1/dd/d25/d54/l63 0 2024-09-16T02:05:48.851 INFO:tasks.workunit.client.1.smithi165.stdout:3/459: chown da/d17/c83 400 1 2024-09-16T02:05:48.854 INFO:tasks.workunit.client.1.smithi165.stdout:5/359: dread - de/d19/d1c/d49/f73 zero size 2024-09-16T02:05:48.855 INFO:tasks.workunit.client.1.smithi165.stdout:5/360: write de/d19/d1c/d4d/f72 [52719,75307] 0 2024-09-16T02:05:48.857 INFO:tasks.workunit.client.1.smithi165.stdout:3/460: dwrite da/d17/f8b [0,4194304] 0 2024-09-16T02:05:48.862 INFO:tasks.workunit.client.0.smithi110.stdout:8/121: creat d3/d2b/d27/f2d x:0 0 0 2024-09-16T02:05:48.864 INFO:tasks.workunit.client.0.smithi110.stdout:8/122: readlink d3/l7 0 2024-09-16T02:05:48.865 INFO:tasks.workunit.client.0.smithi110.stdout:8/123: write d3/f2a [365069,75187] 0 2024-09-16T02:05:48.866 INFO:tasks.workunit.client.1.smithi165.stdout:0/358: mknod d0/d1e/d39/c80 0 2024-09-16T02:05:48.867 INFO:tasks.workunit.client.0.smithi110.stdout:8/124: write d3/f15 [4527333,6976] 0 2024-09-16T02:05:48.868 INFO:tasks.workunit.client.1.smithi165.stdout:7/336: mkdir d0/df/d68 0 2024-09-16T02:05:48.881 INFO:tasks.workunit.client.0.smithi110.stdout:2/166: dwrite d0/da/d18/dc/f2b [0,4194304] 0 2024-09-16T02:05:48.881 INFO:tasks.workunit.client.0.smithi110.stdout:0/119: dwrite d3/f16 [0,4194304] 0 2024-09-16T02:05:48.882 INFO:tasks.workunit.client.1.smithi165.stdout:1/328: creat d1/dd/d25/f64 x:0 0 0 2024-09-16T02:05:48.882 INFO:tasks.workunit.client.1.smithi165.stdout:1/329: write d1/d22/f3d [1222766,113934] 0 2024-09-16T02:05:48.882 INFO:tasks.workunit.client.1.smithi165.stdout:1/330: write d1/d22/f4e [692427,106090] 0 2024-09-16T02:05:48.882 INFO:tasks.workunit.client.1.smithi165.stdout:9/419: truncate d7/df/f1c 2552621 0 2024-09-16T02:05:48.882 INFO:tasks.workunit.client.1.smithi165.stdout:3/461: mkdir da/d17/d7a/d7d/da8 0 2024-09-16T02:05:48.887 INFO:tasks.workunit.client.0.smithi110.stdout:8/125: creat d3/d2b/f2e x:0 0 0 2024-09-16T02:05:48.888 INFO:tasks.workunit.client.0.smithi110.stdout:8/126: fsync d3/d12/f1c 0 2024-09-16T02:05:48.889 INFO:tasks.workunit.client.0.smithi110.stdout:0/120: dwrite d3/f1a [0,4194304] 0 2024-09-16T02:05:48.889 INFO:tasks.workunit.client.1.smithi165.stdout:8/398: mkdir dd/d13/d89 0 2024-09-16T02:05:48.894 INFO:tasks.workunit.client.1.smithi165.stdout:6/352: unlink d7/dc/l11 0 2024-09-16T02:05:48.895 INFO:tasks.workunit.client.0.smithi110.stdout:6/145: creat d0/d2/f23 x:0 0 0 2024-09-16T02:05:48.897 INFO:tasks.workunit.client.0.smithi110.stdout:6/146: write d0/d2/f1c [160637,75989] 0 2024-09-16T02:05:48.898 INFO:tasks.workunit.client.0.smithi110.stdout:6/147: fdatasync d0/d2/dc/d16/f13 0 2024-09-16T02:05:48.901 INFO:tasks.workunit.client.1.smithi165.stdout:7/337: fdatasync d0/f12 0 2024-09-16T02:05:48.902 INFO:tasks.workunit.client.1.smithi165.stdout:6/353: dread d7/d1f/f32 [0,4194304] 0 2024-09-16T02:05:48.903 INFO:tasks.workunit.client.0.smithi110.stdout:3/105: write d8/f15 [1471699,69261] 0 2024-09-16T02:05:48.904 INFO:tasks.workunit.client.0.smithi110.stdout:5/132: getdents d5/dd 0 2024-09-16T02:05:48.904 INFO:tasks.workunit.client.1.smithi165.stdout:6/354: dread d7/dc/d3b/f44 [0,4194304] 0 2024-09-16T02:05:48.906 INFO:tasks.workunit.client.0.smithi110.stdout:5/133: readlink d5/l9 0 2024-09-16T02:05:48.906 INFO:tasks.workunit.client.0.smithi110.stdout:3/106: read f4 [583593,50250] 0 2024-09-16T02:05:48.906 INFO:tasks.workunit.client.0.smithi110.stdout:5/134: chown d5/l24 2 1 2024-09-16T02:05:48.906 INFO:tasks.workunit.client.1.smithi165.stdout:6/355: write f3 [3988931,125325] 0 2024-09-16T02:05:48.906 INFO:tasks.workunit.client.1.smithi165.stdout:1/331: mknod d1/dd/d25/c65 0 2024-09-16T02:05:48.907 INFO:tasks.workunit.client.1.smithi165.stdout:6/356: chown d7/c2c 181 1 2024-09-16T02:05:48.907 INFO:tasks.workunit.client.1.smithi165.stdout:9/420: mkdir d7/df/d37/d43/d88 0 2024-09-16T02:05:48.909 INFO:tasks.workunit.client.0.smithi110.stdout:0/121: symlink d3/d4/l2b 0 2024-09-16T02:05:48.909 INFO:tasks.workunit.client.1.smithi165.stdout:4/333: getdents d4/dc/d20 0 2024-09-16T02:05:48.910 INFO:tasks.workunit.client.0.smithi110.stdout:0/122: chown d3/d4/dc/f1e 846399464 1 2024-09-16T02:05:48.911 INFO:tasks.workunit.client.1.smithi165.stdout:4/334: chown d4/dc/d20/d4e 254 1 2024-09-16T02:05:48.911 INFO:tasks.workunit.client.0.smithi110.stdout:8/127: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:48.915 INFO:tasks.workunit.client.0.smithi110.stdout:6/148: symlink d0/d2/d18/l24 0 2024-09-16T02:05:48.918 INFO:tasks.workunit.client.0.smithi110.stdout:6/149: write d0/d2/dc/f1f [425708,124294] 0 2024-09-16T02:05:48.918 INFO:tasks.workunit.client.0.smithi110.stdout:9/71: getdents d1/d5/d8 0 2024-09-16T02:05:48.919 INFO:tasks.workunit.client.0.smithi110.stdout:8/128: dwrite d3/d12/f1c [0,4194304] 0 2024-09-16T02:05:48.919 INFO:tasks.workunit.client.0.smithi110.stdout:3/107: rmdir d8/dc/d1b 39 2024-09-16T02:05:48.921 INFO:tasks.workunit.client.0.smithi110.stdout:5/135: mknod d5/c29 0 2024-09-16T02:05:48.922 INFO:tasks.workunit.client.1.smithi165.stdout:1/332: creat d1/dd/d25/f66 x:0 0 0 2024-09-16T02:05:48.923 INFO:tasks.workunit.client.0.smithi110.stdout:0/123: symlink d3/d4/dc/d14/l2c 0 2024-09-16T02:05:48.923 INFO:tasks.workunit.client.1.smithi165.stdout:1/333: chown d1/d19/c51 145 1 2024-09-16T02:05:48.924 INFO:tasks.workunit.client.1.smithi165.stdout:6/357: creat d7/dc/d3b/d3a/f5a x:0 0 0 2024-09-16T02:05:48.925 INFO:tasks.workunit.client.1.smithi165.stdout:1/334: truncate d1/dd/d11/d33/d3f/f55 287747 0 2024-09-16T02:05:48.925 INFO:tasks.workunit.client.0.smithi110.stdout:2/167: rename d0/da/d18/c2 to d0/da/c38 0 2024-09-16T02:05:48.925 INFO:tasks.workunit.client.1.smithi165.stdout:6/358: write d7/dc/d3b/d3a/f5a [5514,13951] 0 2024-09-16T02:05:48.926 INFO:tasks.workunit.client.0.smithi110.stdout:2/168: dread - d0/da/f2c zero size 2024-09-16T02:05:48.927 INFO:tasks.workunit.client.1.smithi165.stdout:9/421: rename d7/df/d37/d43/f45 to d7/d14/f89 0 2024-09-16T02:05:48.928 INFO:tasks.workunit.client.1.smithi165.stdout:9/422: fdatasync d7/d32/d38/f77 0 2024-09-16T02:05:48.928 INFO:tasks.workunit.client.1.smithi165.stdout:9/423: chown d7/d14/f16 6510 1 2024-09-16T02:05:48.929 INFO:tasks.workunit.client.1.smithi165.stdout:4/335: symlink d4/dc/d20/d45/l6c 0 2024-09-16T02:05:48.930 INFO:tasks.workunit.client.1.smithi165.stdout:4/336: read d4/dc/d18/f34 [3325187,1676] 0 2024-09-16T02:05:48.932 INFO:tasks.workunit.client.0.smithi110.stdout:9/72: creat d1/f16 x:0 0 0 2024-09-16T02:05:48.934 INFO:tasks.workunit.client.0.smithi110.stdout:3/108: creat d8/f1d x:0 0 0 2024-09-16T02:05:48.935 INFO:tasks.workunit.client.0.smithi110.stdout:3/109: read - d8/f17 zero size 2024-09-16T02:05:48.936 INFO:tasks.workunit.client.1.smithi165.stdout:4/337: dwrite f1 [0,4194304] 0 2024-09-16T02:05:48.943 INFO:tasks.workunit.client.0.smithi110.stdout:2/169: dread d0/da/d18/dc/f1c [0,4194304] 0 2024-09-16T02:05:48.945 INFO:tasks.workunit.client.1.smithi165.stdout:2/426: sync 2024-09-16T02:05:48.945 INFO:tasks.workunit.client.1.smithi165.stdout:9/424: dread d7/f22 [0,4194304] 0 2024-09-16T02:05:48.946 INFO:tasks.workunit.client.0.smithi110.stdout:9/73: truncate f0 3132129 0 2024-09-16T02:05:48.947 INFO:tasks.workunit.client.1.smithi165.stdout:5/361: link de/f1d de/d21/d26/d3a/d54/f79 0 2024-09-16T02:05:48.948 INFO:tasks.workunit.client.0.smithi110.stdout:7/105: sync 2024-09-16T02:05:48.948 INFO:tasks.workunit.client.0.smithi110.stdout:4/47: sync 2024-09-16T02:05:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:48 smithi165 ceph-mon[34621]: pgmap v18: 65 pgs: 65 active+clean; 443 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 43 MiB/s wr, 233 op/s 2024-09-16T02:05:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:48 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:48.952 INFO:tasks.workunit.client.1.smithi165.stdout:8/399: creat dd/f8a x:0 0 0 2024-09-16T02:05:48.953 INFO:tasks.workunit.client.1.smithi165.stdout:8/400: dread - dd/d13/f71 zero size 2024-09-16T02:05:48.954 INFO:tasks.workunit.client.0.smithi110.stdout:5/136: mknod d5/dd/df/d28/c2a 0 2024-09-16T02:05:48.954 INFO:tasks.workunit.client.0.smithi110.stdout:5/137: fsync d5/f1e 0 2024-09-16T02:05:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:48 smithi110 ceph-mon[27634]: pgmap v18: 65 pgs: 65 active+clean; 443 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 43 MiB/s wr, 233 op/s 2024-09-16T02:05:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:48 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:05:48.957 INFO:tasks.workunit.client.1.smithi165.stdout:0/359: getdents d0/d47 0 2024-09-16T02:05:48.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/338: unlink d4/dc/f16 0 2024-09-16T02:05:48.961 INFO:tasks.workunit.client.0.smithi110.stdout:6/150: creat d0/d2/f25 x:0 0 0 2024-09-16T02:05:48.961 INFO:tasks.workunit.client.0.smithi110.stdout:6/151: fsync d0/f10 0 2024-09-16T02:05:48.961 INFO:tasks.workunit.client.1.smithi165.stdout:7/338: rmdir d0/d4b/d50 0 2024-09-16T02:05:48.962 INFO:tasks.workunit.client.0.smithi110.stdout:6/152: read d0/d2/f14 [4601671,76366] 0 2024-09-16T02:05:48.962 INFO:tasks.workunit.client.0.smithi110.stdout:2/170: rmdir d0/da/d18/d25 39 2024-09-16T02:05:48.963 INFO:tasks.workunit.client.0.smithi110.stdout:0/124: truncate d3/d6/f21 134242 0 2024-09-16T02:05:48.964 INFO:tasks.workunit.client.0.smithi110.stdout:6/153: write d0/d2/f23 [92361,112986] 0 2024-09-16T02:05:48.964 INFO:tasks.workunit.client.0.smithi110.stdout:0/125: readlink d3/d4/dc/d14/l2c 0 2024-09-16T02:05:48.965 INFO:tasks.workunit.client.0.smithi110.stdout:0/126: write d3/d4/f1d [23435,104142] 0 2024-09-16T02:05:48.966 INFO:tasks.workunit.client.1.smithi165.stdout:1/335: mkdir d1/dd/d11/d33/d67 0 2024-09-16T02:05:48.968 INFO:tasks.workunit.client.0.smithi110.stdout:4/48: symlink d4/d8/lf 0 2024-09-16T02:05:48.971 INFO:tasks.workunit.client.1.smithi165.stdout:2/427: dwrite fa [0,4194304] 0 2024-09-16T02:05:48.973 INFO:tasks.workunit.client.1.smithi165.stdout:8/401: creat dd/d11/d14/d3f/d25/f8b x:0 0 0 2024-09-16T02:05:48.978 INFO:tasks.workunit.client.0.smithi110.stdout:6/154: dwrite d0/d2/dc/d16/f13 [0,4194304] 0 2024-09-16T02:05:48.980 INFO:tasks.workunit.client.1.smithi165.stdout:7/339: symlink d0/d4b/d58/l69 0 2024-09-16T02:05:48.982 INFO:tasks.workunit.client.1.smithi165.stdout:6/359: dwrite d7/f23 [0,4194304] 0 2024-09-16T02:05:48.983 INFO:tasks.workunit.client.0.smithi110.stdout:9/74: rename d1/f16 to d1/d5/d8/f17 0 2024-09-16T02:05:48.986 INFO:tasks.workunit.client.0.smithi110.stdout:8/129: getdents d3 0 2024-09-16T02:05:48.986 INFO:tasks.workunit.client.1.smithi165.stdout:5/362: dwrite de/d21/d26/d3a/d54/f79 [0,4194304] 0 2024-09-16T02:05:48.987 INFO:tasks.workunit.client.1.smithi165.stdout:9/425: mkdir d7/d32/d85/d8a 0 2024-09-16T02:05:48.992 INFO:tasks.workunit.client.1.smithi165.stdout:5/363: write de/d21/d26/d3a/d54/f4c [2032292,6242] 0 2024-09-16T02:05:48.993 INFO:tasks.workunit.client.1.smithi165.stdout:1/336: rename d1/dd/d25 to d1/d68 0 2024-09-16T02:05:48.995 INFO:tasks.workunit.client.1.smithi165.stdout:5/364: truncate de/d21/d26/d3a/f5a 395968 0 2024-09-16T02:05:48.995 INFO:tasks.workunit.client.0.smithi110.stdout:3/110: link f2 d8/f1e 0 2024-09-16T02:05:48.996 INFO:tasks.workunit.client.0.smithi110.stdout:8/130: dwrite d3/d2b/f2e [0,4194304] 0 2024-09-16T02:05:48.997 INFO:tasks.workunit.client.0.smithi110.stdout:8/131: chown d3/f9 82666806 1 2024-09-16T02:05:48.998 INFO:tasks.workunit.client.1.smithi165.stdout:8/402: symlink dd/d11/d14/d70/d7b/l8c 0 2024-09-16T02:05:48.998 INFO:tasks.workunit.client.1.smithi165.stdout:8/403: fdatasync f6 0 2024-09-16T02:05:48.998 INFO:tasks.workunit.client.1.smithi165.stdout:2/428: read df/d23/d2a/f5c [3664848,5786] 0 2024-09-16T02:05:48.999 INFO:tasks.workunit.client.0.smithi110.stdout:6/155: creat d0/d2/d18/f26 x:0 0 0 2024-09-16T02:05:48.999 INFO:tasks.workunit.client.1.smithi165.stdout:8/404: write dd/d13/f32 [952573,107810] 0 2024-09-16T02:05:49.002 INFO:tasks.workunit.client.0.smithi110.stdout:6/156: read d0/d2/dc/d16/f13 [74924,37534] 0 2024-09-16T02:05:49.006 INFO:tasks.workunit.client.0.smithi110.stdout:5/138: rename d5/f8 to d5/dd/f2b 0 2024-09-16T02:05:49.007 INFO:tasks.workunit.client.0.smithi110.stdout:5/139: chown d5/f16 370485 1 2024-09-16T02:05:49.009 INFO:tasks.workunit.client.1.smithi165.stdout:7/340: mknod d0/d4b/d58/c6a 0 2024-09-16T02:05:49.011 INFO:tasks.workunit.client.0.smithi110.stdout:9/75: creat d1/d5/f18 x:0 0 0 2024-09-16T02:05:49.012 INFO:tasks.workunit.client.1.smithi165.stdout:6/360: dread d7/dc/d3b/f44 [0,4194304] 0 2024-09-16T02:05:49.013 INFO:tasks.workunit.client.0.smithi110.stdout:7/106: write d3/f14 [755902,82196] 0 2024-09-16T02:05:49.013 INFO:tasks.workunit.client.1.smithi165.stdout:6/361: stat d7/dc/l21 0 2024-09-16T02:05:49.013 INFO:tasks.workunit.client.1.smithi165.stdout:6/362: chown d7/d1f/f27 62681 1 2024-09-16T02:05:49.013 INFO:tasks.workunit.client.0.smithi110.stdout:7/107: chown d3/da/fd 1 1 2024-09-16T02:05:49.014 INFO:tasks.workunit.client.1.smithi165.stdout:9/426: unlink d7/df/d37/c76 0 2024-09-16T02:05:49.014 INFO:tasks.workunit.client.1.smithi165.stdout:9/427: read - d7/d1d/f4e zero size 2024-09-16T02:05:49.015 INFO:tasks.workunit.client.1.smithi165.stdout:3/462: sync 2024-09-16T02:05:49.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/428: chown d7/d1f/d27/f3e 87930 1 2024-09-16T02:05:49.017 INFO:tasks.workunit.client.1.smithi165.stdout:3/463: write da/d20/d26/f4f [1346338,128067] 0 2024-09-16T02:05:49.018 INFO:tasks.workunit.client.1.smithi165.stdout:3/464: write da/d20/d26/d6e/f73 [711037,77847] 0 2024-09-16T02:05:49.019 INFO:tasks.workunit.client.1.smithi165.stdout:3/465: dread - da/d57/f7c zero size 2024-09-16T02:05:49.020 INFO:tasks.workunit.client.1.smithi165.stdout:3/466: write da/de/f71 [1318513,3872] 0 2024-09-16T02:05:49.020 INFO:tasks.workunit.client.1.smithi165.stdout:2/429: creat df/d73/f83 x:0 0 0 2024-09-16T02:05:49.021 INFO:tasks.workunit.client.1.smithi165.stdout:2/430: chown df/d23/d28/f81 74 1 2024-09-16T02:05:49.022 INFO:tasks.workunit.client.0.smithi110.stdout:8/132: creat d3/d12/f2f x:0 0 0 2024-09-16T02:05:49.025 INFO:tasks.workunit.client.0.smithi110.stdout:6/157: mknod d0/d2/d5/d1e/c27 0 2024-09-16T02:05:49.027 INFO:tasks.workunit.client.1.smithi165.stdout:7/341: creat d0/d3d/f6b x:0 0 0 2024-09-16T02:05:49.031 INFO:tasks.workunit.client.0.smithi110.stdout:5/140: unlink d5/c29 0 2024-09-16T02:05:49.034 INFO:tasks.workunit.client.0.smithi110.stdout:7/108: chown d3/da/d10/c1b 23 1 2024-09-16T02:05:49.035 INFO:tasks.workunit.client.1.smithi165.stdout:5/365: dread de/f14 [0,4194304] 0 2024-09-16T02:05:49.036 INFO:tasks.workunit.client.0.smithi110.stdout:0/127: write d3/d6/f21 [399073,96321] 0 2024-09-16T02:05:49.040 INFO:tasks.workunit.client.1.smithi165.stdout:3/467: mknod da/d20/d26/d8c/ca9 0 2024-09-16T02:05:49.040 INFO:tasks.workunit.client.1.smithi165.stdout:5/366: dwrite f7 [0,4194304] 0 2024-09-16T02:05:49.041 INFO:tasks.workunit.client.1.smithi165.stdout:5/367: chown de/d19/d67 8404848 1 2024-09-16T02:05:49.043 INFO:tasks.workunit.client.1.smithi165.stdout:8/405: creat dd/d11/d14/d3f/d25/d36/d81/f8d x:0 0 0 2024-09-16T02:05:49.046 INFO:tasks.workunit.client.0.smithi110.stdout:6/158: rmdir d0/d2 39 2024-09-16T02:05:49.047 INFO:tasks.workunit.client.1.smithi165.stdout:5/368: dread de/d19/d1c/f56 [0,4194304] 0 2024-09-16T02:05:49.048 INFO:tasks.workunit.client.1.smithi165.stdout:4/339: getdents d4/dc/d18 0 2024-09-16T02:05:49.048 INFO:tasks.workunit.client.1.smithi165.stdout:5/369: stat de/d21/d26/d3a/d54/l46 0 2024-09-16T02:05:49.049 INFO:tasks.workunit.client.0.smithi110.stdout:5/141: creat d5/f2c x:0 0 0 2024-09-16T02:05:49.051 INFO:tasks.workunit.client.1.smithi165.stdout:4/340: dread d4/dc/d18/f34 [0,4194304] 0 2024-09-16T02:05:49.052 INFO:tasks.workunit.client.1.smithi165.stdout:6/363: mkdir d7/dc/df/d5b 0 2024-09-16T02:05:49.054 INFO:tasks.workunit.client.0.smithi110.stdout:7/109: symlink d3/d15/l1f 0 2024-09-16T02:05:49.054 INFO:tasks.workunit.client.1.smithi165.stdout:9/429: symlink d7/df/d37/d65/l8b 0 2024-09-16T02:05:49.055 INFO:tasks.workunit.client.0.smithi110.stdout:7/110: write d3/da/fe [1136135,1469] 0 2024-09-16T02:05:49.055 INFO:tasks.workunit.client.0.smithi110.stdout:4/49: getdents d4 0 2024-09-16T02:05:49.056 INFO:tasks.workunit.client.0.smithi110.stdout:7/111: stat d3/da/fe 0 2024-09-16T02:05:49.056 INFO:tasks.workunit.client.1.smithi165.stdout:3/468: rename da/d17/d78/d2c/c2f to da/d57/caa 0 2024-09-16T02:05:49.062 INFO:tasks.workunit.client.1.smithi165.stdout:0/360: sync 2024-09-16T02:05:49.063 INFO:tasks.workunit.client.1.smithi165.stdout:8/406: mknod dd/d11/d14/d3f/d25/d36/d81/c8e 0 2024-09-16T02:05:49.066 INFO:tasks.workunit.client.1.smithi165.stdout:5/370: dread fa [0,4194304] 0 2024-09-16T02:05:49.067 INFO:tasks.workunit.client.1.smithi165.stdout:5/371: dread - de/d19/d1c/d49/f73 zero size 2024-09-16T02:05:49.069 INFO:tasks.workunit.client.0.smithi110.stdout:5/142: symlink d5/dd/df/d28/l2d 0 2024-09-16T02:05:49.070 INFO:tasks.workunit.client.1.smithi165.stdout:2/431: write df/f16 [1963440,111053] 0 2024-09-16T02:05:49.070 INFO:tasks.workunit.client.1.smithi165.stdout:7/342: chown d0/df/d42/c53 506 1 2024-09-16T02:05:49.071 INFO:tasks.workunit.client.0.smithi110.stdout:9/76: dwrite d1/fc [0,4194304] 0 2024-09-16T02:05:49.072 INFO:tasks.workunit.client.1.smithi165.stdout:4/341: fsync d4/dc/d20/f27 0 2024-09-16T02:05:49.074 INFO:tasks.workunit.client.0.smithi110.stdout:5/143: dread d5/dd/f10 [0,4194304] 0 2024-09-16T02:05:49.075 INFO:tasks.workunit.client.0.smithi110.stdout:5/144: fsync d5/dd/df/f1c 0 2024-09-16T02:05:49.078 INFO:tasks.workunit.client.0.smithi110.stdout:4/50: rename d4/fb to d4/f10 0 2024-09-16T02:05:49.078 INFO:tasks.workunit.client.0.smithi110.stdout:3/111: link f2 d8/dc/d1b/d1c/f1f 0 2024-09-16T02:05:49.080 INFO:tasks.workunit.client.0.smithi110.stdout:8/133: link c0 d3/c30 0 2024-09-16T02:05:49.080 INFO:tasks.workunit.client.0.smithi110.stdout:7/112: dread f1 [0,4194304] 0 2024-09-16T02:05:49.081 INFO:tasks.workunit.client.1.smithi165.stdout:6/364: dwrite d7/d17/d24/f51 [0,4194304] 0 2024-09-16T02:05:49.081 INFO:tasks.workunit.client.0.smithi110.stdout:7/113: fsync d3/f19 0 2024-09-16T02:05:49.082 INFO:tasks.workunit.client.1.smithi165.stdout:6/365: write d7/dc/df/d1a/f47 [1036703,87698] 0 2024-09-16T02:05:49.082 INFO:tasks.workunit.client.0.smithi110.stdout:7/114: write d3/da/fc [419595,29236] 0 2024-09-16T02:05:49.082 INFO:tasks.workunit.client.1.smithi165.stdout:8/407: rmdir dd/d11/d14/d70/d7b 39 2024-09-16T02:05:49.084 INFO:tasks.workunit.client.0.smithi110.stdout:7/115: write d3/f7 [1206291,2366] 0 2024-09-16T02:05:49.085 INFO:tasks.workunit.client.0.smithi110.stdout:7/116: chown d3/da/cb 107540 1 2024-09-16T02:05:49.087 INFO:tasks.workunit.client.0.smithi110.stdout:9/77: symlink d1/l19 0 2024-09-16T02:05:49.088 INFO:tasks.workunit.client.0.smithi110.stdout:5/145: creat d5/dd/df/f2e x:0 0 0 2024-09-16T02:05:49.089 INFO:tasks.workunit.client.1.smithi165.stdout:8/408: dwrite dd/d11/d38/f3c [0,4194304] 0 2024-09-16T02:05:49.091 INFO:tasks.workunit.client.0.smithi110.stdout:3/112: rmdir d8/dc 39 2024-09-16T02:05:49.091 INFO:tasks.workunit.client.0.smithi110.stdout:9/78: write d1/fc [1158640,30182] 0 2024-09-16T02:05:49.092 INFO:tasks.workunit.client.0.smithi110.stdout:5/146: dread - d5/dd/df/d11/f26 zero size 2024-09-16T02:05:49.094 INFO:tasks.workunit.client.0.smithi110.stdout:3/113: write d8/f15 [315286,62198] 0 2024-09-16T02:05:49.095 INFO:tasks.workunit.client.1.smithi165.stdout:4/342: creat d4/dc/d28/d2b/f6d x:0 0 0 2024-09-16T02:05:49.095 INFO:tasks.workunit.client.0.smithi110.stdout:4/51: rename d4/f6 to d4/f11 0 2024-09-16T02:05:49.095 INFO:tasks.workunit.client.0.smithi110.stdout:3/114: stat d8/fb 0 2024-09-16T02:05:49.096 INFO:tasks.workunit.client.1.smithi165.stdout:4/343: read - d4/dc/d20/f6a zero size 2024-09-16T02:05:49.100 INFO:tasks.workunit.client.0.smithi110.stdout:7/117: dwrite d3/f19 [0,4194304] 0 2024-09-16T02:05:49.101 INFO:tasks.workunit.client.1.smithi165.stdout:1/337: sync 2024-09-16T02:05:49.101 INFO:tasks.workunit.client.1.smithi165.stdout:1/338: stat d1/d19/d24/d30 0 2024-09-16T02:05:49.102 INFO:tasks.workunit.client.0.smithi110.stdout:7/118: truncate d3/d15/f1c 1517524 0 2024-09-16T02:05:49.103 INFO:tasks.workunit.client.1.smithi165.stdout:6/366: mknod d7/d17/d24/c5c 0 2024-09-16T02:05:49.110 INFO:tasks.workunit.client.0.smithi110.stdout:7/119: dwrite d3/f14 [0,4194304] 0 2024-09-16T02:05:49.111 INFO:tasks.workunit.client.0.smithi110.stdout:0/128: getdents d3 0 2024-09-16T02:05:49.112 INFO:tasks.workunit.client.1.smithi165.stdout:7/343: creat d0/df/d68/f6c x:0 0 0 2024-09-16T02:05:49.120 INFO:tasks.workunit.client.0.smithi110.stdout:5/147: rmdir d5/dd 39 2024-09-16T02:05:49.122 INFO:tasks.workunit.client.1.smithi165.stdout:8/409: mknod dd/d11/d14/d3f/d25/d36/d4f/c8f 0 2024-09-16T02:05:49.123 INFO:tasks.workunit.client.1.smithi165.stdout:9/430: link d7/df/l51 d7/d87/l8c 0 2024-09-16T02:05:49.124 INFO:tasks.workunit.client.1.smithi165.stdout:9/431: chown d7/d32/c5a 16353 1 2024-09-16T02:05:49.126 INFO:tasks.workunit.client.0.smithi110.stdout:4/52: write d4/f11 [423780,83284] 0 2024-09-16T02:05:49.128 INFO:tasks.workunit.client.0.smithi110.stdout:4/53: write d4/d8/fe [173310,107953] 0 2024-09-16T02:05:49.128 INFO:tasks.workunit.client.1.smithi165.stdout:3/469: rename da/d9b to da/d17/d7a/dab 0 2024-09-16T02:05:49.130 INFO:tasks.workunit.client.0.smithi110.stdout:6/159: link d0/d2/d5/c8 d0/d2/d5/c28 0 2024-09-16T02:05:49.131 INFO:tasks.workunit.client.0.smithi110.stdout:9/79: dwrite d1/d5/fb [0,4194304] 0 2024-09-16T02:05:49.133 INFO:tasks.workunit.client.1.smithi165.stdout:6/367: mkdir d7/dc/d3b/d3a/d3d/d5d 0 2024-09-16T02:05:49.135 INFO:tasks.workunit.client.0.smithi110.stdout:7/120: mknod d3/da/d10/d11/c20 0 2024-09-16T02:05:49.136 INFO:tasks.workunit.client.0.smithi110.stdout:6/160: read d0/d2/dc/ff [1103312,85040] 0 2024-09-16T02:05:49.136 INFO:tasks.workunit.client.0.smithi110.stdout:7/121: dread - d3/da/fd zero size 2024-09-16T02:05:49.138 INFO:tasks.workunit.client.0.smithi110.stdout:9/80: dread d1/d5/fb [0,4194304] 0 2024-09-16T02:05:49.141 INFO:tasks.workunit.client.0.smithi110.stdout:0/129: mknod d3/d4/dc/d14/c2d 0 2024-09-16T02:05:49.142 INFO:tasks.workunit.client.0.smithi110.stdout:9/81: dread d1/f3 [0,4194304] 0 2024-09-16T02:05:49.143 INFO:tasks.workunit.client.1.smithi165.stdout:2/432: creat df/d23/f84 x:0 0 0 2024-09-16T02:05:49.145 INFO:tasks.workunit.client.0.smithi110.stdout:0/130: dread d3/f16 [0,4194304] 0 2024-09-16T02:05:49.145 INFO:tasks.workunit.client.0.smithi110.stdout:0/131: read d3/f1b [1312280,101628] 0 2024-09-16T02:05:49.146 INFO:tasks.workunit.client.0.smithi110.stdout:3/115: mknod d8/c20 0 2024-09-16T02:05:49.147 INFO:tasks.workunit.client.0.smithi110.stdout:3/116: read d8/f1e [5023339,70788] 0 2024-09-16T02:05:49.147 INFO:tasks.workunit.client.0.smithi110.stdout:0/132: fsync d3/d4/dc/d14/f19 0 2024-09-16T02:05:49.147 INFO:tasks.workunit.client.1.smithi165.stdout:4/344: mknod d4/d40/d4f/c6e 0 2024-09-16T02:05:49.148 INFO:tasks.workunit.client.0.smithi110.stdout:8/134: mkdir d3/d31 0 2024-09-16T02:05:49.150 INFO:tasks.workunit.client.1.smithi165.stdout:9/432: rename d7/d1d/f4e to d7/d32/d38/d53/d5c/f8d 0 2024-09-16T02:05:49.150 INFO:tasks.workunit.client.1.smithi165.stdout:9/433: write f4 [4028630,10984] 0 2024-09-16T02:05:49.152 INFO:tasks.workunit.client.1.smithi165.stdout:0/361: getdents d0/d1e/d39/d48 0 2024-09-16T02:05:49.154 INFO:tasks.workunit.client.1.smithi165.stdout:3/470: rmdir da/d57/d8d 39 2024-09-16T02:05:49.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/339: truncate d1/dd/f10 716839 0 2024-09-16T02:05:49.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/340: fdatasync d1/d22/f3d 0 2024-09-16T02:05:49.163 INFO:tasks.workunit.client.1.smithi165.stdout:5/372: getdents de 0 2024-09-16T02:05:49.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/82: creat d1/d5/f1a x:0 0 0 2024-09-16T02:05:49.164 INFO:tasks.workunit.client.1.smithi165.stdout:6/368: dwrite d7/f1e [0,4194304] 0 2024-09-16T02:05:49.164 INFO:tasks.workunit.client.1.smithi165.stdout:7/344: symlink d0/df/l6d 0 2024-09-16T02:05:49.165 INFO:tasks.workunit.client.1.smithi165.stdout:6/369: read - d7/f57 zero size 2024-09-16T02:05:49.165 INFO:tasks.workunit.client.1.smithi165.stdout:7/345: chown d0/df/d33/c35 7 1 2024-09-16T02:05:49.166 INFO:tasks.workunit.client.0.smithi110.stdout:5/148: creat d5/dd/df/d11/f2f x:0 0 0 2024-09-16T02:05:49.167 INFO:tasks.workunit.client.1.smithi165.stdout:2/433: fsync df/d23/d2a/f5c 0 2024-09-16T02:05:49.167 INFO:tasks.workunit.client.0.smithi110.stdout:5/149: write d5/f19 [181587,8344] 0 2024-09-16T02:05:49.169 INFO:tasks.workunit.client.1.smithi165.stdout:8/410: mknod dd/d7f/c90 0 2024-09-16T02:05:49.170 INFO:tasks.workunit.client.1.smithi165.stdout:8/411: chown dd/d11/d14/f19 2384 1 2024-09-16T02:05:49.171 INFO:tasks.workunit.client.1.smithi165.stdout:8/412: chown dd/d11/d14/d3f/c3e 22590 1 2024-09-16T02:05:49.172 INFO:tasks.workunit.client.1.smithi165.stdout:4/345: rename d4/c10 to d4/c6f 0 2024-09-16T02:05:49.173 INFO:tasks.workunit.client.0.smithi110.stdout:7/122: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:49.175 INFO:tasks.workunit.client.0.smithi110.stdout:7/123: chown d3/da/fc 6399137 1 2024-09-16T02:05:49.175 INFO:tasks.workunit.client.0.smithi110.stdout:3/117: truncate f3 2669924 0 2024-09-16T02:05:49.176 INFO:tasks.workunit.client.0.smithi110.stdout:7/124: chown d3/da/d10/d11/c20 252364 1 2024-09-16T02:05:49.177 INFO:tasks.workunit.client.0.smithi110.stdout:7/125: readlink d3/d15/l1f 0 2024-09-16T02:05:49.179 INFO:tasks.workunit.client.1.smithi165.stdout:0/362: fdatasync d0/fb 0 2024-09-16T02:05:49.183 INFO:tasks.workunit.client.1.smithi165.stdout:5/373: creat de/d19/d1c/d4d/f7a x:0 0 0 2024-09-16T02:05:49.185 INFO:tasks.workunit.client.0.smithi110.stdout:9/83: rename d1/dd/d13 to d1/d1b 0 2024-09-16T02:05:49.185 INFO:tasks.workunit.client.1.smithi165.stdout:6/370: symlink d7/dc/d3b/d3a/l5e 0 2024-09-16T02:05:49.187 INFO:tasks.workunit.client.0.smithi110.stdout:5/150: creat d5/dd/df/d28/f30 x:0 0 0 2024-09-16T02:05:49.191 INFO:tasks.workunit.client.1.smithi165.stdout:5/374: dread de/d21/d26/d3a/d54/f4c [4194304,4194304] 0 2024-09-16T02:05:49.191 INFO:tasks.workunit.client.0.smithi110.stdout:0/133: rename d3/d4/dc/d14/c22 to d3/d4/dc/d14/c2e 0 2024-09-16T02:05:49.193 INFO:tasks.workunit.client.0.smithi110.stdout:0/134: dread d3/d4/dc/d14/f19 [0,4194304] 0 2024-09-16T02:05:49.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/118: truncate f1 5225214 0 2024-09-16T02:05:49.194 INFO:tasks.workunit.client.0.smithi110.stdout:4/54: write d4/f10 [70698,9168] 0 2024-09-16T02:05:49.195 INFO:tasks.workunit.client.0.smithi110.stdout:0/135: truncate d3/d4/dc/d14/f19 55648 0 2024-09-16T02:05:49.196 INFO:tasks.workunit.client.1.smithi165.stdout:4/346: unlink d4/dc/d28/d2b/f60 0 2024-09-16T02:05:49.197 INFO:tasks.workunit.client.0.smithi110.stdout:7/126: symlink d3/d15/l21 0 2024-09-16T02:05:49.198 INFO:tasks.workunit.client.1.smithi165.stdout:9/434: symlink d7/d32/d38/d68/l8e 0 2024-09-16T02:05:49.200 INFO:tasks.workunit.client.1.smithi165.stdout:8/413: dwrite dd/d11/d14/d70/d7b/f84 [0,4194304] 0 2024-09-16T02:05:49.201 INFO:tasks.workunit.client.0.smithi110.stdout:5/151: mknod d5/dd/df/c31 0 2024-09-16T02:05:49.202 INFO:tasks.workunit.client.1.smithi165.stdout:1/341: symlink d1/dd/l69 0 2024-09-16T02:05:49.202 INFO:tasks.workunit.client.0.smithi110.stdout:8/135: mknod d3/d31/c32 0 2024-09-16T02:05:49.203 INFO:tasks.workunit.client.1.smithi165.stdout:2/434: write df/d23/f51 [992640,68703] 0 2024-09-16T02:05:49.203 INFO:tasks.workunit.client.0.smithi110.stdout:7/127: dwrite d3/f13 [4194304,4194304] 0 2024-09-16T02:05:49.205 INFO:tasks.workunit.client.0.smithi110.stdout:7/128: fsync d3/f14 0 2024-09-16T02:05:49.205 INFO:tasks.workunit.client.1.smithi165.stdout:7/346: creat d0/df/d65/f6e x:0 0 0 2024-09-16T02:05:49.206 INFO:tasks.workunit.client.0.smithi110.stdout:7/129: write d3/f9 [1648917,31315] 0 2024-09-16T02:05:49.207 INFO:tasks.workunit.client.1.smithi165.stdout:4/347: dwrite d4/dc/d28/d2b/d42/f69 [0,4194304] 0 2024-09-16T02:05:49.208 INFO:tasks.workunit.client.1.smithi165.stdout:5/375: write fa [2834734,16005] 0 2024-09-16T02:05:49.208 INFO:tasks.workunit.client.1.smithi165.stdout:4/348: fsync f1 0 2024-09-16T02:05:49.211 INFO:tasks.workunit.client.1.smithi165.stdout:4/349: dread - d4/dc/d20/f6a zero size 2024-09-16T02:05:49.212 INFO:tasks.workunit.client.0.smithi110.stdout:9/84: creat d1/d5/d8/de/f1c x:0 0 0 2024-09-16T02:05:49.213 INFO:tasks.workunit.client.0.smithi110.stdout:5/152: creat d5/dd/df/d11/f32 x:0 0 0 2024-09-16T02:05:49.214 INFO:tasks.workunit.client.1.smithi165.stdout:1/342: dread d1/f9 [0,4194304] 0 2024-09-16T02:05:49.216 INFO:tasks.workunit.client.0.smithi110.stdout:0/136: dwrite d3/d4/f11 [0,4194304] 0 2024-09-16T02:05:49.216 INFO:tasks.workunit.client.1.smithi165.stdout:4/350: chown d4/dc/d18/d37/d47/f61 36125 1 2024-09-16T02:05:49.218 INFO:tasks.workunit.client.1.smithi165.stdout:1/343: write d1/d19/d24/d30/f40 [2105437,42336] 0 2024-09-16T02:05:49.218 INFO:tasks.workunit.client.0.smithi110.stdout:5/153: write d5/f6 [1738824,103226] 0 2024-09-16T02:05:49.219 INFO:tasks.workunit.client.1.smithi165.stdout:0/363: symlink d0/d61/l81 0 2024-09-16T02:05:49.221 INFO:tasks.workunit.client.1.smithi165.stdout:1/344: dread - d1/d68/f66 zero size 2024-09-16T02:05:49.221 INFO:tasks.workunit.client.1.smithi165.stdout:5/376: dread de/f1d [0,4194304] 0 2024-09-16T02:05:49.221 INFO:tasks.workunit.client.1.smithi165.stdout:0/364: chown d0/d61/l81 2198 1 2024-09-16T02:05:49.222 INFO:tasks.workunit.client.0.smithi110.stdout:0/137: dread d3/d4/f11 [0,4194304] 0 2024-09-16T02:05:49.223 INFO:tasks.workunit.client.0.smithi110.stdout:5/154: chown d5/dd/df/d28/f30 579 1 2024-09-16T02:05:49.223 INFO:tasks.workunit.client.1.smithi165.stdout:5/377: readlink de/l1b 0 2024-09-16T02:05:49.223 INFO:tasks.workunit.client.0.smithi110.stdout:8/136: dread d3/f10 [0,4194304] 0 2024-09-16T02:05:49.224 INFO:tasks.workunit.client.1.smithi165.stdout:0/365: stat d0/d1e/d39/f7c 0 2024-09-16T02:05:49.224 INFO:tasks.workunit.client.0.smithi110.stdout:0/138: fdatasync d3/d4/dc/f1e 0 2024-09-16T02:05:49.226 INFO:tasks.workunit.client.1.smithi165.stdout:3/471: sync 2024-09-16T02:05:49.228 INFO:tasks.workunit.client.0.smithi110.stdout:4/55: dread d4/f11 [0,4194304] 0 2024-09-16T02:05:49.229 INFO:tasks.workunit.client.0.smithi110.stdout:9/85: rename d1/f7 to d1/d1b/f1d 0 2024-09-16T02:05:49.229 INFO:tasks.workunit.client.0.smithi110.stdout:4/56: chown d4/d8/cd 37 1 2024-09-16T02:05:49.237 INFO:tasks.workunit.client.1.smithi165.stdout:4/351: creat d4/dc/d18/d37/d47/f70 x:0 0 0 2024-09-16T02:05:49.238 INFO:tasks.workunit.client.1.smithi165.stdout:2/435: dread df/d23/f6e [0,4194304] 0 2024-09-16T02:05:49.238 INFO:tasks.workunit.client.1.smithi165.stdout:1/345: symlink d1/d19/d24/l6a 0 2024-09-16T02:05:49.239 INFO:tasks.workunit.client.0.smithi110.stdout:8/137: fsync d3/fd 0 2024-09-16T02:05:49.241 INFO:tasks.workunit.client.0.smithi110.stdout:5/155: symlink d5/dd/df/d28/l33 0 2024-09-16T02:05:49.243 INFO:tasks.workunit.client.1.smithi165.stdout:5/378: creat de/d21/d26/d3a/f7b x:0 0 0 2024-09-16T02:05:49.245 INFO:tasks.workunit.client.0.smithi110.stdout:0/139: mknod d3/d6/c2f 0 2024-09-16T02:05:49.246 INFO:tasks.workunit.client.1.smithi165.stdout:9/435: dread d7/df/f1c [0,4194304] 0 2024-09-16T02:05:49.246 INFO:tasks.workunit.client.1.smithi165.stdout:8/414: rename dd/d13/c57 to dd/d11/d14/d3f/d25/d36/d4f/c91 0 2024-09-16T02:05:49.248 INFO:tasks.workunit.client.1.smithi165.stdout:6/371: getdents d7/dc/df/d1a 0 2024-09-16T02:05:49.249 INFO:tasks.workunit.client.0.smithi110.stdout:4/57: truncate f3 758174 0 2024-09-16T02:05:49.252 INFO:tasks.workunit.client.0.smithi110.stdout:0/140: dwrite d3/d4/dc/f1e [0,4194304] 0 2024-09-16T02:05:49.253 INFO:tasks.workunit.client.0.smithi110.stdout:0/141: read d3/f1a [74115,67210] 0 2024-09-16T02:05:49.253 INFO:tasks.workunit.client.1.smithi165.stdout:4/352: mkdir d4/dc/d18/d37/d47/d71 0 2024-09-16T02:05:49.254 INFO:tasks.workunit.client.1.smithi165.stdout:4/353: readlink d4/l1d 0 2024-09-16T02:05:49.254 INFO:tasks.workunit.client.0.smithi110.stdout:3/119: creat d8/dc/f21 x:0 0 0 2024-09-16T02:05:49.255 INFO:tasks.workunit.client.0.smithi110.stdout:7/130: creat d3/da/f22 x:0 0 0 2024-09-16T02:05:49.256 INFO:tasks.workunit.client.1.smithi165.stdout:2/436: symlink df/d23/d28/d3b/d6d/l85 0 2024-09-16T02:05:49.257 INFO:tasks.workunit.client.0.smithi110.stdout:7/131: write d3/d15/f1c [125480,104417] 0 2024-09-16T02:05:49.261 INFO:tasks.workunit.client.0.smithi110.stdout:7/132: dread d3/d15/f1c [0,4194304] 0 2024-09-16T02:05:49.262 INFO:tasks.workunit.client.1.smithi165.stdout:0/366: truncate d0/d1e/d20/f46 4196482 0 2024-09-16T02:05:49.262 INFO:tasks.workunit.client.0.smithi110.stdout:7/133: write d3/da/fe [2024424,37584] 0 2024-09-16T02:05:49.263 INFO:tasks.workunit.client.0.smithi110.stdout:5/156: mknod d5/dd/c34 0 2024-09-16T02:05:49.263 INFO:tasks.workunit.client.1.smithi165.stdout:2/437: dwrite df/d23/f51 [0,4194304] 0 2024-09-16T02:05:49.263 INFO:tasks.workunit.client.0.smithi110.stdout:5/157: readlink d5/l24 0 2024-09-16T02:05:49.264 INFO:tasks.workunit.client.0.smithi110.stdout:5/158: stat d5/f1e 0 2024-09-16T02:05:49.264 INFO:tasks.workunit.client.1.smithi165.stdout:9/436: mkdir d7/d32/d38/d53/d5c/d61/d8f 0 2024-09-16T02:05:49.265 INFO:tasks.workunit.client.1.smithi165.stdout:2/438: dread - df/d23/f84 zero size 2024-09-16T02:05:49.265 INFO:tasks.workunit.client.1.smithi165.stdout:9/437: write d7/d32/f39 [1377004,77361] 0 2024-09-16T02:05:49.267 INFO:tasks.workunit.client.1.smithi165.stdout:2/439: write df/d10/d37/f74 [118136,107020] 0 2024-09-16T02:05:49.267 INFO:tasks.workunit.client.1.smithi165.stdout:8/415: symlink dd/d11/d14/d3f/d25/d36/d4f/l92 0 2024-09-16T02:05:49.269 INFO:tasks.workunit.client.0.smithi110.stdout:4/58: mkdir d4/d12 0 2024-09-16T02:05:49.270 INFO:tasks.workunit.client.1.smithi165.stdout:2/440: write df/d10/d1a/d2d/f78 [140199,5417] 0 2024-09-16T02:05:49.271 INFO:tasks.workunit.client.1.smithi165.stdout:8/416: chown dd/d11/d14/d3f/d25/l7e 83 1 2024-09-16T02:05:49.271 INFO:tasks.workunit.client.1.smithi165.stdout:6/372: write d7/f9 [4853144,83108] 0 2024-09-16T02:05:49.271 INFO:tasks.workunit.client.1.smithi165.stdout:5/379: dread f6 [0,4194304] 0 2024-09-16T02:05:49.274 INFO:tasks.workunit.client.0.smithi110.stdout:5/159: dwrite d5/dd/df/d11/f2f [0,4194304] 0 2024-09-16T02:05:49.274 INFO:tasks.workunit.client.0.smithi110.stdout:0/142: write d3/f16 [3234202,67813] 0 2024-09-16T02:05:49.275 INFO:tasks.workunit.client.1.smithi165.stdout:9/438: dwrite f2 [0,4194304] 0 2024-09-16T02:05:49.276 INFO:tasks.workunit.client.0.smithi110.stdout:5/160: write d5/f6 [2206907,56776] 0 2024-09-16T02:05:49.277 INFO:tasks.workunit.client.1.smithi165.stdout:5/380: truncate de/d19/d1c/d4d/f72 658718 0 2024-09-16T02:05:49.278 INFO:tasks.workunit.client.0.smithi110.stdout:9/86: write d1/fc [3782601,7319] 0 2024-09-16T02:05:49.279 INFO:tasks.workunit.client.1.smithi165.stdout:4/354: creat d4/dc/d20/d4e/f72 x:0 0 0 2024-09-16T02:05:49.280 INFO:tasks.workunit.client.0.smithi110.stdout:9/87: truncate d1/f3 5002189 0 2024-09-16T02:05:49.281 INFO:tasks.workunit.client.1.smithi165.stdout:5/381: read - de/d19/d1c/d4d/f7a zero size 2024-09-16T02:05:49.282 INFO:tasks.workunit.client.0.smithi110.stdout:9/88: fsync d1/dd/f10 0 2024-09-16T02:05:49.282 INFO:tasks.workunit.client.0.smithi110.stdout:0/143: dread d3/d4/f23 [0,4194304] 0 2024-09-16T02:05:49.284 INFO:tasks.workunit.client.1.smithi165.stdout:2/441: dwrite df/d23/f84 [0,4194304] 0 2024-09-16T02:05:49.285 INFO:tasks.workunit.client.1.smithi165.stdout:9/439: dread d7/df/d37/f3b [0,4194304] 0 2024-09-16T02:05:49.285 INFO:tasks.workunit.client.0.smithi110.stdout:8/138: mkdir d3/d2b/d33 0 2024-09-16T02:05:49.288 INFO:tasks.workunit.client.1.smithi165.stdout:0/367: unlink d0/d1e/d39/d48/l64 0 2024-09-16T02:05:49.289 INFO:tasks.workunit.client.0.smithi110.stdout:7/134: mknod d3/d15/c23 0 2024-09-16T02:05:49.290 INFO:tasks.workunit.client.0.smithi110.stdout:7/135: read - d3/da/f22 zero size 2024-09-16T02:05:49.294 INFO:tasks.workunit.client.1.smithi165.stdout:3/472: dwrite da/d17/d78/d2c/f70 [0,4194304] 0 2024-09-16T02:05:49.296 INFO:tasks.workunit.client.1.smithi165.stdout:2/442: dwrite df/d23/d28/d3b/f56 [0,4194304] 0 2024-09-16T02:05:49.297 INFO:tasks.workunit.client.0.smithi110.stdout:7/136: dwrite d3/f19 [0,4194304] 0 2024-09-16T02:05:49.302 INFO:tasks.workunit.client.1.smithi165.stdout:6/373: mkdir d7/dc/df/d1a/d4d/d5f 0 2024-09-16T02:05:49.304 INFO:tasks.workunit.client.1.smithi165.stdout:8/417: fsync dd/d11/d14/d3f/f35 0 2024-09-16T02:05:49.305 INFO:tasks.workunit.client.1.smithi165.stdout:8/418: write dd/d13/f32 [4186489,3324] 0 2024-09-16T02:05:49.307 INFO:tasks.workunit.client.1.smithi165.stdout:8/419: chown dd/d13/d53/c5c 761 1 2024-09-16T02:05:49.307 INFO:tasks.workunit.client.1.smithi165.stdout:8/420: readlink dd/d34/l82 0 2024-09-16T02:05:49.310 INFO:tasks.workunit.client.0.smithi110.stdout:5/161: creat d5/dd/df/f35 x:0 0 0 2024-09-16T02:05:49.311 INFO:tasks.workunit.client.1.smithi165.stdout:4/355: mkdir d4/dc/d20/d4e/d73 0 2024-09-16T02:05:49.318 INFO:tasks.workunit.client.0.smithi110.stdout:3/120: truncate d8/f9 1071598 0 2024-09-16T02:05:49.319 INFO:tasks.workunit.client.0.smithi110.stdout:3/121: dread - d8/f17 zero size 2024-09-16T02:05:49.319 INFO:tasks.workunit.client.0.smithi110.stdout:0/144: mknod d3/d4/dc/d10/c30 0 2024-09-16T02:05:49.321 INFO:tasks.workunit.client.0.smithi110.stdout:0/145: truncate d3/d4/dc/d14/f19 1096889 0 2024-09-16T02:05:49.321 INFO:tasks.workunit.client.0.smithi110.stdout:8/139: rmdir d3/d2b 39 2024-09-16T02:05:49.322 INFO:tasks.workunit.client.0.smithi110.stdout:7/137: fdatasync d3/f19 0 2024-09-16T02:05:49.323 INFO:tasks.workunit.client.1.smithi165.stdout:7/347: rename d0/df/lc to d0/df/d33/l6f 0 2024-09-16T02:05:49.324 INFO:tasks.workunit.client.1.smithi165.stdout:7/348: dread - d0/d4b/f5d zero size 2024-09-16T02:05:49.326 INFO:tasks.workunit.client.0.smithi110.stdout:4/59: creat d4/d12/f13 x:0 0 0 2024-09-16T02:05:49.326 INFO:tasks.workunit.client.1.smithi165.stdout:2/443: rmdir df/d23/d2a 39 2024-09-16T02:05:49.328 INFO:tasks.workunit.client.1.smithi165.stdout:1/346: getdents d1/dd/d11/d33 0 2024-09-16T02:05:49.329 INFO:tasks.workunit.client.1.smithi165.stdout:1/347: chown d1/dd/d11/d33/f56 367735474 1 2024-09-16T02:05:49.329 INFO:tasks.workunit.client.1.smithi165.stdout:6/374: chown d7/d1f/l36 5931 1 2024-09-16T02:05:49.330 INFO:tasks.workunit.client.0.smithi110.stdout:7/138: dwrite d3/f9 [4194304,4194304] 0 2024-09-16T02:05:49.330 INFO:tasks.workunit.client.1.smithi165.stdout:6/375: write d7/f9 [3004817,54986] 0 2024-09-16T02:05:49.331 INFO:tasks.workunit.client.0.smithi110.stdout:7/139: read d3/da/fe [1097361,14983] 0 2024-09-16T02:05:49.333 INFO:tasks.workunit.client.0.smithi110.stdout:7/140: write d3/f13 [8605065,27197] 0 2024-09-16T02:05:49.334 INFO:tasks.workunit.client.0.smithi110.stdout:7/141: fdatasync d3/da/fc 0 2024-09-16T02:05:49.335 INFO:tasks.workunit.client.1.smithi165.stdout:6/376: fdatasync d7/f9 0 2024-09-16T02:05:49.340 INFO:tasks.workunit.client.1.smithi165.stdout:5/382: fsync de/d21/d26/d3a/f3c 0 2024-09-16T02:05:49.340 INFO:tasks.workunit.client.0.smithi110.stdout:8/140: readlink d3/d12/d1a/l25 0 2024-09-16T02:05:49.341 INFO:tasks.workunit.client.1.smithi165.stdout:0/368: stat d0/d1e/d39/d48/d45/f60 0 2024-09-16T02:05:49.342 INFO:tasks.workunit.client.1.smithi165.stdout:7/349: creat d0/df/d68/f70 x:0 0 0 2024-09-16T02:05:49.343 INFO:tasks.workunit.client.0.smithi110.stdout:4/60: creat d4/f14 x:0 0 0 2024-09-16T02:05:49.344 INFO:tasks.workunit.client.1.smithi165.stdout:7/350: stat d0/df/d33/d2a/f4d 0 2024-09-16T02:05:49.344 INFO:tasks.workunit.client.1.smithi165.stdout:8/421: dwrite dd/d11/f5f [0,4194304] 0 2024-09-16T02:05:49.344 INFO:tasks.workunit.client.1.smithi165.stdout:7/351: chown d0/d4b 237595 1 2024-09-16T02:05:49.346 INFO:tasks.workunit.client.1.smithi165.stdout:1/348: mkdir d1/d6b 0 2024-09-16T02:05:49.351 INFO:tasks.workunit.client.0.smithi110.stdout:4/61: dwrite d4/f14 [0,4194304] 0 2024-09-16T02:05:49.356 INFO:tasks.workunit.client.1.smithi165.stdout:5/383: rename de/l13 to de/d19/d67/l7c 0 2024-09-16T02:05:49.356 INFO:tasks.workunit.client.0.smithi110.stdout:9/89: dwrite f0 [0,4194304] 0 2024-09-16T02:05:49.356 INFO:tasks.workunit.client.0.smithi110.stdout:1/109: sync 2024-09-16T02:05:49.362 INFO:tasks.workunit.client.1.smithi165.stdout:2/444: mkdir df/d23/d2a/d86 0 2024-09-16T02:05:49.364 INFO:tasks.workunit.client.0.smithi110.stdout:5/162: truncate f4 368166 0 2024-09-16T02:05:49.369 INFO:tasks.workunit.client.0.smithi110.stdout:4/62: creat d4/f15 x:0 0 0 2024-09-16T02:05:49.370 INFO:tasks.workunit.client.1.smithi165.stdout:6/377: symlink d7/dc/d3b/l60 0 2024-09-16T02:05:49.370 INFO:tasks.workunit.client.1.smithi165.stdout:9/440: link d7/d1d/l1e d7/d32/d38/d68/l90 0 2024-09-16T02:05:49.370 INFO:tasks.workunit.client.1.smithi165.stdout:2/445: dread df/d23/f51 [0,4194304] 0 2024-09-16T02:05:49.371 INFO:tasks.workunit.client.0.smithi110.stdout:3/122: creat d8/f22 x:0 0 0 2024-09-16T02:05:49.372 INFO:tasks.workunit.client.1.smithi165.stdout:6/378: fdatasync d7/dc/df/d1a/f4f 0 2024-09-16T02:05:49.372 INFO:tasks.workunit.client.0.smithi110.stdout:3/123: chown d8/c14 114 1 2024-09-16T02:05:49.372 INFO:tasks.workunit.client.0.smithi110.stdout:3/124: chown d8/dc/c1a 0 1 2024-09-16T02:05:49.373 INFO:tasks.workunit.client.1.smithi165.stdout:7/352: dwrite d0/d2c/f3b [0,4194304] 0 2024-09-16T02:05:49.373 INFO:tasks.workunit.client.0.smithi110.stdout:9/90: unlink d1/d5/d8/c11 0 2024-09-16T02:05:49.373 INFO:tasks.workunit.client.1.smithi165.stdout:6/379: write f2 [3823281,71176] 0 2024-09-16T02:05:49.374 INFO:tasks.workunit.client.1.smithi165.stdout:6/380: truncate d7/f57 617481 0 2024-09-16T02:05:49.375 INFO:tasks.workunit.client.1.smithi165.stdout:8/422: rename dd/d7f/c90 to dd/d13/d53/c93 0 2024-09-16T02:05:49.376 INFO:tasks.workunit.client.0.smithi110.stdout:0/146: link d3/l24 d3/d4/dc/l31 0 2024-09-16T02:05:49.377 INFO:tasks.workunit.client.0.smithi110.stdout:0/147: chown d3/d6 378245084 1 2024-09-16T02:05:49.382 INFO:tasks.workunit.client.1.smithi165.stdout:8/423: dwrite dd/d34/f4d [0,4194304] 0 2024-09-16T02:05:49.383 INFO:tasks.workunit.client.0.smithi110.stdout:9/91: dwrite d1/d5/f18 [0,4194304] 0 2024-09-16T02:05:49.384 INFO:tasks.workunit.client.1.smithi165.stdout:8/424: write dd/d11/d38/f3c [3490073,124899] 0 2024-09-16T02:05:49.385 INFO:tasks.workunit.client.0.smithi110.stdout:8/141: rename d3/cb to d3/d12/d1d/c34 0 2024-09-16T02:05:49.386 INFO:tasks.workunit.client.0.smithi110.stdout:9/92: rename d1 to d1/d1e 22 2024-09-16T02:05:49.387 INFO:tasks.workunit.client.1.smithi165.stdout:3/473: sync 2024-09-16T02:05:49.389 INFO:tasks.workunit.client.0.smithi110.stdout:0/148: dwrite d3/f16 [0,4194304] 0 2024-09-16T02:05:49.389 INFO:tasks.workunit.client.0.smithi110.stdout:7/142: link d3/lf d3/da/d10/l24 0 2024-09-16T02:05:49.389 INFO:tasks.workunit.client.1.smithi165.stdout:2/446: stat df/d23/d66/f7d 0 2024-09-16T02:05:49.390 INFO:tasks.workunit.client.1.smithi165.stdout:1/349: dwrite d1/dd/d11/d33/f4b [0,4194304] 0 2024-09-16T02:05:49.391 INFO:tasks.workunit.client.0.smithi110.stdout:0/149: write d3/d4/dc/d14/f19 [414763,26612] 0 2024-09-16T02:05:49.392 INFO:tasks.workunit.client.0.smithi110.stdout:0/150: write d3/f16 [404845,48274] 0 2024-09-16T02:05:49.392 INFO:tasks.workunit.client.1.smithi165.stdout:4/356: sync 2024-09-16T02:05:49.397 INFO:tasks.workunit.client.1.smithi165.stdout:9/441: creat d7/d32/d38/d53/d5c/d61/f91 x:0 0 0 2024-09-16T02:05:49.399 INFO:tasks.workunit.client.1.smithi165.stdout:7/353: write d0/df/d42/f5e [625580,47201] 0 2024-09-16T02:05:49.399 INFO:tasks.workunit.client.1.smithi165.stdout:3/474: dwrite da/f9d [0,4194304] 0 2024-09-16T02:05:49.400 INFO:tasks.workunit.client.1.smithi165.stdout:9/442: chown d7/d32/d38/d53/d5c/f81 1969164383 1 2024-09-16T02:05:49.401 INFO:tasks.workunit.client.1.smithi165.stdout:9/443: write f5 [5671464,127636] 0 2024-09-16T02:05:49.402 INFO:tasks.workunit.client.0.smithi110.stdout:1/110: dwrite d0/f14 [0,4194304] 0 2024-09-16T02:05:49.402 INFO:tasks.workunit.client.1.smithi165.stdout:0/369: mkdir d0/d1e/d39/d48/d5f/d82 0 2024-09-16T02:05:49.405 INFO:tasks.workunit.client.0.smithi110.stdout:5/163: mkdir d5/d36 0 2024-09-16T02:05:49.406 INFO:tasks.workunit.client.0.smithi110.stdout:9/93: mkdir d1/d5/d8/de/d1f 0 2024-09-16T02:05:49.406 INFO:tasks.workunit.client.0.smithi110.stdout:7/143: symlink d3/da/d10/l25 0 2024-09-16T02:05:49.409 INFO:tasks.workunit.client.1.smithi165.stdout:8/425: rename dd/d11/d14/d3f/d25/d36/d4f/d75 to dd/d62/d94 0 2024-09-16T02:05:49.411 INFO:tasks.workunit.client.1.smithi165.stdout:9/444: dwrite d7/d1d/f72 [0,4194304] 0 2024-09-16T02:05:49.413 INFO:tasks.workunit.client.0.smithi110.stdout:8/142: dwrite d3/f2a [0,4194304] 0 2024-09-16T02:05:49.415 INFO:tasks.workunit.client.1.smithi165.stdout:1/350: mkdir d1/dd/d11/d33/d3f/d6c 0 2024-09-16T02:05:49.416 INFO:tasks.workunit.client.1.smithi165.stdout:1/351: chown d1/d19/d24/c2f 512003128 1 2024-09-16T02:05:49.417 INFO:tasks.workunit.client.1.smithi165.stdout:1/352: chown d1/dd/f14 484678833 1 2024-09-16T02:05:49.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/381: getdents d7/dc/df/d1a/d4d/d5f 0 2024-09-16T02:05:49.425 INFO:tasks.workunit.client.1.smithi165.stdout:0/370: write d0/d1e/d20/f7f [793641,32301] 0 2024-09-16T02:05:49.426 INFO:tasks.workunit.client.0.smithi110.stdout:7/144: creat d3/f26 x:0 0 0 2024-09-16T02:05:49.428 INFO:tasks.workunit.client.1.smithi165.stdout:7/354: rename d0/df/c2d to d0/df/d68/c71 0 2024-09-16T02:05:49.429 INFO:tasks.workunit.client.1.smithi165.stdout:7/355: stat d0/d3d 0 2024-09-16T02:05:49.430 INFO:tasks.workunit.client.1.smithi165.stdout:7/356: write d0/d4b/f5d [694039,119046] 0 2024-09-16T02:05:49.430 INFO:tasks.workunit.client.0.smithi110.stdout:9/94: mkdir d1/d5/d20 0 2024-09-16T02:05:49.431 INFO:tasks.workunit.client.0.smithi110.stdout:9/95: fsync d1/fc 0 2024-09-16T02:05:49.432 INFO:tasks.workunit.client.0.smithi110.stdout:8/143: chown d3/lc 16595261 1 2024-09-16T02:05:49.434 INFO:tasks.workunit.client.0.smithi110.stdout:4/63: truncate d4/d8/fe 230655 0 2024-09-16T02:05:49.435 INFO:tasks.workunit.client.1.smithi165.stdout:9/445: mkdir d7/df/d67/d92 0 2024-09-16T02:05:49.440 INFO:tasks.workunit.client.1.smithi165.stdout:6/382: symlink d7/dc/d3b/d3a/l61 0 2024-09-16T02:05:49.441 INFO:tasks.workunit.client.0.smithi110.stdout:5/164: getdents d5/d36 0 2024-09-16T02:05:49.441 INFO:tasks.workunit.client.0.smithi110.stdout:7/145: rmdir d3/da/d10 39 2024-09-16T02:05:49.441 INFO:tasks.workunit.client.1.smithi165.stdout:3/475: dread da/de/f21 [0,4194304] 0 2024-09-16T02:05:49.441 INFO:tasks.workunit.client.1.smithi165.stdout:7/357: mkdir d0/df/d33/d2a/d72 0 2024-09-16T02:05:49.442 INFO:tasks.workunit.client.1.smithi165.stdout:7/358: write d0/f12 [7131535,13060] 0 2024-09-16T02:05:49.442 INFO:tasks.workunit.client.1.smithi165.stdout:9/446: dwrite d7/d14/f6c [0,4194304] 0 2024-09-16T02:05:49.445 INFO:tasks.workunit.client.1.smithi165.stdout:7/359: dread - d0/df/d33/d2a/f4d zero size 2024-09-16T02:05:49.445 INFO:tasks.workunit.client.1.smithi165.stdout:3/476: creat da/d20/d26/d52/fac x:0 0 0 2024-09-16T02:05:49.446 INFO:tasks.workunit.client.1.smithi165.stdout:5/384: link de/l1b de/d21/d26/l7d 0 2024-09-16T02:05:49.446 INFO:tasks.workunit.client.1.smithi165.stdout:1/353: dread d1/d19/d24/d30/f40 [0,4194304] 0 2024-09-16T02:05:49.447 INFO:tasks.workunit.client.1.smithi165.stdout:9/447: mkdir d7/df/d67/d92/d93 0 2024-09-16T02:05:49.449 INFO:tasks.workunit.client.1.smithi165.stdout:7/360: creat d0/d4b/d58/f73 x:0 0 0 2024-09-16T02:05:49.449 INFO:tasks.workunit.client.1.smithi165.stdout:3/477: fsync da/d17/f4a 0 2024-09-16T02:05:49.453 INFO:tasks.workunit.client.0.smithi110.stdout:4/64: dwrite d4/f10 [0,4194304] 0 2024-09-16T02:05:49.454 INFO:tasks.workunit.client.0.smithi110.stdout:7/146: write d3/f19 [4711605,77538] 0 2024-09-16T02:05:49.454 INFO:tasks.workunit.client.1.smithi165.stdout:1/354: dwrite d1/d68/f64 [0,4194304] 0 2024-09-16T02:05:49.456 INFO:tasks.workunit.client.1.smithi165.stdout:9/448: dwrite d7/d32/d38/d53/d5c/f81 [0,4194304] 0 2024-09-16T02:05:49.456 INFO:tasks.workunit.client.1.smithi165.stdout:7/361: rename d0/df/d33/d2a/l61 to d0/d4b/l74 0 2024-09-16T02:05:49.459 INFO:tasks.workunit.client.1.smithi165.stdout:7/362: chown d0/df/d33/d2a/c45 32424091 1 2024-09-16T02:05:49.460 INFO:tasks.workunit.client.1.smithi165.stdout:1/355: chown d1/dd/d11/d33/d35/l41 18706 1 2024-09-16T02:05:49.460 INFO:tasks.workunit.client.1.smithi165.stdout:7/363: readlink d0/df/l2b 0 2024-09-16T02:05:49.462 INFO:tasks.workunit.client.0.smithi110.stdout:7/147: write d3/f8 [226870,72987] 0 2024-09-16T02:05:49.462 INFO:tasks.workunit.client.0.smithi110.stdout:3/125: dwrite d8/f9 [0,4194304] 0 2024-09-16T02:05:49.463 INFO:tasks.workunit.client.1.smithi165.stdout:5/385: rename de/d21/d26/d3a/d54/f4c to de/d19/d1c/d4d/f7e 0 2024-09-16T02:05:49.466 INFO:tasks.workunit.client.1.smithi165.stdout:8/426: write dd/d11/d14/d70/f73 [491990,52826] 0 2024-09-16T02:05:49.467 INFO:tasks.workunit.client.0.smithi110.stdout:5/165: dwrite d5/dd/df/d11/f32 [0,4194304] 0 2024-09-16T02:05:49.469 INFO:tasks.workunit.client.0.smithi110.stdout:5/166: chown d5/dd/df/d11 462 1 2024-09-16T02:05:49.471 INFO:tasks.workunit.client.0.smithi110.stdout:1/111: truncate d0/d1/d4/f18 2392652 0 2024-09-16T02:05:49.472 INFO:tasks.workunit.client.0.smithi110.stdout:8/144: rename d3/d12/d1d/c24 to d3/c35 0 2024-09-16T02:05:49.474 INFO:tasks.workunit.client.1.smithi165.stdout:9/449: symlink d7/df/l94 0 2024-09-16T02:05:49.474 INFO:tasks.workunit.client.0.smithi110.stdout:1/112: write d0/da/f15 [2046972,124287] 0 2024-09-16T02:05:49.475 INFO:tasks.workunit.client.0.smithi110.stdout:3/126: dread d8/f15 [0,4194304] 0 2024-09-16T02:05:49.476 INFO:tasks.workunit.client.0.smithi110.stdout:9/96: getdents d1/d1b 0 2024-09-16T02:05:49.478 INFO:tasks.workunit.client.1.smithi165.stdout:1/356: write d1/d19/d24/d30/f40 [837376,103931] 0 2024-09-16T02:05:49.480 INFO:tasks.workunit.client.0.smithi110.stdout:4/65: symlink d4/d8/l16 0 2024-09-16T02:05:49.481 INFO:tasks.workunit.client.0.smithi110.stdout:4/66: write d4/f15 [499374,73376] 0 2024-09-16T02:05:49.485 INFO:tasks.workunit.client.1.smithi165.stdout:6/383: write d7/dc/d3b/f59 [116750,46513] 0 2024-09-16T02:05:49.487 INFO:tasks.workunit.client.1.smithi165.stdout:6/384: fsync d7/dc/df/d1a/f45 0 2024-09-16T02:05:49.487 INFO:tasks.workunit.client.0.smithi110.stdout:7/148: creat d3/f27 x:0 0 0 2024-09-16T02:05:49.488 INFO:tasks.workunit.client.1.smithi165.stdout:6/385: write d7/dc/f48 [23027,69448] 0 2024-09-16T02:05:49.490 INFO:tasks.workunit.client.0.smithi110.stdout:9/97: dread d1/d1b/f1d [0,4194304] 0 2024-09-16T02:05:49.491 INFO:tasks.workunit.client.1.smithi165.stdout:8/427: read dd/d11/f30 [2596430,96677] 0 2024-09-16T02:05:49.495 INFO:tasks.workunit.client.1.smithi165.stdout:2/447: sync 2024-09-16T02:05:49.495 INFO:tasks.workunit.client.1.smithi165.stdout:0/371: sync 2024-09-16T02:05:49.495 INFO:tasks.workunit.client.1.smithi165.stdout:4/357: sync 2024-09-16T02:05:49.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/113: unlink d0/d1/l1e 0 2024-09-16T02:05:49.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/114: read - d0/da/f17 zero size 2024-09-16T02:05:49.498 INFO:tasks.workunit.client.1.smithi165.stdout:3/478: dwrite da/f14 [0,4194304] 0 2024-09-16T02:05:49.499 INFO:tasks.workunit.client.1.smithi165.stdout:6/386: dwrite d7/dc/df/d1a/f45 [0,4194304] 0 2024-09-16T02:05:49.499 INFO:tasks.workunit.client.1.smithi165.stdout:3/479: fsync da/d17/d78/d2c/f70 0 2024-09-16T02:05:49.500 INFO:tasks.workunit.client.1.smithi165.stdout:6/387: chown f3 0 1 2024-09-16T02:05:49.503 INFO:tasks.workunit.client.0.smithi110.stdout:1/115: dread d0/f14 [0,4194304] 0 2024-09-16T02:05:49.504 INFO:tasks.workunit.client.0.smithi110.stdout:4/67: mkdir d4/d8/d17 0 2024-09-16T02:05:49.506 INFO:tasks.workunit.client.1.smithi165.stdout:5/386: write de/d19/d1c/f56 [370189,66624] 0 2024-09-16T02:05:49.508 INFO:tasks.workunit.client.0.smithi110.stdout:4/68: dread d4/f10 [0,4194304] 0 2024-09-16T02:05:49.509 INFO:tasks.workunit.client.1.smithi165.stdout:2/448: mkdir df/d23/d28/d87 0 2024-09-16T02:05:49.510 INFO:tasks.workunit.client.1.smithi165.stdout:1/357: dread d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:49.511 INFO:tasks.workunit.client.1.smithi165.stdout:4/358: creat d4/dc/d28/d2b/f74 x:0 0 0 2024-09-16T02:05:49.512 INFO:tasks.workunit.client.0.smithi110.stdout:5/167: symlink d5/l37 0 2024-09-16T02:05:49.513 INFO:tasks.workunit.client.0.smithi110.stdout:5/168: write d5/dd/df/f35 [441983,19011] 0 2024-09-16T02:05:49.515 INFO:tasks.workunit.client.1.smithi165.stdout:6/388: mknod d7/dc/d3b/d3a/c62 0 2024-09-16T02:05:49.516 INFO:tasks.workunit.client.1.smithi165.stdout:7/364: dwrite d0/df/d7/fe [0,4194304] 0 2024-09-16T02:05:49.517 INFO:tasks.workunit.client.1.smithi165.stdout:3/480: dwrite da/d20/d26/fa7 [0,4194304] 0 2024-09-16T02:05:49.517 INFO:tasks.workunit.client.1.smithi165.stdout:9/450: truncate d7/d32/d4a/f7e 3051479 0 2024-09-16T02:05:49.518 INFO:tasks.workunit.client.1.smithi165.stdout:8/428: symlink dd/d11/d14/d70/l95 0 2024-09-16T02:05:49.519 INFO:tasks.workunit.client.0.smithi110.stdout:3/127: dwrite d8/dc/d1b/d1c/f1f [0,4194304] 0 2024-09-16T02:05:49.522 INFO:tasks.workunit.client.1.smithi165.stdout:0/372: dwrite d0/d1e/f24 [0,4194304] 0 2024-09-16T02:05:49.522 INFO:tasks.workunit.client.1.smithi165.stdout:2/449: unlink df/d23/c6b 0 2024-09-16T02:05:49.523 INFO:tasks.workunit.client.0.smithi110.stdout:1/116: rmdir d0 39 2024-09-16T02:05:49.525 INFO:tasks.workunit.client.0.smithi110.stdout:7/149: creat d3/da/d10/d11/f28 x:0 0 0 2024-09-16T02:05:49.526 INFO:tasks.workunit.client.1.smithi165.stdout:6/389: read d7/d1f/f32 [1052353,51382] 0 2024-09-16T02:05:49.527 INFO:tasks.workunit.client.0.smithi110.stdout:4/69: mkdir d4/d12/d18 0 2024-09-16T02:05:49.527 INFO:tasks.workunit.client.0.smithi110.stdout:4/70: stat d4/l5 0 2024-09-16T02:05:49.528 INFO:tasks.workunit.client.0.smithi110.stdout:5/169: rmdir d5/dd/df/d28 39 2024-09-16T02:05:49.529 INFO:tasks.workunit.client.1.smithi165.stdout:9/451: dwrite d7/fd [0,4194304] 0 2024-09-16T02:05:49.531 INFO:tasks.workunit.client.1.smithi165.stdout:0/373: rmdir d0/d61 39 2024-09-16T02:05:49.531 INFO:tasks.workunit.client.0.smithi110.stdout:1/117: chown d0/d1/d4/l3 4 1 2024-09-16T02:05:49.533 INFO:tasks.workunit.client.0.smithi110.stdout:4/71: unlink d4/d8/l16 0 2024-09-16T02:05:49.534 INFO:tasks.workunit.client.1.smithi165.stdout:9/452: chown d7/d14/f24 1413930 1 2024-09-16T02:05:49.535 INFO:tasks.workunit.client.0.smithi110.stdout:4/72: readlink d4/d8/lf 0 2024-09-16T02:05:49.535 INFO:tasks.workunit.client.0.smithi110.stdout:5/170: rmdir d5/dd/df/d11 39 2024-09-16T02:05:49.535 INFO:tasks.workunit.client.1.smithi165.stdout:4/359: creat d4/dc/d18/d37/d53/d64/f75 x:0 0 0 2024-09-16T02:05:49.536 INFO:tasks.workunit.client.0.smithi110.stdout:3/128: symlink d8/l23 0 2024-09-16T02:05:49.539 INFO:tasks.workunit.client.1.smithi165.stdout:7/365: dwrite d0/df/d33/f4a [0,4194304] 0 2024-09-16T02:05:49.540 INFO:tasks.workunit.client.0.smithi110.stdout:2/171: sync 2024-09-16T02:05:49.540 INFO:tasks.workunit.client.0.smithi110.stdout:5/171: dread d5/dd/f12 [0,4194304] 0 2024-09-16T02:05:49.541 INFO:tasks.workunit.client.1.smithi165.stdout:4/360: readlink d4/dc/l68 0 2024-09-16T02:05:49.544 INFO:tasks.workunit.client.0.smithi110.stdout:1/118: link d0/da/f15 d0/d1/f20 0 2024-09-16T02:05:49.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/129: write f7 [2885198,785] 0 2024-09-16T02:05:49.547 INFO:tasks.workunit.client.1.smithi165.stdout:3/481: getdents da/d17/d7a/d7d 0 2024-09-16T02:05:49.550 INFO:tasks.workunit.client.1.smithi165.stdout:4/361: dwrite d4/dc/d18/f23 [0,4194304] 0 2024-09-16T02:05:49.550 INFO:tasks.workunit.client.1.smithi165.stdout:2/450: rename df/d10/d37/c49 to df/d23/d28/d3b/c88 0 2024-09-16T02:05:49.551 INFO:tasks.workunit.client.0.smithi110.stdout:4/73: symlink d4/d12/d18/l19 0 2024-09-16T02:05:49.556 INFO:tasks.workunit.client.0.smithi110.stdout:9/98: write d1/d1b/f1d [1583137,32463] 0 2024-09-16T02:05:49.557 INFO:tasks.workunit.client.0.smithi110.stdout:9/99: rename d1 to d1/d5/d21 22 2024-09-16T02:05:49.558 INFO:tasks.workunit.client.1.smithi165.stdout:9/453: truncate d7/f22 3263535 0 2024-09-16T02:05:49.558 INFO:tasks.workunit.client.1.smithi165.stdout:8/429: dread dd/d11/d14/f19 [0,4194304] 0 2024-09-16T02:05:49.559 INFO:tasks.workunit.client.0.smithi110.stdout:1/119: write d0/da/f15 [4660498,105365] 0 2024-09-16T02:05:49.561 INFO:tasks.workunit.client.0.smithi110.stdout:7/150: getdents d3/da/d10 0 2024-09-16T02:05:49.562 INFO:tasks.workunit.client.1.smithi165.stdout:9/454: truncate d7/d1f/d27/f3c 709804 0 2024-09-16T02:05:49.562 INFO:tasks.workunit.client.1.smithi165.stdout:4/362: dwrite d4/dc/d18/d37/d47/f70 [0,4194304] 0 2024-09-16T02:05:49.567 INFO:tasks.workunit.client.0.smithi110.stdout:2/172: truncate d0/db/f27 821640 0 2024-09-16T02:05:49.570 INFO:tasks.workunit.client.1.smithi165.stdout:0/374: rename d0/c4a to d0/d1e/d39/d48/d45/c83 0 2024-09-16T02:05:49.571 INFO:tasks.workunit.client.0.smithi110.stdout:9/100: dread d1/dd/f12 [0,4194304] 0 2024-09-16T02:05:49.576 INFO:tasks.workunit.client.1.smithi165.stdout:5/387: dread de/d21/d26/f66 [0,4194304] 0 2024-09-16T02:05:49.578 INFO:tasks.workunit.client.0.smithi110.stdout:8/145: dwrite d3/fe [0,4194304] 0 2024-09-16T02:05:49.582 INFO:tasks.workunit.client.1.smithi165.stdout:4/363: creat d4/dc/d20/d67/f76 x:0 0 0 2024-09-16T02:05:49.585 INFO:tasks.workunit.client.1.smithi165.stdout:3/482: symlink da/d20/d26/d52/d9c/da6/lad 0 2024-09-16T02:05:49.587 INFO:tasks.workunit.client.0.smithi110.stdout:1/120: dwrite d0/f14 [0,4194304] 0 2024-09-16T02:05:49.588 INFO:tasks.workunit.client.1.smithi165.stdout:2/451: mknod df/d23/d28/d87/c89 0 2024-09-16T02:05:49.589 INFO:tasks.workunit.client.1.smithi165.stdout:1/358: truncate d1/f3a 964606 0 2024-09-16T02:05:49.589 INFO:tasks.workunit.client.1.smithi165.stdout:4/364: dwrite d4/dc/d28/d2b/f6d [0,4194304] 0 2024-09-16T02:05:49.591 INFO:tasks.workunit.client.1.smithi165.stdout:4/365: write d4/dc/d20/d67/f76 [112213,65118] 0 2024-09-16T02:05:49.593 INFO:tasks.workunit.client.1.smithi165.stdout:4/366: dread - d4/dc/d20/d4e/f72 zero size 2024-09-16T02:05:49.595 INFO:tasks.workunit.client.0.smithi110.stdout:9/101: rmdir d1/d5/d8 39 2024-09-16T02:05:49.596 INFO:tasks.workunit.client.1.smithi165.stdout:9/455: rename d7/d1d to d7/d32/d38/d53/d56/d95 0 2024-09-16T02:05:49.598 INFO:tasks.workunit.client.1.smithi165.stdout:5/388: creat de/d19/d67/f7f x:0 0 0 2024-09-16T02:05:49.599 INFO:tasks.workunit.client.0.smithi110.stdout:5/172: creat d5/dd/df/f38 x:0 0 0 2024-09-16T02:05:49.600 INFO:tasks.workunit.client.1.smithi165.stdout:6/390: dread d7/dc/df/d1a/f2d [0,4194304] 0 2024-09-16T02:05:49.600 INFO:tasks.workunit.client.1.smithi165.stdout:8/430: symlink dd/l96 0 2024-09-16T02:05:49.602 INFO:tasks.workunit.client.1.smithi165.stdout:7/366: dread d0/df/d33/d2a/f36 [0,4194304] 0 2024-09-16T02:05:49.603 INFO:tasks.workunit.client.1.smithi165.stdout:7/367: write d0/f19 [1974161,91976] 0 2024-09-16T02:05:49.603 INFO:tasks.workunit.client.0.smithi110.stdout:9/102: dwrite d1/dd/f10 [4194304,4194304] 0 2024-09-16T02:05:49.603 INFO:tasks.workunit.client.0.smithi110.stdout:9/103: fsync f0 0 2024-09-16T02:05:49.605 INFO:tasks.workunit.client.1.smithi165.stdout:3/483: truncate da/d17/f4a 1474899 0 2024-09-16T02:05:49.606 INFO:tasks.workunit.client.1.smithi165.stdout:3/484: write da/d57/fa4 [304824,69605] 0 2024-09-16T02:05:49.607 INFO:tasks.workunit.client.1.smithi165.stdout:3/485: write da/f9d [4205335,20091] 0 2024-09-16T02:05:49.610 INFO:tasks.workunit.client.0.smithi110.stdout:1/121: mknod d0/d1/d8/c21 0 2024-09-16T02:05:49.616 INFO:tasks.workunit.client.1.smithi165.stdout:0/375: creat d0/d2a/d70/f84 x:0 0 0 2024-09-16T02:05:49.617 INFO:tasks.workunit.client.0.smithi110.stdout:9/104: creat d1/d1b/f22 x:0 0 0 2024-09-16T02:05:49.618 INFO:tasks.workunit.client.0.smithi110.stdout:7/151: write d3/f7 [2685678,100829] 0 2024-09-16T02:05:49.619 INFO:tasks.workunit.client.0.smithi110.stdout:7/152: write d3/f7 [2193554,2414] 0 2024-09-16T02:05:49.620 INFO:tasks.workunit.client.0.smithi110.stdout:3/130: write f4 [3073885,63987] 0 2024-09-16T02:05:49.620 INFO:tasks.workunit.client.0.smithi110.stdout:7/153: chown d3/f13 48 1 2024-09-16T02:05:49.621 INFO:tasks.workunit.client.0.smithi110.stdout:1/122: mknod d0/d1/c22 0 2024-09-16T02:05:49.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/154: chown d3/d15/f1c 1596940 1 2024-09-16T02:05:49.622 INFO:tasks.workunit.client.0.smithi110.stdout:1/123: write d0/d1/f20 [4065085,86827] 0 2024-09-16T02:05:49.622 INFO:tasks.workunit.client.1.smithi165.stdout:8/431: mknod dd/d62/d94/c97 0 2024-09-16T02:05:49.624 INFO:tasks.workunit.client.0.smithi110.stdout:4/74: truncate d4/f14 2245547 0 2024-09-16T02:05:49.626 INFO:tasks.workunit.client.0.smithi110.stdout:9/105: dread d1/d1b/f1d [0,4194304] 0 2024-09-16T02:05:49.629 INFO:tasks.workunit.client.1.smithi165.stdout:6/391: dread d7/fe [0,4194304] 0 2024-09-16T02:05:49.629 INFO:tasks.workunit.client.1.smithi165.stdout:6/392: chown d7/d1f/l54 118268328 1 2024-09-16T02:05:49.631 INFO:tasks.workunit.client.0.smithi110.stdout:3/131: creat d8/dc/d1b/f24 x:0 0 0 2024-09-16T02:05:49.633 INFO:tasks.workunit.client.1.smithi165.stdout:1/359: symlink d1/dd/d11/d46/d57/l6d 0 2024-09-16T02:05:49.634 INFO:tasks.workunit.client.1.smithi165.stdout:1/360: stat d1/dd/d11/d33/d35 0 2024-09-16T02:05:49.635 INFO:tasks.workunit.client.1.smithi165.stdout:1/361: chown d1/dd/d11/d33/d67 88435799 1 2024-09-16T02:05:49.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/452: dwrite df/d10/d37/f3d [0,4194304] 0 2024-09-16T02:05:49.637 INFO:tasks.workunit.client.1.smithi165.stdout:2/453: fsync df/f16 0 2024-09-16T02:05:49.637 INFO:tasks.workunit.client.1.smithi165.stdout:2/454: dread - df/d73/f7c zero size 2024-09-16T02:05:49.639 INFO:tasks.workunit.client.0.smithi110.stdout:9/106: mkdir d1/d1b/d23 0 2024-09-16T02:05:49.640 INFO:tasks.workunit.client.1.smithi165.stdout:9/456: getdents d7/d1f/d27/d49 0 2024-09-16T02:05:49.641 INFO:tasks.workunit.client.0.smithi110.stdout:8/146: rmdir d3/d2b/d33 0 2024-09-16T02:05:49.642 INFO:tasks.workunit.client.0.smithi110.stdout:4/75: rmdir d4 39 2024-09-16T02:05:49.644 INFO:tasks.workunit.client.1.smithi165.stdout:5/389: rename de/c12 to de/d21/c80 0 2024-09-16T02:05:49.646 INFO:tasks.workunit.client.1.smithi165.stdout:8/432: creat dd/d11/d14/d3f/d25/d36/d4f/f98 x:0 0 0 2024-09-16T02:05:49.647 INFO:tasks.workunit.client.0.smithi110.stdout:7/155: link d3/f13 d3/da/d10/f29 0 2024-09-16T02:05:49.648 INFO:tasks.workunit.client.0.smithi110.stdout:7/156: chown d3/d15/l1f 449007695 1 2024-09-16T02:05:49.648 INFO:tasks.workunit.client.1.smithi165.stdout:7/368: symlink d0/df/d33/d2a/d72/l75 0 2024-09-16T02:05:49.652 INFO:tasks.workunit.client.1.smithi165.stdout:6/393: mknod d7/dc/d3b/d3c/c63 0 2024-09-16T02:05:49.653 INFO:tasks.workunit.client.0.smithi110.stdout:1/124: truncate d0/f6 8032943 0 2024-09-16T02:05:49.653 INFO:tasks.workunit.client.1.smithi165.stdout:7/369: dwrite d0/df/d68/f6c [0,4194304] 0 2024-09-16T02:05:49.654 INFO:tasks.workunit.client.0.smithi110.stdout:1/125: write d0/d1/d8/f19 [913984,18188] 0 2024-09-16T02:05:49.655 INFO:tasks.workunit.client.1.smithi165.stdout:7/370: write d0/df/d65/f6e [455552,32212] 0 2024-09-16T02:05:49.655 INFO:tasks.workunit.client.0.smithi110.stdout:9/107: symlink d1/d1b/l24 0 2024-09-16T02:05:49.662 INFO:tasks.workunit.client.0.smithi110.stdout:7/157: truncate d3/da/fe 347529 0 2024-09-16T02:05:49.662 INFO:tasks.workunit.client.1.smithi165.stdout:7/371: dread d0/d3d/f4f [0,4194304] 0 2024-09-16T02:05:49.662 INFO:tasks.workunit.client.0.smithi110.stdout:1/126: dwrite d0/da/f15 [4194304,4194304] 0 2024-09-16T02:05:49.664 INFO:tasks.workunit.client.1.smithi165.stdout:1/362: unlink d1/dd/d11/d33/d3f/d59/c5e 0 2024-09-16T02:05:49.668 INFO:tasks.workunit.client.1.smithi165.stdout:2/455: mknod df/d10/d1a/d2d/c8a 0 2024-09-16T02:05:49.668 INFO:tasks.workunit.client.1.smithi165.stdout:2/456: readlink df/d10/l1e 0 2024-09-16T02:05:49.668 INFO:tasks.workunit.client.0.smithi110.stdout:8/147: dread d3/d2b/f1e [0,4194304] 0 2024-09-16T02:05:49.669 INFO:tasks.workunit.client.0.smithi110.stdout:9/108: creat d1/dd/f25 x:0 0 0 2024-09-16T02:05:49.670 INFO:tasks.workunit.client.1.smithi165.stdout:0/376: symlink d0/d61/l85 0 2024-09-16T02:05:49.674 INFO:tasks.workunit.client.0.smithi110.stdout:4/76: dread d4/f10 [0,4194304] 0 2024-09-16T02:05:49.674 INFO:tasks.workunit.client.0.smithi110.stdout:3/132: creat d8/dc/f25 x:0 0 0 2024-09-16T02:05:49.676 INFO:tasks.workunit.client.1.smithi165.stdout:5/390: rename de/d21/f62 to de/d21/d4e/f81 0 2024-09-16T02:05:49.679 INFO:tasks.workunit.client.0.smithi110.stdout:7/158: mkdir d3/da/d10/d2a 0 2024-09-16T02:05:49.679 INFO:tasks.workunit.client.1.smithi165.stdout:5/391: dread de/d21/d26/f66 [0,4194304] 0 2024-09-16T02:05:49.680 INFO:tasks.workunit.client.0.smithi110.stdout:8/148: mkdir d3/d12/d1a/d36 0 2024-09-16T02:05:49.682 INFO:tasks.workunit.client.1.smithi165.stdout:3/486: creat da/d20/fae x:0 0 0 2024-09-16T02:05:49.685 INFO:tasks.workunit.client.1.smithi165.stdout:4/367: getdents d4/dc/d28 0 2024-09-16T02:05:49.686 INFO:tasks.workunit.client.0.smithi110.stdout:4/77: mknod d4/d12/d18/c1a 0 2024-09-16T02:05:49.687 INFO:tasks.workunit.client.1.smithi165.stdout:7/372: chown d0/d2c/c52 127 1 2024-09-16T02:05:49.688 INFO:tasks.workunit.client.0.smithi110.stdout:3/133: rmdir d8/dc/d1b/d1c 39 2024-09-16T02:05:49.688 INFO:tasks.workunit.client.1.smithi165.stdout:1/363: mknod d1/dd/d11/d33/d3f/c6e 0 2024-09-16T02:05:49.689 INFO:tasks.workunit.client.1.smithi165.stdout:9/457: dwrite d7/fa [4194304,4194304] 0 2024-09-16T02:05:49.693 INFO:tasks.workunit.client.0.smithi110.stdout:9/109: mkdir d1/d5/d8/d26 0 2024-09-16T02:05:49.694 INFO:tasks.workunit.client.0.smithi110.stdout:3/134: dwrite d8/fb [4194304,4194304] 0 2024-09-16T02:05:49.694 INFO:tasks.workunit.client.1.smithi165.stdout:8/433: mknod dd/d11/d38/d74/d7d/c99 0 2024-09-16T02:05:49.695 INFO:tasks.workunit.client.0.smithi110.stdout:3/135: chown d8/dc/f21 3264979 1 2024-09-16T02:05:49.695 INFO:tasks.workunit.client.0.smithi110.stdout:3/136: read - d8/f22 zero size 2024-09-16T02:05:49.696 INFO:tasks.workunit.client.0.smithi110.stdout:4/78: symlink d4/d12/d18/l1b 0 2024-09-16T02:05:49.702 INFO:tasks.workunit.client.1.smithi165.stdout:8/434: dwrite dd/d11/f47 [0,4194304] 0 2024-09-16T02:05:49.702 INFO:tasks.workunit.client.0.smithi110.stdout:8/149: write d3/f10 [4351842,21914] 0 2024-09-16T02:05:49.707 INFO:tasks.workunit.client.1.smithi165.stdout:7/373: mknod d0/df/d65/c76 0 2024-09-16T02:05:49.708 INFO:tasks.workunit.client.1.smithi165.stdout:1/364: creat d1/d22/f6f x:0 0 0 2024-09-16T02:05:49.710 INFO:tasks.workunit.client.0.smithi110.stdout:4/79: creat d4/f1c x:0 0 0 2024-09-16T02:05:49.711 INFO:tasks.workunit.client.1.smithi165.stdout:8/435: dwrite f6 [0,4194304] 0 2024-09-16T02:05:49.711 INFO:tasks.workunit.client.1.smithi165.stdout:1/365: write d1/d22/f6f [969854,80958] 0 2024-09-16T02:05:49.712 INFO:tasks.workunit.client.1.smithi165.stdout:6/394: truncate d7/dc/df/d1a/f46 1260998 0 2024-09-16T02:05:49.713 INFO:tasks.workunit.client.1.smithi165.stdout:8/436: write dd/d11/d38/f3c [4592038,40757] 0 2024-09-16T02:05:49.714 INFO:tasks.workunit.client.1.smithi165.stdout:7/374: dread d0/df/d7/f23 [0,4194304] 0 2024-09-16T02:05:49.714 INFO:tasks.workunit.client.0.smithi110.stdout:8/150: mkdir d3/d2b/d27/d37 0 2024-09-16T02:05:49.716 INFO:tasks.workunit.client.1.smithi165.stdout:7/375: stat d0/df/d33/d2a/f40 0 2024-09-16T02:05:49.716 INFO:tasks.workunit.client.0.smithi110.stdout:8/151: fdatasync d3/f10 0 2024-09-16T02:05:49.717 INFO:tasks.workunit.client.0.smithi110.stdout:7/159: rmdir d3/da/d10/d2a 0 2024-09-16T02:05:49.720 INFO:tasks.workunit.client.1.smithi165.stdout:5/392: write de/f14 [8041727,95804] 0 2024-09-16T02:05:49.721 INFO:tasks.workunit.client.0.smithi110.stdout:1/127: dread d0/f6 [4194304,4194304] 0 2024-09-16T02:05:49.721 INFO:tasks.workunit.client.0.smithi110.stdout:9/110: truncate d1/fc 151403 0 2024-09-16T02:05:49.723 INFO:tasks.workunit.client.1.smithi165.stdout:3/487: rmdir da/d57/d8d/d97 39 2024-09-16T02:05:49.724 INFO:tasks.workunit.client.1.smithi165.stdout:3/488: write da/d20/f3d [1563541,92331] 0 2024-09-16T02:05:49.725 INFO:tasks.workunit.client.0.smithi110.stdout:4/80: mknod d4/d8/c1d 0 2024-09-16T02:05:49.726 INFO:tasks.workunit.client.1.smithi165.stdout:3/489: chown da/d20/d26/d52/d9c/da6/lad 391839 1 2024-09-16T02:05:49.728 INFO:tasks.workunit.client.1.smithi165.stdout:4/368: link d4/dc/d20/d4e/f54 d4/dc/d20/d45/f77 0 2024-09-16T02:05:49.731 INFO:tasks.workunit.client.0.smithi110.stdout:8/152: rename d3/d2b/d27/d37 to d3/d12/d1a/d38 0 2024-09-16T02:05:49.732 INFO:tasks.workunit.client.0.smithi110.stdout:7/160: creat d3/da/d10/d11/f2b x:0 0 0 2024-09-16T02:05:49.733 INFO:tasks.workunit.client.1.smithi165.stdout:9/458: creat d7/df/d67/d92/d93/f96 x:0 0 0 2024-09-16T02:05:49.735 INFO:tasks.workunit.client.1.smithi165.stdout:1/366: creat d1/dd/d11/d46/f70 x:0 0 0 2024-09-16T02:05:49.737 INFO:tasks.workunit.client.0.smithi110.stdout:9/111: unlink d1/d5/fb 0 2024-09-16T02:05:49.738 INFO:tasks.workunit.client.0.smithi110.stdout:9/112: truncate d1/d1b/f22 600658 0 2024-09-16T02:05:49.743 INFO:tasks.workunit.client.0.smithi110.stdout:7/161: mkdir d3/da/d10/d2c 0 2024-09-16T02:05:49.745 INFO:tasks.workunit.client.1.smithi165.stdout:7/376: rename d0/d3d/l47 to d0/d4b/d63/l77 0 2024-09-16T02:05:49.746 INFO:tasks.workunit.client.1.smithi165.stdout:7/377: write d0/df/f27 [2379384,101754] 0 2024-09-16T02:05:49.747 INFO:tasks.workunit.client.0.smithi110.stdout:8/153: dwrite d3/d12/d1d/f1f [0,4194304] 0 2024-09-16T02:05:49.751 INFO:tasks.workunit.client.1.smithi165.stdout:3/490: rmdir da/d17/d78/d2c 39 2024-09-16T02:05:49.753 INFO:tasks.workunit.client.1.smithi165.stdout:4/369: creat d4/d40/d4f/f78 x:0 0 0 2024-09-16T02:05:49.755 INFO:tasks.workunit.client.0.smithi110.stdout:7/162: creat d3/da/d10/d11/f2d x:0 0 0 2024-09-16T02:05:49.755 INFO:tasks.workunit.client.0.smithi110.stdout:4/81: dwrite d4/f10 [0,4194304] 0 2024-09-16T02:05:49.755 INFO:tasks.workunit.client.0.smithi110.stdout:1/128: write d0/d1/d4/f18 [399093,82095] 0 2024-09-16T02:05:49.755 INFO:tasks.workunit.client.1.smithi165.stdout:2/457: getdents df/d23/d2a 0 2024-09-16T02:05:49.756 INFO:tasks.workunit.client.0.smithi110.stdout:4/82: dread - d4/f1c zero size 2024-09-16T02:05:49.757 INFO:tasks.workunit.client.0.smithi110.stdout:4/83: write d4/f1c [675121,18870] 0 2024-09-16T02:05:49.758 INFO:tasks.workunit.client.0.smithi110.stdout:8/154: creat d3/d2b/d27/f39 x:0 0 0 2024-09-16T02:05:49.760 INFO:tasks.workunit.client.0.smithi110.stdout:9/113: getdents d1/d5/d8/d26 0 2024-09-16T02:05:49.763 INFO:tasks.workunit.client.1.smithi165.stdout:1/367: dwrite d1/dd/d11/f1d [0,4194304] 0 2024-09-16T02:05:49.763 INFO:tasks.workunit.client.1.smithi165.stdout:0/377: rename d0/d1e/d39/d48/l3e to d0/d1e/d39/d48/l86 0 2024-09-16T02:05:49.766 INFO:tasks.workunit.client.1.smithi165.stdout:7/378: write d0/f3 [2783710,60366] 0 2024-09-16T02:05:49.768 INFO:tasks.workunit.client.0.smithi110.stdout:8/155: dwrite d3/fd [0,4194304] 0 2024-09-16T02:05:49.768 INFO:tasks.workunit.client.0.smithi110.stdout:7/163: mkdir d3/da/d2e 0 2024-09-16T02:05:49.769 INFO:tasks.workunit.client.0.smithi110.stdout:4/84: dwrite d4/f10 [0,4194304] 0 2024-09-16T02:05:49.769 INFO:tasks.workunit.client.1.smithi165.stdout:5/393: symlink de/d21/d26/d3a/l82 0 2024-09-16T02:05:49.770 INFO:tasks.workunit.client.1.smithi165.stdout:5/394: rename de to de/d19/d1c/d49/d83 22 2024-09-16T02:05:49.770 INFO:tasks.workunit.client.1.smithi165.stdout:5/395: fsync f7 0 2024-09-16T02:05:49.770 INFO:tasks.workunit.client.1.smithi165.stdout:5/396: read de/f14 [5166691,3995] 0 2024-09-16T02:05:49.771 INFO:tasks.workunit.client.1.smithi165.stdout:5/397: write de/d19/d67/f7f [900716,92257] 0 2024-09-16T02:05:49.773 INFO:tasks.workunit.client.1.smithi165.stdout:3/491: creat da/faf x:0 0 0 2024-09-16T02:05:49.773 INFO:tasks.workunit.client.1.smithi165.stdout:2/458: dread df/d23/f38 [0,4194304] 0 2024-09-16T02:05:49.773 INFO:tasks.workunit.client.1.smithi165.stdout:4/370: creat d4/d40/f79 x:0 0 0 2024-09-16T02:05:49.774 INFO:tasks.workunit.client.0.smithi110.stdout:9/114: mkdir d1/d5/d20/d27 0 2024-09-16T02:05:49.774 INFO:tasks.workunit.client.1.smithi165.stdout:3/492: chown da/d17/d7a/d7d/da8 102537 1 2024-09-16T02:05:49.775 INFO:tasks.workunit.client.0.smithi110.stdout:7/164: dread d3/da/fc [0,4194304] 0 2024-09-16T02:05:49.775 INFO:tasks.workunit.client.1.smithi165.stdout:6/395: creat d7/dc/d3b/f64 x:0 0 0 2024-09-16T02:05:49.776 INFO:tasks.workunit.client.0.smithi110.stdout:4/85: dread - d4/d12/f13 zero size 2024-09-16T02:05:49.776 INFO:tasks.workunit.client.1.smithi165.stdout:6/396: stat d7/dc/df/d1a/l20 0 2024-09-16T02:05:49.777 INFO:tasks.workunit.client.0.smithi110.stdout:8/156: stat d3/d12/d1d/l2c 0 2024-09-16T02:05:49.779 INFO:tasks.workunit.client.1.smithi165.stdout:1/368: mknod d1/dd/d11/d46/d57/c71 0 2024-09-16T02:05:49.781 INFO:tasks.workunit.client.1.smithi165.stdout:4/371: dwrite d4/dc/d20/f6a [0,4194304] 0 2024-09-16T02:05:49.781 INFO:tasks.workunit.client.1.smithi165.stdout:7/379: write d0/d2c/f2e [3673607,69044] 0 2024-09-16T02:05:49.782 INFO:tasks.workunit.client.1.smithi165.stdout:7/380: readlink d0/df/d33/d2a/l46 0 2024-09-16T02:05:49.784 INFO:tasks.workunit.client.0.smithi110.stdout:9/115: write d1/d1b/f1d [1727057,116789] 0 2024-09-16T02:05:49.786 INFO:tasks.workunit.client.0.smithi110.stdout:7/165: mknod d3/da/d10/d11/c2f 0 2024-09-16T02:05:49.788 INFO:tasks.workunit.client.1.smithi165.stdout:2/459: mkdir df/d23/d28/d3b/d6d/d8b 0 2024-09-16T02:05:49.792 INFO:tasks.workunit.client.0.smithi110.stdout:8/157: dwrite d3/d2b/d27/f2d [0,4194304] 0 2024-09-16T02:05:49.792 INFO:tasks.workunit.client.1.smithi165.stdout:3/493: creat da/d17/d7a/d7d/fb0 x:0 0 0 2024-09-16T02:05:49.792 INFO:tasks.workunit.client.1.smithi165.stdout:8/437: getdents dd/d7f 0 2024-09-16T02:05:49.792 INFO:tasks.workunit.client.1.smithi165.stdout:3/494: stat da/d17/f1a 0 2024-09-16T02:05:49.793 INFO:tasks.workunit.client.1.smithi165.stdout:8/438: chown dd/d11/d38/f4b 24588676 1 2024-09-16T02:05:49.793 INFO:tasks.workunit.client.0.smithi110.stdout:9/116: write d1/d5/f1a [36204,93900] 0 2024-09-16T02:05:49.794 INFO:tasks.workunit.client.0.smithi110.stdout:4/86: dwrite d4/f15 [0,4194304] 0 2024-09-16T02:05:49.795 INFO:tasks.workunit.client.1.smithi165.stdout:8/439: truncate dd/d11/d14/d3f/d25/d36/f64 1264170 0 2024-09-16T02:05:49.795 INFO:tasks.workunit.client.1.smithi165.stdout:8/440: fsync dd/f41 0 2024-09-16T02:05:49.797 INFO:tasks.workunit.client.0.smithi110.stdout:7/166: rename d3/f7 to d3/da/d10/f30 0 2024-09-16T02:05:49.799 INFO:tasks.workunit.client.0.smithi110.stdout:7/167: write d3/f8 [30051,46503] 0 2024-09-16T02:05:49.799 INFO:tasks.workunit.client.1.smithi165.stdout:6/397: rename d7/dc/d3b/d3c/c63 to d7/dc/d3b/d3a/d3d/c65 0 2024-09-16T02:05:49.801 INFO:tasks.workunit.client.1.smithi165.stdout:1/369: mkdir d1/d19/d24/d30/d72 0 2024-09-16T02:05:49.802 INFO:tasks.workunit.client.0.smithi110.stdout:4/87: mknod d4/c1e 0 2024-09-16T02:05:49.803 INFO:tasks.workunit.client.0.smithi110.stdout:4/88: truncate d4/f15 4411150 0 2024-09-16T02:05:49.804 INFO:tasks.workunit.client.1.smithi165.stdout:7/381: creat d0/d2c/f78 x:0 0 0 2024-09-16T02:05:49.804 INFO:tasks.workunit.client.0.smithi110.stdout:4/89: readlink d4/d12/d18/l19 0 2024-09-16T02:05:49.804 INFO:tasks.workunit.client.1.smithi165.stdout:7/382: write d0/df/d33/d2a/f54 [993316,74466] 0 2024-09-16T02:05:49.805 INFO:tasks.workunit.client.0.smithi110.stdout:4/90: write d4/f15 [3704998,103960] 0 2024-09-16T02:05:49.806 INFO:tasks.workunit.client.1.smithi165.stdout:5/398: mkdir de/d19/d1c/d84 0 2024-09-16T02:05:49.806 INFO:tasks.workunit.client.1.smithi165.stdout:5/399: fdatasync de/d19/d1c/f4f 0 2024-09-16T02:05:49.812 INFO:tasks.workunit.client.0.smithi110.stdout:7/168: symlink d3/da/d10/d2c/l31 0 2024-09-16T02:05:49.812 INFO:tasks.workunit.client.1.smithi165.stdout:5/400: dwrite fa [0,4194304] 0 2024-09-16T02:05:49.813 INFO:tasks.workunit.client.1.smithi165.stdout:5/401: fsync de/d19/d1c/f4f 0 2024-09-16T02:05:49.816 INFO:tasks.workunit.client.1.smithi165.stdout:0/378: mkdir d0/d1e/d20/d28/d6d/d87 0 2024-09-16T02:05:49.816 INFO:tasks.workunit.client.0.smithi110.stdout:1/129: truncate d0/d1/d8/f19 381575 0 2024-09-16T02:05:49.817 INFO:tasks.workunit.client.1.smithi165.stdout:8/441: mkdir dd/d11/d14/d70/d7b/d9a 0 2024-09-16T02:05:49.819 INFO:tasks.workunit.client.0.smithi110.stdout:4/91: rename d4/d8/fe to d4/d12/d18/f1f 0 2024-09-16T02:05:49.822 INFO:tasks.workunit.client.1.smithi165.stdout:4/372: rename d4/dc/l68 to d4/dc/d18/l7a 0 2024-09-16T02:05:49.823 INFO:tasks.workunit.client.0.smithi110.stdout:1/130: creat d0/d1/f23 x:0 0 0 2024-09-16T02:05:49.825 INFO:tasks.workunit.client.1.smithi165.stdout:6/398: creat d7/d17/f66 x:0 0 0 2024-09-16T02:05:49.826 INFO:tasks.workunit.client.1.smithi165.stdout:9/459: dwrite d7/d32/d4a/f7e [0,4194304] 0 2024-09-16T02:05:49.827 INFO:tasks.workunit.client.1.smithi165.stdout:1/370: creat d1/dd/d11/d46/f73 x:0 0 0 2024-09-16T02:05:49.827 INFO:tasks.workunit.client.1.smithi165.stdout:9/460: chown d7/d55/c78 98270 1 2024-09-16T02:05:49.830 INFO:tasks.workunit.client.0.smithi110.stdout:1/131: creat d0/d1/d4/f24 x:0 0 0 2024-09-16T02:05:49.836 INFO:tasks.workunit.client.1.smithi165.stdout:8/442: mknod dd/d11/d14/d3f/d25/c9b 0 2024-09-16T02:05:49.837 INFO:tasks.workunit.client.0.smithi110.stdout:1/132: dwrite d0/d1/f20 [0,4194304] 0 2024-09-16T02:05:49.837 INFO:tasks.workunit.client.1.smithi165.stdout:8/443: read dd/d11/f5f [431220,4138] 0 2024-09-16T02:05:49.841 INFO:tasks.workunit.client.1.smithi165.stdout:9/461: mkdir d7/d32/d38/d53/d5c/d61/d97 0 2024-09-16T02:05:49.843 INFO:tasks.workunit.client.0.smithi110.stdout:1/133: mkdir d0/d25 0 2024-09-16T02:05:49.843 INFO:tasks.workunit.client.1.smithi165.stdout:8/444: dwrite dd/d13/f71 [0,4194304] 0 2024-09-16T02:05:49.844 INFO:tasks.workunit.client.1.smithi165.stdout:2/460: write df/d23/f6e [2881815,33658] 0 2024-09-16T02:05:49.845 INFO:tasks.workunit.client.1.smithi165.stdout:0/379: creat d0/d1e/d20/d28/d6d/d87/f88 x:0 0 0 2024-09-16T02:05:49.847 INFO:tasks.workunit.client.0.smithi110.stdout:1/134: rmdir d0/da 39 2024-09-16T02:05:49.849 INFO:tasks.workunit.client.0.smithi110.stdout:1/135: truncate d0/d1/f23 455367 0 2024-09-16T02:05:49.849 INFO:tasks.workunit.client.1.smithi165.stdout:5/402: dread de/d19/d1c/d4d/f7e [0,4194304] 0 2024-09-16T02:05:49.855 INFO:tasks.workunit.client.0.smithi110.stdout:1/136: creat d0/d1/d4/f26 x:0 0 0 2024-09-16T02:05:49.857 INFO:tasks.workunit.client.1.smithi165.stdout:9/462: rename d7/d1f/d27/d49/f50 to d7/df/d67/d92/d93/f98 0 2024-09-16T02:05:49.858 INFO:tasks.workunit.client.0.smithi110.stdout:4/92: fdatasync d4/d12/d18/f1f 0 2024-09-16T02:05:49.858 INFO:tasks.workunit.client.0.smithi110.stdout:4/93: stat d4/d8 0 2024-09-16T02:05:49.859 INFO:tasks.workunit.client.1.smithi165.stdout:3/495: getdents da/d17/d78 0 2024-09-16T02:05:49.860 INFO:tasks.workunit.client.0.smithi110.stdout:1/137: rename d0/d1/d8/cf to d0/d25/c27 0 2024-09-16T02:05:49.863 INFO:tasks.workunit.client.0.smithi110.stdout:4/94: symlink d4/d8/l20 0 2024-09-16T02:05:49.864 INFO:tasks.workunit.client.1.smithi165.stdout:7/383: dwrite d0/df/d7/f23 [0,4194304] 0 2024-09-16T02:05:49.866 INFO:tasks.workunit.client.0.smithi110.stdout:1/138: dwrite d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:49.868 INFO:tasks.workunit.client.0.smithi110.stdout:1/139: write d0/f14 [1095934,57136] 0 2024-09-16T02:05:49.869 INFO:tasks.workunit.client.1.smithi165.stdout:5/403: rmdir de 39 2024-09-16T02:05:49.870 INFO:tasks.workunit.client.0.smithi110.stdout:4/95: creat d4/f21 x:0 0 0 2024-09-16T02:05:49.871 INFO:tasks.workunit.client.1.smithi165.stdout:6/399: truncate d7/fe 350772 0 2024-09-16T02:05:49.872 INFO:tasks.workunit.client.1.smithi165.stdout:7/384: dwrite d0/f19 [0,4194304] 0 2024-09-16T02:05:49.874 INFO:tasks.workunit.client.0.smithi110.stdout:1/140: fsync d0/da/f15 0 2024-09-16T02:05:49.875 INFO:tasks.workunit.client.1.smithi165.stdout:1/371: write d1/d19/d24/d30/f40 [896464,78315] 0 2024-09-16T02:05:49.877 INFO:tasks.workunit.client.1.smithi165.stdout:9/463: mkdir d7/d32/d38/d58/d99 0 2024-09-16T02:05:49.878 INFO:tasks.workunit.client.0.smithi110.stdout:4/96: symlink d4/d12/d18/l22 0 2024-09-16T02:05:49.879 INFO:tasks.workunit.client.1.smithi165.stdout:1/372: write d1/d68/f64 [3536351,93075] 0 2024-09-16T02:05:49.880 INFO:tasks.workunit.client.0.smithi110.stdout:4/97: read d4/f15 [33970,127134] 0 2024-09-16T02:05:49.882 INFO:tasks.workunit.client.1.smithi165.stdout:9/464: write f2 [3883564,130433] 0 2024-09-16T02:05:49.882 INFO:tasks.workunit.client.0.smithi110.stdout:1/141: dwrite d0/da/f15 [4194304,4194304] 0 2024-09-16T02:05:49.884 INFO:tasks.workunit.client.1.smithi165.stdout:7/385: dwrite d0/f60 [0,4194304] 0 2024-09-16T02:05:49.888 INFO:tasks.workunit.client.0.smithi110.stdout:1/142: rename d0/f6 to d0/da/f28 0 2024-09-16T02:05:49.890 INFO:tasks.workunit.client.1.smithi165.stdout:3/496: dwrite da/d17/fa3 [0,4194304] 0 2024-09-16T02:05:49.892 INFO:tasks.workunit.client.0.smithi110.stdout:1/143: creat d0/da/f29 x:0 0 0 2024-09-16T02:05:49.892 INFO:tasks.workunit.client.1.smithi165.stdout:9/465: dread d7/fd [0,4194304] 0 2024-09-16T02:05:49.893 INFO:tasks.workunit.client.0.smithi110.stdout:1/144: stat d0/da/f15 0 2024-09-16T02:05:49.893 INFO:tasks.workunit.client.1.smithi165.stdout:4/373: getdents d4/dc/d20/d4e 0 2024-09-16T02:05:49.893 INFO:tasks.workunit.client.0.smithi110.stdout:1/145: chown d0/d1/d4/f26 7919264 1 2024-09-16T02:05:49.901 INFO:tasks.workunit.client.1.smithi165.stdout:9/466: dwrite d7/d32/d38/d53/d56/d95/f6a [0,4194304] 0 2024-09-16T02:05:49.919 INFO:tasks.workunit.client.0.smithi110.stdout:1/146: mkdir d0/d1/d2a 0 2024-09-16T02:05:49.922 INFO:tasks.workunit.client.0.smithi110.stdout:1/147: symlink d0/d25/l2b 0 2024-09-16T02:05:49.933 INFO:tasks.workunit.client.1.smithi165.stdout:2/461: truncate df/d23/d28/f46 3296985 0 2024-09-16T02:05:49.936 INFO:tasks.workunit.client.0.smithi110.stdout:1/148: creat d0/da/f2c x:0 0 0 2024-09-16T02:05:49.937 INFO:tasks.workunit.client.1.smithi165.stdout:6/400: truncate d7/f9 6009744 0 2024-09-16T02:05:49.939 INFO:tasks.workunit.client.1.smithi165.stdout:4/374: symlink d4/d40/l7b 0 2024-09-16T02:05:49.939 INFO:tasks.workunit.client.1.smithi165.stdout:5/404: symlink de/d21/d51/l85 0 2024-09-16T02:05:49.941 INFO:tasks.workunit.client.0.smithi110.stdout:4/98: dwrite d4/d12/d18/f1f [0,4194304] 0 2024-09-16T02:05:49.941 INFO:tasks.workunit.client.1.smithi165.stdout:6/401: dread d7/dc/df/d1a/f45 [0,4194304] 0 2024-09-16T02:05:49.941 INFO:tasks.workunit.client.1.smithi165.stdout:6/402: stat f2 0 2024-09-16T02:05:49.945 INFO:tasks.workunit.client.1.smithi165.stdout:1/373: unlink d1/c38 0 2024-09-16T02:05:49.945 INFO:tasks.workunit.client.1.smithi165.stdout:5/405: dwrite de/d19/d1c/f3e [0,4194304] 0 2024-09-16T02:05:49.945 INFO:tasks.workunit.client.0.smithi110.stdout:4/99: rmdir d4/d12/d18 39 2024-09-16T02:05:49.947 INFO:tasks.workunit.client.1.smithi165.stdout:9/467: mknod d7/d55/c9a 0 2024-09-16T02:05:49.948 INFO:tasks.workunit.client.1.smithi165.stdout:8/445: getdents dd/d11/d14/d70/d7b 0 2024-09-16T02:05:49.954 INFO:tasks.workunit.client.1.smithi165.stdout:3/497: creat da/d17/d7a/d7d/da8/fb1 x:0 0 0 2024-09-16T02:05:49.955 INFO:tasks.workunit.client.0.smithi110.stdout:4/100: dread f3 [0,4194304] 0 2024-09-16T02:05:49.955 INFO:tasks.workunit.client.0.smithi110.stdout:4/101: chown d4/d12 373440392 1 2024-09-16T02:05:49.956 INFO:tasks.workunit.client.1.smithi165.stdout:2/462: rmdir df/d23/d28/d3b/d6d 39 2024-09-16T02:05:49.957 INFO:tasks.workunit.client.0.smithi110.stdout:1/149: rmdir d0/da 39 2024-09-16T02:05:49.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/375: symlink d4/dc/d18/l7c 0 2024-09-16T02:05:49.958 INFO:tasks.workunit.client.1.smithi165.stdout:5/406: dwrite fa [0,4194304] 0 2024-09-16T02:05:49.959 INFO:tasks.workunit.client.1.smithi165.stdout:1/374: dwrite d1/dd/d11/f15 [4194304,4194304] 0 2024-09-16T02:05:49.960 INFO:tasks.workunit.client.0.smithi110.stdout:4/102: rmdir d4/d12/d18 39 2024-09-16T02:05:49.961 INFO:tasks.workunit.client.1.smithi165.stdout:1/375: write d1/dd/d11/f1d [1998117,51642] 0 2024-09-16T02:05:49.963 INFO:tasks.workunit.client.0.smithi110.stdout:1/150: write d0/da/f2c [96307,36929] 0 2024-09-16T02:05:49.969 INFO:tasks.workunit.client.0.smithi110.stdout:4/103: mkdir d4/d8/d17/d23 0 2024-09-16T02:05:49.971 INFO:tasks.workunit.client.1.smithi165.stdout:0/380: sync 2024-09-16T02:05:49.973 INFO:tasks.workunit.client.0.smithi110.stdout:4/104: unlink d4/d12/f13 0 2024-09-16T02:05:49.974 INFO:tasks.workunit.client.1.smithi165.stdout:8/446: write dd/d11/d14/d3f/f6a [403552,5459] 0 2024-09-16T02:05:49.976 INFO:tasks.workunit.client.0.smithi110.stdout:1/151: rename d0/da/l1b to d0/d1/d2a/l2d 0 2024-09-16T02:05:49.977 INFO:tasks.workunit.client.0.smithi110.stdout:1/152: readlink d0/d1/d4/l3 0 2024-09-16T02:05:49.978 INFO:tasks.workunit.client.1.smithi165.stdout:3/498: symlink da/d17/d78/d91/lb2 0 2024-09-16T02:05:49.982 INFO:tasks.workunit.client.1.smithi165.stdout:9/468: write d7/df/d37/f3b [1726600,67347] 0 2024-09-16T02:05:49.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/105: dread d4/f15 [0,4194304] 0 2024-09-16T02:05:49.984 INFO:tasks.workunit.client.0.smithi110.stdout:1/153: symlink d0/da/l2e 0 2024-09-16T02:05:49.987 INFO:tasks.workunit.client.1.smithi165.stdout:3/499: dwrite da/d20/d26/d52/fac [0,4194304] 0 2024-09-16T02:05:49.989 INFO:tasks.workunit.client.0.smithi110.stdout:1/154: rename d0/d1/d4/c13 to d0/d1/d2a/c2f 0 2024-09-16T02:05:49.989 INFO:tasks.workunit.client.0.smithi110.stdout:1/155: fdatasync d0/da/f2c 0 2024-09-16T02:05:49.997 INFO:tasks.workunit.client.0.smithi110.stdout:1/156: truncate d0/da/f28 5767187 0 2024-09-16T02:05:49.999 INFO:tasks.workunit.client.0.smithi110.stdout:4/106: getdents d4/d8 0 2024-09-16T02:05:50.000 INFO:tasks.workunit.client.0.smithi110.stdout:1/157: symlink d0/d1/l30 0 2024-09-16T02:05:50.001 INFO:tasks.workunit.client.0.smithi110.stdout:1/158: readlink d0/da/l2e 0 2024-09-16T02:05:50.004 INFO:tasks.workunit.client.0.smithi110.stdout:1/159: dread d0/da/f15 [4194304,4194304] 0 2024-09-16T02:05:50.004 INFO:tasks.workunit.client.1.smithi165.stdout:7/386: getdents d0/df/d33 0 2024-09-16T02:05:50.005 INFO:tasks.workunit.client.0.smithi110.stdout:1/160: chown d0/da/f17 52785 1 2024-09-16T02:05:50.007 INFO:tasks.workunit.client.1.smithi165.stdout:8/447: creat dd/d11/d14/d3f/f9c x:0 0 0 2024-09-16T02:05:50.009 INFO:tasks.workunit.client.0.smithi110.stdout:1/161: creat d0/d1/d4/f31 x:0 0 0 2024-09-16T02:05:50.011 INFO:tasks.workunit.client.0.smithi110.stdout:4/107: creat d4/d12/f24 x:0 0 0 2024-09-16T02:05:50.013 INFO:tasks.workunit.client.0.smithi110.stdout:1/162: mkdir d0/d1/d2a/d32 0 2024-09-16T02:05:50.014 INFO:tasks.workunit.client.0.smithi110.stdout:1/163: readlink d0/d1/l30 0 2024-09-16T02:05:50.014 INFO:tasks.workunit.client.1.smithi165.stdout:9/469: symlink d7/d1f/d27/d49/l9b 0 2024-09-16T02:05:50.015 INFO:tasks.workunit.client.0.smithi110.stdout:4/108: readlink d4/d12/d18/l1b 0 2024-09-16T02:05:50.015 INFO:tasks.workunit.client.1.smithi165.stdout:6/403: link d7/d1f/l36 d7/dc/d3b/d3c/l67 0 2024-09-16T02:05:50.016 INFO:tasks.workunit.client.0.smithi110.stdout:4/109: write d4/d12/d18/f1f [791685,41609] 0 2024-09-16T02:05:50.018 INFO:tasks.workunit.client.1.smithi165.stdout:4/376: link d4/dc/d28/f43 d4/dc/d18/d37/d47/d71/f7d 0 2024-09-16T02:05:50.020 INFO:tasks.workunit.client.0.smithi110.stdout:4/110: dread d4/f10 [0,4194304] 0 2024-09-16T02:05:50.021 INFO:tasks.workunit.client.1.smithi165.stdout:3/500: rename da/de/f1d to da/d17/d7a/d7d/fb3 0 2024-09-16T02:05:50.022 INFO:tasks.workunit.client.1.smithi165.stdout:5/407: truncate fa 697534 0 2024-09-16T02:05:50.023 INFO:tasks.workunit.client.1.smithi165.stdout:1/376: link d1/dd/d11/f61 d1/d22/f74 0 2024-09-16T02:05:50.024 INFO:tasks.workunit.client.1.smithi165.stdout:1/377: chown d1/d19/l2b 4 1 2024-09-16T02:05:50.028 INFO:tasks.workunit.client.1.smithi165.stdout:5/408: dwrite de/d19/d1c/f4f [0,4194304] 0 2024-09-16T02:05:50.033 INFO:tasks.workunit.client.1.smithi165.stdout:7/387: dwrite d0/df/d33/d2a/f36 [0,4194304] 0 2024-09-16T02:05:50.034 INFO:tasks.workunit.client.1.smithi165.stdout:7/388: chown d0/df/d33/c64 851 1 2024-09-16T02:05:50.035 INFO:tasks.workunit.client.1.smithi165.stdout:4/377: rmdir d4/d40/d4f 39 2024-09-16T02:05:50.035 INFO:tasks.workunit.client.1.smithi165.stdout:4/378: write d4/f1e [4569528,46665] 0 2024-09-16T02:05:50.036 INFO:tasks.workunit.client.0.smithi110.stdout:1/164: getdents d0/d25 0 2024-09-16T02:05:50.037 INFO:tasks.workunit.client.0.smithi110.stdout:4/111: truncate d4/d12/d18/f1f 2495828 0 2024-09-16T02:05:50.038 INFO:tasks.workunit.client.0.smithi110.stdout:4/112: write d4/f21 [519805,45508] 0 2024-09-16T02:05:50.040 INFO:tasks.workunit.client.1.smithi165.stdout:9/470: rename f5 to d7/d32/d38/d58/d99/f9c 0 2024-09-16T02:05:50.042 INFO:tasks.workunit.client.0.smithi110.stdout:1/165: rename d0/da/f15 to d0/d1/d2a/d32/f33 0 2024-09-16T02:05:50.042 INFO:tasks.workunit.client.0.smithi110.stdout:1/166: chown d0/da/f29 1 1 2024-09-16T02:05:50.043 INFO:tasks.workunit.client.1.smithi165.stdout:1/378: truncate d1/d22/f74 14821 0 2024-09-16T02:05:50.047 INFO:tasks.workunit.client.1.smithi165.stdout:8/448: mknod dd/d13/d89/c9d 0 2024-09-16T02:05:50.047 INFO:tasks.workunit.client.1.smithi165.stdout:0/381: dread d0/d1e/d39/d48/d5f/f73 [0,4194304] 0 2024-09-16T02:05:50.047 INFO:tasks.workunit.client.0.smithi110.stdout:1/167: dread d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:50.048 INFO:tasks.workunit.client.0.smithi110.stdout:1/168: fsync d0/da/f17 0 2024-09-16T02:05:50.049 INFO:tasks.workunit.client.1.smithi165.stdout:4/379: dread d4/dc/d28/d2b/f41 [0,4194304] 0 2024-09-16T02:05:50.049 INFO:tasks.workunit.client.1.smithi165.stdout:2/463: getdents df/d23/d28/d3b 0 2024-09-16T02:05:50.050 INFO:tasks.workunit.client.0.smithi110.stdout:4/113: getdents d4/d12/d18 0 2024-09-16T02:05:50.051 INFO:tasks.workunit.client.0.smithi110.stdout:4/114: chown d4/l5 925 1 2024-09-16T02:05:50.051 INFO:tasks.workunit.client.1.smithi165.stdout:7/389: symlink d0/l79 0 2024-09-16T02:05:50.053 INFO:tasks.workunit.client.1.smithi165.stdout:7/390: write d0/df/f27 [1555772,118665] 0 2024-09-16T02:05:50.053 INFO:tasks.workunit.client.0.smithi110.stdout:4/115: read d4/f14 [881926,74396] 0 2024-09-16T02:05:50.054 INFO:tasks.workunit.client.1.smithi165.stdout:7/391: write d0/f12 [7128828,23921] 0 2024-09-16T02:05:50.055 INFO:tasks.workunit.client.1.smithi165.stdout:4/380: dwrite d4/dc/d20/f6a [0,4194304] 0 2024-09-16T02:05:50.056 INFO:tasks.workunit.client.1.smithi165.stdout:7/392: read d0/df/d33/f4a [2279942,18041] 0 2024-09-16T02:05:50.058 INFO:tasks.workunit.client.1.smithi165.stdout:9/471: creat d7/d14/f9d x:0 0 0 2024-09-16T02:05:50.059 INFO:tasks.workunit.client.1.smithi165.stdout:9/472: chown d7/df/d37/f83 2327 1 2024-09-16T02:05:50.060 INFO:tasks.workunit.client.1.smithi165.stdout:1/379: write d1/d22/f3d [666774,118900] 0 2024-09-16T02:05:50.066 INFO:tasks.workunit.client.1.smithi165.stdout:5/409: symlink de/d19/d67/d74/l86 0 2024-09-16T02:05:50.067 INFO:tasks.workunit.client.0.smithi110.stdout:4/116: dread d4/d12/d18/f1f [0,4194304] 0 2024-09-16T02:05:50.068 INFO:tasks.workunit.client.1.smithi165.stdout:6/404: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T02:05:50.070 INFO:tasks.workunit.client.0.smithi110.stdout:4/117: truncate f3 443807 0 2024-09-16T02:05:50.075 INFO:tasks.workunit.client.0.smithi110.stdout:1/169: dwrite d0/d1/d8/f19 [0,4194304] 0 2024-09-16T02:05:50.075 INFO:tasks.workunit.client.0.smithi110.stdout:4/118: creat d4/d8/f25 x:0 0 0 2024-09-16T02:05:50.076 INFO:tasks.workunit.client.0.smithi110.stdout:4/119: dread - d4/fc zero size 2024-09-16T02:05:50.077 INFO:tasks.workunit.client.1.smithi165.stdout:4/381: creat d4/dc/d18/d37/d53/d64/f7e x:0 0 0 2024-09-16T02:05:50.083 INFO:tasks.workunit.client.1.smithi165.stdout:9/473: creat d7/df/d67/f9e x:0 0 0 2024-09-16T02:05:50.084 INFO:tasks.workunit.client.1.smithi165.stdout:4/382: dwrite d4/dc/d28/f4a [0,4194304] 0 2024-09-16T02:05:50.085 INFO:tasks.workunit.client.1.smithi165.stdout:1/380: chown d1/dd/f10 80901 1 2024-09-16T02:05:50.085 INFO:tasks.workunit.client.1.smithi165.stdout:4/383: chown d4/dc/d20/d4e/f54 25986452 1 2024-09-16T02:05:50.085 INFO:tasks.workunit.client.1.smithi165.stdout:0/382: symlink d0/d1e/l89 0 2024-09-16T02:05:50.091 INFO:tasks.workunit.client.0.smithi110.stdout:4/120: dwrite d4/f11 [0,4194304] 0 2024-09-16T02:05:50.092 INFO:tasks.workunit.client.1.smithi165.stdout:7/393: link d0/d3d/f6b d0/d2c/f7a 0 2024-09-16T02:05:50.092 INFO:tasks.workunit.client.0.smithi110.stdout:4/121: dread - d4/d12/f24 zero size 2024-09-16T02:05:50.093 INFO:tasks.workunit.client.0.smithi110.stdout:1/170: link d0/da/f28 d0/d1/d2a/f34 0 2024-09-16T02:05:50.093 INFO:tasks.workunit.client.1.smithi165.stdout:7/394: write d0/df/d33/d2a/f54 [1726018,31276] 0 2024-09-16T02:05:50.094 INFO:tasks.workunit.client.1.smithi165.stdout:6/405: dread d7/dc/df/d1a/f45 [0,4194304] 0 2024-09-16T02:05:50.094 INFO:tasks.workunit.client.0.smithi110.stdout:4/122: fsync d4/d8/f25 0 2024-09-16T02:05:50.094 INFO:tasks.workunit.client.0.smithi110.stdout:1/171: write d0/d1/d4/f31 [15135,59244] 0 2024-09-16T02:05:50.095 INFO:tasks.workunit.client.1.smithi165.stdout:3/501: sync 2024-09-16T02:05:50.096 INFO:tasks.workunit.client.1.smithi165.stdout:9/474: fdatasync d7/d32/f47 0 2024-09-16T02:05:50.096 INFO:tasks.workunit.client.1.smithi165.stdout:3/502: chown da/d20/d26/d52/d6b 8 1 2024-09-16T02:05:50.097 INFO:tasks.workunit.client.1.smithi165.stdout:1/381: symlink d1/d68/d54/l75 0 2024-09-16T02:05:50.097 INFO:tasks.workunit.client.1.smithi165.stdout:3/503: dread - da/d57/f7c zero size 2024-09-16T02:05:50.099 INFO:tasks.workunit.client.1.smithi165.stdout:4/384: symlink d4/dc/d20/l7f 0 2024-09-16T02:05:50.099 INFO:tasks.workunit.client.0.smithi110.stdout:1/172: symlink d0/d1/d2a/d32/l35 0 2024-09-16T02:05:50.101 INFO:tasks.workunit.client.0.smithi110.stdout:4/123: creat d4/d8/d17/f26 x:0 0 0 2024-09-16T02:05:50.101 INFO:tasks.workunit.client.1.smithi165.stdout:1/382: dread d1/d19/d24/d30/f40 [0,4194304] 0 2024-09-16T02:05:50.104 INFO:tasks.workunit.client.1.smithi165.stdout:5/410: symlink de/d21/d26/d3a/d54/l87 0 2024-09-16T02:05:50.104 INFO:tasks.workunit.client.0.smithi110.stdout:1/173: chown d0/da/c12 10 1 2024-09-16T02:05:50.105 INFO:tasks.workunit.client.1.smithi165.stdout:2/464: link df/c1f df/d23/d28/c8c 0 2024-09-16T02:05:50.106 INFO:tasks.workunit.client.0.smithi110.stdout:1/174: write d0/d1/d4/f31 [342205,83231] 0 2024-09-16T02:05:50.106 INFO:tasks.workunit.client.1.smithi165.stdout:2/465: fsync df/d73/f7c 0 2024-09-16T02:05:50.106 INFO:tasks.workunit.client.0.smithi110.stdout:1/175: chown d0/d1/d4/f31 67934 1 2024-09-16T02:05:50.107 INFO:tasks.workunit.client.0.smithi110.stdout:4/124: write d4/d12/d18/f1f [1688053,16323] 0 2024-09-16T02:05:50.108 INFO:tasks.workunit.client.0.smithi110.stdout:4/125: readlink d4/d12/d18/l19 0 2024-09-16T02:05:50.110 INFO:tasks.workunit.client.1.smithi165.stdout:3/504: dread da/d17/f1a [0,4194304] 0 2024-09-16T02:05:50.111 INFO:tasks.workunit.client.0.smithi110.stdout:1/176: creat d0/da/f36 x:0 0 0 2024-09-16T02:05:50.112 INFO:tasks.workunit.client.0.smithi110.stdout:4/126: dread d4/f11 [0,4194304] 0 2024-09-16T02:05:50.113 INFO:tasks.workunit.client.1.smithi165.stdout:9/475: rename d7/l2f to d7/d32/d38/d53/d56/d95/l9f 0 2024-09-16T02:05:50.114 INFO:tasks.workunit.client.1.smithi165.stdout:8/449: getdents dd/d11/d38 0 2024-09-16T02:05:50.115 INFO:tasks.workunit.client.0.smithi110.stdout:1/177: unlink d0/d1/l1c 0 2024-09-16T02:05:50.116 INFO:tasks.workunit.client.0.smithi110.stdout:4/127: creat d4/d12/d18/f27 x:0 0 0 2024-09-16T02:05:50.116 INFO:tasks.workunit.client.1.smithi165.stdout:0/383: getdents d0/d47 0 2024-09-16T02:05:50.117 INFO:tasks.workunit.client.1.smithi165.stdout:0/384: read - d0/d2a/f77 zero size 2024-09-16T02:05:50.118 INFO:tasks.workunit.client.1.smithi165.stdout:2/466: creat df/d23/d66/f8d x:0 0 0 2024-09-16T02:05:50.119 INFO:tasks.workunit.client.1.smithi165.stdout:7/395: symlink d0/df/d7/d67/l7b 0 2024-09-16T02:05:50.120 INFO:tasks.workunit.client.0.smithi110.stdout:1/178: dwrite d0/f14 [0,4194304] 0 2024-09-16T02:05:50.121 INFO:tasks.workunit.client.1.smithi165.stdout:6/406: symlink d7/dc/d3b/l68 0 2024-09-16T02:05:50.123 INFO:tasks.workunit.client.1.smithi165.stdout:9/476: chown d7/d32/d38/d58/c63 30337519 1 2024-09-16T02:05:50.124 INFO:tasks.workunit.client.0.smithi110.stdout:1/179: creat d0/d1/d2a/f37 x:0 0 0 2024-09-16T02:05:50.126 INFO:tasks.workunit.client.1.smithi165.stdout:2/467: dwrite df/d23/d28/f53 [0,4194304] 0 2024-09-16T02:05:50.126 INFO:tasks.workunit.client.1.smithi165.stdout:4/385: link d4/dc/d18/d37/d47/f63 d4/dc/d28/d30/f80 0 2024-09-16T02:05:50.129 INFO:tasks.workunit.client.0.smithi110.stdout:1/180: creat d0/d1/d2a/d32/f38 x:0 0 0 2024-09-16T02:05:50.129 INFO:tasks.workunit.client.0.smithi110.stdout:1/181: stat d0/d1/c1f 0 2024-09-16T02:05:50.130 INFO:tasks.workunit.client.1.smithi165.stdout:5/411: creat de/d19/d1c/d84/f88 x:0 0 0 2024-09-16T02:05:50.131 INFO:tasks.workunit.client.0.smithi110.stdout:1/182: write d0/d1/d4/f26 [780610,23540] 0 2024-09-16T02:05:50.132 INFO:tasks.workunit.client.1.smithi165.stdout:2/468: chown df/d10/c17 340 1 2024-09-16T02:05:50.132 INFO:tasks.workunit.client.0.smithi110.stdout:1/183: chown d0/d1/d4 3277 1 2024-09-16T02:05:50.132 INFO:tasks.workunit.client.0.smithi110.stdout:1/184: chown d0/d1 2 1 2024-09-16T02:05:50.133 INFO:tasks.workunit.client.1.smithi165.stdout:3/505: dwrite da/d17/d7a/d7d/fb3 [0,4194304] 0 2024-09-16T02:05:50.138 INFO:tasks.workunit.client.1.smithi165.stdout:8/450: mkdir dd/d9e 0 2024-09-16T02:05:50.138 INFO:tasks.workunit.client.1.smithi165.stdout:6/407: dwrite d7/f23 [0,4194304] 0 2024-09-16T02:05:50.142 INFO:tasks.workunit.client.1.smithi165.stdout:1/383: link d1/dd/l69 d1/d6b/l76 0 2024-09-16T02:05:50.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/185: dwrite d0/d1/d8/f19 [0,4194304] 0 2024-09-16T02:05:50.143 INFO:tasks.workunit.client.1.smithi165.stdout:4/386: dwrite d4/dc/d18/f23 [0,4194304] 0 2024-09-16T02:05:50.143 INFO:tasks.workunit.client.1.smithi165.stdout:9/477: creat d7/df/d67/d92/d93/fa0 x:0 0 0 2024-09-16T02:05:50.144 INFO:tasks.workunit.client.0.smithi110.stdout:4/128: dwrite d4/f14 [0,4194304] 0 2024-09-16T02:05:50.145 INFO:tasks.workunit.client.1.smithi165.stdout:0/385: creat d0/d1e/d39/d48/d5f/d82/f8a x:0 0 0 2024-09-16T02:05:50.145 INFO:tasks.workunit.client.1.smithi165.stdout:4/387: read - d4/dc/d28/f5f zero size 2024-09-16T02:05:50.146 INFO:tasks.workunit.client.0.smithi110.stdout:4/129: stat d4/d12/d18/l1b 0 2024-09-16T02:05:50.147 INFO:tasks.workunit.client.1.smithi165.stdout:0/386: write d0/d47/f6f [265972,107855] 0 2024-09-16T02:05:50.147 INFO:tasks.workunit.client.1.smithi165.stdout:0/387: fdatasync d0/f15 0 2024-09-16T02:05:50.148 INFO:tasks.workunit.client.0.smithi110.stdout:4/130: rename d4/d8 to d4/d8/d17/d23/d28 22 2024-09-16T02:05:50.149 INFO:tasks.workunit.client.1.smithi165.stdout:5/412: creat de/d21/d26/d3a/d54/f89 x:0 0 0 2024-09-16T02:05:50.152 INFO:tasks.workunit.client.1.smithi165.stdout:6/408: creat d7/d17/f69 x:0 0 0 2024-09-16T02:05:50.153 INFO:tasks.workunit.client.0.smithi110.stdout:1/186: dwrite d0/d1/f23 [0,4194304] 0 2024-09-16T02:05:50.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/384: write d1/d19/d24/d30/f40 [729942,42153] 0 2024-09-16T02:05:50.160 INFO:tasks.workunit.client.1.smithi165.stdout:6/409: dwrite f2 [0,4194304] 0 2024-09-16T02:05:50.161 INFO:tasks.workunit.client.1.smithi165.stdout:6/410: dread - d7/d17/f69 zero size 2024-09-16T02:05:50.162 INFO:tasks.workunit.client.1.smithi165.stdout:6/411: stat d7/dc/d3b/d3a/f49 0 2024-09-16T02:05:50.166 INFO:tasks.workunit.client.0.smithi110.stdout:1/187: symlink d0/d1/l39 0 2024-09-16T02:05:50.167 INFO:tasks.workunit.client.0.smithi110.stdout:1/188: dread - d0/da/f36 zero size 2024-09-16T02:05:50.167 INFO:tasks.workunit.client.1.smithi165.stdout:7/396: write d0/d2c/f7a [929660,59979] 0 2024-09-16T02:05:50.167 INFO:tasks.workunit.client.1.smithi165.stdout:0/388: rmdir d0/d2a 39 2024-09-16T02:05:50.167 INFO:tasks.workunit.client.1.smithi165.stdout:2/469: getdents df/d10/d64 0 2024-09-16T02:05:50.169 INFO:tasks.workunit.client.1.smithi165.stdout:8/451: mknod dd/d9e/c9f 0 2024-09-16T02:05:50.169 INFO:tasks.workunit.client.1.smithi165.stdout:0/389: chown d0/d1e/d39/c80 570 1 2024-09-16T02:05:50.170 INFO:tasks.workunit.client.0.smithi110.stdout:1/189: rmdir d0/d1/d2a/d32 39 2024-09-16T02:05:50.171 INFO:tasks.workunit.client.0.smithi110.stdout:1/190: chown d0/d1/d4/l1a 230700 1 2024-09-16T02:05:50.175 INFO:tasks.workunit.client.1.smithi165.stdout:8/452: dwrite dd/f41 [0,4194304] 0 2024-09-16T02:05:50.177 INFO:tasks.workunit.client.1.smithi165.stdout:1/385: readlink d1/d68/l5c 0 2024-09-16T02:05:50.177 INFO:tasks.workunit.client.1.smithi165.stdout:6/412: rmdir d7/dc 39 2024-09-16T02:05:50.178 INFO:tasks.workunit.client.0.smithi110.stdout:1/191: creat d0/d1/d2a/d32/f3a x:0 0 0 2024-09-16T02:05:50.178 INFO:tasks.workunit.client.1.smithi165.stdout:6/413: fsync f3 0 2024-09-16T02:05:50.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/506: creat da/d57/fb4 x:0 0 0 2024-09-16T02:05:50.180 INFO:tasks.workunit.client.1.smithi165.stdout:1/386: truncate d1/d68/f64 4276603 0 2024-09-16T02:05:50.180 INFO:tasks.workunit.client.1.smithi165.stdout:1/387: stat d1/c62 0 2024-09-16T02:05:50.181 INFO:tasks.workunit.client.1.smithi165.stdout:3/507: write da/d17/d7a/f96 [414721,35588] 0 2024-09-16T02:05:50.184 INFO:tasks.workunit.client.1.smithi165.stdout:3/508: write da/d20/d26/d52/fac [142268,15559] 0 2024-09-16T02:05:50.188 INFO:tasks.workunit.client.0.smithi110.stdout:4/131: dwrite d4/f10 [0,4194304] 0 2024-09-16T02:05:50.189 INFO:tasks.workunit.client.1.smithi165.stdout:8/453: mknod dd/d11/d38/ca0 0 2024-09-16T02:05:50.191 INFO:tasks.workunit.client.1.smithi165.stdout:8/454: write dd/d11/d14/f54 [74061,106121] 0 2024-09-16T02:05:50.191 INFO:tasks.workunit.client.1.smithi165.stdout:8/455: chown dd/d11/d14/d3f/d25/d36/d4f/c8f 5 1 2024-09-16T02:05:50.194 INFO:tasks.workunit.client.1.smithi165.stdout:6/414: dread - d7/dc/d3b/f64 zero size 2024-09-16T02:05:50.197 INFO:tasks.workunit.client.0.smithi110.stdout:4/132: creat d4/d12/d18/f29 x:0 0 0 2024-09-16T02:05:50.197 INFO:tasks.workunit.client.0.smithi110.stdout:1/192: write d0/d1/d2a/f34 [2393909,38524] 0 2024-09-16T02:05:50.198 INFO:tasks.workunit.client.1.smithi165.stdout:2/470: creat df/d23/d28/d3b/d6d/d8b/f8e x:0 0 0 2024-09-16T02:05:50.198 INFO:tasks.workunit.client.1.smithi165.stdout:0/390: creat d0/d2a/d70/f8b x:0 0 0 2024-09-16T02:05:50.199 INFO:tasks.workunit.client.1.smithi165.stdout:9/478: truncate d7/d32/d38/d68/d7f/f70 2939155 0 2024-09-16T02:05:50.204 INFO:tasks.workunit.client.1.smithi165.stdout:3/509: mkdir da/d17/d78/d2c/d2d/d6c/db5 0 2024-09-16T02:05:50.204 INFO:tasks.workunit.client.0.smithi110.stdout:1/193: creat d0/d25/f3b x:0 0 0 2024-09-16T02:05:50.204 INFO:tasks.workunit.client.0.smithi110.stdout:4/133: dwrite d4/d12/d18/f1f [0,4194304] 0 2024-09-16T02:05:50.205 INFO:tasks.workunit.client.1.smithi165.stdout:4/388: getdents d4 0 2024-09-16T02:05:50.211 INFO:tasks.workunit.client.0.smithi110.stdout:1/194: symlink d0/d1/l3c 0 2024-09-16T02:05:50.212 INFO:tasks.workunit.client.0.smithi110.stdout:1/195: dread - d0/d25/f3b zero size 2024-09-16T02:05:50.215 INFO:tasks.workunit.client.1.smithi165.stdout:8/456: dread dd/d13/f32 [0,4194304] 0 2024-09-16T02:05:50.215 INFO:tasks.workunit.client.1.smithi165.stdout:0/391: truncate d0/d1e/d39/d48/d45/f44 3034012 0 2024-09-16T02:05:50.216 INFO:tasks.workunit.client.0.smithi110.stdout:4/134: symlink d4/d12/d18/l2a 0 2024-09-16T02:05:50.216 INFO:tasks.workunit.client.0.smithi110.stdout:4/135: chown d4/d8/lf 260115 1 2024-09-16T02:05:50.216 INFO:tasks.workunit.client.1.smithi165.stdout:8/457: chown dd/d11/d14/d3f/f9c 1 1 2024-09-16T02:05:50.217 INFO:tasks.workunit.client.0.smithi110.stdout:1/196: mknod d0/da/c3d 0 2024-09-16T02:05:50.217 INFO:tasks.workunit.client.1.smithi165.stdout:8/458: chown dd/d11/d14/d3f/d25/f6f 115980918 1 2024-09-16T02:05:50.218 INFO:tasks.workunit.client.0.smithi110.stdout:1/197: chown d0/da/f17 0 1 2024-09-16T02:05:50.219 INFO:tasks.workunit.client.1.smithi165.stdout:1/388: rename d1/d22/c2a to d1/d19/d24/c77 0 2024-09-16T02:05:50.219 INFO:tasks.workunit.client.0.smithi110.stdout:1/198: chown d0/d1/l30 620618320 1 2024-09-16T02:05:50.221 INFO:tasks.workunit.client.1.smithi165.stdout:3/510: creat da/d20/d26/d6e/fb6 x:0 0 0 2024-09-16T02:05:50.221 INFO:tasks.workunit.client.1.smithi165.stdout:3/511: fdatasync da/faf 0 2024-09-16T02:05:50.221 INFO:tasks.workunit.client.0.smithi110.stdout:1/199: chown d0/d1/d2a/f37 30277 1 2024-09-16T02:05:50.222 INFO:tasks.workunit.client.1.smithi165.stdout:9/479: mknod d7/d14/d7a/ca1 0 2024-09-16T02:05:50.223 INFO:tasks.workunit.client.0.smithi110.stdout:4/136: dwrite d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:50.225 INFO:tasks.workunit.client.1.smithi165.stdout:5/413: getdents de/d60/d65 0 2024-09-16T02:05:50.230 INFO:tasks.workunit.client.1.smithi165.stdout:2/471: rename df/d23/d28/d3b/d6d/l85 to df/d73/l8f 0 2024-09-16T02:05:50.231 INFO:tasks.workunit.client.1.smithi165.stdout:1/389: fdatasync d1/dd/d11/d33/d3f/d59/f60 0 2024-09-16T02:05:50.232 INFO:tasks.workunit.client.0.smithi110.stdout:4/137: dwrite d4/d8/f25 [0,4194304] 0 2024-09-16T02:05:50.236 INFO:tasks.workunit.client.1.smithi165.stdout:6/415: creat d7/dc/d3b/f6a x:0 0 0 2024-09-16T02:05:50.239 INFO:tasks.workunit.client.1.smithi165.stdout:9/480: fdatasync d7/d55/f66 0 2024-09-16T02:05:50.240 INFO:tasks.workunit.client.1.smithi165.stdout:9/481: fdatasync d7/d1f/f46 0 2024-09-16T02:05:50.241 INFO:tasks.workunit.client.0.smithi110.stdout:1/200: getdents d0/d1 0 2024-09-16T02:05:50.241 INFO:tasks.workunit.client.0.smithi110.stdout:1/201: stat d0/d25/c27 0 2024-09-16T02:05:50.241 INFO:tasks.workunit.client.1.smithi165.stdout:0/392: mknod d0/d1e/d39/d48/d6e/c8c 0 2024-09-16T02:05:50.242 INFO:tasks.workunit.client.0.smithi110.stdout:1/202: fsync d0/d1/d2a/d32/f3a 0 2024-09-16T02:05:50.242 INFO:tasks.workunit.client.1.smithi165.stdout:0/393: readlink d0/la 0 2024-09-16T02:05:50.243 INFO:tasks.workunit.client.1.smithi165.stdout:8/459: mknod dd/d11/d14/d70/d7b/d9a/ca1 0 2024-09-16T02:05:50.246 INFO:tasks.workunit.client.0.smithi110.stdout:4/138: creat d4/d12/f2b x:0 0 0 2024-09-16T02:05:50.246 INFO:tasks.workunit.client.0.smithi110.stdout:4/139: fdatasync d4/f10 0 2024-09-16T02:05:50.247 INFO:tasks.workunit.client.0.smithi110.stdout:1/203: creat d0/d25/f3e x:0 0 0 2024-09-16T02:05:50.249 INFO:tasks.workunit.client.1.smithi165.stdout:0/394: dread d0/d1e/d20/f7f [0,4194304] 0 2024-09-16T02:05:50.249 INFO:tasks.workunit.client.1.smithi165.stdout:5/414: write de/d19/d1c/d4d/f7e [5345487,65308] 0 2024-09-16T02:05:50.250 INFO:tasks.workunit.client.1.smithi165.stdout:9/482: symlink d7/df/d67/la2 0 2024-09-16T02:05:50.251 INFO:tasks.workunit.client.1.smithi165.stdout:1/390: dread d1/dd/d11/d33/d3f/d59/f60 [0,4194304] 0 2024-09-16T02:05:50.256 INFO:tasks.workunit.client.0.smithi110.stdout:4/140: truncate d4/f10 2911574 0 2024-09-16T02:05:50.262 INFO:tasks.workunit.client.0.smithi110.stdout:4/141: dwrite d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:50.264 INFO:tasks.workunit.client.0.smithi110.stdout:1/204: write d0/d1/f20 [9192638,9849] 0 2024-09-16T02:05:50.265 INFO:tasks.workunit.client.0.smithi110.stdout:1/205: chown d0/d25/f3b 14025 1 2024-09-16T02:05:50.269 INFO:tasks.workunit.client.0.smithi110.stdout:1/206: dread d0/f14 [0,4194304] 0 2024-09-16T02:05:50.271 INFO:tasks.workunit.client.0.smithi110.stdout:1/207: creat d0/d1/f3f x:0 0 0 2024-09-16T02:05:50.272 INFO:tasks.workunit.client.0.smithi110.stdout:4/142: dread d4/f1c [0,4194304] 0 2024-09-16T02:05:50.273 INFO:tasks.workunit.client.1.smithi165.stdout:7/397: sync 2024-09-16T02:05:50.273 INFO:tasks.workunit.client.0.smithi110.stdout:4/143: write d4/d12/d18/f27 [1414255,9503] 0 2024-09-16T02:05:50.274 INFO:tasks.workunit.client.1.smithi165.stdout:5/415: read de/d21/f63 [3434290,7336] 0 2024-09-16T02:05:50.274 INFO:tasks.workunit.client.1.smithi165.stdout:8/460: unlink dd/d11/d14/d3f/d25/d36/d81/c8e 0 2024-09-16T02:05:50.274 INFO:tasks.workunit.client.0.smithi110.stdout:4/144: chown d4/f15 78347 1 2024-09-16T02:05:50.274 INFO:tasks.workunit.client.1.smithi165.stdout:9/483: write d7/df/d67/d92/d93/f96 [741638,66327] 0 2024-09-16T02:05:50.275 INFO:tasks.workunit.client.1.smithi165.stdout:0/395: symlink d0/d47/l8d 0 2024-09-16T02:05:50.275 INFO:tasks.workunit.client.1.smithi165.stdout:6/416: truncate d7/d17/d24/f51 3157756 0 2024-09-16T02:05:50.276 INFO:tasks.workunit.client.1.smithi165.stdout:8/461: chown dd/d9e/c9f 1062648 1 2024-09-16T02:05:50.277 INFO:tasks.workunit.client.1.smithi165.stdout:2/472: link df/f3f df/f90 0 2024-09-16T02:05:50.278 INFO:tasks.workunit.client.1.smithi165.stdout:6/417: dread - d7/dc/d3b/d3a/f49 zero size 2024-09-16T02:05:50.278 INFO:tasks.workunit.client.0.smithi110.stdout:4/145: rename d4/d8/f25 to d4/f2c 0 2024-09-16T02:05:50.279 INFO:tasks.workunit.client.1.smithi165.stdout:1/391: symlink d1/dd/d11/l78 0 2024-09-16T02:05:50.283 INFO:tasks.workunit.client.0.smithi110.stdout:4/146: rmdir d4/d12 39 2024-09-16T02:05:50.284 INFO:tasks.workunit.client.1.smithi165.stdout:9/484: dwrite d7/df/d67/f9e [0,4194304] 0 2024-09-16T02:05:50.286 INFO:tasks.workunit.client.1.smithi165.stdout:6/418: dwrite d7/f23 [0,4194304] 0 2024-09-16T02:05:50.288 INFO:tasks.workunit.client.0.smithi110.stdout:4/147: symlink d4/d8/l2d 0 2024-09-16T02:05:50.288 INFO:tasks.workunit.client.1.smithi165.stdout:7/398: rename d0/df/d33/d2a/f40 to d0/d2c/f7c 0 2024-09-16T02:05:50.289 INFO:tasks.workunit.client.1.smithi165.stdout:6/419: write d7/dc/d3b/f64 [831536,53904] 0 2024-09-16T02:05:50.290 INFO:tasks.workunit.client.1.smithi165.stdout:7/399: read d0/d2c/f7a [953346,31398] 0 2024-09-16T02:05:50.291 INFO:tasks.workunit.client.0.smithi110.stdout:1/208: truncate d0/d1/f23 3583395 0 2024-09-16T02:05:50.293 INFO:tasks.workunit.client.0.smithi110.stdout:1/209: chown d0/d1/d2a/d32/f38 628 1 2024-09-16T02:05:50.296 INFO:tasks.workunit.client.1.smithi165.stdout:9/485: dwrite d7/df/d37/f6b [0,4194304] 0 2024-09-16T02:05:50.299 INFO:tasks.workunit.client.1.smithi165.stdout:9/486: dread - d7/d32/d38/d53/d5c/f8d zero size 2024-09-16T02:05:50.300 INFO:tasks.workunit.client.0.smithi110.stdout:1/210: mkdir d0/d1/d2a/d32/d40 0 2024-09-16T02:05:50.300 INFO:tasks.workunit.client.0.smithi110.stdout:4/148: dwrite d4/d12/f24 [0,4194304] 0 2024-09-16T02:05:50.301 INFO:tasks.workunit.client.0.smithi110.stdout:4/149: chown d4/fc 163935 1 2024-09-16T02:05:50.302 INFO:tasks.workunit.client.1.smithi165.stdout:7/400: dread d0/df/d68/f6c [0,4194304] 0 2024-09-16T02:05:50.303 INFO:tasks.workunit.client.1.smithi165.stdout:8/462: dwrite dd/d11/d14/f19 [0,4194304] 0 2024-09-16T02:05:50.304 INFO:tasks.workunit.client.1.smithi165.stdout:1/392: rename d1/dd/f37 to d1/f79 0 2024-09-16T02:05:50.305 INFO:tasks.workunit.client.1.smithi165.stdout:2/473: dread df/f3f [0,4194304] 0 2024-09-16T02:05:50.311 INFO:tasks.workunit.client.1.smithi165.stdout:0/396: dwrite d0/ff [0,4194304] 0 2024-09-16T02:05:50.312 INFO:tasks.workunit.client.0.smithi110.stdout:1/211: link d0/d25/f3b d0/d1/d2a/d32/f41 0 2024-09-16T02:05:50.313 INFO:tasks.workunit.client.1.smithi165.stdout:0/397: write d0/ff [1874555,45464] 0 2024-09-16T02:05:50.313 INFO:tasks.workunit.client.0.smithi110.stdout:1/212: readlink d0/d1/l39 0 2024-09-16T02:05:50.314 INFO:tasks.workunit.client.0.smithi110.stdout:4/150: mknod d4/d8/d17/d23/c2e 0 2024-09-16T02:05:50.314 INFO:tasks.workunit.client.0.smithi110.stdout:1/213: truncate d0/d1/d4/f31 888595 0 2024-09-16T02:05:50.315 INFO:tasks.workunit.client.0.smithi110.stdout:1/214: chown d0/d1/d4/l3 1645391 1 2024-09-16T02:05:50.320 INFO:tasks.workunit.client.0.smithi110.stdout:1/215: creat d0/d25/f42 x:0 0 0 2024-09-16T02:05:50.321 INFO:tasks.workunit.client.1.smithi165.stdout:6/420: write d7/d1f/f32 [1508185,69861] 0 2024-09-16T02:05:50.321 INFO:tasks.workunit.client.0.smithi110.stdout:1/216: dread - d0/d1/d2a/f37 zero size 2024-09-16T02:05:50.321 INFO:tasks.workunit.client.1.smithi165.stdout:6/421: chown d7/d1f 0 1 2024-09-16T02:05:50.322 INFO:tasks.workunit.client.1.smithi165.stdout:1/393: dread d1/dd/d11/d33/f3b [0,4194304] 0 2024-09-16T02:05:50.325 INFO:tasks.workunit.client.0.smithi110.stdout:4/151: rmdir d4/d8 39 2024-09-16T02:05:50.327 INFO:tasks.workunit.client.0.smithi110.stdout:1/217: mknod d0/d1/d2a/c43 0 2024-09-16T02:05:50.328 INFO:tasks.workunit.client.1.smithi165.stdout:1/394: dread d1/dd/d11/d33/f3b [0,4194304] 0 2024-09-16T02:05:50.328 INFO:tasks.workunit.client.0.smithi110.stdout:4/152: fdatasync d4/f11 0 2024-09-16T02:05:50.329 INFO:tasks.workunit.client.0.smithi110.stdout:1/218: write d0/d25/f3e [117861,33967] 0 2024-09-16T02:05:50.329 INFO:tasks.workunit.client.1.smithi165.stdout:8/463: dwrite dd/d11/d38/f4b [4194304,4194304] 0 2024-09-16T02:05:50.329 INFO:tasks.workunit.client.1.smithi165.stdout:0/398: rmdir d0/d2a 39 2024-09-16T02:05:50.330 INFO:tasks.workunit.client.0.smithi110.stdout:4/153: read d4/d12/d18/f1f [3367262,31458] 0 2024-09-16T02:05:50.330 INFO:tasks.workunit.client.0.smithi110.stdout:1/219: fsync d0/d1/d2a/f34 0 2024-09-16T02:05:50.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/401: symlink d0/df/d42/l7d 0 2024-09-16T02:05:50.331 INFO:tasks.workunit.client.1.smithi165.stdout:1/395: write d1/dd/d11/f15 [3073758,7189] 0 2024-09-16T02:05:50.331 INFO:tasks.workunit.client.1.smithi165.stdout:2/474: dwrite df/f90 [0,4194304] 0 2024-09-16T02:05:50.331 INFO:tasks.workunit.client.0.smithi110.stdout:4/154: readlink d4/l9 0 2024-09-16T02:05:50.332 INFO:tasks.workunit.client.1.smithi165.stdout:2/475: stat df/d10/d37/c60 0 2024-09-16T02:05:50.332 INFO:tasks.workunit.client.1.smithi165.stdout:8/464: readlink dd/d11/d14/d3f/d25/d36/l66 0 2024-09-16T02:05:50.333 INFO:tasks.workunit.client.1.smithi165.stdout:6/422: rename d7/dc/d3b/f6a to d7/dc/df/d1a/d4d/f6b 0 2024-09-16T02:05:50.335 INFO:tasks.workunit.client.1.smithi165.stdout:6/423: write d7/dc/d3b/d3a/f5a [1055635,43212] 0 2024-09-16T02:05:50.339 INFO:tasks.workunit.client.0.smithi110.stdout:1/220: symlink d0/l44 0 2024-09-16T02:05:50.340 INFO:tasks.workunit.client.0.smithi110.stdout:4/155: dwrite d4/d12/f2b [0,4194304] 0 2024-09-16T02:05:50.341 INFO:tasks.workunit.client.0.smithi110.stdout:4/156: fsync d4/d12/d18/f29 0 2024-09-16T02:05:50.342 INFO:tasks.workunit.client.1.smithi165.stdout:6/424: dwrite d7/dc/df/d1a/f4f [0,4194304] 0 2024-09-16T02:05:50.343 INFO:tasks.workunit.client.1.smithi165.stdout:6/425: chown c4 998091 1 2024-09-16T02:05:50.345 INFO:tasks.workunit.client.1.smithi165.stdout:8/465: symlink dd/d11/d38/la2 0 2024-09-16T02:05:50.348 INFO:tasks.workunit.client.1.smithi165.stdout:7/402: rename d0/d2c/f3b to d0/df/d7/f7e 0 2024-09-16T02:05:50.353 INFO:tasks.workunit.client.1.smithi165.stdout:0/399: creat d0/d2a/d70/f8e x:0 0 0 2024-09-16T02:05:50.356 INFO:tasks.workunit.client.0.smithi110.stdout:4/157: symlink d4/d12/l2f 0 2024-09-16T02:05:50.357 INFO:tasks.workunit.client.0.smithi110.stdout:1/221: dwrite d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:50.358 INFO:tasks.workunit.client.1.smithi165.stdout:6/426: mknod d7/d17/c6c 0 2024-09-16T02:05:50.360 INFO:tasks.workunit.client.1.smithi165.stdout:0/400: dwrite d0/d2a/d70/f8e [0,4194304] 0 2024-09-16T02:05:50.362 INFO:tasks.workunit.client.0.smithi110.stdout:1/222: symlink d0/d1/d8/l45 0 2024-09-16T02:05:50.366 INFO:tasks.workunit.client.0.smithi110.stdout:1/223: unlink d0/d25/f3e 0 2024-09-16T02:05:50.371 INFO:tasks.workunit.client.1.smithi165.stdout:6/427: mknod d7/d17/c6d 0 2024-09-16T02:05:50.373 INFO:tasks.workunit.client.1.smithi165.stdout:0/401: rmdir d0/d1e/d20/d28 39 2024-09-16T02:05:50.375 INFO:tasks.workunit.client.1.smithi165.stdout:7/403: rmdir d0/df/d7 39 2024-09-16T02:05:50.376 INFO:tasks.workunit.client.1.smithi165.stdout:2/476: dread df/d23/f51 [0,4194304] 0 2024-09-16T02:05:50.376 INFO:tasks.workunit.client.1.smithi165.stdout:7/404: stat d0/df/d65/f6e 0 2024-09-16T02:05:50.376 INFO:tasks.workunit.client.0.smithi110.stdout:1/224: mkdir d0/d1/d4/d46 0 2024-09-16T02:05:50.377 INFO:tasks.workunit.client.1.smithi165.stdout:7/405: truncate d0/df/d42/f5e 2672371 0 2024-09-16T02:05:50.378 INFO:tasks.workunit.client.1.smithi165.stdout:7/406: readlink d0/df/l2b 0 2024-09-16T02:05:50.378 INFO:tasks.workunit.client.1.smithi165.stdout:1/396: rename d1/d22/l2d to d1/d6b/l7a 0 2024-09-16T02:05:50.378 INFO:tasks.workunit.client.0.smithi110.stdout:4/158: link d4/c7 d4/d8/c30 0 2024-09-16T02:05:50.379 INFO:tasks.workunit.client.1.smithi165.stdout:8/466: link dd/d11/d38/d74/d7d/c99 dd/d11/d14/d3f/d25/ca3 0 2024-09-16T02:05:50.379 INFO:tasks.workunit.client.0.smithi110.stdout:4/159: dread d4/f1c [0,4194304] 0 2024-09-16T02:05:50.380 INFO:tasks.workunit.client.0.smithi110.stdout:4/160: chown d4/d12/d18/l19 235241 1 2024-09-16T02:05:50.382 INFO:tasks.workunit.client.1.smithi165.stdout:2/477: rename df/f4f to df/d10/d64/f91 0 2024-09-16T02:05:50.382 INFO:tasks.workunit.client.1.smithi165.stdout:1/397: symlink d1/dd/d11/d42/l7b 0 2024-09-16T02:05:50.382 INFO:tasks.workunit.client.1.smithi165.stdout:2/478: truncate df/d73/f83 933059 0 2024-09-16T02:05:50.383 INFO:tasks.workunit.client.0.smithi110.stdout:4/161: chown d4/f10 7346 1 2024-09-16T02:05:50.383 INFO:tasks.workunit.client.0.smithi110.stdout:4/162: read d4/f11 [597236,102780] 0 2024-09-16T02:05:50.384 INFO:tasks.workunit.client.1.smithi165.stdout:7/407: mkdir d0/df/d33/d2a/d72/d7f 0 2024-09-16T02:05:50.387 INFO:tasks.workunit.client.1.smithi165.stdout:8/467: rmdir dd/d11/d14/d3f 39 2024-09-16T02:05:50.388 INFO:tasks.workunit.client.0.smithi110.stdout:4/163: rmdir d4/d12/d18 39 2024-09-16T02:05:50.392 INFO:tasks.workunit.client.1.smithi165.stdout:7/408: rmdir d0/d4b 39 2024-09-16T02:05:50.394 INFO:tasks.workunit.client.1.smithi165.stdout:0/402: creat d0/d1e/d39/d48/f8f x:0 0 0 2024-09-16T02:05:50.394 INFO:tasks.workunit.client.0.smithi110.stdout:4/164: write d4/f10 [2472210,41775] 0 2024-09-16T02:05:50.395 INFO:tasks.workunit.client.1.smithi165.stdout:1/398: symlink d1/dd/d11/d33/d67/l7c 0 2024-09-16T02:05:50.396 INFO:tasks.workunit.client.1.smithi165.stdout:1/399: stat d1/f9 0 2024-09-16T02:05:50.396 INFO:tasks.workunit.client.1.smithi165.stdout:1/400: fdatasync d1/d32/f34 0 2024-09-16T02:05:50.398 INFO:tasks.workunit.client.1.smithi165.stdout:2/479: creat df/f92 x:0 0 0 2024-09-16T02:05:50.398 INFO:tasks.workunit.client.1.smithi165.stdout:8/468: creat dd/d11/d14/d3f/d72/fa4 x:0 0 0 2024-09-16T02:05:50.399 INFO:tasks.workunit.client.1.smithi165.stdout:7/409: symlink d0/df/d7/d67/l80 0 2024-09-16T02:05:50.400 INFO:tasks.workunit.client.1.smithi165.stdout:7/410: stat d0/df/d33/f29 0 2024-09-16T02:05:50.400 INFO:tasks.workunit.client.1.smithi165.stdout:0/403: mknod d0/d1e/d20/c90 0 2024-09-16T02:05:50.401 INFO:tasks.workunit.client.0.smithi110.stdout:4/165: dwrite d4/fc [0,4194304] 0 2024-09-16T02:05:50.401 INFO:tasks.workunit.client.0.smithi110.stdout:4/166: chown d4/f2c 0 1 2024-09-16T02:05:50.402 INFO:tasks.workunit.client.1.smithi165.stdout:8/469: write dd/d13/f32 [3417402,91612] 0 2024-09-16T02:05:50.403 INFO:tasks.workunit.client.1.smithi165.stdout:4/389: sync 2024-09-16T02:05:50.403 INFO:tasks.workunit.client.1.smithi165.stdout:3/512: sync 2024-09-16T02:05:50.404 INFO:tasks.workunit.client.0.smithi110.stdout:4/167: mkdir d4/d8/d31 0 2024-09-16T02:05:50.404 INFO:tasks.workunit.client.1.smithi165.stdout:1/401: mkdir d1/dd/d11/d33/d3f/d47/d7d 0 2024-09-16T02:05:50.406 INFO:tasks.workunit.client.1.smithi165.stdout:2/480: mknod df/c93 0 2024-09-16T02:05:50.407 INFO:tasks.workunit.client.1.smithi165.stdout:7/411: symlink d0/df/l81 0 2024-09-16T02:05:50.408 INFO:tasks.workunit.client.0.smithi110.stdout:4/168: mknod d4/d12/c32 0 2024-09-16T02:05:50.409 INFO:tasks.workunit.client.0.smithi110.stdout:4/169: stat d4/d8/l20 0 2024-09-16T02:05:50.410 INFO:tasks.workunit.client.1.smithi165.stdout:0/404: dread d0/d1e/d39/d48/f38 [0,4194304] 0 2024-09-16T02:05:50.410 INFO:tasks.workunit.client.1.smithi165.stdout:8/470: creat dd/d11/d14/d3f/d72/fa5 x:0 0 0 2024-09-16T02:05:50.412 INFO:tasks.workunit.client.0.smithi110.stdout:4/170: write d4/f2c [184069,91218] 0 2024-09-16T02:05:50.412 INFO:tasks.workunit.client.1.smithi165.stdout:3/513: mkdir da/d17/d78/d2c/db7 0 2024-09-16T02:05:50.413 INFO:tasks.workunit.client.1.smithi165.stdout:1/402: mkdir d1/dd/d11/d33/d3f/d7e 0 2024-09-16T02:05:50.414 INFO:tasks.workunit.client.1.smithi165.stdout:2/481: truncate df/d23/f51 1156039 0 2024-09-16T02:05:50.417 INFO:tasks.workunit.client.1.smithi165.stdout:8/471: mkdir dd/d11/d38/da6 0 2024-09-16T02:05:50.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/412: dwrite d0/df/d33/d2a/f4d [0,4194304] 0 2024-09-16T02:05:50.419 INFO:tasks.workunit.client.0.smithi110.stdout:4/171: dwrite d4/f21 [0,4194304] 0 2024-09-16T02:05:50.420 INFO:tasks.workunit.client.1.smithi165.stdout:8/472: write dd/d11/d14/d3f/f9c [639896,19198] 0 2024-09-16T02:05:50.422 INFO:tasks.workunit.client.1.smithi165.stdout:5/416: sync 2024-09-16T02:05:50.422 INFO:tasks.workunit.client.1.smithi165.stdout:9/487: sync 2024-09-16T02:05:50.422 INFO:tasks.workunit.client.1.smithi165.stdout:6/428: sync 2024-09-16T02:05:50.424 INFO:tasks.workunit.client.1.smithi165.stdout:2/482: dread df/d23/d28/f53 [0,4194304] 0 2024-09-16T02:05:50.425 INFO:tasks.workunit.client.1.smithi165.stdout:1/403: dwrite d1/d22/f3d [0,4194304] 0 2024-09-16T02:05:50.428 INFO:tasks.workunit.client.1.smithi165.stdout:5/417: write de/d21/d51/f5f [924326,5424] 0 2024-09-16T02:05:50.429 INFO:tasks.workunit.client.0.smithi110.stdout:4/172: dwrite d4/d8/d17/f26 [0,4194304] 0 2024-09-16T02:05:50.431 INFO:tasks.workunit.client.1.smithi165.stdout:4/390: dwrite d4/dc/d20/d45/f77 [0,4194304] 0 2024-09-16T02:05:50.433 INFO:tasks.workunit.client.1.smithi165.stdout:7/413: rename d0/df/d42/f4e to d0/df/d33/d2a/d72/f82 0 2024-09-16T02:05:50.436 INFO:tasks.workunit.client.1.smithi165.stdout:1/404: write d1/dd/d11/d33/d3f/f55 [1137620,70121] 0 2024-09-16T02:05:50.437 INFO:tasks.workunit.client.1.smithi165.stdout:4/391: write d4/f26 [405118,36255] 0 2024-09-16T02:05:50.441 INFO:tasks.workunit.client.1.smithi165.stdout:7/414: readlink d0/df/d33/l6f 0 2024-09-16T02:05:50.443 INFO:tasks.workunit.client.1.smithi165.stdout:5/418: creat de/d21/d26/f8a x:0 0 0 2024-09-16T02:05:50.444 INFO:tasks.workunit.client.0.smithi110.stdout:4/173: link d4/c7 d4/d8/d31/c33 0 2024-09-16T02:05:50.444 INFO:tasks.workunit.client.1.smithi165.stdout:1/405: mknod d1/dd/d11/d46/c7f 0 2024-09-16T02:05:50.445 INFO:tasks.workunit.client.1.smithi165.stdout:2/483: dread df/d10/d1a/f22 [0,4194304] 0 2024-09-16T02:05:50.447 INFO:tasks.workunit.client.1.smithi165.stdout:9/488: dwrite d7/d32/d38/d53/d5c/f81 [0,4194304] 0 2024-09-16T02:05:50.447 INFO:tasks.workunit.client.1.smithi165.stdout:8/473: dread dd/d11/f5f [0,4194304] 0 2024-09-16T02:05:50.448 INFO:tasks.workunit.client.1.smithi165.stdout:0/405: truncate d0/d1e/d39/d48/d45/f44 146102 0 2024-09-16T02:05:50.448 INFO:tasks.workunit.client.1.smithi165.stdout:2/484: write df/f16 [1066304,19110] 0 2024-09-16T02:05:50.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/419: creat de/d21/f8b x:0 0 0 2024-09-16T02:05:50.449 INFO:tasks.workunit.client.0.smithi110.stdout:4/174: creat d4/d12/d18/f34 x:0 0 0 2024-09-16T02:05:50.450 INFO:tasks.workunit.client.1.smithi165.stdout:7/415: mkdir d0/df/d83 0 2024-09-16T02:05:50.451 INFO:tasks.workunit.client.1.smithi165.stdout:1/406: mkdir d1/d6b/d80 0 2024-09-16T02:05:50.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/175: mkdir d4/d8/d17/d23/d35 0 2024-09-16T02:05:50.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/176: chown d4/f1c 7789058 1 2024-09-16T02:05:50.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/177: dread d4/f10 [0,4194304] 0 2024-09-16T02:05:50.473 INFO:tasks.workunit.client.0.smithi110.stdout:4/178: dwrite f3 [0,4194304] 0 2024-09-16T02:05:50.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/179: mkdir d4/d8/d31/d36 0 2024-09-16T02:05:50.479 INFO:tasks.workunit.client.0.smithi110.stdout:4/180: dread d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:50.480 INFO:tasks.workunit.client.0.smithi110.stdout:4/181: read d4/f1c [201629,56269] 0 2024-09-16T02:05:50.480 INFO:tasks.workunit.client.0.smithi110.stdout:4/182: fsync d4/f11 0 2024-09-16T02:05:50.484 INFO:tasks.workunit.client.0.smithi110.stdout:4/183: write d4/d12/d18/f1f [4812352,20884] 0 2024-09-16T02:05:50.486 INFO:tasks.workunit.client.0.smithi110.stdout:4/184: creat d4/d8/d17/d23/f37 x:0 0 0 2024-09-16T02:05:50.490 INFO:tasks.workunit.client.0.smithi110.stdout:4/185: truncate d4/d12/d18/f27 3546506 0 2024-09-16T02:05:50.492 INFO:tasks.workunit.client.0.smithi110.stdout:4/186: dread d4/f2c [0,4194304] 0 2024-09-16T02:05:50.494 INFO:tasks.workunit.client.0.smithi110.stdout:4/187: symlink d4/d8/d17/l38 0 2024-09-16T02:05:50.497 INFO:tasks.workunit.client.0.smithi110.stdout:4/188: rename d4/d12/f2b to d4/d8/d31/f39 0 2024-09-16T02:05:50.498 INFO:tasks.workunit.client.1.smithi165.stdout:3/514: dread da/d20/d26/f4f [0,4194304] 0 2024-09-16T02:05:50.499 INFO:tasks.workunit.client.0.smithi110.stdout:4/189: write d4/d8/d17/f26 [1934279,92645] 0 2024-09-16T02:05:50.499 INFO:tasks.workunit.client.1.smithi165.stdout:8/474: chown dd/d11/d38/d74/d7d/c99 6564 1 2024-09-16T02:05:50.500 INFO:tasks.workunit.client.0.smithi110.stdout:4/190: stat d4/d8/d31/f39 0 2024-09-16T02:05:50.500 INFO:tasks.workunit.client.0.smithi110.stdout:4/191: stat d4 0 2024-09-16T02:05:50.500 INFO:tasks.workunit.client.1.smithi165.stdout:5/420: mkdir de/d21/d26/d3a/d54/d8c 0 2024-09-16T02:05:50.501 INFO:tasks.workunit.client.1.smithi165.stdout:2/485: creat df/d23/d28/f94 x:0 0 0 2024-09-16T02:05:50.501 INFO:tasks.workunit.client.1.smithi165.stdout:8/475: dread - dd/d34/f48 zero size 2024-09-16T02:05:50.502 INFO:tasks.workunit.client.1.smithi165.stdout:0/406: dread d0/d1e/d39/d48/d45/f37 [0,4194304] 0 2024-09-16T02:05:50.503 INFO:tasks.workunit.client.1.smithi165.stdout:7/416: rename d0/df/d33/d2a/d72 to d0/df/d83/d84 0 2024-09-16T02:05:50.504 INFO:tasks.workunit.client.1.smithi165.stdout:4/392: getdents d4/dc/d20/d67 0 2024-09-16T02:05:50.504 INFO:tasks.workunit.client.1.smithi165.stdout:5/421: write de/d19/d1c/f4f [1329527,73482] 0 2024-09-16T02:05:50.506 INFO:tasks.workunit.client.1.smithi165.stdout:3/515: write da/d17/f9f [5031566,116295] 0 2024-09-16T02:05:50.506 INFO:tasks.workunit.client.1.smithi165.stdout:8/476: chown dd/d11/d14/d3f/d25/d36/f64 125041 1 2024-09-16T02:05:50.507 INFO:tasks.workunit.client.0.smithi110.stdout:4/192: dwrite d4/d12/d18/f34 [0,4194304] 0 2024-09-16T02:05:50.508 INFO:tasks.workunit.client.1.smithi165.stdout:1/407: dwrite d1/dd/d11/f1d [0,4194304] 0 2024-09-16T02:05:50.512 INFO:tasks.workunit.client.0.smithi110.stdout:4/193: dread d4/d8/d31/f39 [0,4194304] 0 2024-09-16T02:05:50.512 INFO:tasks.workunit.client.1.smithi165.stdout:2/486: rename df/d10/l80 to df/d23/d28/d3b/d6d/l95 0 2024-09-16T02:05:50.513 INFO:tasks.workunit.client.1.smithi165.stdout:0/407: dwrite d0/d2a/d70/f84 [0,4194304] 0 2024-09-16T02:05:50.514 INFO:tasks.workunit.client.1.smithi165.stdout:2/487: write df/d10/d37/f3d [4587952,18361] 0 2024-09-16T02:05:50.514 INFO:tasks.workunit.client.1.smithi165.stdout:4/393: symlink d4/dc/d28/d3b/l81 0 2024-09-16T02:05:50.517 INFO:tasks.workunit.client.1.smithi165.stdout:2/488: fdatasync df/d23/d28/d3b/f56 0 2024-09-16T02:05:50.518 INFO:tasks.workunit.client.1.smithi165.stdout:5/422: symlink de/d21/d51/l8d 0 2024-09-16T02:05:50.519 INFO:tasks.workunit.client.1.smithi165.stdout:3/516: fsync da/d20/d26/f4f 0 2024-09-16T02:05:50.520 INFO:tasks.workunit.client.1.smithi165.stdout:3/517: read - da/faf zero size 2024-09-16T02:05:50.521 INFO:tasks.workunit.client.0.smithi110.stdout:4/194: creat d4/d8/d31/d36/f3a x:0 0 0 2024-09-16T02:05:50.521 INFO:tasks.workunit.client.1.smithi165.stdout:2/489: truncate df/d10/d37/f74 1251509 0 2024-09-16T02:05:50.522 INFO:tasks.workunit.client.1.smithi165.stdout:0/408: chown d0/d1e/d20/d28/l41 3693 1 2024-09-16T02:05:50.523 INFO:tasks.workunit.client.1.smithi165.stdout:6/429: sync 2024-09-16T02:05:50.524 INFO:tasks.workunit.client.0.smithi110.stdout:4/195: mkdir d4/d12/d3b 0 2024-09-16T02:05:50.526 INFO:tasks.workunit.client.1.smithi165.stdout:2/490: creat df/d23/d28/d3b/f96 x:0 0 0 2024-09-16T02:05:50.527 INFO:tasks.workunit.client.0.smithi110.stdout:4/196: mkdir d4/d8/d31/d36/d3c 0 2024-09-16T02:05:50.528 INFO:tasks.workunit.client.1.smithi165.stdout:2/491: truncate df/f34 4521951 0 2024-09-16T02:05:50.529 INFO:tasks.workunit.client.0.smithi110.stdout:4/197: write d4/d12/d18/f1f [1189582,75836] 0 2024-09-16T02:05:50.529 INFO:tasks.workunit.client.1.smithi165.stdout:0/409: write d0/d2a/f77 [805737,112084] 0 2024-09-16T02:05:50.529 INFO:tasks.workunit.client.1.smithi165.stdout:4/394: truncate f1 1747560 0 2024-09-16T02:05:50.530 INFO:tasks.workunit.client.0.smithi110.stdout:6/161: sync 2024-09-16T02:05:50.530 INFO:tasks.workunit.client.0.smithi110.stdout:4/198: write d4/d8/d17/f26 [1836474,100100] 0 2024-09-16T02:05:50.531 INFO:tasks.workunit.client.0.smithi110.stdout:6/162: readlink d0/d2/d18/l24 0 2024-09-16T02:05:50.531 INFO:tasks.workunit.client.1.smithi165.stdout:4/395: truncate d4/dc/f58 159057 0 2024-09-16T02:05:50.531 INFO:tasks.workunit.client.1.smithi165.stdout:8/477: creat dd/d11/d14/d70/fa7 x:0 0 0 2024-09-16T02:05:50.533 INFO:tasks.workunit.client.0.smithi110.stdout:4/199: write d4/f1c [759478,119172] 0 2024-09-16T02:05:50.535 INFO:tasks.workunit.client.1.smithi165.stdout:5/423: link de/d21/f41 de/d21/d26/d3a/d54/d8c/f8e 0 2024-09-16T02:05:50.535 INFO:tasks.workunit.client.0.smithi110.stdout:6/163: unlink d0/d2/c17 0 2024-09-16T02:05:50.536 INFO:tasks.workunit.client.0.smithi110.stdout:6/164: chown d0/d2/d5 1 1 2024-09-16T02:05:50.537 INFO:tasks.workunit.client.0.smithi110.stdout:6/165: read - d0/d2/f25 zero size 2024-09-16T02:05:50.538 INFO:tasks.workunit.client.1.smithi165.stdout:9/489: sync 2024-09-16T02:05:50.538 INFO:tasks.workunit.client.1.smithi165.stdout:7/417: getdents d0/df/d42 0 2024-09-16T02:05:50.538 INFO:tasks.workunit.client.1.smithi165.stdout:0/410: dwrite d0/d2a/f77 [0,4194304] 0 2024-09-16T02:05:50.539 INFO:tasks.workunit.client.0.smithi110.stdout:6/166: fdatasync d0/d2/d5/f22 0 2024-09-16T02:05:50.540 INFO:tasks.workunit.client.0.smithi110.stdout:6/167: fdatasync d0/f10 0 2024-09-16T02:05:50.540 INFO:tasks.workunit.client.0.smithi110.stdout:4/200: dwrite d4/d12/d18/f29 [0,4194304] 0 2024-09-16T02:05:50.542 INFO:tasks.workunit.client.1.smithi165.stdout:9/490: read f4 [4095733,105165] 0 2024-09-16T02:05:50.543 INFO:tasks.workunit.client.1.smithi165.stdout:3/518: dread da/d17/d78/d2c/f4e [0,4194304] 0 2024-09-16T02:05:50.544 INFO:tasks.workunit.client.1.smithi165.stdout:8/478: dwrite dd/d11/d14/d70/fa7 [0,4194304] 0 2024-09-16T02:05:50.544 INFO:tasks.workunit.client.1.smithi165.stdout:1/408: getdents d1/d32 0 2024-09-16T02:05:50.546 INFO:tasks.workunit.client.1.smithi165.stdout:4/396: fsync d4/dc/d18/d37/d47/f63 0 2024-09-16T02:05:50.547 INFO:tasks.workunit.client.1.smithi165.stdout:8/479: write dd/d13/f21 [2290375,28049] 0 2024-09-16T02:05:50.547 INFO:tasks.workunit.client.1.smithi165.stdout:9/491: write d7/d32/d38/d53/d56/d95/f72 [4071713,16468] 0 2024-09-16T02:05:50.550 INFO:tasks.workunit.client.0.smithi110.stdout:6/168: dwrite d0/d2/f1c [0,4194304] 0 2024-09-16T02:05:50.550 INFO:tasks.workunit.client.1.smithi165.stdout:5/424: creat de/d21/f8f x:0 0 0 2024-09-16T02:05:50.551 INFO:tasks.workunit.client.1.smithi165.stdout:6/430: dread d7/f1e [4194304,4194304] 0 2024-09-16T02:05:50.555 INFO:tasks.workunit.client.0.smithi110.stdout:4/201: mkdir d4/d8/d31/d36/d3c/d3d 0 2024-09-16T02:05:50.556 INFO:tasks.workunit.client.0.smithi110.stdout:6/169: rmdir d0/d2/d5 39 2024-09-16T02:05:50.556 INFO:tasks.workunit.client.0.smithi110.stdout:4/202: write d4/fc [4627670,105789] 0 2024-09-16T02:05:50.557 INFO:tasks.workunit.client.1.smithi165.stdout:2/492: unlink df/d10/d1a/c33 0 2024-09-16T02:05:50.558 INFO:tasks.workunit.client.0.smithi110.stdout:4/203: write d4/d12/d18/f29 [1906938,30308] 0 2024-09-16T02:05:50.559 INFO:tasks.workunit.client.1.smithi165.stdout:7/418: chown d0/d2c/l30 297 1 2024-09-16T02:05:50.560 INFO:tasks.workunit.client.0.smithi110.stdout:6/170: read d0/d2/f23 [55553,48358] 0 2024-09-16T02:05:50.561 INFO:tasks.workunit.client.1.smithi165.stdout:0/411: mkdir d0/d1e/d39/d48/d5f/d82/d91 0 2024-09-16T02:05:50.562 INFO:tasks.workunit.client.1.smithi165.stdout:0/412: chown d0/d1e/d39/d48/d5f/f73 14191 1 2024-09-16T02:05:50.563 INFO:tasks.workunit.client.1.smithi165.stdout:1/409: read d1/f9 [3623009,27017] 0 2024-09-16T02:05:50.567 INFO:tasks.workunit.client.0.smithi110.stdout:6/171: read - d0/d2/d5/f22 zero size 2024-09-16T02:05:50.568 INFO:tasks.workunit.client.1.smithi165.stdout:0/413: dwrite d0/f13 [4194304,4194304] 0 2024-09-16T02:05:50.571 INFO:tasks.workunit.client.1.smithi165.stdout:8/480: unlink c4 0 2024-09-16T02:05:50.574 INFO:tasks.workunit.client.0.smithi110.stdout:6/172: mkdir d0/d29 0 2024-09-16T02:05:50.575 INFO:tasks.workunit.client.1.smithi165.stdout:0/414: dwrite d0/d1e/f24 [0,4194304] 0 2024-09-16T02:05:50.577 INFO:tasks.workunit.client.1.smithi165.stdout:5/425: truncate de/d21/d26/d3a/f5a 1075802 0 2024-09-16T02:05:50.578 INFO:tasks.workunit.client.0.smithi110.stdout:6/173: mkdir d0/d29/d2a 0 2024-09-16T02:05:50.579 INFO:tasks.workunit.client.0.smithi110.stdout:6/174: chown d0/d2/f23 716 1 2024-09-16T02:05:50.580 INFO:tasks.workunit.client.0.smithi110.stdout:4/204: truncate d4/f10 1150049 0 2024-09-16T02:05:50.581 INFO:tasks.workunit.client.0.smithi110.stdout:4/205: chown d4/d12/d18/c1a 29589 1 2024-09-16T02:05:50.581 INFO:tasks.workunit.client.0.smithi110.stdout:4/206: chown d4/d12/d3b 804585668 1 2024-09-16T02:05:50.582 INFO:tasks.workunit.client.0.smithi110.stdout:4/207: fsync d4/f11 0 2024-09-16T02:05:50.582 INFO:tasks.workunit.client.1.smithi165.stdout:1/410: rename d1/d19/d24/d30/f45 to d1/d19/d4d/f81 0 2024-09-16T02:05:50.583 INFO:tasks.workunit.client.0.smithi110.stdout:6/175: creat d0/d29/d2a/f2b x:0 0 0 2024-09-16T02:05:50.585 INFO:tasks.workunit.client.1.smithi165.stdout:3/519: creat da/d17/d78/d2c/db7/fb8 x:0 0 0 2024-09-16T02:05:50.585 INFO:tasks.workunit.client.1.smithi165.stdout:8/481: creat dd/d11/d14/d3f/d25/fa8 x:0 0 0 2024-09-16T02:05:50.586 INFO:tasks.workunit.client.1.smithi165.stdout:3/520: write da/d17/f8b [3033224,75019] 0 2024-09-16T02:05:50.587 INFO:tasks.workunit.client.1.smithi165.stdout:4/397: mknod d4/dc/d18/d37/d47/d71/c82 0 2024-09-16T02:05:50.587 INFO:tasks.workunit.client.1.smithi165.stdout:6/431: dwrite d7/dc/df/d1a/f2d [0,4194304] 0 2024-09-16T02:05:50.588 INFO:tasks.workunit.client.0.smithi110.stdout:4/208: rename d4/d8/d31/c33 to d4/d8/c3e 0 2024-09-16T02:05:50.589 INFO:tasks.workunit.client.1.smithi165.stdout:3/521: chown da/d20/d26/d52/c85 1021 1 2024-09-16T02:05:50.591 INFO:tasks.workunit.client.1.smithi165.stdout:7/419: dread d0/df/d7/f7e [0,4194304] 0 2024-09-16T02:05:50.592 INFO:tasks.workunit.client.0.smithi110.stdout:4/209: rename d4/d12/l2f to d4/d8/d31/l3f 0 2024-09-16T02:05:50.595 INFO:tasks.workunit.client.0.smithi110.stdout:4/210: truncate d4/f15 389675 0 2024-09-16T02:05:50.597 INFO:tasks.workunit.client.1.smithi165.stdout:8/482: mknod dd/d11/d14/d70/d7b/d9a/ca9 0 2024-09-16T02:05:50.597 INFO:tasks.workunit.client.1.smithi165.stdout:8/483: chown dd/d11/d14/d3f/d25/d36 4840 1 2024-09-16T02:05:50.598 INFO:tasks.workunit.client.1.smithi165.stdout:4/398: unlink d4/dc/d28/d3b/f52 0 2024-09-16T02:05:50.600 INFO:tasks.workunit.client.1.smithi165.stdout:9/492: getdents d7/d32/d38/d58 0 2024-09-16T02:05:50.601 INFO:tasks.workunit.client.1.smithi165.stdout:9/493: readlink d7/d32/d38/d53/l6d 0 2024-09-16T02:05:50.603 INFO:tasks.workunit.client.1.smithi165.stdout:7/420: dread d0/f19 [0,4194304] 0 2024-09-16T02:05:50.604 INFO:tasks.workunit.client.1.smithi165.stdout:3/522: link da/d17/d7a/d7d/fb3 da/d17/d7a/dab/fb9 0 2024-09-16T02:05:50.606 INFO:tasks.workunit.client.1.smithi165.stdout:4/399: fdatasync d4/dc/d18/d37/d47/f63 0 2024-09-16T02:05:50.606 INFO:tasks.workunit.client.1.smithi165.stdout:4/400: fdatasync d4/f1e 0 2024-09-16T02:05:50.607 INFO:tasks.workunit.client.1.smithi165.stdout:9/494: unlink d7/df/d37/d43/c82 0 2024-09-16T02:05:50.608 INFO:tasks.workunit.client.1.smithi165.stdout:9/495: stat d7/d87 0 2024-09-16T02:05:50.609 INFO:tasks.workunit.client.1.smithi165.stdout:3/523: dread da/d20/d26/f7f [0,4194304] 0 2024-09-16T02:05:50.610 INFO:tasks.workunit.client.1.smithi165.stdout:4/401: mknod d4/dc/d20/d67/c83 0 2024-09-16T02:05:50.614 INFO:tasks.workunit.client.1.smithi165.stdout:9/496: dwrite d7/d32/d38/d68/d7f/f6e [0,4194304] 0 2024-09-16T02:05:50.614 INFO:tasks.workunit.client.1.smithi165.stdout:5/426: write de/d19/f32 [45342,77729] 0 2024-09-16T02:05:50.615 INFO:tasks.workunit.client.0.smithi110.stdout:6/176: dwrite d0/d2/d5/fa [4194304,4194304] 0 2024-09-16T02:05:50.615 INFO:tasks.workunit.client.1.smithi165.stdout:2/493: truncate df/f34 2747076 0 2024-09-16T02:05:50.619 INFO:tasks.workunit.client.0.smithi110.stdout:6/177: mknod d0/d2/d5/d1e/c2c 0 2024-09-16T02:05:50.622 INFO:tasks.workunit.client.0.smithi110.stdout:6/178: mkdir d0/d29/d2a/d2d 0 2024-09-16T02:05:50.652 INFO:tasks.workunit.client.0.smithi110.stdout:6/179: dread d0/d2/dc/d16/f13 [0,4194304] 0 2024-09-16T02:05:50.654 INFO:tasks.workunit.client.0.smithi110.stdout:6/180: rename d0/c1a to d0/d2/d18/c2e 0 2024-09-16T02:05:50.655 INFO:tasks.workunit.client.0.smithi110.stdout:6/181: read d0/d2/f14 [4892502,38427] 0 2024-09-16T02:05:50.656 INFO:tasks.workunit.client.0.smithi110.stdout:6/182: rmdir d0/d2/dc 39 2024-09-16T02:05:50.657 INFO:tasks.workunit.client.0.smithi110.stdout:6/183: mkdir d0/d29/d2a/d2f 0 2024-09-16T02:05:50.658 INFO:tasks.workunit.client.1.smithi165.stdout:2/494: fsync df/d23/f50 0 2024-09-16T02:05:50.659 INFO:tasks.workunit.client.1.smithi165.stdout:0/415: write d0/d1e/d39/d48/d45/f4b [2430447,11192] 0 2024-09-16T02:05:50.659 INFO:tasks.workunit.client.1.smithi165.stdout:5/427: chown de/d21/c47 1 1 2024-09-16T02:05:50.659 INFO:tasks.workunit.client.1.smithi165.stdout:1/411: truncate d1/dd/d11/f1d 486853 0 2024-09-16T02:05:50.660 INFO:tasks.workunit.client.0.smithi110.stdout:6/184: link d0/d2/d18/l24 d0/d2/d5/d1e/l30 0 2024-09-16T02:05:50.660 INFO:tasks.workunit.client.1.smithi165.stdout:8/484: write dd/d11/d14/d3f/f35 [3958848,72216] 0 2024-09-16T02:05:50.663 INFO:tasks.workunit.client.1.smithi165.stdout:2/495: write df/d73/f83 [1548896,43759] 0 2024-09-16T02:05:50.663 INFO:tasks.workunit.client.1.smithi165.stdout:1/412: chown d1/d68/l5c 1 1 2024-09-16T02:05:50.663 INFO:tasks.workunit.client.1.smithi165.stdout:4/402: dwrite d4/d40/d4f/f78 [0,4194304] 0 2024-09-16T02:05:50.665 INFO:tasks.workunit.client.1.smithi165.stdout:9/497: rename d7/d1f/f46 to d7/d32/d38/d53/d5c/d61/d97/fa3 0 2024-09-16T02:05:50.665 INFO:tasks.workunit.client.1.smithi165.stdout:5/428: symlink de/d21/d51/l90 0 2024-09-16T02:05:50.667 INFO:tasks.workunit.client.0.smithi110.stdout:6/185: dwrite d0/d2/d5/f22 [0,4194304] 0 2024-09-16T02:05:50.668 INFO:tasks.workunit.client.1.smithi165.stdout:5/429: chown de/d21/d26/d3a/f7b 480 1 2024-09-16T02:05:50.673 INFO:tasks.workunit.client.1.smithi165.stdout:8/485: mkdir dd/d11/daa 0 2024-09-16T02:05:50.674 INFO:tasks.workunit.client.1.smithi165.stdout:5/430: chown de/d21/d51/l90 1034930 1 2024-09-16T02:05:50.674 INFO:tasks.workunit.client.0.smithi110.stdout:6/186: dread d0/d2/dc/f1f [0,4194304] 0 2024-09-16T02:05:50.675 INFO:tasks.workunit.client.1.smithi165.stdout:2/496: write df/d23/d28/d3b/f96 [705913,101224] 0 2024-09-16T02:05:50.675 INFO:tasks.workunit.client.1.smithi165.stdout:0/416: dread d0/d1e/f26 [0,4194304] 0 2024-09-16T02:05:50.676 INFO:tasks.workunit.client.1.smithi165.stdout:8/486: write f6 [5652625,4682] 0 2024-09-16T02:05:50.678 INFO:tasks.workunit.client.1.smithi165.stdout:4/403: dwrite d4/dc/d20/d67/f76 [0,4194304] 0 2024-09-16T02:05:50.680 INFO:tasks.workunit.client.1.smithi165.stdout:1/413: creat d1/d22/f82 x:0 0 0 2024-09-16T02:05:50.682 INFO:tasks.workunit.client.1.smithi165.stdout:9/498: dwrite d7/d55/f66 [0,4194304] 0 2024-09-16T02:05:50.682 INFO:tasks.workunit.client.1.smithi165.stdout:5/431: rmdir de/d21/d26/d3a/d54 39 2024-09-16T02:05:50.683 INFO:tasks.workunit.client.1.smithi165.stdout:8/487: dread dd/d13/d53/f61 [0,4194304] 0 2024-09-16T02:05:50.684 INFO:tasks.workunit.client.1.smithi165.stdout:6/432: sync 2024-09-16T02:05:50.687 INFO:tasks.workunit.client.1.smithi165.stdout:2/497: rename df/d10/d37/c60 to df/d10/d1a/c97 0 2024-09-16T02:05:50.688 INFO:tasks.workunit.client.1.smithi165.stdout:6/433: stat d7/dc/df/d1a/f47 0 2024-09-16T02:05:50.691 INFO:tasks.workunit.client.1.smithi165.stdout:5/432: write fa [179743,100845] 0 2024-09-16T02:05:50.691 INFO:tasks.workunit.client.0.smithi110.stdout:6/187: write d0/d2/f14 [2286279,98561] 0 2024-09-16T02:05:50.691 INFO:tasks.workunit.client.1.smithi165.stdout:4/404: mknod d4/dc/d18/d37/d53/c84 0 2024-09-16T02:05:50.694 INFO:tasks.workunit.client.0.smithi110.stdout:6/188: mkdir d0/d2/d18/d31 0 2024-09-16T02:05:50.695 INFO:tasks.workunit.client.0.smithi110.stdout:6/189: chown d0/d2/f23 107 1 2024-09-16T02:05:50.695 INFO:tasks.workunit.client.1.smithi165.stdout:2/498: mkdir df/d73/d79/d98 0 2024-09-16T02:05:50.696 INFO:tasks.workunit.client.1.smithi165.stdout:0/417: dwrite d0/d2a/d70/f8e [4194304,4194304] 0 2024-09-16T02:05:50.697 INFO:tasks.workunit.client.0.smithi110.stdout:6/190: creat d0/d29/f32 x:0 0 0 2024-09-16T02:05:50.698 INFO:tasks.workunit.client.1.smithi165.stdout:4/405: rmdir d4/dc/d28 39 2024-09-16T02:05:50.699 INFO:tasks.workunit.client.0.smithi110.stdout:6/191: creat d0/d2/dc/d16/f33 x:0 0 0 2024-09-16T02:05:50.700 INFO:tasks.workunit.client.1.smithi165.stdout:2/499: write df/d73/f7c [518075,37557] 0 2024-09-16T02:05:50.700 INFO:tasks.workunit.client.1.smithi165.stdout:6/434: creat d7/dc/df/d1a/d4d/d5f/f6e x:0 0 0 2024-09-16T02:05:50.701 INFO:tasks.workunit.client.0.smithi110.stdout:6/192: read d0/d2/d5/f22 [712888,9818] 0 2024-09-16T02:05:50.702 INFO:tasks.workunit.client.0.smithi110.stdout:6/193: fsync d0/d2/d5/f22 0 2024-09-16T02:05:50.704 INFO:tasks.workunit.client.1.smithi165.stdout:1/414: dwrite d1/dd/d11/d33/f3b [0,4194304] 0 2024-09-16T02:05:50.705 INFO:tasks.workunit.client.0.smithi110.stdout:6/194: mkdir d0/d29/d2a/d2f/d34 0 2024-09-16T02:05:50.706 INFO:tasks.workunit.client.1.smithi165.stdout:5/433: creat de/d21/d26/d3a/f91 x:0 0 0 2024-09-16T02:05:50.708 INFO:tasks.workunit.client.1.smithi165.stdout:8/488: dread dd/d11/f5f [0,4194304] 0 2024-09-16T02:05:50.708 INFO:tasks.workunit.client.1.smithi165.stdout:0/418: rename d0/d1e/d20/d28/d6d/l72 to d0/d1e/d39/l92 0 2024-09-16T02:05:50.708 INFO:tasks.workunit.client.0.smithi110.stdout:6/195: symlink d0/l35 0 2024-09-16T02:05:50.709 INFO:tasks.workunit.client.0.smithi110.stdout:6/196: read d0/d2/dc/f1f [200499,98503] 0 2024-09-16T02:05:50.712 INFO:tasks.workunit.client.1.smithi165.stdout:8/489: write dd/d13/f21 [1843007,46905] 0 2024-09-16T02:05:50.712 INFO:tasks.workunit.client.0.smithi110.stdout:6/197: unlink d0/d2/d5/f22 0 2024-09-16T02:05:50.715 INFO:tasks.workunit.client.1.smithi165.stdout:2/500: rename df/d23/d2a/l43 to df/d23/d28/d3b/d82/l99 0 2024-09-16T02:05:50.717 INFO:tasks.workunit.client.1.smithi165.stdout:2/501: dread - df/f92 zero size 2024-09-16T02:05:50.718 INFO:tasks.workunit.client.1.smithi165.stdout:0/419: link d0/d1e/f24 d0/d1e/f93 0 2024-09-16T02:05:50.718 INFO:tasks.workunit.client.1.smithi165.stdout:4/406: dwrite d4/dc/d18/f34 [4194304,4194304] 0 2024-09-16T02:05:50.719 INFO:tasks.workunit.client.0.smithi110.stdout:6/198: dwrite d0/d29/d2a/f2b [0,4194304] 0 2024-09-16T02:05:50.722 INFO:tasks.workunit.client.0.smithi110.stdout:6/199: write d0/d2/dc/f1f [1382279,65304] 0 2024-09-16T02:05:50.722 INFO:tasks.workunit.client.1.smithi165.stdout:2/502: write df/d23/f50 [2783029,67390] 0 2024-09-16T02:05:50.723 INFO:tasks.workunit.client.1.smithi165.stdout:1/415: dwrite d1/d22/f4e [0,4194304] 0 2024-09-16T02:05:50.724 INFO:tasks.workunit.client.0.smithi110.stdout:6/200: symlink d0/d2/d5/d1e/l36 0 2024-09-16T02:05:50.726 INFO:tasks.workunit.client.1.smithi165.stdout:8/490: dwrite dd/d13/f65 [0,4194304] 0 2024-09-16T02:05:50.728 INFO:tasks.workunit.client.0.smithi110.stdout:6/201: creat d0/d29/d2a/f37 x:0 0 0 2024-09-16T02:05:50.728 INFO:tasks.workunit.client.1.smithi165.stdout:8/491: readlink dd/l96 0 2024-09-16T02:05:50.730 INFO:tasks.workunit.client.1.smithi165.stdout:4/407: symlink d4/dc/d20/d4e/d73/l85 0 2024-09-16T02:05:50.730 INFO:tasks.workunit.client.1.smithi165.stdout:2/503: write df/d23/d28/d3b/d6d/d8b/f8e [263851,87618] 0 2024-09-16T02:05:50.733 INFO:tasks.workunit.client.1.smithi165.stdout:1/416: creat d1/dd/d11/d33/d3f/d47/f83 x:0 0 0 2024-09-16T02:05:50.733 INFO:tasks.workunit.client.0.smithi110.stdout:6/202: creat d0/d2/d5/d1e/f38 x:0 0 0 2024-09-16T02:05:50.739 INFO:tasks.workunit.client.0.smithi110.stdout:6/203: mknod d0/d29/d2a/c39 0 2024-09-16T02:05:50.743 INFO:tasks.workunit.client.1.smithi165.stdout:5/434: write f6 [1320730,21274] 0 2024-09-16T02:05:50.743 INFO:tasks.workunit.client.1.smithi165.stdout:0/420: link d0/d1e/c1f d0/d1e/d39/d48/d5f/d82/d91/c94 0 2024-09-16T02:05:50.745 INFO:tasks.workunit.client.1.smithi165.stdout:0/421: readlink d0/d1e/d20/d28/l43 0 2024-09-16T02:05:50.746 INFO:tasks.workunit.client.1.smithi165.stdout:2/504: rename df/d23/d2a to df/d23/d28/d9a 0 2024-09-16T02:05:50.747 INFO:tasks.workunit.client.1.smithi165.stdout:5/435: mkdir de/d19/d1c/d84/d92 0 2024-09-16T02:05:50.750 INFO:tasks.workunit.client.1.smithi165.stdout:2/505: write df/d73/f83 [313663,47412] 0 2024-09-16T02:05:50.750 INFO:tasks.workunit.client.1.smithi165.stdout:6/435: dwrite d7/dc/df/d1a/f46 [0,4194304] 0 2024-09-16T02:05:50.751 INFO:tasks.workunit.client.1.smithi165.stdout:1/417: rename d1/d68/d54 to d1/d19/d4d/d84 0 2024-09-16T02:05:50.753 INFO:tasks.workunit.client.1.smithi165.stdout:1/418: write d1/f49 [715394,91101] 0 2024-09-16T02:05:50.755 INFO:tasks.workunit.client.1.smithi165.stdout:6/436: write d7/d1f/f27 [2385648,91537] 0 2024-09-16T02:05:50.758 INFO:tasks.workunit.client.0.smithi110.stdout:6/204: rmdir d0/d2/d5 39 2024-09-16T02:05:50.761 INFO:tasks.workunit.client.1.smithi165.stdout:0/422: read d0/d47/f59 [794260,129598] 0 2024-09-16T02:05:50.763 INFO:tasks.workunit.client.1.smithi165.stdout:6/437: creat d7/dc/d3b/f6f x:0 0 0 2024-09-16T02:05:50.765 INFO:tasks.workunit.client.0.smithi110.stdout:6/205: rename d0/d2/d5/d1e/f38 to d0/d2/f3a 0 2024-09-16T02:05:50.765 INFO:tasks.workunit.client.1.smithi165.stdout:5/436: dwrite de/d19/d1c/f56 [0,4194304] 0 2024-09-16T02:05:50.765 INFO:tasks.workunit.client.1.smithi165.stdout:2/506: dwrite df/d23/d66/f8d [0,4194304] 0 2024-09-16T02:05:50.765 INFO:tasks.workunit.client.1.smithi165.stdout:0/423: write d0/d1e/d39/f6a [7896380,104439] 0 2024-09-16T02:05:50.767 INFO:tasks.workunit.client.0.smithi110.stdout:0/151: sync 2024-09-16T02:05:50.767 INFO:tasks.workunit.client.0.smithi110.stdout:2/173: sync 2024-09-16T02:05:50.768 INFO:tasks.workunit.client.1.smithi165.stdout:5/437: fsync de/d21/d26/d3a/f5a 0 2024-09-16T02:05:50.768 INFO:tasks.workunit.client.1.smithi165.stdout:1/419: dread d1/d22/f6f [0,4194304] 0 2024-09-16T02:05:50.772 INFO:tasks.workunit.client.1.smithi165.stdout:5/438: chown fc 278487 1 2024-09-16T02:05:50.773 INFO:tasks.workunit.client.0.smithi110.stdout:6/206: dread d0/d2/f1c [0,4194304] 0 2024-09-16T02:05:50.776 INFO:tasks.workunit.client.1.smithi165.stdout:6/438: dread d7/f9 [4194304,4194304] 0 2024-09-16T02:05:50.777 INFO:tasks.workunit.client.1.smithi165.stdout:4/408: dwrite d4/dc/d28/d30/f80 [0,4194304] 0 2024-09-16T02:05:50.778 INFO:tasks.workunit.client.0.smithi110.stdout:6/207: creat d0/d2/dc/d16/f3b x:0 0 0 2024-09-16T02:05:50.779 INFO:tasks.workunit.client.1.smithi165.stdout:0/424: creat d0/d1e/d39/d48/d45/f95 x:0 0 0 2024-09-16T02:05:50.781 INFO:tasks.workunit.client.1.smithi165.stdout:0/425: truncate d0/d2a/d70/f8b 961076 0 2024-09-16T02:05:50.781 INFO:tasks.workunit.client.0.smithi110.stdout:0/152: dwrite d3/d6/ff [0,4194304] 0 2024-09-16T02:05:50.788 INFO:tasks.workunit.client.1.smithi165.stdout:6/439: creat d7/dc/d3b/d3c/f70 x:0 0 0 2024-09-16T02:05:50.791 INFO:tasks.workunit.client.1.smithi165.stdout:0/426: fdatasync d0/d1e/f93 0 2024-09-16T02:05:50.794 INFO:tasks.workunit.client.1.smithi165.stdout:5/439: fdatasync de/d21/d26/d3a/d54/f79 0 2024-09-16T02:05:50.795 INFO:tasks.workunit.client.0.smithi110.stdout:0/153: link d3/d4/dc/d10/c30 d3/d4/c32 0 2024-09-16T02:05:50.795 INFO:tasks.workunit.client.1.smithi165.stdout:5/440: write de/d21/f8b [209795,28359] 0 2024-09-16T02:05:50.795 INFO:tasks.workunit.client.1.smithi165.stdout:5/441: fsync de/d21/f8f 0 2024-09-16T02:05:50.796 INFO:tasks.workunit.client.1.smithi165.stdout:6/440: mknod d7/dc/df/d1a/d4d/d5f/c71 0 2024-09-16T02:05:50.797 INFO:tasks.workunit.client.0.smithi110.stdout:2/174: write d0/da/f24 [668102,34601] 0 2024-09-16T02:05:50.797 INFO:tasks.workunit.client.1.smithi165.stdout:6/441: chown d7/dc/d3b/d3a/d3d 1868766 1 2024-09-16T02:05:50.797 INFO:tasks.workunit.client.1.smithi165.stdout:6/442: readlink d7/d1f/l36 0 2024-09-16T02:05:50.798 INFO:tasks.workunit.client.1.smithi165.stdout:6/443: chown d7/dc/c30 4157 1 2024-09-16T02:05:50.799 INFO:tasks.workunit.client.0.smithi110.stdout:0/154: dread d3/d6/ff [0,4194304] 0 2024-09-16T02:05:50.803 INFO:tasks.workunit.client.0.smithi110.stdout:2/175: mkdir d0/da/d18/d2d/d39 0 2024-09-16T02:05:50.804 INFO:tasks.workunit.client.1.smithi165.stdout:7/421: sync 2024-09-16T02:05:50.804 INFO:tasks.workunit.client.1.smithi165.stdout:6/444: dwrite d7/d17/f66 [0,4194304] 0 2024-09-16T02:05:50.804 INFO:tasks.workunit.client.1.smithi165.stdout:6/445: chown d7/d17/d24/l35 565190889 1 2024-09-16T02:05:50.806 INFO:tasks.workunit.client.1.smithi165.stdout:1/420: link d1/dd/d11/f1d d1/d22/f85 0 2024-09-16T02:05:50.809 INFO:tasks.workunit.client.1.smithi165.stdout:7/422: mkdir d0/d2c/d85 0 2024-09-16T02:05:50.809 INFO:tasks.workunit.client.1.smithi165.stdout:5/442: rename de/d21/f63 to de/d21/d26/d3a/f93 0 2024-09-16T02:05:50.810 INFO:tasks.workunit.client.0.smithi110.stdout:2/176: dwrite d0/da/f24 [0,4194304] 0 2024-09-16T02:05:50.811 INFO:tasks.workunit.client.0.smithi110.stdout:2/177: chown d0/l4 1607759 1 2024-09-16T02:05:50.811 INFO:tasks.workunit.client.1.smithi165.stdout:7/423: readlink d0/df/d33/l3f 0 2024-09-16T02:05:50.813 INFO:tasks.workunit.client.1.smithi165.stdout:4/409: write d4/dc/d18/d37/d47/d71/f7d [90517,42894] 0 2024-09-16T02:05:50.814 INFO:tasks.workunit.client.0.smithi110.stdout:2/178: symlink d0/da/d18/d2d/l3a 0 2024-09-16T02:05:50.814 INFO:tasks.workunit.client.1.smithi165.stdout:7/424: truncate d0/df/f5f 4716402 0 2024-09-16T02:05:50.815 INFO:tasks.workunit.client.1.smithi165.stdout:6/446: dwrite d7/dc/df/d1a/d4d/d5f/f6e [0,4194304] 0 2024-09-16T02:05:50.816 INFO:tasks.workunit.client.1.smithi165.stdout:4/410: chown d4/dc/d18/d37/d53/f5a 47111983 1 2024-09-16T02:05:50.818 INFO:tasks.workunit.client.1.smithi165.stdout:5/443: rmdir de/d19/d1c 39 2024-09-16T02:05:50.819 INFO:tasks.workunit.client.1.smithi165.stdout:6/447: rmdir d7/d17/d24 39 2024-09-16T02:05:50.820 INFO:tasks.workunit.client.1.smithi165.stdout:5/444: truncate de/d21/d51/f5f 1913346 0 2024-09-16T02:05:50.820 INFO:tasks.workunit.client.1.smithi165.stdout:6/448: stat d7/dc/f48 0 2024-09-16T02:05:50.821 INFO:tasks.workunit.client.0.smithi110.stdout:2/179: dwrite d0/f16 [0,4194304] 0 2024-09-16T02:05:50.823 INFO:tasks.workunit.client.1.smithi165.stdout:7/425: unlink d0/df/d33/d2a/f36 0 2024-09-16T02:05:50.824 INFO:tasks.workunit.client.0.smithi110.stdout:2/180: chown d0/da/d18/dc 18077 1 2024-09-16T02:05:50.824 INFO:tasks.workunit.client.1.smithi165.stdout:4/411: creat d4/dc/d18/d37/d47/f86 x:0 0 0 2024-09-16T02:05:50.827 INFO:tasks.workunit.client.1.smithi165.stdout:5/445: unlink de/d21/d26/f66 0 2024-09-16T02:05:50.829 INFO:tasks.workunit.client.1.smithi165.stdout:6/449: chown d7/dc/d3b/d3a/d3d/c65 989 1 2024-09-16T02:05:50.832 INFO:tasks.workunit.client.1.smithi165.stdout:6/450: truncate d7/dc/d3b/f59 365801 0 2024-09-16T02:05:50.832 INFO:tasks.workunit.client.1.smithi165.stdout:7/426: dwrite d0/f12 [4194304,4194304] 0 2024-09-16T02:05:50.832 INFO:tasks.workunit.client.1.smithi165.stdout:4/412: creat d4/dc/d28/d2b/d42/f87 x:0 0 0 2024-09-16T02:05:50.833 INFO:tasks.workunit.client.1.smithi165.stdout:6/451: chown d7/dc/df/d1a 33147 1 2024-09-16T02:05:50.833 INFO:tasks.workunit.client.1.smithi165.stdout:7/427: readlink d0/df/l2b 0 2024-09-16T02:05:50.834 INFO:tasks.workunit.client.1.smithi165.stdout:4/413: fsync d4/dc/d20/f62 0 2024-09-16T02:05:50.834 INFO:tasks.workunit.client.1.smithi165.stdout:5/446: mkdir de/d21/d26/d94 0 2024-09-16T02:05:50.835 INFO:tasks.workunit.client.1.smithi165.stdout:7/428: symlink d0/df/d65/l86 0 2024-09-16T02:05:50.837 INFO:tasks.workunit.client.1.smithi165.stdout:5/447: stat de/d21/d26/d3a/d6d 0 2024-09-16T02:05:50.838 INFO:tasks.workunit.client.1.smithi165.stdout:1/421: dread d1/dd/d11/d33/f4b [0,4194304] 0 2024-09-16T02:05:50.840 INFO:tasks.workunit.client.1.smithi165.stdout:7/429: unlink d0/d2c/f7a 0 2024-09-16T02:05:50.841 INFO:tasks.workunit.client.1.smithi165.stdout:7/430: fdatasync d0/f60 0 2024-09-16T02:05:50.842 INFO:tasks.workunit.client.0.smithi110.stdout:0/155: dread d3/d4/f29 [0,4194304] 0 2024-09-16T02:05:50.843 INFO:tasks.workunit.client.0.smithi110.stdout:0/156: readlink d3/d4/dc/l31 0 2024-09-16T02:05:50.844 INFO:tasks.workunit.client.1.smithi165.stdout:4/414: dwrite d4/d40/d4f/f78 [0,4194304] 0 2024-09-16T02:05:50.844 INFO:tasks.workunit.client.1.smithi165.stdout:1/422: rename d1/dd/d11/l43 to d1/dd/d11/l86 0 2024-09-16T02:05:50.846 INFO:tasks.workunit.client.0.smithi110.stdout:0/157: rename d3/d6/ca to d3/d4/dc/c33 0 2024-09-16T02:05:50.846 INFO:tasks.workunit.client.1.smithi165.stdout:1/423: stat d1/dd/d11/d46/l48 0 2024-09-16T02:05:50.849 INFO:tasks.workunit.client.0.smithi110.stdout:0/158: rename d3/f16 to d3/d6/f34 0 2024-09-16T02:05:50.856 INFO:tasks.workunit.client.1.smithi165.stdout:4/415: dwrite d4/dc/d28/d2b/d42/f87 [0,4194304] 0 2024-09-16T02:05:50.859 INFO:tasks.workunit.client.1.smithi165.stdout:1/424: rename d1/d22/f20 to d1/d22/f87 0 2024-09-16T02:05:50.860 INFO:tasks.workunit.client.1.smithi165.stdout:4/416: mknod d4/dc/d20/d4e/c88 0 2024-09-16T02:05:50.866 INFO:tasks.workunit.client.1.smithi165.stdout:5/448: dwrite de/d21/d26/d3a/d54/d8c/f8e [0,4194304] 0 2024-09-16T02:05:50.866 INFO:tasks.workunit.client.1.smithi165.stdout:6/452: dwrite d7/d17/d24/f51 [0,4194304] 0 2024-09-16T02:05:50.866 INFO:tasks.workunit.client.0.smithi110.stdout:2/181: dread d0/da/d18/dc/f2b [0,4194304] 0 2024-09-16T02:05:50.867 INFO:tasks.workunit.client.0.smithi110.stdout:2/182: stat d0/db/f36 0 2024-09-16T02:05:50.867 INFO:tasks.workunit.client.1.smithi165.stdout:7/431: dread d0/f41 [0,4194304] 0 2024-09-16T02:05:50.869 INFO:tasks.workunit.client.1.smithi165.stdout:1/425: truncate d1/dd/d11/d33/f56 2622260 0 2024-09-16T02:05:50.869 INFO:tasks.workunit.client.1.smithi165.stdout:5/449: write de/d21/f8f [74098,102088] 0 2024-09-16T02:05:50.872 INFO:tasks.workunit.client.0.smithi110.stdout:2/183: mkdir d0/da/d18/d25/d3b 0 2024-09-16T02:05:50.872 INFO:tasks.workunit.client.0.smithi110.stdout:2/184: symlink d0/da/d18/d25/l3c 0 2024-09-16T02:05:50.881 INFO:tasks.workunit.client.1.smithi165.stdout:5/450: mkdir de/d21/d26/d3a/d6d/d95 0 2024-09-16T02:05:50.882 INFO:tasks.workunit.client.0.smithi110.stdout:0/159: creat d3/d4/dc/d10/f35 x:0 0 0 2024-09-16T02:05:50.882 INFO:tasks.workunit.client.1.smithi165.stdout:1/426: dread d1/d32/f34 [0,4194304] 0 2024-09-16T02:05:50.885 INFO:tasks.workunit.client.1.smithi165.stdout:1/427: write d1/dd/f2e [44673,19634] 0 2024-09-16T02:05:50.886 INFO:tasks.workunit.client.1.smithi165.stdout:5/451: rename de/f2a to de/d19/d1c/d84/f96 0 2024-09-16T02:05:50.887 INFO:tasks.workunit.client.1.smithi165.stdout:1/428: creat d1/d32/f88 x:0 0 0 2024-09-16T02:05:50.888 INFO:tasks.workunit.client.0.smithi110.stdout:0/160: dwrite d3/d4/dc/f1e [0,4194304] 0 2024-09-16T02:05:50.891 INFO:tasks.workunit.client.1.smithi165.stdout:1/429: read d1/dd/d11/d33/d3f/d59/f60 [221085,15164] 0 2024-09-16T02:05:50.892 INFO:tasks.workunit.client.0.smithi110.stdout:0/161: unlink d3/d4/dc/c33 0 2024-09-16T02:05:50.892 INFO:tasks.workunit.client.0.smithi110.stdout:0/162: dread - d3/d4/f27 zero size 2024-09-16T02:05:50.893 INFO:tasks.workunit.client.1.smithi165.stdout:5/452: dwrite de/d19/f1f [0,4194304] 0 2024-09-16T02:05:50.895 INFO:tasks.workunit.client.1.smithi165.stdout:1/430: symlink d1/d19/d24/l89 0 2024-09-16T02:05:50.897 INFO:tasks.workunit.client.0.smithi110.stdout:0/163: dread d3/f1a [0,4194304] 0 2024-09-16T02:05:50.899 INFO:tasks.workunit.client.1.smithi165.stdout:5/453: creat de/d19/d1c/d84/d92/f97 x:0 0 0 2024-09-16T02:05:50.901 INFO:tasks.workunit.client.1.smithi165.stdout:1/431: creat d1/dd/d11/d33/f8a x:0 0 0 2024-09-16T02:05:50.902 INFO:tasks.workunit.client.0.smithi110.stdout:0/164: unlink d3/d4/dc/d14/c2e 0 2024-09-16T02:05:50.902 INFO:tasks.workunit.client.1.smithi165.stdout:1/432: chown d1/d19/d4d/d84/l75 763022 1 2024-09-16T02:05:50.903 INFO:tasks.workunit.client.1.smithi165.stdout:5/454: mkdir de/d21/d26/d98 0 2024-09-16T02:05:50.905 INFO:tasks.workunit.client.1.smithi165.stdout:7/432: dread d0/f60 [0,4194304] 0 2024-09-16T02:05:50.905 INFO:tasks.workunit.client.0.smithi110.stdout:0/165: write d3/d6/f21 [525719,108241] 0 2024-09-16T02:05:50.906 INFO:tasks.workunit.client.1.smithi165.stdout:4/417: truncate d4/dc/d28/d30/f80 2833655 0 2024-09-16T02:05:50.907 INFO:tasks.workunit.client.1.smithi165.stdout:6/453: write d7/fe [1127991,112219] 0 2024-09-16T02:05:50.908 INFO:tasks.workunit.client.0.smithi110.stdout:0/166: read d3/d4/f11 [4057561,1077] 0 2024-09-16T02:05:50.908 INFO:tasks.workunit.client.1.smithi165.stdout:7/433: mknod d0/df/d33/d2a/c87 0 2024-09-16T02:05:50.910 INFO:tasks.workunit.client.0.smithi110.stdout:0/167: write d3/d4/f11 [3940518,126541] 0 2024-09-16T02:05:50.911 INFO:tasks.workunit.client.1.smithi165.stdout:7/434: unlink d0/d2c/f78 0 2024-09-16T02:05:50.913 INFO:tasks.workunit.client.0.smithi110.stdout:0/168: chown d3/ld 27494 1 2024-09-16T02:05:50.917 INFO:tasks.workunit.client.0.smithi110.stdout:0/169: rename d3/ld to d3/d6/l36 0 2024-09-16T02:05:50.918 INFO:tasks.workunit.client.1.smithi165.stdout:1/433: dread d1/d19/d24/d30/f40 [0,4194304] 0 2024-09-16T02:05:50.918 INFO:tasks.workunit.client.1.smithi165.stdout:6/454: creat d7/dc/f72 x:0 0 0 2024-09-16T02:05:50.920 INFO:tasks.workunit.client.1.smithi165.stdout:9/499: sync 2024-09-16T02:05:50.921 INFO:tasks.workunit.client.1.smithi165.stdout:3/524: sync 2024-09-16T02:05:50.926 INFO:tasks.workunit.client.0.smithi110.stdout:0/170: read - d3/d4/dc/d10/f35 zero size 2024-09-16T02:05:50.928 INFO:tasks.workunit.client.0.smithi110.stdout:0/171: truncate d3/d6/f21 1562610 0 2024-09-16T02:05:50.928 INFO:tasks.workunit.client.0.smithi110.stdout:0/172: readlink d3/lb 0 2024-09-16T02:05:50.930 INFO:tasks.workunit.client.0.smithi110.stdout:0/173: symlink d3/l37 0 2024-09-16T02:05:50.931 INFO:tasks.workunit.client.0.smithi110.stdout:0/174: stat d3/d4/c7 0 2024-09-16T02:05:50.931 INFO:tasks.workunit.client.1.smithi165.stdout:7/435: creat d0/d2c/d85/f88 x:0 0 0 2024-09-16T02:05:50.932 INFO:tasks.workunit.client.1.smithi165.stdout:1/434: fsync d1/dd/d11/d46/f70 0 2024-09-16T02:05:50.932 INFO:tasks.workunit.client.0.smithi110.stdout:0/175: symlink d3/d4/dc/d10/l38 0 2024-09-16T02:05:50.932 INFO:tasks.workunit.client.1.smithi165.stdout:4/418: truncate d4/dc/d20/d67/f76 1573224 0 2024-09-16T02:05:50.933 INFO:tasks.workunit.client.1.smithi165.stdout:1/435: chown d1/f3a 12383 1 2024-09-16T02:05:50.935 INFO:tasks.workunit.client.0.smithi110.stdout:0/176: chown d3/d6/l36 1916290976 1 2024-09-16T02:05:50.936 INFO:tasks.workunit.client.1.smithi165.stdout:9/500: mknod d7/df/d67/d92/ca4 0 2024-09-16T02:05:50.937 INFO:tasks.workunit.client.1.smithi165.stdout:3/525: dread da/d17/d7a/dab/fb9 [0,4194304] 0 2024-09-16T02:05:50.938 INFO:tasks.workunit.client.0.smithi110.stdout:0/177: creat d3/d6/f39 x:0 0 0 2024-09-16T02:05:50.939 INFO:tasks.workunit.client.1.smithi165.stdout:4/419: creat d4/dc/d28/d2b/f89 x:0 0 0 2024-09-16T02:05:50.941 INFO:tasks.workunit.client.1.smithi165.stdout:1/436: truncate d1/dd/d11/d33/f8a 126333 0 2024-09-16T02:05:50.941 INFO:tasks.workunit.client.1.smithi165.stdout:6/455: mkdir d7/dc/d3b/d3a/d3d/d5d/d73 0 2024-09-16T02:05:50.942 INFO:tasks.workunit.client.1.smithi165.stdout:6/456: chown d7/d1f/c25 54 1 2024-09-16T02:05:50.942 INFO:tasks.workunit.client.0.smithi110.stdout:0/178: symlink d3/d4/dc/d10/l3a 0 2024-09-16T02:05:50.944 INFO:tasks.workunit.client.1.smithi165.stdout:3/526: creat da/d17/d78/d2c/d2d/d6c/fba x:0 0 0 2024-09-16T02:05:50.945 INFO:tasks.workunit.client.1.smithi165.stdout:4/420: unlink d4/f3c 0 2024-09-16T02:05:50.947 INFO:tasks.workunit.client.1.smithi165.stdout:6/457: mkdir d7/dc/d3b/d3a/d74 0 2024-09-16T02:05:50.948 INFO:tasks.workunit.client.1.smithi165.stdout:7/436: dread d0/df/d68/f6c [0,4194304] 0 2024-09-16T02:05:50.948 INFO:tasks.workunit.client.0.smithi110.stdout:0/179: link d3/f17 d3/d6/f3b 0 2024-09-16T02:05:50.951 INFO:tasks.workunit.client.1.smithi165.stdout:7/437: dread d0/df/d7/f7e [0,4194304] 0 2024-09-16T02:05:50.953 INFO:tasks.workunit.client.1.smithi165.stdout:1/437: symlink d1/d19/d24/d30/d72/l8b 0 2024-09-16T02:05:50.954 INFO:tasks.workunit.client.0.smithi110.stdout:0/180: truncate d3/f1a 3757861 0 2024-09-16T02:05:50.955 INFO:tasks.workunit.client.1.smithi165.stdout:4/421: creat d4/dc/d18/d37/d47/f8a x:0 0 0 2024-09-16T02:05:50.955 INFO:tasks.workunit.client.1.smithi165.stdout:9/501: truncate d7/d1f/f5d 4006987 0 2024-09-16T02:05:50.956 INFO:tasks.workunit.client.1.smithi165.stdout:9/502: fsync d7/df/d37/f3b 0 2024-09-16T02:05:50.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:50 smithi110 ceph-mon[27634]: pgmap v19: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 24 MiB/s rd, 155 MiB/s wr, 434 op/s 2024-09-16T02:05:50.957 INFO:tasks.workunit.client.1.smithi165.stdout:3/527: creat da/d17/d78/d2c/d2d/d6c/db5/fbb x:0 0 0 2024-09-16T02:05:50.958 INFO:tasks.workunit.client.0.smithi110.stdout:0/181: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:50.959 INFO:tasks.workunit.client.1.smithi165.stdout:6/458: mkdir d7/d17/d75 0 2024-09-16T02:05:50.959 INFO:tasks.workunit.client.1.smithi165.stdout:7/438: mknod d0/df/d83/d84/d7f/c89 0 2024-09-16T02:05:50.961 INFO:tasks.workunit.client.1.smithi165.stdout:9/503: creat d7/d32/d38/d53/d56/d95/fa5 x:0 0 0 2024-09-16T02:05:50.961 INFO:tasks.workunit.client.0.smithi110.stdout:0/182: rename d3/d4/dc/d10/f1f to d3/d4/dc/d10/f3c 0 2024-09-16T02:05:50.963 INFO:tasks.workunit.client.1.smithi165.stdout:7/439: unlink d0/df/d68/f6c 0 2024-09-16T02:05:50.963 INFO:tasks.workunit.client.1.smithi165.stdout:1/438: dwrite d1/d19/d24/d30/f40 [0,4194304] 0 2024-09-16T02:05:50.964 INFO:tasks.workunit.client.0.smithi110.stdout:0/183: write d3/d4/f23 [4718420,69778] 0 2024-09-16T02:05:50.965 INFO:tasks.workunit.client.0.smithi110.stdout:0/184: dread - d3/d6/f3b zero size 2024-09-16T02:05:50.965 INFO:tasks.workunit.client.1.smithi165.stdout:6/459: creat d7/d17/d75/f76 x:0 0 0 2024-09-16T02:05:50.966 INFO:tasks.workunit.client.0.smithi110.stdout:0/185: write d3/d4/f1d [665472,100303] 0 2024-09-16T02:05:50.967 INFO:tasks.workunit.client.1.smithi165.stdout:1/439: dread d1/d22/f6f [0,4194304] 0 2024-09-16T02:05:50.968 INFO:tasks.workunit.client.1.smithi165.stdout:7/440: read d0/d3d/f6b [714562,94841] 0 2024-09-16T02:05:50.970 INFO:tasks.workunit.client.0.smithi110.stdout:0/186: fsync d3/d6/f34 0 2024-09-16T02:05:50.971 INFO:tasks.workunit.client.0.smithi110.stdout:0/187: write d3/d4/dc/d10/f35 [592108,4520] 0 2024-09-16T02:05:50.975 INFO:tasks.workunit.client.1.smithi165.stdout:6/460: write d7/f1e [3032856,57091] 0 2024-09-16T02:05:50.979 INFO:tasks.workunit.client.1.smithi165.stdout:9/504: dwrite d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:50.980 INFO:tasks.workunit.client.1.smithi165.stdout:1/440: dread d1/d22/f4e [0,4194304] 0 2024-09-16T02:05:50.982 INFO:tasks.workunit.client.0.smithi110.stdout:0/188: rename d3/d4/dc/d14/l2c to d3/l3d 0 2024-09-16T02:05:50.983 INFO:tasks.workunit.client.1.smithi165.stdout:6/461: dwrite d7/f23 [0,4194304] 0 2024-09-16T02:05:50.986 INFO:tasks.workunit.client.0.smithi110.stdout:0/189: truncate d3/f9 899602 0 2024-09-16T02:05:50.988 INFO:tasks.workunit.client.1.smithi165.stdout:6/462: creat d7/d17/d75/f77 x:0 0 0 2024-09-16T02:05:50.988 INFO:tasks.workunit.client.0.smithi110.stdout:0/190: creat d3/d4/dc/f3e x:0 0 0 2024-09-16T02:05:50.988 INFO:tasks.workunit.client.1.smithi165.stdout:6/463: chown d7/c2c 4164147 1 2024-09-16T02:05:50.990 INFO:tasks.workunit.client.1.smithi165.stdout:1/441: symlink d1/dd/d11/d33/d67/l8c 0 2024-09-16T02:05:50.991 INFO:tasks.workunit.client.1.smithi165.stdout:1/442: write d1/dd/f14 [3678359,44342] 0 2024-09-16T02:05:50.993 INFO:tasks.workunit.client.1.smithi165.stdout:6/464: creat d7/dc/d3b/d3a/f78 x:0 0 0 2024-09-16T02:05:50.995 INFO:tasks.workunit.client.1.smithi165.stdout:1/443: fdatasync d1/dd/d11/f1d 0 2024-09-16T02:05:50.996 INFO:tasks.workunit.client.1.smithi165.stdout:6/465: mknod d7/dc/d3b/d3c/c79 0 2024-09-16T02:05:50.997 INFO:tasks.workunit.client.1.smithi165.stdout:6/466: fdatasync d7/d17/d75/f77 0 2024-09-16T02:05:50.997 INFO:tasks.workunit.client.1.smithi165.stdout:6/467: readlink d7/l2b 0 2024-09-16T02:05:50.998 INFO:tasks.workunit.client.1.smithi165.stdout:1/444: chown d1/dd/d11/d33/f3b 18779 1 2024-09-16T02:05:50.998 INFO:tasks.workunit.client.1.smithi165.stdout:6/468: chown d7/c2c 280022670 1 2024-09-16T02:05:50.999 INFO:tasks.workunit.client.1.smithi165.stdout:6/469: dread - d7/d17/d75/f76 zero size 2024-09-16T02:05:51.000 INFO:tasks.workunit.client.1.smithi165.stdout:6/470: chown d7/dc/d3b/l4c 2776 1 2024-09-16T02:05:51.001 INFO:tasks.workunit.client.1.smithi165.stdout:1/445: rmdir d1/d6b/d80 0 2024-09-16T02:05:51.002 INFO:tasks.workunit.client.1.smithi165.stdout:6/471: mknod d7/d17/d24/c7a 0 2024-09-16T02:05:51.002 INFO:tasks.workunit.client.1.smithi165.stdout:6/472: readlink d7/dc/df/d1a/l20 0 2024-09-16T02:05:51.003 INFO:tasks.workunit.client.1.smithi165.stdout:1/446: write d1/dd/d11/d33/d3f/d47/f83 [615329,103410] 0 2024-09-16T02:05:51.004 INFO:tasks.workunit.client.1.smithi165.stdout:7/441: dread d0/df/f27 [0,4194304] 0 2024-09-16T02:05:51.005 INFO:tasks.workunit.client.1.smithi165.stdout:6/473: write d7/dc/df/d1a/f4f [1616801,88413] 0 2024-09-16T02:05:51.005 INFO:tasks.workunit.client.1.smithi165.stdout:1/447: dread - d1/dd/d11/d46/f70 zero size 2024-09-16T02:05:51.006 INFO:tasks.workunit.client.1.smithi165.stdout:6/474: stat c4 0 2024-09-16T02:05:51.007 INFO:tasks.workunit.client.1.smithi165.stdout:6/475: chown d7/d17/d24/f51 25887271 1 2024-09-16T02:05:51.008 INFO:tasks.workunit.client.1.smithi165.stdout:7/442: mknod d0/df/d7/d67/c8a 0 2024-09-16T02:05:51.008 INFO:tasks.workunit.client.1.smithi165.stdout:9/505: dread d7/df/f1c [0,4194304] 0 2024-09-16T02:05:51.008 INFO:tasks.workunit.client.1.smithi165.stdout:7/443: chown d0/df/d33/d2a 16320629 1 2024-09-16T02:05:51.009 INFO:tasks.workunit.client.1.smithi165.stdout:1/448: creat d1/dd/d11/d33/d3f/d47/f8d x:0 0 0 2024-09-16T02:05:51.010 INFO:tasks.workunit.client.1.smithi165.stdout:7/444: write d0/df/d7/f23 [1025813,1268] 0 2024-09-16T02:05:51.010 INFO:tasks.workunit.client.1.smithi165.stdout:9/506: dread d7/d32/d38/f73 [0,4194304] 0 2024-09-16T02:05:51.011 INFO:tasks.workunit.client.1.smithi165.stdout:1/449: chown d1/dd/d11/d33/d3f/d7e 225 1 2024-09-16T02:05:51.012 INFO:tasks.workunit.client.1.smithi165.stdout:1/450: fsync d1/dd/d11/d33/f8a 0 2024-09-16T02:05:51.014 INFO:tasks.workunit.client.1.smithi165.stdout:6/476: mkdir d7/dc/d3b/d3a/d74/d7b 0 2024-09-16T02:05:51.018 INFO:tasks.workunit.client.1.smithi165.stdout:9/507: creat d7/df/d37/d43/d88/fa6 x:0 0 0 2024-09-16T02:05:51.020 INFO:tasks.workunit.client.1.smithi165.stdout:1/451: truncate d1/dd/d11/d33/f56 1519133 0 2024-09-16T02:05:51.021 INFO:tasks.workunit.client.0.smithi110.stdout:0/191: link d3/f1b d3/d4/f3f 0 2024-09-16T02:05:51.024 INFO:tasks.workunit.client.1.smithi165.stdout:7/445: getdents d0 0 2024-09-16T02:05:51.025 INFO:tasks.workunit.client.1.smithi165.stdout:1/452: chown d1/d22/l4c 11975 1 2024-09-16T02:05:51.027 INFO:tasks.workunit.client.1.smithi165.stdout:1/453: fsync d1/dd/d11/f1b 0 2024-09-16T02:05:51.029 INFO:tasks.workunit.client.1.smithi165.stdout:6/477: truncate d7/d17/d24/f51 144436 0 2024-09-16T02:05:51.029 INFO:tasks.workunit.client.0.smithi110.stdout:0/192: getdents d3/d4/dc/d14 0 2024-09-16T02:05:51.030 INFO:tasks.workunit.client.1.smithi165.stdout:9/508: link d7/df/c3f d7/d32/d85/d8a/ca7 0 2024-09-16T02:05:51.030 INFO:tasks.workunit.client.1.smithi165.stdout:7/446: dwrite d0/df/d33/d2a/f4d [0,4194304] 0 2024-09-16T02:05:51.031 INFO:tasks.workunit.client.1.smithi165.stdout:6/478: truncate d7/d1f/f27 2499842 0 2024-09-16T02:05:51.032 INFO:tasks.workunit.client.1.smithi165.stdout:7/447: fdatasync d0/df/d65/f6e 0 2024-09-16T02:05:51.033 INFO:tasks.workunit.client.1.smithi165.stdout:7/448: fsync d0/df/d33/d2a/f54 0 2024-09-16T02:05:51.034 INFO:tasks.workunit.client.1.smithi165.stdout:1/454: creat d1/dd/d11/d46/d57/f8e x:0 0 0 2024-09-16T02:05:51.035 INFO:tasks.workunit.client.1.smithi165.stdout:1/455: write d1/f3a [3870971,62899] 0 2024-09-16T02:05:51.035 INFO:tasks.workunit.client.1.smithi165.stdout:9/509: fdatasync d7/d14/f24 0 2024-09-16T02:05:51.041 INFO:tasks.workunit.client.1.smithi165.stdout:2/507: sync 2024-09-16T02:05:51.041 INFO:tasks.workunit.client.1.smithi165.stdout:8/492: sync 2024-09-16T02:05:51.042 INFO:tasks.workunit.client.1.smithi165.stdout:2/508: chown df/d10/d1a/d2d 145 1 2024-09-16T02:05:51.042 INFO:tasks.workunit.client.1.smithi165.stdout:1/456: rmdir d1/d68 39 2024-09-16T02:05:51.044 INFO:tasks.workunit.client.1.smithi165.stdout:9/510: mkdir d7/d32/d4a/da8 0 2024-09-16T02:05:51.045 INFO:tasks.workunit.client.1.smithi165.stdout:9/511: truncate d7/d32/d38/d53/d5c/d61/f91 570062 0 2024-09-16T02:05:51.048 INFO:tasks.workunit.client.1.smithi165.stdout:8/493: creat dd/d11/d14/d3f/d72/fab x:0 0 0 2024-09-16T02:05:51.050 INFO:tasks.workunit.client.1.smithi165.stdout:1/457: write d1/d22/f2c [1638359,5816] 0 2024-09-16T02:05:51.052 INFO:tasks.workunit.client.0.smithi110.stdout:0/193: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:51.055 INFO:tasks.workunit.client.1.smithi165.stdout:7/449: dwrite d0/f41 [0,4194304] 0 2024-09-16T02:05:51.055 INFO:tasks.workunit.client.1.smithi165.stdout:1/458: rmdir d1/d19 39 2024-09-16T02:05:51.056 INFO:tasks.workunit.client.1.smithi165.stdout:6/479: truncate d7/dc/df/d1a/d4d/f4e 242110 0 2024-09-16T02:05:51.056 INFO:tasks.workunit.client.0.smithi110.stdout:0/194: stat d3/d4/dc/d14/c15 0 2024-09-16T02:05:51.057 INFO:tasks.workunit.client.1.smithi165.stdout:1/459: write d1/dd/d11/d33/f3b [4841394,130626] 0 2024-09-16T02:05:51.058 INFO:tasks.workunit.client.1.smithi165.stdout:8/494: symlink dd/d13/lac 0 2024-09-16T02:05:51.059 INFO:tasks.workunit.client.1.smithi165.stdout:9/512: write d7/d32/d38/d68/d7f/f70 [1805085,43225] 0 2024-09-16T02:05:51.060 INFO:tasks.workunit.client.1.smithi165.stdout:9/513: chown d7/d14/f24 1889 1 2024-09-16T02:05:51.061 INFO:tasks.workunit.client.1.smithi165.stdout:2/509: getdents df/d23/d28/d9a 0 2024-09-16T02:05:51.061 INFO:tasks.workunit.client.1.smithi165.stdout:2/510: chown df/d10/d37/c44 448638028 1 2024-09-16T02:05:51.064 INFO:tasks.workunit.client.0.smithi110.stdout:0/195: getdents d3 0 2024-09-16T02:05:51.065 INFO:tasks.workunit.client.1.smithi165.stdout:1/460: write d1/d22/f6f [628351,66003] 0 2024-09-16T02:05:51.067 INFO:tasks.workunit.client.1.smithi165.stdout:8/495: creat dd/d11/daa/fad x:0 0 0 2024-09-16T02:05:51.067 INFO:tasks.workunit.client.1.smithi165.stdout:2/511: creat df/d73/f9b x:0 0 0 2024-09-16T02:05:51.068 INFO:tasks.workunit.client.0.smithi110.stdout:0/196: unlink d3/d4/f29 0 2024-09-16T02:05:51.071 INFO:tasks.workunit.client.0.smithi110.stdout:0/197: rmdir d3/d4/dc 39 2024-09-16T02:05:51.072 INFO:tasks.workunit.client.1.smithi165.stdout:2/512: dread - df/d23/d28/f94 zero size 2024-09-16T02:05:51.074 INFO:tasks.workunit.client.1.smithi165.stdout:6/480: getdents d7/dc/d3b/d3a/d74 0 2024-09-16T02:05:51.074 INFO:tasks.workunit.client.0.smithi110.stdout:0/198: mknod d3/d4/dc/c40 0 2024-09-16T02:05:51.075 INFO:tasks.workunit.client.1.smithi165.stdout:7/450: dwrite d0/d2c/f7c [0,4194304] 0 2024-09-16T02:05:51.076 INFO:tasks.workunit.client.1.smithi165.stdout:1/461: symlink d1/dd/d11/d33/d3f/d6c/l8f 0 2024-09-16T02:05:51.080 INFO:tasks.workunit.client.1.smithi165.stdout:9/514: dwrite d7/df/d67/f7b [0,4194304] 0 2024-09-16T02:05:51.080 INFO:tasks.workunit.client.1.smithi165.stdout:2/513: write df/d10/d1a/d2d/f78 [686945,14185] 0 2024-09-16T02:05:51.081 INFO:tasks.workunit.client.0.smithi110.stdout:0/199: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:51.087 INFO:tasks.workunit.client.1.smithi165.stdout:8/496: dwrite dd/d11/d14/f54 [0,4194304] 0 2024-09-16T02:05:51.088 INFO:tasks.workunit.client.1.smithi165.stdout:1/462: creat d1/dd/d11/d33/d3f/d59/f90 x:0 0 0 2024-09-16T02:05:51.088 INFO:tasks.workunit.client.1.smithi165.stdout:6/481: dread d7/f1e [4194304,4194304] 0 2024-09-16T02:05:51.089 INFO:tasks.workunit.client.0.smithi110.stdout:0/200: getdents d3 0 2024-09-16T02:05:51.091 INFO:tasks.workunit.client.1.smithi165.stdout:1/463: write d1/d22/f6f [1579870,63786] 0 2024-09-16T02:05:51.091 INFO:tasks.workunit.client.1.smithi165.stdout:8/497: fsync dd/d11/daa/fad 0 2024-09-16T02:05:51.095 INFO:tasks.workunit.client.1.smithi165.stdout:6/482: readlink d7/dc/l56 0 2024-09-16T02:05:51.096 INFO:tasks.workunit.client.1.smithi165.stdout:7/451: getdents d0/df/d83 0 2024-09-16T02:05:51.097 INFO:tasks.workunit.client.1.smithi165.stdout:1/464: write d1/dd/d11/d33/d3f/d59/f90 [382792,7528] 0 2024-09-16T02:05:51.098 INFO:tasks.workunit.client.1.smithi165.stdout:2/514: dread df/f34 [0,4194304] 0 2024-09-16T02:05:51.100 INFO:tasks.workunit.client.1.smithi165.stdout:6/483: unlink d7/dc/d3b/d3c/l67 0 2024-09-16T02:05:51.101 INFO:tasks.workunit.client.1.smithi165.stdout:0/427: sync 2024-09-16T02:05:51.103 INFO:tasks.workunit.client.1.smithi165.stdout:8/498: getdents dd/d13 0 2024-09-16T02:05:51.103 INFO:tasks.workunit.client.1.smithi165.stdout:9/515: dwrite d7/d32/d38/d53/d5c/d61/d97/fa3 [0,4194304] 0 2024-09-16T02:05:51.105 INFO:tasks.workunit.client.1.smithi165.stdout:7/452: write d0/df/f27 [779868,31932] 0 2024-09-16T02:05:51.109 INFO:tasks.workunit.client.1.smithi165.stdout:2/515: rename df/d23/d28/d87/c89 to df/c9c 0 2024-09-16T02:05:51.109 INFO:tasks.workunit.client.1.smithi165.stdout:9/516: truncate d7/d1f/d27/d49/f5e 1467762 0 2024-09-16T02:05:51.112 INFO:tasks.workunit.client.1.smithi165.stdout:0/428: mkdir d0/d1e/d39/d48/d5f/d96 0 2024-09-16T02:05:51.113 INFO:tasks.workunit.client.1.smithi165.stdout:7/453: write d0/df/d7/f7e [2240132,99459] 0 2024-09-16T02:05:51.114 INFO:tasks.workunit.client.1.smithi165.stdout:1/465: dread d1/dd/d11/d33/d3f/f55 [0,4194304] 0 2024-09-16T02:05:51.116 INFO:tasks.workunit.client.1.smithi165.stdout:7/454: fsync d0/d2c/f2e 0 2024-09-16T02:05:51.117 INFO:tasks.workunit.client.1.smithi165.stdout:9/517: creat d7/df/d37/fa9 x:0 0 0 2024-09-16T02:05:51.118 INFO:tasks.workunit.client.1.smithi165.stdout:7/455: fsync d0/f60 0 2024-09-16T02:05:51.120 INFO:tasks.workunit.client.1.smithi165.stdout:8/499: dwrite dd/d11/d14/d3f/d25/fa8 [0,4194304] 0 2024-09-16T02:05:51.120 INFO:tasks.workunit.client.1.smithi165.stdout:9/518: read d7/d14/f16 [583215,20111] 0 2024-09-16T02:05:51.121 INFO:tasks.workunit.client.1.smithi165.stdout:2/516: rename df/d10/d1a/d2d/f4b to df/d23/d28/d9a/f9d 0 2024-09-16T02:05:51.122 INFO:tasks.workunit.client.1.smithi165.stdout:1/466: creat d1/d19/d24/d30/d72/f91 x:0 0 0 2024-09-16T02:05:51.123 INFO:tasks.workunit.client.1.smithi165.stdout:7/456: creat d0/d4b/d63/f8b x:0 0 0 2024-09-16T02:05:51.124 INFO:tasks.workunit.client.1.smithi165.stdout:0/429: creat d0/d1e/d20/f97 x:0 0 0 2024-09-16T02:05:51.128 INFO:tasks.workunit.client.1.smithi165.stdout:2/517: chown df/d10/d1a/d68/c72 206507166 1 2024-09-16T02:05:51.130 INFO:tasks.workunit.client.1.smithi165.stdout:2/518: write df/d23/f6e [5006343,71046] 0 2024-09-16T02:05:51.131 INFO:tasks.workunit.client.1.smithi165.stdout:8/500: dwrite dd/d13/f65 [0,4194304] 0 2024-09-16T02:05:51.134 INFO:tasks.workunit.client.1.smithi165.stdout:8/501: write dd/d11/d14/d3f/d25/fa8 [4370771,6979] 0 2024-09-16T02:05:51.134 INFO:tasks.workunit.client.1.smithi165.stdout:2/519: fdatasync df/d23/d28/f53 0 2024-09-16T02:05:51.140 INFO:tasks.workunit.client.1.smithi165.stdout:1/467: dread d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:51.143 INFO:tasks.workunit.client.1.smithi165.stdout:7/457: truncate d0/df/d7/f7e 1418287 0 2024-09-16T02:05:51.144 INFO:tasks.workunit.client.1.smithi165.stdout:1/468: mkdir d1/dd/d11/d33/d92 0 2024-09-16T02:05:51.145 INFO:tasks.workunit.client.1.smithi165.stdout:9/519: dread d7/df/d67/f9e [0,4194304] 0 2024-09-16T02:05:51.147 INFO:tasks.workunit.client.1.smithi165.stdout:7/458: rmdir d0/df/d7 39 2024-09-16T02:05:51.148 INFO:tasks.workunit.client.1.smithi165.stdout:9/520: mknod d7/d55/caa 0 2024-09-16T02:05:51.148 INFO:tasks.workunit.client.1.smithi165.stdout:8/502: dwrite dd/d11/d14/d3f/f6a [0,4194304] 0 2024-09-16T02:05:51.149 INFO:tasks.workunit.client.1.smithi165.stdout:1/469: creat d1/d19/d24/d30/d72/f93 x:0 0 0 2024-09-16T02:05:51.151 INFO:tasks.workunit.client.1.smithi165.stdout:7/459: write d0/df/d33/d2a/f4d [4858053,37272] 0 2024-09-16T02:05:51.152 INFO:tasks.workunit.client.1.smithi165.stdout:9/521: creat d7/df/d67/fab x:0 0 0 2024-09-16T02:05:51.155 INFO:tasks.workunit.client.1.smithi165.stdout:1/470: unlink d1/dd/d11/d46/d57/f8e 0 2024-09-16T02:05:51.156 INFO:tasks.workunit.client.1.smithi165.stdout:2/520: dwrite df/d23/d28/d3b/f5b [0,4194304] 0 2024-09-16T02:05:51.157 INFO:tasks.workunit.client.1.smithi165.stdout:9/522: fsync d7/d32/f47 0 2024-09-16T02:05:51.159 INFO:tasks.workunit.client.1.smithi165.stdout:0/430: dread d0/ff [0,4194304] 0 2024-09-16T02:05:51.162 INFO:tasks.workunit.client.1.smithi165.stdout:2/521: symlink df/d23/d66/l9e 0 2024-09-16T02:05:51.163 INFO:tasks.workunit.client.1.smithi165.stdout:8/503: dread dd/d11/d14/f54 [0,4194304] 0 2024-09-16T02:05:51.164 INFO:tasks.workunit.client.1.smithi165.stdout:2/522: chown df/d23/d28/c4c 620855 1 2024-09-16T02:05:51.165 INFO:tasks.workunit.client.1.smithi165.stdout:0/431: symlink d0/d1e/d39/d48/d74/l98 0 2024-09-16T02:05:51.167 INFO:tasks.workunit.client.1.smithi165.stdout:7/460: dwrite d0/df/d33/d2a/f4d [0,4194304] 0 2024-09-16T02:05:51.177 INFO:tasks.workunit.client.1.smithi165.stdout:2/523: creat df/d10/f9f x:0 0 0 2024-09-16T02:05:51.181 INFO:tasks.workunit.client.1.smithi165.stdout:1/471: rmdir d1/dd/d11/d46 39 2024-09-16T02:05:51.183 INFO:tasks.workunit.client.1.smithi165.stdout:1/472: write d1/d19/d4d/f81 [978515,93553] 0 2024-09-16T02:05:51.186 INFO:tasks.workunit.client.1.smithi165.stdout:9/523: truncate d7/d32/d38/d58/d99/f9c 2090534 0 2024-09-16T02:05:51.186 INFO:tasks.workunit.client.1.smithi165.stdout:1/473: rmdir d1/d68 39 2024-09-16T02:05:51.187 INFO:tasks.workunit.client.1.smithi165.stdout:1/474: stat d1/dd/c5a 0 2024-09-16T02:05:51.187 INFO:tasks.workunit.client.1.smithi165.stdout:9/524: write d7/d1f/d27/f3e [1262678,4646] 0 2024-09-16T02:05:51.188 INFO:tasks.workunit.client.1.smithi165.stdout:8/504: truncate dd/d11/d38/f39 420615 0 2024-09-16T02:05:51.190 INFO:tasks.workunit.client.1.smithi165.stdout:7/461: truncate d0/df/d7/f23 3099790 0 2024-09-16T02:05:51.190 INFO:tasks.workunit.client.1.smithi165.stdout:2/524: dread df/f16 [0,4194304] 0 2024-09-16T02:05:51.190 INFO:tasks.workunit.client.1.smithi165.stdout:1/475: mkdir d1/d94 0 2024-09-16T02:05:51.192 INFO:tasks.workunit.client.1.smithi165.stdout:5/455: sync 2024-09-16T02:05:51.192 INFO:tasks.workunit.client.1.smithi165.stdout:3/528: sync 2024-09-16T02:05:51.192 INFO:tasks.workunit.client.1.smithi165.stdout:4/422: sync 2024-09-16T02:05:51.192 INFO:tasks.workunit.client.1.smithi165.stdout:0/432: dwrite d0/d1e/d39/f7c [0,4194304] 0 2024-09-16T02:05:51.196 INFO:tasks.workunit.client.1.smithi165.stdout:2/525: unlink df/d23/d28/c4c 0 2024-09-16T02:05:51.196 INFO:tasks.workunit.client.1.smithi165.stdout:0/433: chown d0/d47/f59 122250748 1 2024-09-16T02:05:51.197 INFO:tasks.workunit.client.1.smithi165.stdout:3/529: mknod da/de/cbc 0 2024-09-16T02:05:51.197 INFO:tasks.workunit.client.1.smithi165.stdout:5/456: chown de/d21/d26/d3a/d54/l46 1588736624 1 2024-09-16T02:05:51.199 INFO:tasks.workunit.client.1.smithi165.stdout:4/423: rmdir d4/dc/d28/d3b 39 2024-09-16T02:05:51.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:50 smithi165 ceph-mon[34621]: pgmap v19: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 24 MiB/s rd, 155 MiB/s wr, 434 op/s 2024-09-16T02:05:51.200 INFO:tasks.workunit.client.1.smithi165.stdout:3/530: readlink da/d17/d78/l43 0 2024-09-16T02:05:51.203 INFO:tasks.workunit.client.1.smithi165.stdout:5/457: unlink de/d21/d51/c52 0 2024-09-16T02:05:51.203 INFO:tasks.workunit.client.1.smithi165.stdout:9/525: dwrite d7/df/d67/f9e [0,4194304] 0 2024-09-16T02:05:51.205 INFO:tasks.workunit.client.1.smithi165.stdout:4/424: rmdir d4/dc/d20 39 2024-09-16T02:05:51.205 INFO:tasks.workunit.client.1.smithi165.stdout:5/458: read de/d21/f8f [103162,67780] 0 2024-09-16T02:05:51.208 INFO:tasks.workunit.client.1.smithi165.stdout:5/459: write fa [719445,81742] 0 2024-09-16T02:05:51.209 INFO:tasks.workunit.client.1.smithi165.stdout:6/484: sync 2024-09-16T02:05:51.210 INFO:tasks.workunit.client.1.smithi165.stdout:6/485: read d7/f1e [5212320,35818] 0 2024-09-16T02:05:51.211 INFO:tasks.workunit.client.1.smithi165.stdout:0/434: dread d0/d1e/d39/d48/d45/f37 [0,4194304] 0 2024-09-16T02:05:51.231 INFO:tasks.workunit.client.1.smithi165.stdout:0/435: chown d0/d1e/d39/d48/d45/c50 10680872 1 2024-09-16T02:05:51.232 INFO:tasks.workunit.client.1.smithi165.stdout:1/476: dread d1/dd/d11/d33/d3f/d59/f60 [0,4194304] 0 2024-09-16T02:05:51.233 INFO:tasks.workunit.client.1.smithi165.stdout:5/460: dwrite de/d21/d26/d3a/f5a [0,4194304] 0 2024-09-16T02:05:51.235 INFO:tasks.workunit.client.1.smithi165.stdout:5/461: truncate de/d21/d26/d3a/d54/f89 525543 0 2024-09-16T02:05:51.235 INFO:tasks.workunit.client.1.smithi165.stdout:1/477: read d1/fc [3295705,39330] 0 2024-09-16T02:05:51.235 INFO:tasks.workunit.client.1.smithi165.stdout:5/462: chown de/f14 17517 1 2024-09-16T02:05:51.291 INFO:tasks.workunit.client.1.smithi165.stdout:4/425: sync 2024-09-16T02:05:51.292 INFO:tasks.workunit.client.1.smithi165.stdout:4/426: fsync d4/dc/d18/d37/d47/f70 0 2024-09-16T02:05:51.296 INFO:tasks.workunit.client.0.smithi110.stdout:5/173: sync 2024-09-16T02:05:51.297 INFO:tasks.workunit.client.1.smithi165.stdout:8/505: truncate dd/d11/d38/f4b 69171 0 2024-09-16T02:05:51.298 INFO:tasks.workunit.client.1.smithi165.stdout:7/462: truncate d0/d3d/f5b 2978129 0 2024-09-16T02:05:51.299 INFO:tasks.workunit.client.1.smithi165.stdout:7/463: dread - d0/d4b/d63/f8b zero size 2024-09-16T02:05:51.300 INFO:tasks.workunit.client.1.smithi165.stdout:8/506: dread dd/d11/d38/f45 [0,4194304] 0 2024-09-16T02:05:51.305 INFO:tasks.workunit.client.1.smithi165.stdout:8/507: dread dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:51.319 INFO:tasks.workunit.client.1.smithi165.stdout:8/508: dread dd/d11/f47 [0,4194304] 0 2024-09-16T02:05:51.337 INFO:tasks.workunit.client.1.smithi165.stdout:0/436: mkdir d0/d1e/d39/d99 0 2024-09-16T02:05:51.339 INFO:tasks.workunit.client.1.smithi165.stdout:2/526: truncate df/f3f 3761773 0 2024-09-16T02:05:51.340 INFO:tasks.workunit.client.1.smithi165.stdout:1/478: stat d1/dd/d11/d46/d57/c71 0 2024-09-16T02:05:51.341 INFO:tasks.workunit.client.1.smithi165.stdout:1/479: write d1/dd/d11/d33/d3f/d59/f60 [17808,31674] 0 2024-09-16T02:05:51.341 INFO:tasks.workunit.client.1.smithi165.stdout:5/463: creat de/d19/d1c/d49/f99 x:0 0 0 2024-09-16T02:05:51.343 INFO:tasks.workunit.client.1.smithi165.stdout:5/464: write de/d19/d1c/d4d/f72 [553940,86312] 0 2024-09-16T02:05:51.345 INFO:tasks.workunit.client.1.smithi165.stdout:4/427: rename d4/dc/d18/d37/d47 to d4/dc/d18/d37/d53/d64/d8b 0 2024-09-16T02:05:51.346 INFO:tasks.workunit.client.1.smithi165.stdout:4/428: fdatasync d4/dc/d18/d37/d53/d64/d8b/f86 0 2024-09-16T02:05:51.347 INFO:tasks.workunit.client.1.smithi165.stdout:5/465: dread fa [0,4194304] 0 2024-09-16T02:05:51.349 INFO:tasks.workunit.client.1.smithi165.stdout:5/466: chown de/d21/d26/c75 1867071113 1 2024-09-16T02:05:51.353 INFO:tasks.workunit.client.1.smithi165.stdout:6/486: creat d7/dc/d3b/d3a/d3d/d5d/d73/f7c x:0 0 0 2024-09-16T02:05:51.353 INFO:tasks.workunit.client.1.smithi165.stdout:7/464: fdatasync d0/df/d33/f29 0 2024-09-16T02:05:51.354 INFO:tasks.workunit.client.1.smithi165.stdout:6/487: chown d7/dc/c30 4630546 1 2024-09-16T02:05:51.354 INFO:tasks.workunit.client.1.smithi165.stdout:7/465: stat d0/df/d7/d67/l7b 0 2024-09-16T02:05:51.354 INFO:tasks.workunit.client.1.smithi165.stdout:8/509: mknod dd/d11/d14/d3f/d25/d36/d81/cae 0 2024-09-16T02:05:51.355 INFO:tasks.workunit.client.1.smithi165.stdout:7/466: write d0/df/d7/fe [4999298,59362] 0 2024-09-16T02:05:51.357 INFO:tasks.workunit.client.1.smithi165.stdout:8/510: write dd/d11/d14/d3f/d25/d36/f64 [359057,86957] 0 2024-09-16T02:05:51.358 INFO:tasks.workunit.client.1.smithi165.stdout:8/511: stat dd/d34/f48 0 2024-09-16T02:05:51.360 INFO:tasks.workunit.client.1.smithi165.stdout:2/527: mknod df/d23/d28/d3b/d6d/d8b/ca0 0 2024-09-16T02:05:51.360 INFO:tasks.workunit.client.0.smithi110.stdout:5/174: dwrite d5/dd/f12 [0,4194304] 0 2024-09-16T02:05:51.361 INFO:tasks.workunit.client.1.smithi165.stdout:1/480: mkdir d1/d19/d24/d30/d72/d95 0 2024-09-16T02:05:51.363 INFO:tasks.workunit.client.1.smithi165.stdout:8/512: dread dd/d11/d14/d3f/d25/fa8 [0,4194304] 0 2024-09-16T02:05:51.366 INFO:tasks.workunit.client.1.smithi165.stdout:9/526: link d7/df/d37/d43/l5f d7/d32/d38/d58/lac 0 2024-09-16T02:05:51.367 INFO:tasks.workunit.client.1.smithi165.stdout:3/531: getdents da/d20/d26/d8c 0 2024-09-16T02:05:51.369 INFO:tasks.workunit.client.1.smithi165.stdout:5/467: mkdir de/d21/d26/d9a 0 2024-09-16T02:05:51.371 INFO:tasks.workunit.client.1.smithi165.stdout:6/488: dread d7/dc/df/d1a/f45 [0,4194304] 0 2024-09-16T02:05:51.374 INFO:tasks.workunit.client.1.smithi165.stdout:7/467: dread d0/df/d33/d2a/f5a [0,4194304] 0 2024-09-16T02:05:51.377 INFO:tasks.workunit.client.0.smithi110.stdout:5/175: dread d5/f19 [0,4194304] 0 2024-09-16T02:05:51.378 INFO:tasks.workunit.client.1.smithi165.stdout:8/513: symlink dd/d11/d38/d74/laf 0 2024-09-16T02:05:51.379 INFO:tasks.workunit.client.1.smithi165.stdout:2/528: dread df/d10/d1a/d2d/f4e [0,4194304] 0 2024-09-16T02:05:51.379 INFO:tasks.workunit.client.1.smithi165.stdout:9/527: symlink d7/d32/d38/d53/d56/lad 0 2024-09-16T02:05:51.380 INFO:tasks.workunit.client.1.smithi165.stdout:9/528: stat d7/d32/f39 0 2024-09-16T02:05:51.382 INFO:tasks.workunit.client.1.smithi165.stdout:7/468: dread d0/d4b/f5d [0,4194304] 0 2024-09-16T02:05:51.384 INFO:tasks.workunit.client.1.smithi165.stdout:6/489: creat d7/d17/d75/f7d x:0 0 0 2024-09-16T02:05:51.387 INFO:tasks.workunit.client.1.smithi165.stdout:0/437: dwrite d0/d1e/f93 [0,4194304] 0 2024-09-16T02:05:51.388 INFO:tasks.workunit.client.1.smithi165.stdout:8/514: dread dd/d13/d53/f61 [0,4194304] 0 2024-09-16T02:05:51.391 INFO:tasks.workunit.client.1.smithi165.stdout:5/468: dread fc [0,4194304] 0 2024-09-16T02:05:51.392 INFO:tasks.workunit.client.1.smithi165.stdout:7/469: rename d0/df/d83/d84/d7f to d0/d2c/d85/d8c 0 2024-09-16T02:05:51.394 INFO:tasks.workunit.client.1.smithi165.stdout:6/490: creat d7/d17/d24/f7e x:0 0 0 2024-09-16T02:05:51.394 INFO:tasks.workunit.client.1.smithi165.stdout:1/481: link d1/dd/d11/d33/f4b d1/dd/d11/d33/d92/f96 0 2024-09-16T02:05:51.397 INFO:tasks.workunit.client.1.smithi165.stdout:1/482: write d1/d19/d24/d30/f40 [198044,92578] 0 2024-09-16T02:05:51.398 INFO:tasks.workunit.client.0.smithi110.stdout:5/176: write d5/f13 [1253436,106892] 0 2024-09-16T02:05:51.398 INFO:tasks.workunit.client.1.smithi165.stdout:3/532: creat da/d17/d78/d2c/d2d/fbd x:0 0 0 2024-09-16T02:05:51.398 INFO:tasks.workunit.client.1.smithi165.stdout:7/470: dread d0/df/d42/f5e [0,4194304] 0 2024-09-16T02:05:51.399 INFO:tasks.workunit.client.1.smithi165.stdout:3/533: dread - da/d20/d26/d8c/fa2 zero size 2024-09-16T02:05:51.399 INFO:tasks.workunit.client.1.smithi165.stdout:8/515: rmdir dd/d13 39 2024-09-16T02:05:51.400 INFO:tasks.workunit.client.1.smithi165.stdout:7/471: chown d0/d2c/c52 3 1 2024-09-16T02:05:51.400 INFO:tasks.workunit.client.1.smithi165.stdout:5/469: mknod de/d19/d1c/d4d/c9b 0 2024-09-16T02:05:51.400 INFO:tasks.workunit.client.1.smithi165.stdout:8/516: chown dd/d11/d14 703 1 2024-09-16T02:05:51.401 INFO:tasks.workunit.client.0.smithi110.stdout:5/177: symlink d5/d36/l39 0 2024-09-16T02:05:51.402 INFO:tasks.workunit.client.1.smithi165.stdout:8/517: chown dd/d11/d14/d3f/c3b 3243 1 2024-09-16T02:05:51.402 INFO:tasks.workunit.client.1.smithi165.stdout:2/529: creat df/d23/d28/d3b/fa1 x:0 0 0 2024-09-16T02:05:51.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/483: mkdir d1/d19/d24/d97 0 2024-09-16T02:05:51.404 INFO:tasks.workunit.client.0.smithi110.stdout:5/178: creat d5/dd/df/d11/f3a x:0 0 0 2024-09-16T02:05:51.405 INFO:tasks.workunit.client.1.smithi165.stdout:6/491: mkdir d7/dc/d7f 0 2024-09-16T02:05:51.406 INFO:tasks.workunit.client.0.smithi110.stdout:5/179: fdatasync d5/dd/f10 0 2024-09-16T02:05:51.407 INFO:tasks.workunit.client.1.smithi165.stdout:1/484: symlink d1/dd/d11/d46/d57/l98 0 2024-09-16T02:05:51.408 INFO:tasks.workunit.client.1.smithi165.stdout:8/518: dwrite dd/f8a [0,4194304] 0 2024-09-16T02:05:51.410 INFO:tasks.workunit.client.1.smithi165.stdout:2/530: symlink df/d10/la2 0 2024-09-16T02:05:51.410 INFO:tasks.workunit.client.1.smithi165.stdout:7/472: dread d0/df/d33/f29 [0,4194304] 0 2024-09-16T02:05:51.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/180: mkdir d5/dd/df/d3b 0 2024-09-16T02:05:51.413 INFO:tasks.workunit.client.1.smithi165.stdout:0/438: rename d0/d1e/d39/d48/d79 to d0/d1e/d20/d28/d9a 0 2024-09-16T02:05:51.414 INFO:tasks.workunit.client.1.smithi165.stdout:1/485: unlink d1/d19/c51 0 2024-09-16T02:05:51.416 INFO:tasks.workunit.client.0.smithi110.stdout:5/181: chown d5/dd/df/d28 30586 1 2024-09-16T02:05:51.418 INFO:tasks.workunit.client.0.smithi110.stdout:5/182: read d5/dd/df/f35 [17389,7784] 0 2024-09-16T02:05:51.418 INFO:tasks.workunit.client.1.smithi165.stdout:8/519: rmdir dd/d11/d14/d3f/d25/d36/d81 39 2024-09-16T02:05:51.419 INFO:tasks.workunit.client.1.smithi165.stdout:8/520: fsync dd/d34/f48 0 2024-09-16T02:05:51.422 INFO:tasks.workunit.client.1.smithi165.stdout:7/473: creat d0/d2c/f8d x:0 0 0 2024-09-16T02:05:51.426 INFO:tasks.workunit.client.1.smithi165.stdout:9/529: truncate d7/df/d37/f83 6537444 0 2024-09-16T02:05:51.427 INFO:tasks.workunit.client.1.smithi165.stdout:3/534: rename da/d17/d78/d2c/c37 to da/d20/d26/d8c/cbe 0 2024-09-16T02:05:51.428 INFO:tasks.workunit.client.1.smithi165.stdout:8/521: dwrite dd/d62/d94/f88 [0,4194304] 0 2024-09-16T02:05:51.429 INFO:tasks.workunit.client.0.smithi110.stdout:5/183: rmdir d5/dd/df/d3b 0 2024-09-16T02:05:51.430 INFO:tasks.workunit.client.0.smithi110.stdout:5/184: chown d5/l37 0 1 2024-09-16T02:05:51.431 INFO:tasks.workunit.client.1.smithi165.stdout:7/474: mknod d0/d2c/c8e 0 2024-09-16T02:05:51.432 INFO:tasks.workunit.client.1.smithi165.stdout:4/429: dwrite d4/dc/d28/d30/f80 [0,4194304] 0 2024-09-16T02:05:51.434 INFO:tasks.workunit.client.0.smithi110.stdout:5/185: rename d5/cb to d5/dd/df/d28/c3c 0 2024-09-16T02:05:51.435 INFO:tasks.workunit.client.0.smithi110.stdout:5/186: chown d5/f1e 1058638876 1 2024-09-16T02:05:51.436 INFO:tasks.workunit.client.1.smithi165.stdout:9/530: mknod d7/d1f/cae 0 2024-09-16T02:05:51.437 INFO:tasks.workunit.client.1.smithi165.stdout:3/535: read - da/d57/d8d/d97/f76 zero size 2024-09-16T02:05:51.438 INFO:tasks.workunit.client.1.smithi165.stdout:5/470: rename de/d21/d51/l76 to de/d19/d1c/d84/d92/l9c 0 2024-09-16T02:05:51.439 INFO:tasks.workunit.client.1.smithi165.stdout:1/486: symlink d1/d68/l99 0 2024-09-16T02:05:51.439 INFO:tasks.workunit.client.1.smithi165.stdout:5/471: chown de/d19/d1c/f56 1 1 2024-09-16T02:05:51.445 INFO:tasks.workunit.client.1.smithi165.stdout:0/439: link d0/d1e/f57 d0/d1e/d39/d48/d5f/d82/f9b 0 2024-09-16T02:05:51.446 INFO:tasks.workunit.client.1.smithi165.stdout:3/536: unlink da/d17/d78/d2c/d2d/c5c 0 2024-09-16T02:05:51.447 INFO:tasks.workunit.client.1.smithi165.stdout:8/522: fdatasync dd/d62/d94/f88 0 2024-09-16T02:05:51.447 INFO:tasks.workunit.client.1.smithi165.stdout:5/472: fdatasync fc 0 2024-09-16T02:05:51.448 INFO:tasks.workunit.client.1.smithi165.stdout:6/492: dwrite d7/dc/df/d1a/d4d/f4e [0,4194304] 0 2024-09-16T02:05:51.450 INFO:tasks.workunit.client.1.smithi165.stdout:5/473: fsync de/d19/f33 0 2024-09-16T02:05:51.450 INFO:tasks.workunit.client.1.smithi165.stdout:6/493: chown d7/c2c 2448501 1 2024-09-16T02:05:51.453 INFO:tasks.workunit.client.1.smithi165.stdout:4/430: mknod d4/dc/d28/d2b/c8c 0 2024-09-16T02:05:51.455 INFO:tasks.workunit.client.1.smithi165.stdout:2/531: write df/f90 [4449094,25563] 0 2024-09-16T02:05:51.458 INFO:tasks.workunit.client.1.smithi165.stdout:6/494: dwrite d7/dc/df/d1a/f2d [0,4194304] 0 2024-09-16T02:05:51.459 INFO:tasks.workunit.client.1.smithi165.stdout:5/474: readlink de/d19/d1c/d84/d92/l9c 0 2024-09-16T02:05:51.460 INFO:tasks.workunit.client.1.smithi165.stdout:5/475: write de/d19/d1c/f4f [1176024,36504] 0 2024-09-16T02:05:51.461 INFO:tasks.workunit.client.1.smithi165.stdout:0/440: mkdir d0/d1e/d20/d9c 0 2024-09-16T02:05:51.463 INFO:tasks.workunit.client.1.smithi165.stdout:8/523: mkdir dd/d11/d38/da6/db0 0 2024-09-16T02:05:51.464 INFO:tasks.workunit.client.1.smithi165.stdout:7/475: write d0/df/d7/f23 [1047324,21776] 0 2024-09-16T02:05:51.465 INFO:tasks.workunit.client.1.smithi165.stdout:4/431: symlink d4/dc/d18/d37/d53/d64/d8b/d71/l8d 0 2024-09-16T02:05:51.469 INFO:tasks.workunit.client.1.smithi165.stdout:6/495: dwrite d7/d1f/f27 [0,4194304] 0 2024-09-16T02:05:51.469 INFO:tasks.workunit.client.1.smithi165.stdout:9/531: rename d7/d1f/f5d to d7/d32/faf 0 2024-09-16T02:05:51.471 INFO:tasks.workunit.client.1.smithi165.stdout:3/537: creat da/d17/d78/d2c/d2d/fbf x:0 0 0 2024-09-16T02:05:51.472 INFO:tasks.workunit.client.1.smithi165.stdout:4/432: write d4/dc/d28/f5f [33388,35146] 0 2024-09-16T02:05:51.476 INFO:tasks.workunit.client.1.smithi165.stdout:6/496: write d7/dc/f72 [116295,36898] 0 2024-09-16T02:05:51.476 INFO:tasks.workunit.client.1.smithi165.stdout:7/476: creat d0/d4b/d63/f8f x:0 0 0 2024-09-16T02:05:51.477 INFO:tasks.workunit.client.1.smithi165.stdout:1/487: rename d1/dd/d11/d33/f4b to d1/dd/d11/d33/d35/f9a 0 2024-09-16T02:05:51.477 INFO:tasks.workunit.client.1.smithi165.stdout:4/433: fdatasync d4/dc/d28/d2b/f6d 0 2024-09-16T02:05:51.478 INFO:tasks.workunit.client.1.smithi165.stdout:5/476: dwrite de/d19/d1c/d49/f73 [0,4194304] 0 2024-09-16T02:05:51.478 INFO:tasks.workunit.client.1.smithi165.stdout:9/532: dread - d7/df/d67/d92/d93/fa0 zero size 2024-09-16T02:05:51.479 INFO:tasks.workunit.client.1.smithi165.stdout:3/538: read da/d20/d26/d52/f93 [1029019,31133] 0 2024-09-16T02:05:51.481 INFO:tasks.workunit.client.1.smithi165.stdout:6/497: write d7/d17/f69 [579585,104766] 0 2024-09-16T02:05:51.485 INFO:tasks.workunit.client.1.smithi165.stdout:9/533: write d7/d32/d38/d58/f79 [831565,101982] 0 2024-09-16T02:05:51.488 INFO:tasks.workunit.client.1.smithi165.stdout:3/539: write da/d17/d7a/d7d/da8/fb1 [656494,72065] 0 2024-09-16T02:05:51.490 INFO:tasks.workunit.client.1.smithi165.stdout:6/498: rmdir d7/d17/d24 39 2024-09-16T02:05:51.491 INFO:tasks.workunit.client.1.smithi165.stdout:5/477: mkdir de/d21/d26/d94/d9d 0 2024-09-16T02:05:51.491 INFO:tasks.workunit.client.1.smithi165.stdout:2/532: link df/d23/d28/d3b/d82/l99 df/d23/d28/d9a/la3 0 2024-09-16T02:05:51.493 INFO:tasks.workunit.client.1.smithi165.stdout:1/488: creat d1/dd/d11/d33/d67/f9b x:0 0 0 2024-09-16T02:05:51.494 INFO:tasks.workunit.client.1.smithi165.stdout:0/441: dwrite d0/d47/f65 [0,4194304] 0 2024-09-16T02:05:51.495 INFO:tasks.workunit.client.1.smithi165.stdout:2/533: stat df/d10/l1e 0 2024-09-16T02:05:51.495 INFO:tasks.workunit.client.1.smithi165.stdout:6/499: readlink d7/d1f/l36 0 2024-09-16T02:05:51.495 INFO:tasks.workunit.client.1.smithi165.stdout:3/540: mknod da/d20/d26/d8c/cc0 0 2024-09-16T02:05:51.495 INFO:tasks.workunit.client.1.smithi165.stdout:9/534: chown d7/c8 53 1 2024-09-16T02:05:51.497 INFO:tasks.workunit.client.1.smithi165.stdout:4/434: link d4/dc/d20/f62 d4/dc/d20/d4e/d73/f8e 0 2024-09-16T02:05:51.497 INFO:tasks.workunit.client.1.smithi165.stdout:7/477: getdents d0/d4b 0 2024-09-16T02:05:51.503 INFO:tasks.workunit.client.1.smithi165.stdout:7/478: write d0/f59 [1003257,130216] 0 2024-09-16T02:05:51.506 INFO:tasks.workunit.client.1.smithi165.stdout:0/442: mknod d0/d1e/d20/d28/c9d 0 2024-09-16T02:05:51.510 INFO:tasks.workunit.client.1.smithi165.stdout:8/524: dwrite dd/d11/d38/f4b [0,4194304] 0 2024-09-16T02:05:51.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/489: dwrite d1/d32/f34 [0,4194304] 0 2024-09-16T02:05:51.515 INFO:tasks.workunit.client.1.smithi165.stdout:4/435: unlink d4/dc/d18/d37/d53/d64/d8b/d71/l8d 0 2024-09-16T02:05:51.516 INFO:tasks.workunit.client.1.smithi165.stdout:7/479: creat d0/df/d33/f90 x:0 0 0 2024-09-16T02:05:51.516 INFO:tasks.workunit.client.1.smithi165.stdout:2/534: dwrite df/d10/d1a/d2d/f58 [0,4194304] 0 2024-09-16T02:05:51.517 INFO:tasks.workunit.client.1.smithi165.stdout:6/500: rmdir d7/dc/d3b/d3a/d74/d7b 0 2024-09-16T02:05:51.522 INFO:tasks.workunit.client.1.smithi165.stdout:9/535: dread d7/f35 [0,4194304] 0 2024-09-16T02:05:51.522 INFO:tasks.workunit.client.1.smithi165.stdout:0/443: write d0/d1e/d39/d48/f38 [716939,92134] 0 2024-09-16T02:05:51.524 INFO:tasks.workunit.client.1.smithi165.stdout:3/541: getdents da/d17/d7a/d7d/da8 0 2024-09-16T02:05:51.525 INFO:tasks.workunit.client.1.smithi165.stdout:0/444: read d0/d1e/f93 [1471570,38893] 0 2024-09-16T02:05:51.525 INFO:tasks.workunit.client.1.smithi165.stdout:6/501: mknod d7/dc/d3b/d3c/c80 0 2024-09-16T02:05:51.526 INFO:tasks.workunit.client.1.smithi165.stdout:1/490: symlink d1/d22/l9c 0 2024-09-16T02:05:51.527 INFO:tasks.workunit.client.1.smithi165.stdout:8/525: creat dd/fb1 x:0 0 0 2024-09-16T02:05:51.527 INFO:tasks.workunit.client.1.smithi165.stdout:4/436: symlink d4/dc/l8f 0 2024-09-16T02:05:51.529 INFO:tasks.workunit.client.1.smithi165.stdout:6/502: chown d7/dc/df/d1a/l20 2133527815 1 2024-09-16T02:05:51.529 INFO:tasks.workunit.client.1.smithi165.stdout:9/536: chown d7/df/c29 31250368 1 2024-09-16T02:05:51.529 INFO:tasks.workunit.client.1.smithi165.stdout:2/535: mknod df/d23/ca4 0 2024-09-16T02:05:51.530 INFO:tasks.workunit.client.1.smithi165.stdout:7/480: rename d0/d4b/d63/l77 to d0/df/d65/l91 0 2024-09-16T02:05:51.534 INFO:tasks.workunit.client.1.smithi165.stdout:0/445: readlink d0/d1e/d39/l92 0 2024-09-16T02:05:51.534 INFO:tasks.workunit.client.1.smithi165.stdout:8/526: creat dd/d11/daa/fb2 x:0 0 0 2024-09-16T02:05:51.536 INFO:tasks.workunit.client.0.smithi110.stdout:3/137: sync 2024-09-16T02:05:51.536 INFO:tasks.workunit.client.0.smithi110.stdout:8/158: sync 2024-09-16T02:05:51.537 INFO:tasks.workunit.client.1.smithi165.stdout:5/478: dread de/d19/d1c/f4f [0,4194304] 0 2024-09-16T02:05:51.537 INFO:tasks.workunit.client.1.smithi165.stdout:2/536: mknod df/d73/d79/ca5 0 2024-09-16T02:05:51.538 INFO:tasks.workunit.client.1.smithi165.stdout:4/437: creat d4/dc/d28/d3b/f90 x:0 0 0 2024-09-16T02:05:51.540 INFO:tasks.workunit.client.1.smithi165.stdout:9/537: write d7/d32/d38/d53/d5c/f8d [774411,129796] 0 2024-09-16T02:05:51.540 INFO:tasks.workunit.client.1.smithi165.stdout:5/479: chown c0 2211 1 2024-09-16T02:05:51.540 INFO:tasks.workunit.client.0.smithi110.stdout:8/159: dread d3/f2a [0,4194304] 0 2024-09-16T02:05:51.541 INFO:tasks.workunit.client.1.smithi165.stdout:3/542: dwrite da/d17/d78/d2c/d2d/fbd [0,4194304] 0 2024-09-16T02:05:51.541 INFO:tasks.workunit.client.1.smithi165.stdout:7/481: link d0/f59 d0/df/d7/f92 0 2024-09-16T02:05:51.543 INFO:tasks.workunit.client.1.smithi165.stdout:7/482: fdatasync d0/d2c/f8d 0 2024-09-16T02:05:51.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/138: creat d8/dc/d1b/d1c/f26 x:0 0 0 2024-09-16T02:05:51.545 INFO:tasks.workunit.client.1.smithi165.stdout:8/527: readlink dd/d11/d14/d3f/d25/d36/d85/l86 0 2024-09-16T02:05:51.547 INFO:tasks.workunit.client.0.smithi110.stdout:8/160: mkdir d3/d2b/d27/d3a 0 2024-09-16T02:05:51.550 INFO:tasks.workunit.client.0.smithi110.stdout:3/139: dwrite d8/f9 [0,4194304] 0 2024-09-16T02:05:51.552 INFO:tasks.workunit.client.0.smithi110.stdout:3/140: write d8/dc/d1b/d1c/f26 [160358,10628] 0 2024-09-16T02:05:51.556 INFO:tasks.workunit.client.0.smithi110.stdout:8/161: dwrite d3/d2b/d27/f2d [0,4194304] 0 2024-09-16T02:05:51.560 INFO:tasks.workunit.client.0.smithi110.stdout:8/162: unlink d3/d12/f1c 0 2024-09-16T02:05:51.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/141: dwrite d8/dc/d1b/d1c/f1f [0,4194304] 0 2024-09-16T02:05:51.576 INFO:tasks.workunit.client.0.smithi110.stdout:8/163: dread d3/f15 [0,4194304] 0 2024-09-16T02:05:51.576 INFO:tasks.workunit.client.0.smithi110.stdout:3/142: truncate d8/f9 1759084 0 2024-09-16T02:05:51.577 INFO:tasks.workunit.client.0.smithi110.stdout:8/164: write d3/d12/d1a/f23 [348613,51016] 0 2024-09-16T02:05:51.578 INFO:tasks.workunit.client.1.smithi165.stdout:2/537: mknod df/d73/ca6 0 2024-09-16T02:05:51.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/143: creat d8/dc/f27 x:0 0 0 2024-09-16T02:05:51.579 INFO:tasks.workunit.client.1.smithi165.stdout:1/491: write d1/d22/f3d [4317201,54505] 0 2024-09-16T02:05:51.580 INFO:tasks.workunit.client.0.smithi110.stdout:8/165: mkdir d3/d12/d1a/d38/d3b 0 2024-09-16T02:05:51.580 INFO:tasks.workunit.client.1.smithi165.stdout:6/503: dwrite d7/dc/df/d1a/f46 [0,4194304] 0 2024-09-16T02:05:51.580 INFO:tasks.workunit.client.1.smithi165.stdout:0/446: fdatasync d0/d1e/d39/d48/d5f/f73 0 2024-09-16T02:05:51.581 INFO:tasks.workunit.client.0.smithi110.stdout:3/144: creat d8/f28 x:0 0 0 2024-09-16T02:05:51.581 INFO:tasks.workunit.client.1.smithi165.stdout:8/528: chown dd/d34/l82 101816 1 2024-09-16T02:05:51.582 INFO:tasks.workunit.client.0.smithi110.stdout:8/166: creat d3/f3c x:0 0 0 2024-09-16T02:05:51.585 INFO:tasks.workunit.client.0.smithi110.stdout:3/145: mkdir d8/d29 0 2024-09-16T02:05:51.586 INFO:tasks.workunit.client.1.smithi165.stdout:1/492: write d1/dd/d11/d33/d3f/d59/f60 [3843810,28255] 0 2024-09-16T02:05:51.588 INFO:tasks.workunit.client.1.smithi165.stdout:8/529: mkdir dd/d11/d14/d3f/db3 0 2024-09-16T02:05:51.588 INFO:tasks.workunit.client.0.smithi110.stdout:8/167: dwrite d3/d12/f2f [0,4194304] 0 2024-09-16T02:05:51.589 INFO:tasks.workunit.client.0.smithi110.stdout:8/168: truncate d3/f3c 424254 0 2024-09-16T02:05:51.590 INFO:tasks.workunit.client.1.smithi165.stdout:6/504: rename d7/d17/c6d to d7/dc/d3b/d3a/d3d/c81 0 2024-09-16T02:05:51.590 INFO:tasks.workunit.client.1.smithi165.stdout:5/480: dwrite de/d21/d51/f5f [0,4194304] 0 2024-09-16T02:05:51.595 INFO:tasks.workunit.client.0.smithi110.stdout:3/146: creat d8/f2a x:0 0 0 2024-09-16T02:05:51.596 INFO:tasks.workunit.client.1.smithi165.stdout:3/543: getdents da/d17/d78/d2c/d2d/d6c/db5 0 2024-09-16T02:05:51.596 INFO:tasks.workunit.client.0.smithi110.stdout:8/169: creat d3/f3d x:0 0 0 2024-09-16T02:05:51.597 INFO:tasks.workunit.client.0.smithi110.stdout:3/147: write d8/fb [25192,18014] 0 2024-09-16T02:05:51.600 INFO:tasks.workunit.client.0.smithi110.stdout:8/170: rename d3/f10 to d3/d31/f3e 0 2024-09-16T02:05:51.600 INFO:tasks.workunit.client.1.smithi165.stdout:9/538: dread d7/d32/f39 [0,4194304] 0 2024-09-16T02:05:51.603 INFO:tasks.workunit.client.1.smithi165.stdout:1/493: dwrite d1/dd/d11/f15 [4194304,4194304] 0 2024-09-16T02:05:51.603 INFO:tasks.workunit.client.1.smithi165.stdout:8/530: rename dd/d13/f21 to dd/d34/fb4 0 2024-09-16T02:05:51.605 INFO:tasks.workunit.client.1.smithi165.stdout:1/494: fdatasync d1/d22/f2c 0 2024-09-16T02:05:51.605 INFO:tasks.workunit.client.1.smithi165.stdout:0/447: link d0/l5 d0/d1e/d39/d48/d5f/l9e 0 2024-09-16T02:05:51.605 INFO:tasks.workunit.client.1.smithi165.stdout:2/538: dread df/d23/d28/d3b/d6d/d8b/f8e [0,4194304] 0 2024-09-16T02:05:51.609 INFO:tasks.workunit.client.1.smithi165.stdout:3/544: truncate da/d17/d78/f23 4016136 0 2024-09-16T02:05:51.610 INFO:tasks.workunit.client.1.smithi165.stdout:8/531: symlink dd/d11/daa/lb5 0 2024-09-16T02:05:51.613 INFO:tasks.workunit.client.1.smithi165.stdout:6/505: getdents d7/d17/d75 0 2024-09-16T02:05:51.615 INFO:tasks.workunit.client.1.smithi165.stdout:1/495: dwrite d1/dd/d11/d33/d3f/d59/f60 [0,4194304] 0 2024-09-16T02:05:51.615 INFO:tasks.workunit.client.1.smithi165.stdout:3/545: creat da/d17/d78/d2c/db7/fc1 x:0 0 0 2024-09-16T02:05:51.615 INFO:tasks.workunit.client.1.smithi165.stdout:6/506: chown d7/dc/d3b/f59 1 1 2024-09-16T02:05:51.617 INFO:tasks.workunit.client.1.smithi165.stdout:9/539: creat d7/d32/d38/d53/fb0 x:0 0 0 2024-09-16T02:05:51.617 INFO:tasks.workunit.client.1.smithi165.stdout:2/539: symlink df/la7 0 2024-09-16T02:05:51.621 INFO:tasks.workunit.client.1.smithi165.stdout:2/540: dread - df/d23/d28/d3b/fa1 zero size 2024-09-16T02:05:51.621 INFO:tasks.workunit.client.1.smithi165.stdout:3/546: creat da/d17/d78/d2c/fc2 x:0 0 0 2024-09-16T02:05:51.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/496: mknod d1/dd/d11/d33/d3f/d47/c9d 0 2024-09-16T02:05:51.623 INFO:tasks.workunit.client.1.smithi165.stdout:9/540: write d7/d32/d38/d68/d7f/f6e [2525505,45605] 0 2024-09-16T02:05:51.625 INFO:tasks.workunit.client.1.smithi165.stdout:2/541: read df/f90 [3073629,84897] 0 2024-09-16T02:05:51.625 INFO:tasks.workunit.client.1.smithi165.stdout:7/483: dread d0/df/d33/d2a/f54 [0,4194304] 0 2024-09-16T02:05:51.626 INFO:tasks.workunit.client.1.smithi165.stdout:8/532: dwrite dd/d11/d14/d3f/d72/fab [0,4194304] 0 2024-09-16T02:05:51.627 INFO:tasks.workunit.client.1.smithi165.stdout:9/541: readlink d7/d1f/d54/l5b 0 2024-09-16T02:05:51.627 INFO:tasks.workunit.client.1.smithi165.stdout:6/507: rename d7/d17/d24 to d7/dc/d3b/d3a/d3d/d5d/d73/d82 0 2024-09-16T02:05:51.632 INFO:tasks.workunit.client.1.smithi165.stdout:2/542: write df/d23/d28/f65 [323140,23520] 0 2024-09-16T02:05:51.634 INFO:tasks.workunit.client.0.smithi110.stdout:8/171: truncate d3/f2a 1774457 0 2024-09-16T02:05:51.639 INFO:tasks.workunit.client.1.smithi165.stdout:7/484: getdents d0/df/d83/d84 0 2024-09-16T02:05:51.640 INFO:tasks.workunit.client.1.smithi165.stdout:7/485: dread - d0/df/d68/f70 zero size 2024-09-16T02:05:51.640 INFO:tasks.workunit.client.1.smithi165.stdout:3/547: dwrite da/d17/d78/d2c/d2d/d6c/db5/fbb [0,4194304] 0 2024-09-16T02:05:51.642 INFO:tasks.workunit.client.1.smithi165.stdout:6/508: dwrite f3 [0,4194304] 0 2024-09-16T02:05:51.643 INFO:tasks.workunit.client.1.smithi165.stdout:0/448: truncate d0/f13 3665062 0 2024-09-16T02:05:51.643 INFO:tasks.workunit.client.1.smithi165.stdout:2/543: symlink df/d23/d28/d9a/d86/la8 0 2024-09-16T02:05:51.646 INFO:tasks.workunit.client.1.smithi165.stdout:6/509: truncate d7/d1f/f32 2122385 0 2024-09-16T02:05:51.648 INFO:tasks.workunit.client.1.smithi165.stdout:2/544: chown df/d23/d28/d3b/f96 89 1 2024-09-16T02:05:51.650 INFO:tasks.workunit.client.1.smithi165.stdout:1/497: truncate d1/d22/f4e 676437 0 2024-09-16T02:05:51.651 INFO:tasks.workunit.client.1.smithi165.stdout:3/548: creat da/d17/d78/d2c/d2d/d6c/db5/fc3 x:0 0 0 2024-09-16T02:05:51.652 INFO:tasks.workunit.client.1.smithi165.stdout:6/510: symlink d7/dc/d3b/d3c/l83 0 2024-09-16T02:05:51.653 INFO:tasks.workunit.client.1.smithi165.stdout:3/549: chown da/d20/d26/d52/c85 15952358 1 2024-09-16T02:05:51.654 INFO:tasks.workunit.client.1.smithi165.stdout:5/481: dread f7 [4194304,4194304] 0 2024-09-16T02:05:51.655 INFO:tasks.workunit.client.1.smithi165.stdout:2/545: fdatasync df/d73/d79/f71 0 2024-09-16T02:05:51.656 INFO:tasks.workunit.client.1.smithi165.stdout:1/498: creat d1/dd/d11/d33/d3f/d59/f9e x:0 0 0 2024-09-16T02:05:51.658 INFO:tasks.workunit.client.1.smithi165.stdout:6/511: unlink d7/dc/d3b/d3a/d3d/d5d/d73/d82/c5c 0 2024-09-16T02:05:51.659 INFO:tasks.workunit.client.1.smithi165.stdout:2/546: truncate df/d73/f9b 133307 0 2024-09-16T02:05:51.659 INFO:tasks.workunit.client.1.smithi165.stdout:5/482: unlink de/d19/d1c/c48 0 2024-09-16T02:05:51.661 INFO:tasks.workunit.client.1.smithi165.stdout:0/449: write d0/d1e/f24 [216870,62838] 0 2024-09-16T02:05:51.663 INFO:tasks.workunit.client.1.smithi165.stdout:1/499: fsync d1/dd/d11/d33/d92/f96 0 2024-09-16T02:05:51.665 INFO:tasks.workunit.client.1.smithi165.stdout:6/512: creat d7/dc/df/d1a/d4d/d5f/f84 x:0 0 0 2024-09-16T02:05:51.665 INFO:tasks.workunit.client.1.smithi165.stdout:5/483: read de/d19/f33 [1545783,7561] 0 2024-09-16T02:05:51.665 INFO:tasks.workunit.client.1.smithi165.stdout:7/486: dwrite d0/d4b/f5d [0,4194304] 0 2024-09-16T02:05:51.666 INFO:tasks.workunit.client.1.smithi165.stdout:0/450: fdatasync d0/d1e/f26 0 2024-09-16T02:05:51.668 INFO:tasks.workunit.client.0.smithi110.stdout:8/172: dwrite d3/f2a [0,4194304] 0 2024-09-16T02:05:51.668 INFO:tasks.workunit.client.1.smithi165.stdout:2/547: rename df/d10/d1a/d2d/c8a to df/d23/d28/d9a/d86/ca9 0 2024-09-16T02:05:51.669 INFO:tasks.workunit.client.1.smithi165.stdout:1/500: chown d1/d19/d24/d30/f40 2333 1 2024-09-16T02:05:51.669 INFO:tasks.workunit.client.1.smithi165.stdout:5/484: stat de/d21/d26/d3a/f5a 0 2024-09-16T02:05:51.669 INFO:tasks.workunit.client.1.smithi165.stdout:7/487: chown d0/df/d33/d2a/l46 724 1 2024-09-16T02:05:51.672 INFO:tasks.workunit.client.0.smithi110.stdout:8/173: symlink d3/d31/l3f 0 2024-09-16T02:05:51.674 INFO:tasks.workunit.client.1.smithi165.stdout:6/513: creat d7/dc/df/d1a/d4d/f85 x:0 0 0 2024-09-16T02:05:51.675 INFO:tasks.workunit.client.0.smithi110.stdout:8/174: rmdir d3/d31 39 2024-09-16T02:05:51.675 INFO:tasks.workunit.client.1.smithi165.stdout:2/548: fsync df/d23/d28/d3b/f7a 0 2024-09-16T02:05:51.676 INFO:tasks.workunit.client.0.smithi110.stdout:8/175: chown c2 28289 1 2024-09-16T02:05:51.676 INFO:tasks.workunit.client.0.smithi110.stdout:8/176: dread - d3/d2b/d27/f39 zero size 2024-09-16T02:05:51.678 INFO:tasks.workunit.client.1.smithi165.stdout:3/550: dwrite da/d17/f4b [0,4194304] 0 2024-09-16T02:05:51.683 INFO:tasks.workunit.client.1.smithi165.stdout:7/488: creat d0/df/d7/f93 x:0 0 0 2024-09-16T02:05:51.683 INFO:tasks.workunit.client.1.smithi165.stdout:1/501: write d1/dd/d11/d33/d92/f96 [4708888,44329] 0 2024-09-16T02:05:51.687 INFO:tasks.workunit.client.1.smithi165.stdout:3/551: creat da/d20/d26/d8c/fc4 x:0 0 0 2024-09-16T02:05:51.687 INFO:tasks.workunit.client.1.smithi165.stdout:7/489: fdatasync d0/d2c/d85/f88 0 2024-09-16T02:05:51.689 INFO:tasks.workunit.client.1.smithi165.stdout:0/451: getdents d0/d2a 0 2024-09-16T02:05:51.690 INFO:tasks.workunit.client.1.smithi165.stdout:8/533: dread dd/d13/f71 [0,4194304] 0 2024-09-16T02:05:51.693 INFO:tasks.workunit.client.1.smithi165.stdout:0/452: chown d0/d1e/d39/d48 1 1 2024-09-16T02:05:51.694 INFO:tasks.workunit.client.1.smithi165.stdout:2/549: dwrite df/d23/d28/d9a/f41 [4194304,4194304] 0 2024-09-16T02:05:51.694 INFO:tasks.workunit.client.1.smithi165.stdout:5/485: dwrite de/d21/d26/d3a/f93 [4194304,4194304] 0 2024-09-16T02:05:51.694 INFO:tasks.workunit.client.1.smithi165.stdout:7/490: creat d0/df/d33/d2a/f94 x:0 0 0 2024-09-16T02:05:51.695 INFO:tasks.workunit.client.0.smithi110.stdout:8/177: dwrite d3/f9 [0,4194304] 0 2024-09-16T02:05:51.696 INFO:tasks.workunit.client.1.smithi165.stdout:3/552: creat da/d20/d26/fc5 x:0 0 0 2024-09-16T02:05:51.697 INFO:tasks.workunit.client.1.smithi165.stdout:2/550: write df/d23/f38 [3439250,32885] 0 2024-09-16T02:05:51.697 INFO:tasks.workunit.client.1.smithi165.stdout:7/491: dread - d0/df/d7/f93 zero size 2024-09-16T02:05:51.698 INFO:tasks.workunit.client.1.smithi165.stdout:5/486: write f7 [7113977,80078] 0 2024-09-16T02:05:51.698 INFO:tasks.workunit.client.1.smithi165.stdout:0/453: chown d0/d1e/d39/c62 11 1 2024-09-16T02:05:51.699 INFO:tasks.workunit.client.1.smithi165.stdout:3/553: chown da/d20 130264 1 2024-09-16T02:05:51.699 INFO:tasks.workunit.client.0.smithi110.stdout:8/178: creat d3/d12/d1a/f40 x:0 0 0 2024-09-16T02:05:51.700 INFO:tasks.workunit.client.0.smithi110.stdout:8/179: dread - d3/d2b/d27/f39 zero size 2024-09-16T02:05:51.701 INFO:tasks.workunit.client.1.smithi165.stdout:1/502: dwrite d1/f79 [0,4194304] 0 2024-09-16T02:05:51.703 INFO:tasks.workunit.client.0.smithi110.stdout:9/117: sync 2024-09-16T02:05:51.704 INFO:tasks.workunit.client.0.smithi110.stdout:8/180: unlink d3/f15 0 2024-09-16T02:05:51.705 INFO:tasks.workunit.client.1.smithi165.stdout:2/551: creat df/d23/d66/faa x:0 0 0 2024-09-16T02:05:51.705 INFO:tasks.workunit.client.1.smithi165.stdout:7/492: dread d0/df/d33/d2a/f54 [0,4194304] 0 2024-09-16T02:05:51.707 INFO:tasks.workunit.client.1.smithi165.stdout:0/454: symlink d0/d1e/l9f 0 2024-09-16T02:05:51.709 INFO:tasks.workunit.client.1.smithi165.stdout:3/554: creat da/d17/d78/d2c/d2d/d6c/fc6 x:0 0 0 2024-09-16T02:05:51.710 INFO:tasks.workunit.client.1.smithi165.stdout:2/552: stat df/d23/d28/d3b/c88 0 2024-09-16T02:05:51.713 INFO:tasks.workunit.client.1.smithi165.stdout:5/487: dwrite de/d21/d26/d3a/f91 [0,4194304] 0 2024-09-16T02:05:51.713 INFO:tasks.workunit.client.0.smithi110.stdout:8/181: dwrite d3/d2b/d27/f39 [0,4194304] 0 2024-09-16T02:05:51.714 INFO:tasks.workunit.client.0.smithi110.stdout:9/118: fdatasync d1/fc 0 2024-09-16T02:05:51.716 INFO:tasks.workunit.client.1.smithi165.stdout:0/455: creat d0/d1e/d20/d28/d9a/fa0 x:0 0 0 2024-09-16T02:05:51.717 INFO:tasks.workunit.client.1.smithi165.stdout:3/555: symlink da/d57/d8d/d97/lc7 0 2024-09-16T02:05:51.718 INFO:tasks.workunit.client.1.smithi165.stdout:7/493: truncate d0/f59 789838 0 2024-09-16T02:05:51.718 INFO:tasks.workunit.client.1.smithi165.stdout:4/438: sync 2024-09-16T02:05:51.720 INFO:tasks.workunit.client.1.smithi165.stdout:5/488: dread de/d21/d26/d3a/f5a [0,4194304] 0 2024-09-16T02:05:51.722 INFO:tasks.workunit.client.0.smithi110.stdout:8/182: symlink d3/d2b/d27/l41 0 2024-09-16T02:05:51.723 INFO:tasks.workunit.client.0.smithi110.stdout:9/119: getdents d1/d5/d8/d26 0 2024-09-16T02:05:51.723 INFO:tasks.workunit.client.1.smithi165.stdout:0/456: creat d0/d1e/d39/d48/d6e/fa1 x:0 0 0 2024-09-16T02:05:51.724 INFO:tasks.workunit.client.0.smithi110.stdout:9/120: stat d1/d1b/f22 0 2024-09-16T02:05:51.724 INFO:tasks.workunit.client.0.smithi110.stdout:9/121: chown d1/d1b/l24 71 1 2024-09-16T02:05:51.726 INFO:tasks.workunit.client.1.smithi165.stdout:3/556: unlink da/de/c8e 0 2024-09-16T02:05:51.727 INFO:tasks.workunit.client.1.smithi165.stdout:4/439: chown d4/dc/d28/f43 1543711 1 2024-09-16T02:05:51.729 INFO:tasks.workunit.client.0.smithi110.stdout:8/183: unlink d3/d12/d1a/l25 0 2024-09-16T02:05:51.730 INFO:tasks.workunit.client.0.smithi110.stdout:8/184: write d3/fd [4669960,34477] 0 2024-09-16T02:05:51.735 INFO:tasks.workunit.client.1.smithi165.stdout:5/489: creat de/d19/d67/d74/f9e x:0 0 0 2024-09-16T02:05:51.735 INFO:tasks.workunit.client.1.smithi165.stdout:3/557: dwrite da/d57/d8d/f98 [0,4194304] 0 2024-09-16T02:05:51.735 INFO:tasks.workunit.client.1.smithi165.stdout:1/503: truncate d1/dd/f14 1409157 0 2024-09-16T02:05:51.736 INFO:tasks.workunit.client.0.smithi110.stdout:8/185: dwrite d3/f2a [0,4194304] 0 2024-09-16T02:05:51.736 INFO:tasks.workunit.client.1.smithi165.stdout:5/490: chown de/d21/d51/l90 3 1 2024-09-16T02:05:51.738 INFO:tasks.workunit.client.0.smithi110.stdout:9/122: symlink d1/d5/l28 0 2024-09-16T02:05:51.739 INFO:tasks.workunit.client.0.smithi110.stdout:1/225: sync 2024-09-16T02:05:51.739 INFO:tasks.workunit.client.0.smithi110.stdout:7/169: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.0.smithi110.stdout:3/148: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.0.smithi110.stdout:6/208: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.0.smithi110.stdout:0/201: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.0.smithi110.stdout:5/187: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.0.smithi110.stdout:2/185: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.0.smithi110.stdout:4/211: sync 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.1.smithi165.stdout:5/491: dread f7 [4194304,4194304] 0 2024-09-16T02:05:51.740 INFO:tasks.workunit.client.1.smithi165.stdout:4/440: mkdir d4/dc/d18/d37/d53/d64/d91 0 2024-09-16T02:05:51.741 INFO:tasks.workunit.client.0.smithi110.stdout:6/209: chown d0/d29 803764 1 2024-09-16T02:05:51.742 INFO:tasks.workunit.client.1.smithi165.stdout:2/553: creat df/d23/d28/d3b/fab x:0 0 0 2024-09-16T02:05:51.743 INFO:tasks.workunit.client.0.smithi110.stdout:2/186: dread - d0/db/f36 zero size 2024-09-16T02:05:51.748 INFO:tasks.workunit.client.1.smithi165.stdout:3/558: creat da/d17/d78/d2c/d2d/d6c/fc8 x:0 0 0 2024-09-16T02:05:51.750 INFO:tasks.workunit.client.1.smithi165.stdout:3/559: dread - da/d20/d26/d8c/fc4 zero size 2024-09-16T02:05:51.751 INFO:tasks.workunit.client.1.smithi165.stdout:3/560: readlink da/de/l19 0 2024-09-16T02:05:51.751 INFO:tasks.workunit.client.1.smithi165.stdout:2/554: dwrite df/f92 [0,4194304] 0 2024-09-16T02:05:51.752 INFO:tasks.workunit.client.1.smithi165.stdout:0/457: symlink d0/d1e/d20/la2 0 2024-09-16T02:05:51.753 INFO:tasks.workunit.client.0.smithi110.stdout:8/186: dwrite d3/d12/d1a/f23 [0,4194304] 0 2024-09-16T02:05:51.753 INFO:tasks.workunit.client.1.smithi165.stdout:2/555: stat df/d23/d28/f65 0 2024-09-16T02:05:51.759 INFO:tasks.workunit.client.1.smithi165.stdout:5/492: creat de/d21/f9f x:0 0 0 2024-09-16T02:05:51.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/493: chown de/d21/l24 104 1 2024-09-16T02:05:51.762 INFO:tasks.workunit.client.0.smithi110.stdout:0/202: mkdir d3/d4/d41 0 2024-09-16T02:05:51.764 INFO:tasks.workunit.client.0.smithi110.stdout:7/170: dread d3/da/d10/f30 [0,4194304] 0 2024-09-16T02:05:51.771 INFO:tasks.workunit.client.0.smithi110.stdout:9/123: dwrite d1/f3 [0,4194304] 0 2024-09-16T02:05:51.771 INFO:tasks.workunit.client.0.smithi110.stdout:5/188: dread d5/dd/f17 [0,4194304] 0 2024-09-16T02:05:51.772 INFO:tasks.workunit.client.1.smithi165.stdout:3/561: rename da/d17/l28 to da/d20/d26/d52/lc9 0 2024-09-16T02:05:51.772 INFO:tasks.workunit.client.0.smithi110.stdout:8/187: stat d3/d31 0 2024-09-16T02:05:51.773 INFO:tasks.workunit.client.0.smithi110.stdout:8/188: fsync d3/f3d 0 2024-09-16T02:05:51.776 INFO:tasks.workunit.client.0.smithi110.stdout:1/226: creat d0/f47 x:0 0 0 2024-09-16T02:05:51.777 INFO:tasks.workunit.client.1.smithi165.stdout:7/494: getdents d0/df/d7 0 2024-09-16T02:05:51.778 INFO:tasks.workunit.client.0.smithi110.stdout:0/203: symlink d3/d4/dc/d10/l42 0 2024-09-16T02:05:51.779 INFO:tasks.workunit.client.0.smithi110.stdout:0/204: write d3/f28 [800075,73702] 0 2024-09-16T02:05:51.779 INFO:tasks.workunit.client.0.smithi110.stdout:2/187: getdents d0/db/d33 0 2024-09-16T02:05:51.780 INFO:tasks.workunit.client.1.smithi165.stdout:7/495: chown d0/df/d33/d2a/l46 111 1 2024-09-16T02:05:51.781 INFO:tasks.workunit.client.0.smithi110.stdout:8/189: dwrite d3/d12/f2f [0,4194304] 0 2024-09-16T02:05:51.781 INFO:tasks.workunit.client.1.smithi165.stdout:1/504: rmdir d1/d94 0 2024-09-16T02:05:51.781 INFO:tasks.workunit.client.1.smithi165.stdout:1/505: fsync d1/f79 0 2024-09-16T02:05:51.782 INFO:tasks.workunit.client.0.smithi110.stdout:3/149: rename d8/f28 to d8/dc/f2b 0 2024-09-16T02:05:51.784 INFO:tasks.workunit.client.1.smithi165.stdout:5/494: read de/f1d [809887,63440] 0 2024-09-16T02:05:51.784 INFO:tasks.workunit.client.1.smithi165.stdout:5/495: write fc [5029353,62517] 0 2024-09-16T02:05:51.785 INFO:tasks.workunit.client.1.smithi165.stdout:5/496: stat de/d21/d51 0 2024-09-16T02:05:51.786 INFO:tasks.workunit.client.1.smithi165.stdout:3/562: creat da/d17/d78/fca x:0 0 0 2024-09-16T02:05:51.787 INFO:tasks.workunit.client.0.smithi110.stdout:9/124: mkdir d1/d5/d8/d29 0 2024-09-16T02:05:51.789 INFO:tasks.workunit.client.0.smithi110.stdout:5/189: mkdir d5/d36/d3d 0 2024-09-16T02:05:51.791 INFO:tasks.workunit.client.0.smithi110.stdout:1/227: symlink d0/d1/l48 0 2024-09-16T02:05:51.792 INFO:tasks.workunit.client.0.smithi110.stdout:4/212: getdents d4/d8/d31 0 2024-09-16T02:05:51.794 INFO:tasks.workunit.client.1.smithi165.stdout:0/458: dwrite d0/d2a/f77 [4194304,4194304] 0 2024-09-16T02:05:51.797 INFO:tasks.workunit.client.0.smithi110.stdout:0/205: mkdir d3/d6/d43 0 2024-09-16T02:05:51.798 INFO:tasks.workunit.client.1.smithi165.stdout:0/459: read d0/d1e/d20/f46 [2576119,47919] 0 2024-09-16T02:05:51.799 INFO:tasks.workunit.client.1.smithi165.stdout:5/497: unlink de/d21/l24 0 2024-09-16T02:05:51.799 INFO:tasks.workunit.client.0.smithi110.stdout:1/228: dwrite d0/d1/d2a/d32/f38 [0,4194304] 0 2024-09-16T02:05:51.801 INFO:tasks.workunit.client.0.smithi110.stdout:1/229: write d0/d1/d8/f19 [3830612,43770] 0 2024-09-16T02:05:51.802 INFO:tasks.workunit.client.0.smithi110.stdout:2/188: creat d0/da/d18/dc/f3d x:0 0 0 2024-09-16T02:05:51.803 INFO:tasks.workunit.client.0.smithi110.stdout:2/189: write d0/da/d18/dc/f3d [765802,121445] 0 2024-09-16T02:05:51.804 INFO:tasks.workunit.client.1.smithi165.stdout:4/441: getdents d4/dc/d18/d37/d53/d64/d8b 0 2024-09-16T02:05:51.805 INFO:tasks.workunit.client.0.smithi110.stdout:6/210: getdents d0/d29 0 2024-09-16T02:05:51.807 INFO:tasks.workunit.client.1.smithi165.stdout:7/496: rename d0/df/d33/c57 to d0/d4b/d63/c95 0 2024-09-16T02:05:51.807 INFO:tasks.workunit.client.1.smithi165.stdout:0/460: dwrite d0/d1e/d39/d48/d6e/f76 [0,4194304] 0 2024-09-16T02:05:51.810 INFO:tasks.workunit.client.0.smithi110.stdout:5/190: symlink d5/dd/l3e 0 2024-09-16T02:05:51.812 INFO:tasks.workunit.client.0.smithi110.stdout:4/213: write d4/f2c [3883675,106452] 0 2024-09-16T02:05:51.813 INFO:tasks.workunit.client.1.smithi165.stdout:0/461: dread d0/d47/f6f [0,4194304] 0 2024-09-16T02:05:51.814 INFO:tasks.workunit.client.1.smithi165.stdout:7/497: dread d0/d3d/f6b [0,4194304] 0 2024-09-16T02:05:51.814 INFO:tasks.workunit.client.1.smithi165.stdout:7/498: readlink d0/df/d7/d67/l80 0 2024-09-16T02:05:51.815 INFO:tasks.workunit.client.0.smithi110.stdout:0/206: rmdir d3/d4/dc 39 2024-09-16T02:05:51.816 INFO:tasks.workunit.client.1.smithi165.stdout:2/556: getdents df/d23/d28/d87 0 2024-09-16T02:05:51.817 INFO:tasks.workunit.client.0.smithi110.stdout:6/211: dwrite d0/d2/dc/d16/f3b [0,4194304] 0 2024-09-16T02:05:51.817 INFO:tasks.workunit.client.1.smithi165.stdout:2/557: truncate df/d10/d64/f91 2043629 0 2024-09-16T02:05:51.818 INFO:tasks.workunit.client.0.smithi110.stdout:6/212: chown d0/d2/d5/d1e/l36 2 1 2024-09-16T02:05:51.820 INFO:tasks.workunit.client.0.smithi110.stdout:1/230: creat d0/da/f49 x:0 0 0 2024-09-16T02:05:51.821 INFO:tasks.workunit.client.1.smithi165.stdout:2/558: dread df/d10/d1a/d2d/f58 [0,4194304] 0 2024-09-16T02:05:51.823 INFO:tasks.workunit.client.1.smithi165.stdout:9/542: sync 2024-09-16T02:05:51.827 INFO:tasks.workunit.client.1.smithi165.stdout:1/506: write d1/d22/f4e [469731,92117] 0 2024-09-16T02:05:51.829 INFO:tasks.workunit.client.1.smithi165.stdout:3/563: rename da/d17/l53 to da/de/lcb 0 2024-09-16T02:05:51.831 INFO:tasks.workunit.client.0.smithi110.stdout:9/125: dwrite d1/d5/d8/f17 [0,4194304] 0 2024-09-16T02:05:51.832 INFO:tasks.workunit.client.1.smithi165.stdout:5/498: link de/d19/d1c/d4d/f7e de/d21/d26/d98/fa0 0 2024-09-16T02:05:51.833 INFO:tasks.workunit.client.1.smithi165.stdout:9/543: dwrite d7/d32/d38/d68/d7f/f6e [0,4194304] 0 2024-09-16T02:05:51.839 INFO:tasks.workunit.client.0.smithi110.stdout:9/126: dwrite d1/d5/d8/de/f1c [0,4194304] 0 2024-09-16T02:05:51.840 INFO:tasks.workunit.client.0.smithi110.stdout:3/150: rename f1 to d8/dc/d1b/f2c 0 2024-09-16T02:05:51.843 INFO:tasks.workunit.client.1.smithi165.stdout:4/442: symlink d4/dc/d28/l92 0 2024-09-16T02:05:51.848 INFO:tasks.workunit.client.0.smithi110.stdout:6/213: write d0/d2/dc/d16/f3b [4865433,58098] 0 2024-09-16T02:05:51.850 INFO:tasks.workunit.client.0.smithi110.stdout:2/190: dread d0/da/d18/f19 [0,4194304] 0 2024-09-16T02:05:51.851 INFO:tasks.workunit.client.0.smithi110.stdout:4/214: symlink d4/d8/d17/d23/d35/l40 0 2024-09-16T02:05:51.851 INFO:tasks.workunit.client.0.smithi110.stdout:2/191: write d0/da/d18/dc/f30 [601474,80183] 0 2024-09-16T02:05:51.853 INFO:tasks.workunit.client.1.smithi165.stdout:1/507: rename d1/dd/d11/d46/d57/l6d to d1/d68/l9f 0 2024-09-16T02:05:51.855 INFO:tasks.workunit.client.0.smithi110.stdout:1/231: getdents d0/d1/d2a/d32/d40 0 2024-09-16T02:05:51.859 INFO:tasks.workunit.client.0.smithi110.stdout:0/207: rename d3/d4/f3f to d3/d6/f44 0 2024-09-16T02:05:51.860 INFO:tasks.workunit.client.1.smithi165.stdout:4/443: mknod d4/dc/d18/d37/d53/c93 0 2024-09-16T02:05:51.861 INFO:tasks.workunit.client.1.smithi165.stdout:2/559: symlink df/d23/lac 0 2024-09-16T02:05:51.861 INFO:tasks.workunit.client.0.smithi110.stdout:6/214: mknod d0/d29/c3c 0 2024-09-16T02:05:51.863 INFO:tasks.workunit.client.1.smithi165.stdout:6/514: sync 2024-09-16T02:05:51.863 INFO:tasks.workunit.client.1.smithi165.stdout:3/564: rename da/de to da/d17/dcc 0 2024-09-16T02:05:51.865 INFO:tasks.workunit.client.0.smithi110.stdout:5/191: rename d5/dd/df/f27 to d5/dd/df/f3f 0 2024-09-16T02:05:51.866 INFO:tasks.workunit.client.1.smithi165.stdout:2/560: dread df/d23/d28/d3b/f96 [0,4194304] 0 2024-09-16T02:05:51.866 INFO:tasks.workunit.client.0.smithi110.stdout:1/232: creat d0/d25/f4a x:0 0 0 2024-09-16T02:05:51.867 INFO:tasks.workunit.client.1.smithi165.stdout:4/444: dwrite f2 [0,4194304] 0 2024-09-16T02:05:51.868 INFO:tasks.workunit.client.1.smithi165.stdout:2/561: write df/d23/d28/d3b/f96 [252529,75157] 0 2024-09-16T02:05:51.868 INFO:tasks.workunit.client.1.smithi165.stdout:4/445: write d4/dc/d20/d45/f77 [4069190,52798] 0 2024-09-16T02:05:51.869 INFO:tasks.workunit.client.1.smithi165.stdout:5/499: creat de/d21/d26/d3a/d6d/d95/fa1 x:0 0 0 2024-09-16T02:05:51.870 INFO:tasks.workunit.client.0.smithi110.stdout:2/192: rename d0/da/d18/c15 to d0/da/d18/d2d/d39/c3e 0 2024-09-16T02:05:51.870 INFO:tasks.workunit.client.1.smithi165.stdout:2/562: write df/d23/f84 [2108015,43723] 0 2024-09-16T02:05:51.872 INFO:tasks.workunit.client.0.smithi110.stdout:0/208: dread d3/d4/f11 [0,4194304] 0 2024-09-16T02:05:51.872 INFO:tasks.workunit.client.0.smithi110.stdout:9/127: symlink d1/d5/d20/d27/l2a 0 2024-09-16T02:05:51.873 INFO:tasks.workunit.client.1.smithi165.stdout:2/563: chown df/d10/d1a/d2d/f58 150011175 1 2024-09-16T02:05:51.873 INFO:tasks.workunit.client.1.smithi165.stdout:2/564: stat df/f92 0 2024-09-16T02:05:51.876 INFO:tasks.workunit.client.0.smithi110.stdout:1/233: dwrite d0/d1/d8/f19 [4194304,4194304] 0 2024-09-16T02:05:51.878 INFO:tasks.workunit.client.0.smithi110.stdout:5/192: symlink d5/d36/l40 0 2024-09-16T02:05:51.881 INFO:tasks.workunit.client.1.smithi165.stdout:9/544: rename d7/d1f/f2a to d7/d32/d85/d8a/fb1 0 2024-09-16T02:05:51.884 INFO:tasks.workunit.client.1.smithi165.stdout:3/565: creat da/d17/d78/d2c/db7/fcd x:0 0 0 2024-09-16T02:05:51.884 INFO:tasks.workunit.client.0.smithi110.stdout:1/234: dwrite d0/d1/d8/f19 [0,4194304] 0 2024-09-16T02:05:51.885 INFO:tasks.workunit.client.1.smithi165.stdout:0/462: write d0/d1e/d39/d48/f75 [93795,32352] 0 2024-09-16T02:05:51.885 INFO:tasks.workunit.client.1.smithi165.stdout:3/566: write da/d17/dcc/f71 [1320129,94625] 0 2024-09-16T02:05:51.888 INFO:tasks.workunit.client.0.smithi110.stdout:6/215: rename d0/d2/d18/f26 to d0/d2/d18/d1d/f3d 0 2024-09-16T02:05:51.889 INFO:tasks.workunit.client.0.smithi110.stdout:9/128: dread f0 [0,4194304] 0 2024-09-16T02:05:51.968 INFO:tasks.workunit.client.1.smithi165.stdout:8/534: sync 2024-09-16T02:05:51.984 INFO:tasks.workunit.client.1.smithi165.stdout:4/446: rmdir d4/dc 39 2024-09-16T02:05:51.985 INFO:tasks.workunit.client.0.smithi110.stdout:0/209: mknod d3/d6/c45 0 2024-09-16T02:05:51.985 INFO:tasks.workunit.client.0.smithi110.stdout:0/210: chown d3/d4/l2b 87168 1 2024-09-16T02:05:51.987 INFO:tasks.workunit.client.0.smithi110.stdout:2/193: creat d0/da/d18/d2d/d39/f3f x:0 0 0 2024-09-16T02:05:51.987 INFO:tasks.workunit.client.0.smithi110.stdout:2/194: chown d0/da/d18/f29 200 1 2024-09-16T02:05:51.988 INFO:tasks.workunit.client.1.smithi165.stdout:3/567: sync 2024-09-16T02:05:51.988 INFO:tasks.workunit.client.0.smithi110.stdout:2/195: chown d0/da/d18/d25/d3b 7 1 2024-09-16T02:05:51.989 INFO:tasks.workunit.client.0.smithi110.stdout:2/196: chown d0/da/l22 94 1 2024-09-16T02:05:51.990 INFO:tasks.workunit.client.1.smithi165.stdout:5/500: mknod de/d60/d65/ca2 0 2024-09-16T02:05:51.990 INFO:tasks.workunit.client.0.smithi110.stdout:2/197: write d0/da/f24 [3755855,113882] 0 2024-09-16T02:05:51.992 INFO:tasks.workunit.client.1.smithi165.stdout:2/565: rmdir df/d23/d28/d3b 39 2024-09-16T02:05:51.996 INFO:tasks.workunit.client.1.smithi165.stdout:6/515: mkdir d7/dc/d3b/d86 0 2024-09-16T02:05:51.997 INFO:tasks.workunit.client.1.smithi165.stdout:6/516: write d7/dc/df/d1a/f2d [166551,25424] 0 2024-09-16T02:05:52.001 INFO:tasks.workunit.client.0.smithi110.stdout:9/129: mkdir d1/d2b 0 2024-09-16T02:05:52.004 INFO:tasks.workunit.client.0.smithi110.stdout:0/211: write d3/d4/dc/f1c [954297,5589] 0 2024-09-16T02:05:52.005 INFO:tasks.workunit.client.1.smithi165.stdout:0/463: symlink d0/d2a/d70/la3 0 2024-09-16T02:05:52.006 INFO:tasks.workunit.client.0.smithi110.stdout:6/216: dwrite d0/d2/f23 [0,4194304] 0 2024-09-16T02:05:52.009 INFO:tasks.workunit.client.0.smithi110.stdout:1/235: write d0/d25/f3b [948257,125051] 0 2024-09-16T02:05:52.012 INFO:tasks.workunit.client.0.smithi110.stdout:2/198: dwrite d0/da/d18/f19 [0,4194304] 0 2024-09-16T02:05:52.015 INFO:tasks.workunit.client.0.smithi110.stdout:0/212: write d3/d6/ff [4362841,35720] 0 2024-09-16T02:05:52.017 INFO:tasks.workunit.client.0.smithi110.stdout:6/217: symlink d0/d2/d5/l3e 0 2024-09-16T02:05:52.018 INFO:tasks.workunit.client.0.smithi110.stdout:5/193: link d5/l37 d5/dd/df/d11/l41 0 2024-09-16T02:05:52.021 INFO:tasks.workunit.client.0.smithi110.stdout:0/213: dread d3/d4/dc/f1c [0,4194304] 0 2024-09-16T02:05:52.022 INFO:tasks.workunit.client.1.smithi165.stdout:7/499: getdents d0/df/d33 0 2024-09-16T02:05:52.022 INFO:tasks.workunit.client.1.smithi165.stdout:3/568: mknod da/d17/d7a/d7d/da8/cce 0 2024-09-16T02:05:52.023 INFO:tasks.workunit.client.0.smithi110.stdout:0/214: chown d3/d6/ff 28 1 2024-09-16T02:05:52.024 INFO:tasks.workunit.client.1.smithi165.stdout:0/464: dread d0/d47/f59 [0,4194304] 0 2024-09-16T02:05:52.025 INFO:tasks.workunit.client.1.smithi165.stdout:5/501: rename de/d21/f41 to de/d19/d1c/d49/fa3 0 2024-09-16T02:05:52.027 INFO:tasks.workunit.client.0.smithi110.stdout:6/218: dwrite d0/d2/f25 [0,4194304] 0 2024-09-16T02:05:52.028 INFO:tasks.workunit.client.0.smithi110.stdout:2/199: symlink d0/l40 0 2024-09-16T02:05:52.028 INFO:tasks.workunit.client.1.smithi165.stdout:1/508: link d1/d19/d24/l6a d1/la0 0 2024-09-16T02:05:52.029 INFO:tasks.workunit.client.0.smithi110.stdout:6/219: write d0/d2/f23 [3196416,83507] 0 2024-09-16T02:05:52.030 INFO:tasks.workunit.client.1.smithi165.stdout:6/517: mkdir d7/dc/d3b/d3a/d3d/d5d/d87 0 2024-09-16T02:05:52.033 INFO:tasks.workunit.client.0.smithi110.stdout:5/194: creat d5/d36/d3d/f42 x:0 0 0 2024-09-16T02:05:52.033 INFO:tasks.workunit.client.1.smithi165.stdout:8/535: truncate dd/d11/d38/f39 576729 0 2024-09-16T02:05:52.034 INFO:tasks.workunit.client.0.smithi110.stdout:0/215: rmdir d3/d4/dc 39 2024-09-16T02:05:52.034 INFO:tasks.workunit.client.1.smithi165.stdout:4/447: mknod d4/dc/d18/d37/d53/d64/d8b/d71/c94 0 2024-09-16T02:05:52.035 INFO:tasks.workunit.client.0.smithi110.stdout:0/216: write d3/f28 [1872734,3322] 0 2024-09-16T02:05:52.036 INFO:tasks.workunit.client.0.smithi110.stdout:1/236: rename d0/d1/c22 to d0/c4b 0 2024-09-16T02:05:52.038 INFO:tasks.workunit.client.1.smithi165.stdout:7/500: mknod d0/df/d42/c96 0 2024-09-16T02:05:52.041 INFO:tasks.workunit.client.0.smithi110.stdout:2/200: mkdir d0/da/d18/d2d/d41 0 2024-09-16T02:05:52.042 INFO:tasks.workunit.client.1.smithi165.stdout:3/569: write da/d17/d7a/dab/fb9 [271136,91367] 0 2024-09-16T02:05:52.043 INFO:tasks.workunit.client.0.smithi110.stdout:6/220: creat d0/d29/f3f x:0 0 0 2024-09-16T02:05:52.045 INFO:tasks.workunit.client.1.smithi165.stdout:0/465: unlink d0/d1e/d20/d28/c4d 0 2024-09-16T02:05:52.048 INFO:tasks.workunit.client.0.smithi110.stdout:6/221: dread d0/d2/dc/d16/f13 [0,4194304] 0 2024-09-16T02:05:52.048 INFO:tasks.workunit.client.1.smithi165.stdout:3/570: dwrite da/d17/d78/d2c/d2d/d6c/f61 [0,4194304] 0 2024-09-16T02:05:52.049 INFO:tasks.workunit.client.0.smithi110.stdout:5/195: dread d5/dd/f10 [0,4194304] 0 2024-09-16T02:05:52.050 INFO:tasks.workunit.client.0.smithi110.stdout:5/196: dread - d5/dd/df/d28/f30 zero size 2024-09-16T02:05:52.053 INFO:tasks.workunit.client.1.smithi165.stdout:0/466: dwrite d0/d1e/f93 [0,4194304] 0 2024-09-16T02:05:52.054 INFO:tasks.workunit.client.0.smithi110.stdout:6/222: creat d0/d2/d5/d1e/f40 x:0 0 0 2024-09-16T02:05:52.055 INFO:tasks.workunit.client.0.smithi110.stdout:0/217: mknod d3/d4/c46 0 2024-09-16T02:05:52.057 INFO:tasks.workunit.client.1.smithi165.stdout:4/448: mknod d4/dc/d18/d37/d53/c95 0 2024-09-16T02:05:52.059 INFO:tasks.workunit.client.0.smithi110.stdout:5/197: rename d5/dd/df/f2e to d5/dd/f43 0 2024-09-16T02:05:52.061 INFO:tasks.workunit.client.0.smithi110.stdout:0/218: chown d3/d4/dc/c40 123 1 2024-09-16T02:05:52.063 INFO:tasks.workunit.client.1.smithi165.stdout:3/571: creat da/d20/d26/d52/fcf x:0 0 0 2024-09-16T02:05:52.064 INFO:tasks.workunit.client.1.smithi165.stdout:3/572: write da/d17/f4b [324254,28359] 0 2024-09-16T02:05:52.064 INFO:tasks.workunit.client.0.smithi110.stdout:6/223: rename d0/d2/d5/fa to d0/d2/dc/f41 0 2024-09-16T02:05:52.066 INFO:tasks.workunit.client.1.smithi165.stdout:9/545: getdents d7/df/d67/d92 0 2024-09-16T02:05:52.066 INFO:tasks.workunit.client.0.smithi110.stdout:5/198: mknod d5/dd/df/d28/c44 0 2024-09-16T02:05:52.067 INFO:tasks.workunit.client.1.smithi165.stdout:6/518: link d7/d17/f66 d7/dc/df/d1a/d4d/d5f/f88 0 2024-09-16T02:05:52.068 INFO:tasks.workunit.client.0.smithi110.stdout:1/237: getdents d0/d1/d2a/d32 0 2024-09-16T02:05:52.069 INFO:tasks.workunit.client.0.smithi110.stdout:0/219: truncate d3/f1a 4425003 0 2024-09-16T02:05:52.070 INFO:tasks.workunit.client.0.smithi110.stdout:0/220: chown d3/d6/c45 93155592 1 2024-09-16T02:05:52.071 INFO:tasks.workunit.client.1.smithi165.stdout:7/501: link d0/d4b/d58/f73 d0/d2c/d85/f97 0 2024-09-16T02:05:52.071 INFO:tasks.workunit.client.0.smithi110.stdout:2/201: getdents d0/da/d18/d2d/d39 0 2024-09-16T02:05:52.072 INFO:tasks.workunit.client.1.smithi165.stdout:3/573: dwrite da/d17/d78/d2c/fc2 [0,4194304] 0 2024-09-16T02:05:52.073 INFO:tasks.workunit.client.0.smithi110.stdout:5/199: mkdir d5/d36/d45 0 2024-09-16T02:05:52.074 INFO:tasks.workunit.client.1.smithi165.stdout:2/566: getdents df/d10/d1a/d2d 0 2024-09-16T02:05:52.075 INFO:tasks.workunit.client.1.smithi165.stdout:4/449: dread d4/f26 [0,4194304] 0 2024-09-16T02:05:52.076 INFO:tasks.workunit.client.1.smithi165.stdout:2/567: chown df/f3f 5338945 1 2024-09-16T02:05:52.077 INFO:tasks.workunit.client.1.smithi165.stdout:4/450: fdatasync d4/dc/d20/d4e/f72 0 2024-09-16T02:05:52.077 INFO:tasks.workunit.client.0.smithi110.stdout:2/202: write d0/f7 [2992846,92939] 0 2024-09-16T02:05:52.077 INFO:tasks.workunit.client.1.smithi165.stdout:9/546: creat d7/d32/d85/d8a/fb2 x:0 0 0 2024-09-16T02:05:52.083 INFO:tasks.workunit.client.0.smithi110.stdout:0/221: dwrite d3/f17 [0,4194304] 0 2024-09-16T02:05:52.083 INFO:tasks.workunit.client.1.smithi165.stdout:8/536: rename dd/d34/f4d to dd/d11/d14/d3f/d25/d36/fb6 0 2024-09-16T02:05:52.086 INFO:tasks.workunit.client.0.smithi110.stdout:6/224: creat d0/d2/f42 x:0 0 0 2024-09-16T02:05:52.087 INFO:tasks.workunit.client.1.smithi165.stdout:6/519: chown d7/dc/d3b/d3a/d3d/d5d/d73/d82/c2f 0 1 2024-09-16T02:05:52.087 INFO:tasks.workunit.client.1.smithi165.stdout:6/520: readlink d7/dc/l1b 0 2024-09-16T02:05:52.089 INFO:tasks.workunit.client.0.smithi110.stdout:2/203: creat d0/da/d18/d2d/f42 x:0 0 0 2024-09-16T02:05:52.090 INFO:tasks.workunit.client.0.smithi110.stdout:2/204: chown d0/da/d18/d2d 2 1 2024-09-16T02:05:52.091 INFO:tasks.workunit.client.1.smithi165.stdout:6/521: read d7/d1f/f33 [974315,47455] 0 2024-09-16T02:05:52.091 INFO:tasks.workunit.client.1.smithi165.stdout:7/502: chown d0/df/d7/f92 27970 1 2024-09-16T02:05:52.091 INFO:tasks.workunit.client.0.smithi110.stdout:2/205: write d0/da/d18/f19 [271294,55949] 0 2024-09-16T02:05:52.092 INFO:tasks.workunit.client.1.smithi165.stdout:6/522: dread - d7/dc/df/d1a/d4d/d5f/f84 zero size 2024-09-16T02:05:52.093 INFO:tasks.workunit.client.1.smithi165.stdout:7/503: truncate d0/df/d83/d84/f82 4269801 0 2024-09-16T02:05:52.094 INFO:tasks.workunit.client.0.smithi110.stdout:0/222: fsync d3/d6/f44 0 2024-09-16T02:05:52.095 INFO:tasks.workunit.client.1.smithi165.stdout:5/502: link de/d19/f33 de/fa4 0 2024-09-16T02:05:52.096 INFO:tasks.workunit.client.0.smithi110.stdout:1/238: getdents d0/d1/d2a/d32 0 2024-09-16T02:05:52.097 INFO:tasks.workunit.client.1.smithi165.stdout:1/509: getdents d1/d19/d4d 0 2024-09-16T02:05:52.099 INFO:tasks.workunit.client.1.smithi165.stdout:2/568: fdatasync df/d10/d1a/d2d/f4e 0 2024-09-16T02:05:52.100 INFO:tasks.workunit.client.1.smithi165.stdout:0/467: dwrite d0/d1e/d39/d48/d5f/f73 [0,4194304] 0 2024-09-16T02:05:52.100 INFO:tasks.workunit.client.1.smithi165.stdout:2/569: stat df/d10/d37/c44 0 2024-09-16T02:05:52.102 INFO:tasks.workunit.client.1.smithi165.stdout:1/510: dread d1/f79 [0,4194304] 0 2024-09-16T02:05:52.104 INFO:tasks.workunit.client.1.smithi165.stdout:8/537: rmdir dd/d9e 39 2024-09-16T02:05:52.107 INFO:tasks.workunit.client.1.smithi165.stdout:1/511: dread d1/dd/d11/f1d [0,4194304] 0 2024-09-16T02:05:52.107 INFO:tasks.workunit.client.1.smithi165.stdout:6/523: rmdir d7/dc/df/d1a/d4d/d5f 39 2024-09-16T02:05:52.109 INFO:tasks.workunit.client.1.smithi165.stdout:7/504: symlink d0/l98 0 2024-09-16T02:05:52.111 INFO:tasks.workunit.client.0.smithi110.stdout:2/206: creat d0/da/d18/d25/d3b/f43 x:0 0 0 2024-09-16T02:05:52.111 INFO:tasks.workunit.client.1.smithi165.stdout:3/574: mknod da/d17/d78/d2c/d2d/cd0 0 2024-09-16T02:05:52.112 INFO:tasks.workunit.client.0.smithi110.stdout:5/200: getdents d5/dd 0 2024-09-16T02:05:52.113 INFO:tasks.workunit.client.1.smithi165.stdout:5/503: mkdir de/d19/d1c/d49/da5 0 2024-09-16T02:05:52.113 INFO:tasks.workunit.client.0.smithi110.stdout:0/223: symlink d3/d6/d43/l47 0 2024-09-16T02:05:52.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/201: fdatasync d5/dd/df/d11/f32 0 2024-09-16T02:05:52.115 INFO:tasks.workunit.client.0.smithi110.stdout:6/225: link d0/d2/d5/d1e/c27 d0/d2/d5/d1e/c43 0 2024-09-16T02:05:52.116 INFO:tasks.workunit.client.0.smithi110.stdout:6/226: chown d0/d2/d18/d31 8164359 1 2024-09-16T02:05:52.117 INFO:tasks.workunit.client.0.smithi110.stdout:6/227: truncate d0/d29/f32 944022 0 2024-09-16T02:05:52.117 INFO:tasks.workunit.client.1.smithi165.stdout:2/570: dread - df/d23/d28/d3b/f7a zero size 2024-09-16T02:05:52.120 INFO:tasks.workunit.client.0.smithi110.stdout:5/202: mknod d5/dd/df/d11/c46 0 2024-09-16T02:05:52.120 INFO:tasks.workunit.client.0.smithi110.stdout:0/224: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:52.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/203: truncate d5/dd/f43 1048552 0 2024-09-16T02:05:52.121 INFO:tasks.workunit.client.0.smithi110.stdout:1/239: link d0/d1/d8/c21 d0/d25/c4c 0 2024-09-16T02:05:52.123 INFO:tasks.workunit.client.1.smithi165.stdout:1/512: symlink d1/d19/d24/d30/la1 0 2024-09-16T02:05:52.123 INFO:tasks.workunit.client.0.smithi110.stdout:2/207: creat d0/da/d18/d2d/d41/f44 x:0 0 0 2024-09-16T02:05:52.125 INFO:tasks.workunit.client.1.smithi165.stdout:3/575: creat da/d17/d78/d2c/db7/fd1 x:0 0 0 2024-09-16T02:05:52.126 INFO:tasks.workunit.client.0.smithi110.stdout:6/228: dread d0/f10 [0,4194304] 0 2024-09-16T02:05:52.126 INFO:tasks.workunit.client.0.smithi110.stdout:6/229: chown d0/f10 152305520 1 2024-09-16T02:05:52.127 INFO:tasks.workunit.client.1.smithi165.stdout:7/505: dread d0/f60 [0,4194304] 0 2024-09-16T02:05:52.128 INFO:tasks.workunit.client.1.smithi165.stdout:4/451: link d4/dc/l8f d4/dc/d20/l96 0 2024-09-16T02:05:52.130 INFO:tasks.workunit.client.0.smithi110.stdout:1/240: rename d0/d1/d8/ld to d0/da/l4d 0 2024-09-16T02:05:52.130 INFO:tasks.workunit.client.1.smithi165.stdout:0/468: truncate d0/f13 2818107 0 2024-09-16T02:05:52.131 INFO:tasks.workunit.client.0.smithi110.stdout:2/208: dwrite d0/f16 [0,4194304] 0 2024-09-16T02:05:52.131 INFO:tasks.workunit.client.1.smithi165.stdout:5/504: dwrite de/d21/d26/d3a/f3c [0,4194304] 0 2024-09-16T02:05:52.132 INFO:tasks.workunit.client.1.smithi165.stdout:5/505: chown de/d19/c3b 210 1 2024-09-16T02:05:52.132 INFO:tasks.workunit.client.1.smithi165.stdout:5/506: chown de/d19/f32 3452 1 2024-09-16T02:05:52.133 INFO:tasks.workunit.client.0.smithi110.stdout:6/230: creat d0/d2/d5/d1e/f44 x:0 0 0 2024-09-16T02:05:52.135 INFO:tasks.workunit.client.0.smithi110.stdout:6/231: chown d0/d29/d2a/f2b 5948 1 2024-09-16T02:05:52.135 INFO:tasks.workunit.client.0.smithi110.stdout:0/225: dwrite d3/d4/dc/d10/f3c [0,4194304] 0 2024-09-16T02:05:52.135 INFO:tasks.workunit.client.0.smithi110.stdout:1/241: symlink d0/da/l4e 0 2024-09-16T02:05:52.136 INFO:tasks.workunit.client.1.smithi165.stdout:2/571: symlink df/d10/d64/lad 0 2024-09-16T02:05:52.136 INFO:tasks.workunit.client.1.smithi165.stdout:8/538: mkdir dd/d13/d53/db7 0 2024-09-16T02:05:52.138 INFO:tasks.workunit.client.0.smithi110.stdout:1/242: chown d0/d1/d2a 1205 1 2024-09-16T02:05:52.140 INFO:tasks.workunit.client.1.smithi165.stdout:7/506: fsync d0/d3d/f4f 0 2024-09-16T02:05:52.140 INFO:tasks.workunit.client.1.smithi165.stdout:3/576: write da/d20/d26/d52/f93 [557474,121074] 0 2024-09-16T02:05:52.141 INFO:tasks.workunit.client.0.smithi110.stdout:0/226: unlink d3/d4/dc/d10/l38 0 2024-09-16T02:05:52.144 INFO:tasks.workunit.client.1.smithi165.stdout:5/507: dwrite de/d19/d1c/d49/f73 [0,4194304] 0 2024-09-16T02:05:52.145 INFO:tasks.workunit.client.1.smithi165.stdout:9/547: getdents d7/d1f/d54 0 2024-09-16T02:05:52.146 INFO:tasks.workunit.client.1.smithi165.stdout:9/548: readlink d7/d1f/d27/l75 0 2024-09-16T02:05:52.146 INFO:tasks.workunit.client.0.smithi110.stdout:1/243: dread d0/d1/d2a/d32/f41 [0,4194304] 0 2024-09-16T02:05:52.146 INFO:tasks.workunit.client.0.smithi110.stdout:2/209: creat d0/da/f45 x:0 0 0 2024-09-16T02:05:52.147 INFO:tasks.workunit.client.0.smithi110.stdout:1/244: write d0/da/f17 [908014,128344] 0 2024-09-16T02:05:52.148 INFO:tasks.workunit.client.1.smithi165.stdout:5/508: chown de/d19/d1c/f4f 947 1 2024-09-16T02:05:52.149 INFO:tasks.workunit.client.1.smithi165.stdout:2/572: creat df/d23/d28/d9a/d86/fae x:0 0 0 2024-09-16T02:05:52.150 INFO:tasks.workunit.client.0.smithi110.stdout:6/232: rename d0/d2/d18/c2e to d0/d2/d18/d1d/c45 0 2024-09-16T02:05:52.152 INFO:tasks.workunit.client.0.smithi110.stdout:6/233: truncate d0/d2/f42 695235 0 2024-09-16T02:05:52.152 INFO:tasks.workunit.client.1.smithi165.stdout:2/573: truncate df/d10/f9f 664525 0 2024-09-16T02:05:52.153 INFO:tasks.workunit.client.0.smithi110.stdout:6/234: chown d0/d29/d2a/d2f 7 1 2024-09-16T02:05:52.153 INFO:tasks.workunit.client.1.smithi165.stdout:3/577: dwrite da/d17/d78/d2c/fc2 [0,4194304] 0 2024-09-16T02:05:52.154 INFO:tasks.workunit.client.0.smithi110.stdout:1/245: dread d0/d1/d2a/d32/f38 [0,4194304] 0 2024-09-16T02:05:52.155 INFO:tasks.workunit.client.0.smithi110.stdout:1/246: dread - d0/da/f36 zero size 2024-09-16T02:05:52.155 INFO:tasks.workunit.client.1.smithi165.stdout:7/507: rename d0/d2c/c52 to d0/df/d7/c99 0 2024-09-16T02:05:52.156 INFO:tasks.workunit.client.1.smithi165.stdout:0/469: mkdir d0/d1e/d39/d48/d5f/d96/da4 0 2024-09-16T02:05:52.158 INFO:tasks.workunit.client.1.smithi165.stdout:9/549: symlink d7/d32/d38/d68/d7f/lb3 0 2024-09-16T02:05:52.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/513: creat d1/d22/fa2 x:0 0 0 2024-09-16T02:05:52.160 INFO:tasks.workunit.client.1.smithi165.stdout:0/470: truncate d0/d1e/d39/d48/d74/f7b 529737 0 2024-09-16T02:05:52.162 INFO:tasks.workunit.client.1.smithi165.stdout:1/514: write d1/dd/d11/d46/f73 [547740,96989] 0 2024-09-16T02:05:52.162 INFO:tasks.workunit.client.1.smithi165.stdout:0/471: write d0/d1e/d39/d48/f8f [358927,101681] 0 2024-09-16T02:05:52.163 INFO:tasks.workunit.client.0.smithi110.stdout:1/247: link d0/d1/d4/f31 d0/d1/d2a/d32/f4f 0 2024-09-16T02:05:52.163 INFO:tasks.workunit.client.0.smithi110.stdout:6/235: dwrite d0/d2/f1c [0,4194304] 0 2024-09-16T02:05:52.164 INFO:tasks.workunit.client.1.smithi165.stdout:5/509: symlink de/la6 0 2024-09-16T02:05:52.164 INFO:tasks.workunit.client.1.smithi165.stdout:7/508: rmdir d0/df/d83/d84 39 2024-09-16T02:05:52.164 INFO:tasks.workunit.client.1.smithi165.stdout:8/539: dread f9 [0,4194304] 0 2024-09-16T02:05:52.165 INFO:tasks.workunit.client.0.smithi110.stdout:6/236: write d0/d2/f25 [2259919,5742] 0 2024-09-16T02:05:52.165 INFO:tasks.workunit.client.1.smithi165.stdout:7/509: write d0/d4b/d63/f8b [376979,119652] 0 2024-09-16T02:05:52.166 INFO:tasks.workunit.client.0.smithi110.stdout:6/237: fdatasync d0/d2/f42 0 2024-09-16T02:05:52.169 INFO:tasks.workunit.client.1.smithi165.stdout:3/578: link da/d20/d26/f9a da/d17/d78/fd2 0 2024-09-16T02:05:52.170 INFO:tasks.workunit.client.1.smithi165.stdout:3/579: write da/d17/d78/d2c/db7/fcd [1037884,1081] 0 2024-09-16T02:05:52.172 INFO:tasks.workunit.client.0.smithi110.stdout:6/238: creat d0/d2/d18/f46 x:0 0 0 2024-09-16T02:05:52.173 INFO:tasks.workunit.client.1.smithi165.stdout:0/472: creat d0/d1e/d39/d48/d5f/d82/fa5 x:0 0 0 2024-09-16T02:05:52.174 INFO:tasks.workunit.client.0.smithi110.stdout:6/239: write d0/d2/dc/f1f [825900,18168] 0 2024-09-16T02:05:52.174 INFO:tasks.workunit.client.1.smithi165.stdout:0/473: fdatasync d0/f23 0 2024-09-16T02:05:52.176 INFO:tasks.workunit.client.1.smithi165.stdout:0/474: write d0/d1e/d20/d28/f68 [562034,101400] 0 2024-09-16T02:05:52.178 INFO:tasks.workunit.client.1.smithi165.stdout:7/510: symlink d0/df/d65/l9a 0 2024-09-16T02:05:52.179 INFO:tasks.workunit.client.1.smithi165.stdout:9/550: creat d7/d32/d38/d53/d5c/d61/d8f/fb4 x:0 0 0 2024-09-16T02:05:52.181 INFO:tasks.workunit.client.1.smithi165.stdout:1/515: mkdir d1/dd/d11/d33/d92/da3 0 2024-09-16T02:05:52.182 INFO:tasks.workunit.client.1.smithi165.stdout:3/580: rename da/d17/d7a/d7d/l88 to da/d17/ld3 0 2024-09-16T02:05:52.184 INFO:tasks.workunit.client.0.smithi110.stdout:6/240: creat d0/f47 x:0 0 0 2024-09-16T02:05:52.185 INFO:tasks.workunit.client.1.smithi165.stdout:4/452: write d4/f44 [277659,34626] 0 2024-09-16T02:05:52.188 INFO:tasks.workunit.client.1.smithi165.stdout:9/551: mknod d7/d32/d38/d68/d7f/cb5 0 2024-09-16T02:05:52.190 INFO:tasks.workunit.client.1.smithi165.stdout:0/475: mknod d0/d1e/d20/d9c/ca6 0 2024-09-16T02:05:52.191 INFO:tasks.workunit.client.0.smithi110.stdout:6/241: dwrite d0/d2/f42 [0,4194304] 0 2024-09-16T02:05:52.192 INFO:tasks.workunit.client.1.smithi165.stdout:6/524: sync 2024-09-16T02:05:52.192 INFO:tasks.workunit.client.1.smithi165.stdout:1/516: symlink d1/d22/la4 0 2024-09-16T02:05:52.193 INFO:tasks.workunit.client.1.smithi165.stdout:0/476: dread d0/d1e/f57 [0,4194304] 0 2024-09-16T02:05:52.194 INFO:tasks.workunit.client.1.smithi165.stdout:9/552: dread d7/df/d37/f3b [0,4194304] 0 2024-09-16T02:05:52.194 INFO:tasks.workunit.client.1.smithi165.stdout:4/453: unlink d4/dc/d18/d37/d53/c59 0 2024-09-16T02:05:52.194 INFO:tasks.workunit.client.0.smithi110.stdout:6/242: mkdir d0/d2/d5/d1e/d48 0 2024-09-16T02:05:52.195 INFO:tasks.workunit.client.1.smithi165.stdout:6/525: write d7/dc/df/d1a/f47 [3067675,1622] 0 2024-09-16T02:05:52.195 INFO:tasks.workunit.client.1.smithi165.stdout:1/517: chown d1/dd/d11/d33/d67/l8c 333427217 1 2024-09-16T02:05:52.195 INFO:tasks.workunit.client.1.smithi165.stdout:0/477: chown d0/d1e/d39/d48/d74/l98 0 1 2024-09-16T02:05:52.196 INFO:tasks.workunit.client.0.smithi110.stdout:6/243: mkdir d0/d29/d2a/d2f/d49 0 2024-09-16T02:05:52.198 INFO:tasks.workunit.client.0.smithi110.stdout:1/248: rmdir d0/d1/d4 39 2024-09-16T02:05:52.198 INFO:tasks.workunit.client.1.smithi165.stdout:4/454: creat d4/dc/d20/d45/f97 x:0 0 0 2024-09-16T02:05:52.199 INFO:tasks.workunit.client.1.smithi165.stdout:4/455: fsync d4/f1e 0 2024-09-16T02:05:52.201 INFO:tasks.workunit.client.1.smithi165.stdout:2/574: truncate df/d23/f84 2397969 0 2024-09-16T02:05:52.203 INFO:tasks.workunit.client.1.smithi165.stdout:0/478: dread d0/d47/f6f [0,4194304] 0 2024-09-16T02:05:52.204 INFO:tasks.workunit.client.0.smithi110.stdout:6/244: mkdir d0/d29/d2a/d2f/d34/d4a 0 2024-09-16T02:05:52.205 INFO:tasks.workunit.client.0.smithi110.stdout:1/249: dwrite d0/da/f36 [0,4194304] 0 2024-09-16T02:05:52.206 INFO:tasks.workunit.client.1.smithi165.stdout:3/581: dread da/d20/d26/d52/f6d [0,4194304] 0 2024-09-16T02:05:52.206 INFO:tasks.workunit.client.1.smithi165.stdout:0/479: write d0/d1e/d39/d48/f8f [1260695,10453] 0 2024-09-16T02:05:52.206 INFO:tasks.workunit.client.0.smithi110.stdout:6/245: fdatasync d0/d2/d18/f46 0 2024-09-16T02:05:52.206 INFO:tasks.workunit.client.1.smithi165.stdout:6/526: creat d7/dc/d3b/d3a/d3d/d5d/d73/d82/f89 x:0 0 0 2024-09-16T02:05:52.208 INFO:tasks.workunit.client.1.smithi165.stdout:9/553: dwrite d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:52.208 INFO:tasks.workunit.client.1.smithi165.stdout:3/582: write da/d17/d7a/f96 [234805,77615] 0 2024-09-16T02:05:52.209 INFO:tasks.workunit.client.1.smithi165.stdout:4/456: symlink d4/dc/d18/d37/d53/l98 0 2024-09-16T02:05:52.210 INFO:tasks.workunit.client.1.smithi165.stdout:8/540: write dd/d11/d38/f45 [568425,29757] 0 2024-09-16T02:05:52.211 INFO:tasks.workunit.client.1.smithi165.stdout:4/457: chown d4/c2e 1211326666 1 2024-09-16T02:05:52.212 INFO:tasks.workunit.client.1.smithi165.stdout:4/458: chown d4/f44 1867 1 2024-09-16T02:05:52.213 INFO:tasks.workunit.client.1.smithi165.stdout:3/583: truncate da/d17/d78/d2c/d2d/d6c/fba 444574 0 2024-09-16T02:05:52.213 INFO:tasks.workunit.client.1.smithi165.stdout:1/518: mkdir d1/d19/d24/d97/da5 0 2024-09-16T02:05:52.214 INFO:tasks.workunit.client.0.smithi110.stdout:1/250: mknod d0/d1/c50 0 2024-09-16T02:05:52.215 INFO:tasks.workunit.client.1.smithi165.stdout:1/519: dread d1/d22/f85 [0,4194304] 0 2024-09-16T02:05:52.219 INFO:tasks.workunit.client.1.smithi165.stdout:5/510: truncate de/d21/d26/d3a/f3c 3871018 0 2024-09-16T02:05:52.224 INFO:tasks.workunit.client.1.smithi165.stdout:2/575: dread df/d23/f51 [0,4194304] 0 2024-09-16T02:05:52.224 INFO:tasks.workunit.client.1.smithi165.stdout:0/480: read d0/d1e/d20/f46 [1243059,87481] 0 2024-09-16T02:05:52.225 INFO:tasks.workunit.client.0.smithi110.stdout:7/171: sync 2024-09-16T02:05:52.225 INFO:tasks.workunit.client.0.smithi110.stdout:6/246: getdents d0/d29 0 2024-09-16T02:05:52.225 INFO:tasks.workunit.client.0.smithi110.stdout:6/247: chown d0/d29/c3c 32961828 1 2024-09-16T02:05:52.226 INFO:tasks.workunit.client.1.smithi165.stdout:9/554: mkdir d7/df/d67/d92/d93/db6 0 2024-09-16T02:05:52.226 INFO:tasks.workunit.client.0.smithi110.stdout:6/248: write d0/d29/d2a/f37 [102361,21309] 0 2024-09-16T02:05:52.227 INFO:tasks.workunit.client.0.smithi110.stdout:7/172: creat d3/f32 x:0 0 0 2024-09-16T02:05:52.229 INFO:tasks.workunit.client.1.smithi165.stdout:8/541: symlink dd/d11/d38/d74/lb8 0 2024-09-16T02:05:52.231 INFO:tasks.workunit.client.1.smithi165.stdout:4/459: mkdir d4/dc/d28/d2b/d42/d99 0 2024-09-16T02:05:52.232 INFO:tasks.workunit.client.0.smithi110.stdout:6/249: dread d0/d2/f23 [0,4194304] 0 2024-09-16T02:05:52.235 INFO:tasks.workunit.client.0.smithi110.stdout:7/173: dwrite d3/f27 [0,4194304] 0 2024-09-16T02:05:52.237 INFO:tasks.workunit.client.1.smithi165.stdout:5/511: creat de/d19/d1c/d84/d92/fa7 x:0 0 0 2024-09-16T02:05:52.237 INFO:tasks.workunit.client.0.smithi110.stdout:7/174: truncate d3/f32 292906 0 2024-09-16T02:05:52.237 INFO:tasks.workunit.client.0.smithi110.stdout:7/175: stat f1 0 2024-09-16T02:05:52.237 INFO:tasks.workunit.client.1.smithi165.stdout:4/460: dread d4/dc/d28/f43 [0,4194304] 0 2024-09-16T02:05:52.237 INFO:tasks.workunit.client.1.smithi165.stdout:6/527: getdents d7/dc/d7f 0 2024-09-16T02:05:52.242 INFO:tasks.workunit.client.0.smithi110.stdout:7/176: mknod d3/da/d10/d2c/c33 0 2024-09-16T02:05:52.244 INFO:tasks.workunit.client.1.smithi165.stdout:9/555: symlink d7/df/d67/d92/lb7 0 2024-09-16T02:05:52.245 INFO:tasks.workunit.client.1.smithi165.stdout:8/542: stat dd/d13/c4e 0 2024-09-16T02:05:52.245 INFO:tasks.workunit.client.1.smithi165.stdout:4/461: dwrite d4/f1e [0,4194304] 0 2024-09-16T02:05:52.245 INFO:tasks.workunit.client.0.smithi110.stdout:7/177: fsync d3/f14 0 2024-09-16T02:05:52.247 INFO:tasks.workunit.client.0.smithi110.stdout:1/251: dwrite d0/d1/d2a/d32/f4f [0,4194304] 0 2024-09-16T02:05:52.249 INFO:tasks.workunit.client.0.smithi110.stdout:6/250: dread d0/d2/dc/f41 [0,4194304] 0 2024-09-16T02:05:52.250 INFO:tasks.workunit.client.0.smithi110.stdout:7/178: creat d3/f34 x:0 0 0 2024-09-16T02:05:52.251 INFO:tasks.workunit.client.1.smithi165.stdout:3/584: link da/d17/d78/d2c/f74 da/fd4 0 2024-09-16T02:05:52.251 INFO:tasks.workunit.client.0.smithi110.stdout:6/251: chown d0/d2/d5/d1e/f44 40141151 1 2024-09-16T02:05:52.252 INFO:tasks.workunit.client.0.smithi110.stdout:7/179: dread - d3/da/d10/d11/f2b zero size 2024-09-16T02:05:52.253 INFO:tasks.workunit.client.1.smithi165.stdout:1/520: symlink d1/dd/d11/d33/la6 0 2024-09-16T02:05:52.254 INFO:tasks.workunit.client.1.smithi165.stdout:5/512: mkdir de/d21/d26/d94/da8 0 2024-09-16T02:05:52.256 INFO:tasks.workunit.client.1.smithi165.stdout:1/521: write d1/f3a [1201884,8612] 0 2024-09-16T02:05:52.256 INFO:tasks.workunit.client.1.smithi165.stdout:6/528: rename d7/dc/df/d1a/f45 to d7/dc/d3b/d3a/d3d/d5d/d73/d82/f8a 0 2024-09-16T02:05:52.257 INFO:tasks.workunit.client.0.smithi110.stdout:6/252: truncate d0/d2/dc/ff 4627225 0 2024-09-16T02:05:52.258 INFO:tasks.workunit.client.1.smithi165.stdout:9/556: dread d7/d1f/d27/f3e [0,4194304] 0 2024-09-16T02:05:52.258 INFO:tasks.workunit.client.1.smithi165.stdout:4/462: dwrite d4/dc/d28/d2b/f74 [0,4194304] 0 2024-09-16T02:05:52.259 INFO:tasks.workunit.client.1.smithi165.stdout:0/481: mkdir d0/d1e/d20/d28/da7 0 2024-09-16T02:05:52.259 INFO:tasks.workunit.client.1.smithi165.stdout:5/513: chown de/d19/d1c/f3e 18327 1 2024-09-16T02:05:52.260 INFO:tasks.workunit.client.0.smithi110.stdout:1/252: dwrite d0/d25/f3b [0,4194304] 0 2024-09-16T02:05:52.262 INFO:tasks.workunit.client.1.smithi165.stdout:5/514: dread - de/d19/d1c/d84/d92/fa7 zero size 2024-09-16T02:05:52.263 INFO:tasks.workunit.client.0.smithi110.stdout:6/253: creat d0/d2/dc/f4b x:0 0 0 2024-09-16T02:05:52.265 INFO:tasks.workunit.client.1.smithi165.stdout:2/576: dwrite df/d73/d79/f71 [0,4194304] 0 2024-09-16T02:05:52.266 INFO:tasks.workunit.client.1.smithi165.stdout:8/543: mkdir dd/d11/daa/db9 0 2024-09-16T02:05:52.268 INFO:tasks.workunit.client.1.smithi165.stdout:7/511: sync 2024-09-16T02:05:52.270 INFO:tasks.workunit.client.0.smithi110.stdout:1/253: mkdir d0/d1/d4/d46/d51 0 2024-09-16T02:05:52.270 INFO:tasks.workunit.client.1.smithi165.stdout:4/463: dwrite d4/dc/d28/d2b/f6d [0,4194304] 0 2024-09-16T02:05:52.274 INFO:tasks.workunit.client.0.smithi110.stdout:1/254: mknod d0/d25/c52 0 2024-09-16T02:05:52.276 INFO:tasks.workunit.client.1.smithi165.stdout:4/464: write d4/f44 [28893,23964] 0 2024-09-16T02:05:52.277 INFO:tasks.workunit.client.0.smithi110.stdout:1/255: rmdir d0/da 39 2024-09-16T02:05:52.278 INFO:tasks.workunit.client.1.smithi165.stdout:3/585: unlink da/d20/d26/d52/d6b/c7b 0 2024-09-16T02:05:52.278 INFO:tasks.workunit.client.1.smithi165.stdout:9/557: unlink d7/c8 0 2024-09-16T02:05:52.279 INFO:tasks.workunit.client.0.smithi110.stdout:1/256: truncate d0/d1/d4/f24 257416 0 2024-09-16T02:05:52.281 INFO:tasks.workunit.client.1.smithi165.stdout:5/515: mknod de/d60/d65/ca9 0 2024-09-16T02:05:52.282 INFO:tasks.workunit.client.1.smithi165.stdout:2/577: rmdir df/d23/d28/d9a/d86 39 2024-09-16T02:05:52.285 INFO:tasks.workunit.client.1.smithi165.stdout:9/558: truncate d7/d32/d38/d53/d56/d95/fa5 1024410 0 2024-09-16T02:05:52.285 INFO:tasks.workunit.client.1.smithi165.stdout:3/586: symlink da/d20/d26/d52/d9c/ld5 0 2024-09-16T02:05:52.286 INFO:tasks.workunit.client.1.smithi165.stdout:0/482: mknod d0/d1e/d39/d48/d5f/ca8 0 2024-09-16T02:05:52.287 INFO:tasks.workunit.client.1.smithi165.stdout:0/483: write d0/d1e/d39/d48/d6e/fa1 [215690,77799] 0 2024-09-16T02:05:52.288 INFO:tasks.workunit.client.1.smithi165.stdout:7/512: unlink d0/df/d65/l91 0 2024-09-16T02:05:52.289 INFO:tasks.workunit.client.1.smithi165.stdout:5/516: mkdir de/d19/d1c/d84/daa 0 2024-09-16T02:05:52.290 INFO:tasks.workunit.client.1.smithi165.stdout:2/578: symlink df/d23/d28/d3b/d82/laf 0 2024-09-16T02:05:52.290 INFO:tasks.workunit.client.1.smithi165.stdout:7/513: truncate d0/d2c/d85/f88 609175 0 2024-09-16T02:05:52.291 INFO:tasks.workunit.client.1.smithi165.stdout:8/544: link dd/d11/d14/f54 dd/d13/d53/fba 0 2024-09-16T02:05:52.291 INFO:tasks.workunit.client.1.smithi165.stdout:6/529: link d7/dc/d3b/d3a/d3d/c40 d7/dc/df/d5b/c8b 0 2024-09-16T02:05:52.292 INFO:tasks.workunit.client.1.smithi165.stdout:3/587: mknod da/d17/d7a/dab/cd6 0 2024-09-16T02:05:52.292 INFO:tasks.workunit.client.1.smithi165.stdout:9/559: chown d7/df/d37/f83 41845225 1 2024-09-16T02:05:52.293 INFO:tasks.workunit.client.1.smithi165.stdout:3/588: chown da/d20/d26/d52/l87 0 1 2024-09-16T02:05:52.294 INFO:tasks.workunit.client.1.smithi165.stdout:0/484: creat d0/d1e/d20/d28/d6d/d87/fa9 x:0 0 0 2024-09-16T02:05:52.294 INFO:tasks.workunit.client.1.smithi165.stdout:6/530: dread d7/d17/f69 [0,4194304] 0 2024-09-16T02:05:52.295 INFO:tasks.workunit.client.1.smithi165.stdout:5/517: mkdir de/d21/d26/d3a/d6d/d95/dab 0 2024-09-16T02:05:52.301 INFO:tasks.workunit.client.1.smithi165.stdout:3/589: creat da/fd7 x:0 0 0 2024-09-16T02:05:52.302 INFO:tasks.workunit.client.1.smithi165.stdout:0/485: mkdir d0/d2a/d70/daa 0 2024-09-16T02:05:52.302 INFO:tasks.workunit.client.1.smithi165.stdout:3/590: chown da/d17/d78/d2c/d2d/d6c/fc6 105 1 2024-09-16T02:05:52.302 INFO:tasks.workunit.client.1.smithi165.stdout:3/591: chown da/d17/d78 7188477 1 2024-09-16T02:05:52.302 INFO:tasks.workunit.client.0.smithi110.stdout:6/254: truncate d0/d2/dc/d16/f13 1849173 0 2024-09-16T02:05:52.303 INFO:tasks.workunit.client.0.smithi110.stdout:6/255: fsync d0/d2/dc/f4b 0 2024-09-16T02:05:52.303 INFO:tasks.workunit.client.1.smithi165.stdout:3/592: rename da/d20 to da/d20/d26/d8c/dd8 22 2024-09-16T02:05:52.303 INFO:tasks.workunit.client.1.smithi165.stdout:5/518: mknod de/d19/d1c/d4d/cac 0 2024-09-16T02:05:52.305 INFO:tasks.workunit.client.1.smithi165.stdout:9/560: mknod d7/df/d67/d92/d93/db6/cb8 0 2024-09-16T02:05:52.306 INFO:tasks.workunit.client.1.smithi165.stdout:0/486: truncate d0/d1e/d20/f7f 1551682 0 2024-09-16T02:05:52.312 INFO:tasks.workunit.client.0.smithi110.stdout:6/256: dwrite d0/d29/f3f [0,4194304] 0 2024-09-16T02:05:52.312 INFO:tasks.workunit.client.1.smithi165.stdout:9/561: creat d7/d32/d38/d53/d5c/d61/fb9 x:0 0 0 2024-09-16T02:05:52.316 INFO:tasks.workunit.client.1.smithi165.stdout:0/487: creat d0/d2a/d70/fab x:0 0 0 2024-09-16T02:05:52.316 INFO:tasks.workunit.client.0.smithi110.stdout:6/257: mknod d0/d29/d2a/c4c 0 2024-09-16T02:05:52.318 INFO:tasks.workunit.client.0.smithi110.stdout:1/257: dread d0/f14 [0,4194304] 0 2024-09-16T02:05:52.319 INFO:tasks.workunit.client.1.smithi165.stdout:3/593: dread da/d17/f4a [0,4194304] 0 2024-09-16T02:05:52.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/258: stat d0/d2/d18/l24 0 2024-09-16T02:05:52.320 INFO:tasks.workunit.client.1.smithi165.stdout:3/594: chown da/d20/d26/d52/f93 209192 1 2024-09-16T02:05:52.321 INFO:tasks.workunit.client.1.smithi165.stdout:2/579: link df/d23/d28/d3b/l52 df/d10/d1a/d68/lb0 0 2024-09-16T02:05:52.322 INFO:tasks.workunit.client.1.smithi165.stdout:0/488: dwrite d0/d1e/d39/d48/d74/f7b [0,4194304] 0 2024-09-16T02:05:52.323 INFO:tasks.workunit.client.1.smithi165.stdout:9/562: creat d7/d87/fba x:0 0 0 2024-09-16T02:05:52.324 INFO:tasks.workunit.client.0.smithi110.stdout:6/259: dread d0/d2/f14 [0,4194304] 0 2024-09-16T02:05:52.325 INFO:tasks.workunit.client.1.smithi165.stdout:9/563: chown d7/d32/d38/d53/d56/lad 36 1 2024-09-16T02:05:52.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/564: write d7/d32/d38/d53/d5c/f8d [637526,126458] 0 2024-09-16T02:05:52.327 INFO:tasks.workunit.client.0.smithi110.stdout:1/258: creat d0/d1/f53 x:0 0 0 2024-09-16T02:05:52.327 INFO:tasks.workunit.client.1.smithi165.stdout:2/580: write df/f3f [5072276,46945] 0 2024-09-16T02:05:52.330 INFO:tasks.workunit.client.1.smithi165.stdout:6/531: dread d7/d1f/f33 [0,4194304] 0 2024-09-16T02:05:52.333 INFO:tasks.workunit.client.1.smithi165.stdout:2/581: dread df/f92 [0,4194304] 0 2024-09-16T02:05:52.352 INFO:tasks.workunit.client.1.smithi165.stdout:0/489: mkdir d0/d1e/d39/d48/d5f/d96/dac 0 2024-09-16T02:05:52.357 INFO:tasks.workunit.client.1.smithi165.stdout:1/522: fsync d1/dd/d11/f61 0 2024-09-16T02:05:52.358 INFO:tasks.workunit.client.1.smithi165.stdout:1/523: write d1/d32/f34 [3961895,81285] 0 2024-09-16T02:05:52.358 INFO:tasks.workunit.client.1.smithi165.stdout:9/565: dread d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:52.359 INFO:tasks.workunit.client.0.smithi110.stdout:1/259: mknod d0/d25/c54 0 2024-09-16T02:05:52.364 INFO:tasks.workunit.client.1.smithi165.stdout:6/532: creat d7/d1f/f8c x:0 0 0 2024-09-16T02:05:52.367 INFO:tasks.workunit.client.0.smithi110.stdout:1/260: dwrite d0/f47 [0,4194304] 0 2024-09-16T02:05:52.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/260: rename d0/d2/dc/f1f to d0/d2/f4d 0 2024-09-16T02:05:52.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/261: write d0/d2/dc/d16/f3b [3078745,116390] 0 2024-09-16T02:05:52.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/262: stat d0/d2/d5/c28 0 2024-09-16T02:05:52.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/263: fdatasync d0/d2/d5/d1e/f44 0 2024-09-16T02:05:52.369 INFO:tasks.workunit.client.0.smithi110.stdout:6/264: write d0/d29/f3f [761409,18377] 0 2024-09-16T02:05:52.369 INFO:tasks.workunit.client.1.smithi165.stdout:2/582: mkdir df/d73/d79/db1 0 2024-09-16T02:05:52.369 INFO:tasks.workunit.client.1.smithi165.stdout:4/465: truncate d4/dc/d18/d37/d53/d64/d8b/f61 203632 0 2024-09-16T02:05:52.369 INFO:tasks.workunit.client.0.smithi110.stdout:6/265: write d0/d2/f25 [1045460,80048] 0 2024-09-16T02:05:52.371 INFO:tasks.workunit.client.0.smithi110.stdout:6/266: read d0/d2/f25 [929213,64477] 0 2024-09-16T02:05:52.373 INFO:tasks.workunit.client.0.smithi110.stdout:1/261: creat d0/d25/f55 x:0 0 0 2024-09-16T02:05:52.373 INFO:tasks.workunit.client.1.smithi165.stdout:2/583: dread df/f34 [0,4194304] 0 2024-09-16T02:05:52.374 INFO:tasks.workunit.client.1.smithi165.stdout:7/514: write d0/df/d33/f4a [324873,90438] 0 2024-09-16T02:05:52.374 INFO:tasks.workunit.client.0.smithi110.stdout:1/262: chown d0/d1/d4/f26 4 1 2024-09-16T02:05:52.374 INFO:tasks.workunit.client.1.smithi165.stdout:9/566: mkdir d7/d32/d38/d58/dbb 0 2024-09-16T02:05:52.375 INFO:tasks.workunit.client.1.smithi165.stdout:9/567: stat d7/df/d67/la2 0 2024-09-16T02:05:52.378 INFO:tasks.workunit.client.0.smithi110.stdout:1/263: dread d0/d1/d4/f31 [0,4194304] 0 2024-09-16T02:05:52.379 INFO:tasks.workunit.client.1.smithi165.stdout:1/524: rename d1/dd/d11/d33/d3f/d59/f60 to d1/dd/d11/d33/d3f/d7e/fa7 0 2024-09-16T02:05:52.379 INFO:tasks.workunit.client.1.smithi165.stdout:8/545: dwrite dd/d13/d53/f61 [0,4194304] 0 2024-09-16T02:05:52.382 INFO:tasks.workunit.client.0.smithi110.stdout:1/264: dread d0/d1/d2a/d32/f41 [0,4194304] 0 2024-09-16T02:05:52.385 INFO:tasks.workunit.client.1.smithi165.stdout:1/525: dwrite d1/d22/f3d [0,4194304] 0 2024-09-16T02:05:52.386 INFO:tasks.workunit.client.0.smithi110.stdout:6/267: creat d0/d2/d5/f4e x:0 0 0 2024-09-16T02:05:52.391 INFO:tasks.workunit.client.1.smithi165.stdout:2/584: creat df/d23/d28/d3b/d6d/d8b/fb2 x:0 0 0 2024-09-16T02:05:52.399 INFO:tasks.workunit.client.0.smithi110.stdout:6/268: unlink d0/d2/d5/l3e 0 2024-09-16T02:05:52.401 INFO:tasks.workunit.client.1.smithi165.stdout:9/568: symlink d7/d1f/d27/d49/lbc 0 2024-09-16T02:05:52.403 INFO:tasks.workunit.client.1.smithi165.stdout:3/595: sync 2024-09-16T02:05:52.404 INFO:tasks.workunit.client.1.smithi165.stdout:3/596: chown da/d17 4 1 2024-09-16T02:05:52.407 INFO:tasks.workunit.client.1.smithi165.stdout:5/519: dwrite de/d19/f33 [0,4194304] 0 2024-09-16T02:05:52.408 INFO:tasks.workunit.client.0.smithi110.stdout:1/265: rename d0/d25/f55 to d0/f56 0 2024-09-16T02:05:52.409 INFO:tasks.workunit.client.1.smithi165.stdout:6/533: mknod d7/dc/df/d1a/d4d/c8d 0 2024-09-16T02:05:52.410 INFO:tasks.workunit.client.1.smithi165.stdout:5/520: write de/d19/d1c/d84/f88 [565412,126061] 0 2024-09-16T02:05:52.411 INFO:tasks.workunit.client.1.smithi165.stdout:1/526: creat d1/dd/d11/d33/d67/fa8 x:0 0 0 2024-09-16T02:05:52.412 INFO:tasks.workunit.client.1.smithi165.stdout:5/521: stat de/d21/c47 0 2024-09-16T02:05:52.414 INFO:tasks.workunit.client.1.smithi165.stdout:8/546: dwrite dd/d13/f71 [4194304,4194304] 0 2024-09-16T02:05:52.418 INFO:tasks.workunit.client.1.smithi165.stdout:9/569: symlink d7/df/d37/d43/d88/lbd 0 2024-09-16T02:05:52.419 INFO:tasks.workunit.client.1.smithi165.stdout:1/527: dwrite d1/d22/f82 [0,4194304] 0 2024-09-16T02:05:52.420 INFO:tasks.workunit.client.0.smithi110.stdout:1/266: dwrite d0/da/f17 [0,4194304] 0 2024-09-16T02:05:52.420 INFO:tasks.workunit.client.1.smithi165.stdout:1/528: readlink d1/d19/l2b 0 2024-09-16T02:05:52.422 INFO:tasks.workunit.client.1.smithi165.stdout:3/597: mkdir da/d20/d26/d8c/dd9 0 2024-09-16T02:05:52.427 INFO:tasks.workunit.client.0.smithi110.stdout:1/267: write d0/f14 [2486210,39447] 0 2024-09-16T02:05:52.429 INFO:tasks.workunit.client.1.smithi165.stdout:6/534: rename d7/dc/df/d1a/d4d/c8d to d7/dc/d3b/d3a/d3d/c8e 0 2024-09-16T02:05:52.431 INFO:tasks.workunit.client.1.smithi165.stdout:2/585: link df/f92 df/d23/d28/d3b/d6d/d8b/fb3 0 2024-09-16T02:05:52.435 INFO:tasks.workunit.client.1.smithi165.stdout:5/522: mkdir de/d21/d26/d3a/d6d/dad 0 2024-09-16T02:05:52.438 INFO:tasks.workunit.client.1.smithi165.stdout:4/466: getdents d4 0 2024-09-16T02:05:52.439 INFO:tasks.workunit.client.1.smithi165.stdout:3/598: unlink da/d17/d78/d2c/d2d/d6c/db5/fc3 0 2024-09-16T02:05:52.439 INFO:tasks.workunit.client.1.smithi165.stdout:3/599: chown da/d17/d7a/d7d 2895450 1 2024-09-16T02:05:52.440 INFO:tasks.workunit.client.1.smithi165.stdout:0/490: link d0/d1e/d39/d48/c5e d0/d1e/d39/d48/cad 0 2024-09-16T02:05:52.443 INFO:tasks.workunit.client.1.smithi165.stdout:8/547: rename dd/d11/d14/d3f/d25/c3d to dd/d11/d38/d74/d7d/cbb 0 2024-09-16T02:05:52.444 INFO:tasks.workunit.client.1.smithi165.stdout:6/535: rmdir d7/dc/d3b/d3c 39 2024-09-16T02:05:52.446 INFO:tasks.workunit.client.1.smithi165.stdout:6/536: write d7/dc/d3b/d3a/f49 [1007873,56085] 0 2024-09-16T02:05:52.447 INFO:tasks.workunit.client.1.smithi165.stdout:5/523: creat de/d21/d26/d3a/d6d/d95/fae x:0 0 0 2024-09-16T02:05:52.448 INFO:tasks.workunit.client.0.smithi110.stdout:1/268: fdatasync d0/da/f17 0 2024-09-16T02:05:52.448 INFO:tasks.workunit.client.1.smithi165.stdout:1/529: symlink d1/dd/d11/d33/d3f/d47/d7d/la9 0 2024-09-16T02:05:52.449 INFO:tasks.workunit.client.1.smithi165.stdout:7/515: dwrite d0/df/d7/f92 [0,4194304] 0 2024-09-16T02:05:52.452 INFO:tasks.workunit.client.0.smithi110.stdout:1/269: dread d0/f14 [0,4194304] 0 2024-09-16T02:05:52.453 INFO:tasks.workunit.client.1.smithi165.stdout:4/467: creat d4/dc/d18/d37/d53/d64/d8b/d71/f9a x:0 0 0 2024-09-16T02:05:52.453 INFO:tasks.workunit.client.1.smithi165.stdout:1/530: fsync d1/dd/d11/f61 0 2024-09-16T02:05:52.453 INFO:tasks.workunit.client.1.smithi165.stdout:5/524: chown de/d21/d26/d3a/d6d/d95/fae 71 1 2024-09-16T02:05:52.453 INFO:tasks.workunit.client.1.smithi165.stdout:3/600: readlink da/d20/d26/d52/lc9 0 2024-09-16T02:05:52.454 INFO:tasks.workunit.client.1.smithi165.stdout:4/468: fsync d4/dc/d28/d2b/f89 0 2024-09-16T02:05:52.455 INFO:tasks.workunit.client.1.smithi165.stdout:3/601: write da/d17/f8b [5135451,115196] 0 2024-09-16T02:05:52.461 INFO:tasks.workunit.client.1.smithi165.stdout:6/537: dwrite d7/dc/d3b/f64 [0,4194304] 0 2024-09-16T02:05:52.462 INFO:tasks.workunit.client.1.smithi165.stdout:3/602: chown da/d17/d78/d2c/db7/fcd 236712164 1 2024-09-16T02:05:52.462 INFO:tasks.workunit.client.0.smithi110.stdout:1/270: creat d0/d1/f57 x:0 0 0 2024-09-16T02:05:52.464 INFO:tasks.workunit.client.1.smithi165.stdout:5/525: creat de/d60/d65/faf x:0 0 0 2024-09-16T02:05:52.467 INFO:tasks.workunit.client.0.smithi110.stdout:1/271: symlink d0/d1/d4/d46/d51/l58 0 2024-09-16T02:05:52.467 INFO:tasks.workunit.client.0.smithi110.stdout:1/272: chown d0/l44 864371243 1 2024-09-16T02:05:52.468 INFO:tasks.workunit.client.0.smithi110.stdout:6/269: dread d0/d2/dc/d16/f13 [0,4194304] 0 2024-09-16T02:05:52.468 INFO:tasks.workunit.client.1.smithi165.stdout:4/469: dread d4/dc/d28/d2b/f74 [0,4194304] 0 2024-09-16T02:05:52.468 INFO:tasks.workunit.client.1.smithi165.stdout:7/516: dread d0/f19 [0,4194304] 0 2024-09-16T02:05:52.469 INFO:tasks.workunit.client.0.smithi110.stdout:6/270: chown d0/d29/d2a 436149010 1 2024-09-16T02:05:52.471 INFO:tasks.workunit.client.1.smithi165.stdout:1/531: dread d1/dd/d11/d33/d3f/f55 [0,4194304] 0 2024-09-16T02:05:52.472 INFO:tasks.workunit.client.0.smithi110.stdout:1/273: mknod d0/da/c59 0 2024-09-16T02:05:52.476 INFO:tasks.workunit.client.0.smithi110.stdout:1/274: rmdir d0/d1/d4/d46/d51 39 2024-09-16T02:05:52.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/275: dwrite d0/da/f36 [0,4194304] 0 2024-09-16T02:05:52.490 INFO:tasks.workunit.client.0.smithi110.stdout:6/271: dread d0/d2/dc/ff [0,4194304] 0 2024-09-16T02:05:52.492 INFO:tasks.workunit.client.0.smithi110.stdout:1/276: dwrite d0/d1/f53 [0,4194304] 0 2024-09-16T02:05:52.493 INFO:tasks.workunit.client.0.smithi110.stdout:6/272: symlink d0/d29/d2a/d2f/l4f 0 2024-09-16T02:05:52.494 INFO:tasks.workunit.client.0.smithi110.stdout:1/277: write d0/d1/d4/f26 [652165,82160] 0 2024-09-16T02:05:52.497 INFO:tasks.workunit.client.0.smithi110.stdout:1/278: mknod d0/d1/d2a/d32/c5a 0 2024-09-16T02:05:52.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/279: write d0/d1/f53 [325398,125941] 0 2024-09-16T02:05:52.499 INFO:tasks.workunit.client.0.smithi110.stdout:1/280: dread - d0/d1/d2a/f37 zero size 2024-09-16T02:05:52.500 INFO:tasks.workunit.client.1.smithi165.stdout:8/548: creat dd/d11/d14/fbc x:0 0 0 2024-09-16T02:05:52.501 INFO:tasks.workunit.client.0.smithi110.stdout:6/273: rmdir d0 39 2024-09-16T02:05:52.502 INFO:tasks.workunit.client.1.smithi165.stdout:2/586: truncate df/d10/d37/f3d 4109889 0 2024-09-16T02:05:52.502 INFO:tasks.workunit.client.0.smithi110.stdout:1/281: symlink d0/d1/d4/d46/d51/l5b 0 2024-09-16T02:05:52.503 INFO:tasks.workunit.client.0.smithi110.stdout:1/282: chown d0/da/l2e 2 1 2024-09-16T02:05:52.504 INFO:tasks.workunit.client.1.smithi165.stdout:1/532: write d1/d19/d24/d30/d72/f91 [158930,122950] 0 2024-09-16T02:05:52.504 INFO:tasks.workunit.client.1.smithi165.stdout:0/491: dread d0/f2e [0,4194304] 0 2024-09-16T02:05:52.505 INFO:tasks.workunit.client.1.smithi165.stdout:7/517: dwrite d0/f60 [0,4194304] 0 2024-09-16T02:05:52.506 INFO:tasks.workunit.client.1.smithi165.stdout:4/470: write d4/dc/d20/f27 [5122459,60363] 0 2024-09-16T02:05:52.506 INFO:tasks.workunit.client.1.smithi165.stdout:6/538: mknod d7/dc/d3b/d3a/d3d/d5d/d87/c8f 0 2024-09-16T02:05:52.510 INFO:tasks.workunit.client.1.smithi165.stdout:6/539: dread - d7/dc/d3b/f6f zero size 2024-09-16T02:05:52.512 INFO:tasks.workunit.client.0.smithi110.stdout:1/283: dwrite d0/d1/d2a/d32/f33 [4194304,4194304] 0 2024-09-16T02:05:52.513 INFO:tasks.workunit.client.1.smithi165.stdout:6/540: write d7/dc/f72 [785854,94225] 0 2024-09-16T02:05:52.513 INFO:tasks.workunit.client.1.smithi165.stdout:1/533: creat d1/d19/d24/d30/d72/faa x:0 0 0 2024-09-16T02:05:52.513 INFO:tasks.workunit.client.1.smithi165.stdout:2/587: dread df/d73/f7c [0,4194304] 0 2024-09-16T02:05:52.514 INFO:tasks.workunit.client.0.smithi110.stdout:1/284: dread - d0/f56 zero size 2024-09-16T02:05:52.515 INFO:tasks.workunit.client.0.smithi110.stdout:6/274: dwrite d0/d2/f4d [0,4194304] 0 2024-09-16T02:05:52.516 INFO:tasks.workunit.client.1.smithi165.stdout:5/526: getdents de/d21/d26/d3a 0 2024-09-16T02:05:52.519 INFO:tasks.workunit.client.1.smithi165.stdout:4/471: dwrite d4/dc/d20/d4e/f54 [0,4194304] 0 2024-09-16T02:05:52.522 INFO:tasks.workunit.client.1.smithi165.stdout:8/549: rename dd/d13/d53/f61 to dd/d11/fbd 0 2024-09-16T02:05:52.523 INFO:tasks.workunit.client.0.smithi110.stdout:1/285: rename d0/da/f28 to d0/da/f5c 0 2024-09-16T02:05:52.524 INFO:tasks.workunit.client.0.smithi110.stdout:6/275: symlink d0/d2/d5/d1e/l50 0 2024-09-16T02:05:52.526 INFO:tasks.workunit.client.0.smithi110.stdout:1/286: read d0/d1/d2a/d32/f41 [2998200,63979] 0 2024-09-16T02:05:52.527 INFO:tasks.workunit.client.1.smithi165.stdout:1/534: dwrite d1/d19/d24/d30/d72/f93 [0,4194304] 0 2024-09-16T02:05:52.527 INFO:tasks.workunit.client.1.smithi165.stdout:0/492: rmdir d0/d2a/d70/daa 0 2024-09-16T02:05:52.527 INFO:tasks.workunit.client.1.smithi165.stdout:0/493: readlink d0/d1e/d20/d28/l41 0 2024-09-16T02:05:52.528 INFO:tasks.workunit.client.1.smithi165.stdout:5/527: symlink de/d19/d67/d74/lb0 0 2024-09-16T02:05:52.529 INFO:tasks.workunit.client.0.smithi110.stdout:6/276: mknod d0/d29/d2a/d2d/c51 0 2024-09-16T02:05:52.531 INFO:tasks.workunit.client.0.smithi110.stdout:6/277: creat d0/d2/d5/f52 x:0 0 0 2024-09-16T02:05:52.531 INFO:tasks.workunit.client.1.smithi165.stdout:0/494: read - d0/d1e/d39/d48/d5f/d82/fa5 zero size 2024-09-16T02:05:52.531 INFO:tasks.workunit.client.1.smithi165.stdout:9/570: sync 2024-09-16T02:05:52.532 INFO:tasks.workunit.client.1.smithi165.stdout:4/472: creat d4/dc/d18/f9b x:0 0 0 2024-09-16T02:05:52.532 INFO:tasks.workunit.client.0.smithi110.stdout:1/287: creat d0/d1/d2a/f5d x:0 0 0 2024-09-16T02:05:52.538 INFO:tasks.workunit.client.0.smithi110.stdout:1/288: creat d0/d1/d4/d46/f5e x:0 0 0 2024-09-16T02:05:52.539 INFO:tasks.workunit.client.0.smithi110.stdout:1/289: dread - d0/da/f29 zero size 2024-09-16T02:05:52.543 INFO:tasks.workunit.client.1.smithi165.stdout:6/541: mkdir d7/dc/df/d1a/d4d/d90 0 2024-09-16T02:05:52.543 INFO:tasks.workunit.client.1.smithi165.stdout:4/473: stat d4/dc/d20/d4e/f54 0 2024-09-16T02:05:52.543 INFO:tasks.workunit.client.1.smithi165.stdout:2/588: mkdir df/d10/db4 0 2024-09-16T02:05:52.543 INFO:tasks.workunit.client.1.smithi165.stdout:1/535: creat d1/d19/d4d/fab x:0 0 0 2024-09-16T02:05:52.543 INFO:tasks.workunit.client.1.smithi165.stdout:6/542: write d7/dc/df/d1a/f47 [3557806,74493] 0 2024-09-16T02:05:52.545 INFO:tasks.workunit.client.1.smithi165.stdout:5/528: dread de/d21/d26/d3a/f91 [0,4194304] 0 2024-09-16T02:05:52.546 INFO:tasks.workunit.client.1.smithi165.stdout:6/543: readlink d7/dc/d3b/d3a/l61 0 2024-09-16T02:05:52.547 INFO:tasks.workunit.client.1.smithi165.stdout:7/518: rename d0/df/d33/l1f to d0/df/d42/l9b 0 2024-09-16T02:05:52.547 INFO:tasks.workunit.client.1.smithi165.stdout:4/474: truncate d4/dc/d28/f43 956327 0 2024-09-16T02:05:52.548 INFO:tasks.workunit.client.1.smithi165.stdout:6/544: readlink d7/dc/d3b/l52 0 2024-09-16T02:05:52.548 INFO:tasks.workunit.client.1.smithi165.stdout:9/571: dwrite d7/d32/d38/d53/d5c/d61/d97/fa3 [0,4194304] 0 2024-09-16T02:05:52.554 INFO:tasks.workunit.client.1.smithi165.stdout:2/589: dread df/d23/f38 [0,4194304] 0 2024-09-16T02:05:52.561 INFO:tasks.workunit.client.0.smithi110.stdout:8/190: sync 2024-09-16T02:05:52.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/151: sync 2024-09-16T02:05:52.562 INFO:tasks.workunit.client.1.smithi165.stdout:2/590: dwrite df/d23/f50 [0,4194304] 0 2024-09-16T02:05:52.563 INFO:tasks.workunit.client.1.smithi165.stdout:2/591: write df/d73/f9b [451347,82988] 0 2024-09-16T02:05:52.569 INFO:tasks.workunit.client.1.smithi165.stdout:1/536: mknod d1/d19/d24/d97/da5/cac 0 2024-09-16T02:05:52.571 INFO:tasks.workunit.client.1.smithi165.stdout:8/550: rename dd/d62/d94 to dd/d11/d14/d3f/db3/dbe 0 2024-09-16T02:05:52.572 INFO:tasks.workunit.client.1.smithi165.stdout:1/537: dread d1/f79 [0,4194304] 0 2024-09-16T02:05:52.573 INFO:tasks.workunit.client.0.smithi110.stdout:3/152: link d8/f9 d8/d29/f2d 0 2024-09-16T02:05:52.574 INFO:tasks.workunit.client.0.smithi110.stdout:3/153: read - d8/f2a zero size 2024-09-16T02:05:52.575 INFO:tasks.workunit.client.1.smithi165.stdout:9/572: symlink d7/df/d67/d92/lbe 0 2024-09-16T02:05:52.576 INFO:tasks.workunit.client.0.smithi110.stdout:6/278: getdents d0/d29/d2a/d2d 0 2024-09-16T02:05:52.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/154: creat d8/dc/d1b/d1c/f2e x:0 0 0 2024-09-16T02:05:52.580 INFO:tasks.workunit.client.0.smithi110.stdout:6/279: dread d0/d2/f4d [0,4194304] 0 2024-09-16T02:05:52.584 INFO:tasks.workunit.client.1.smithi165.stdout:5/529: mkdir de/d19/d1c/d49/da5/db1 0 2024-09-16T02:05:52.586 INFO:tasks.workunit.client.0.smithi110.stdout:6/280: creat d0/d29/f53 x:0 0 0 2024-09-16T02:05:52.586 INFO:tasks.workunit.client.1.smithi165.stdout:0/495: getdents d0/d1e/d20 0 2024-09-16T02:05:52.587 INFO:tasks.workunit.client.0.smithi110.stdout:6/281: read d0/d29/f3f [914463,115433] 0 2024-09-16T02:05:52.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/155: symlink d8/dc/l2f 0 2024-09-16T02:05:52.588 INFO:tasks.workunit.client.0.smithi110.stdout:6/282: write d0/f10 [321071,54853] 0 2024-09-16T02:05:52.590 INFO:tasks.workunit.client.0.smithi110.stdout:8/191: dread d3/d2b/f1e [0,4194304] 0 2024-09-16T02:05:52.591 INFO:tasks.workunit.client.1.smithi165.stdout:3/603: sync 2024-09-16T02:05:52.591 INFO:tasks.workunit.client.1.smithi165.stdout:9/573: dread d7/d32/d38/d53/d56/d95/f6a [0,4194304] 0 2024-09-16T02:05:52.593 INFO:tasks.workunit.client.1.smithi165.stdout:3/604: write da/d17/d78/d2c/d2d/d6c/fc8 [920067,82579] 0 2024-09-16T02:05:52.593 INFO:tasks.workunit.client.0.smithi110.stdout:3/156: unlink d8/f9 0 2024-09-16T02:05:52.594 INFO:tasks.workunit.client.0.smithi110.stdout:8/192: dread d3/d2b/f1e [0,4194304] 0 2024-09-16T02:05:52.598 INFO:tasks.workunit.client.1.smithi165.stdout:6/545: rename d7/dc/d3b/f64 to d7/dc/df/d1a/d4d/d5f/f91 0 2024-09-16T02:05:52.604 INFO:tasks.workunit.client.0.smithi110.stdout:3/157: creat d8/d29/f30 x:0 0 0 2024-09-16T02:05:52.605 INFO:tasks.workunit.client.0.smithi110.stdout:8/193: dwrite d3/d12/d1d/f1f [0,4194304] 0 2024-09-16T02:05:52.606 INFO:tasks.workunit.client.0.smithi110.stdout:3/158: write d8/dc/d1b/d1c/f2e [385318,85436] 0 2024-09-16T02:05:52.608 INFO:tasks.workunit.client.0.smithi110.stdout:8/194: write d3/d2b/d27/f2d [257409,66385] 0 2024-09-16T02:05:52.613 INFO:tasks.workunit.client.0.smithi110.stdout:8/195: stat d3/c5 0 2024-09-16T02:05:52.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/159: dwrite d8/f1d [0,4194304] 0 2024-09-16T02:05:52.617 INFO:tasks.workunit.client.1.smithi165.stdout:8/551: creat dd/d11/d38/da6/db0/fbf x:0 0 0 2024-09-16T02:05:52.618 INFO:tasks.workunit.client.1.smithi165.stdout:2/592: dwrite df/d23/d66/f7d [0,4194304] 0 2024-09-16T02:05:52.618 INFO:tasks.workunit.client.1.smithi165.stdout:2/593: readlink df/d23/d28/l3c 0 2024-09-16T02:05:52.618 INFO:tasks.workunit.client.1.smithi165.stdout:7/519: creat d0/df/d83/f9c x:0 0 0 2024-09-16T02:05:52.618 INFO:tasks.workunit.client.1.smithi165.stdout:3/605: mknod da/d20/d26/d8c/cda 0 2024-09-16T02:05:52.620 INFO:tasks.workunit.client.1.smithi165.stdout:5/530: write de/d21/d26/d3a/f3c [3754605,99954] 0 2024-09-16T02:05:52.620 INFO:tasks.workunit.client.0.smithi110.stdout:6/283: dwrite d0/d2/f25 [0,4194304] 0 2024-09-16T02:05:52.620 INFO:tasks.workunit.client.1.smithi165.stdout:0/496: symlink d0/d1e/d39/d48/d5f/d96/dac/lae 0 2024-09-16T02:05:52.626 INFO:tasks.workunit.client.1.smithi165.stdout:9/574: dwrite d7/df/d67/d92/d93/f98 [0,4194304] 0 2024-09-16T02:05:52.627 INFO:tasks.workunit.client.1.smithi165.stdout:8/552: fdatasync dd/f67 0 2024-09-16T02:05:52.630 INFO:tasks.workunit.client.0.smithi110.stdout:8/196: rmdir d3/d12/d1a/d38/d3b 0 2024-09-16T02:05:52.630 INFO:tasks.workunit.client.1.smithi165.stdout:0/497: dread d0/d1e/f24 [0,4194304] 0 2024-09-16T02:05:52.631 INFO:tasks.workunit.client.1.smithi165.stdout:4/475: sync 2024-09-16T02:05:52.633 INFO:tasks.workunit.client.1.smithi165.stdout:0/498: fsync d0/d1e/d39/f7c 0 2024-09-16T02:05:52.634 INFO:tasks.workunit.client.1.smithi165.stdout:1/538: link d1/d19/d24/l89 d1/dd/d11/d33/d3f/d47/lad 0 2024-09-16T02:05:52.634 INFO:tasks.workunit.client.1.smithi165.stdout:1/539: readlink d1/dd/d11/d46/l5b 0 2024-09-16T02:05:52.636 INFO:tasks.workunit.client.0.smithi110.stdout:3/160: creat d8/dc/d1b/f31 x:0 0 0 2024-09-16T02:05:52.639 INFO:tasks.workunit.client.0.smithi110.stdout:6/284: rmdir d0/d2/d18/d31 0 2024-09-16T02:05:52.640 INFO:tasks.workunit.client.1.smithi165.stdout:0/499: dread d0/d1e/d20/f7f [0,4194304] 0 2024-09-16T02:05:52.640 INFO:tasks.workunit.client.0.smithi110.stdout:6/285: chown d0/d29/d2a/d2f/l4f 653 1 2024-09-16T02:05:52.641 INFO:tasks.workunit.client.0.smithi110.stdout:3/161: fsync d8/f16 0 2024-09-16T02:05:52.644 INFO:tasks.workunit.client.1.smithi165.stdout:2/594: mknod df/d23/d28/cb5 0 2024-09-16T02:05:52.645 INFO:tasks.workunit.client.0.smithi110.stdout:8/197: link d3/d31/c32 d3/d12/d1a/d36/c42 0 2024-09-16T02:05:52.646 INFO:tasks.workunit.client.1.smithi165.stdout:5/531: dread de/d21/d26/d3a/f93 [4194304,4194304] 0 2024-09-16T02:05:52.646 INFO:tasks.workunit.client.1.smithi165.stdout:0/500: dread d0/d1e/d20/d28/f68 [0,4194304] 0 2024-09-16T02:05:52.649 INFO:tasks.workunit.client.1.smithi165.stdout:0/501: write d0/d1e/d39/d48/d74/f7b [2726485,53509] 0 2024-09-16T02:05:52.649 INFO:tasks.workunit.client.1.smithi165.stdout:5/532: truncate de/d19/d1c/d84/f88 1646358 0 2024-09-16T02:05:52.652 INFO:tasks.workunit.client.1.smithi165.stdout:2/595: dwrite df/d23/d66/f8d [0,4194304] 0 2024-09-16T02:05:52.652 INFO:tasks.workunit.client.0.smithi110.stdout:8/198: rename d3/c8 to d3/d12/c43 0 2024-09-16T02:05:52.653 INFO:tasks.workunit.client.0.smithi110.stdout:6/286: link d0/d2/dc/ff d0/d2/dc/f54 0 2024-09-16T02:05:52.654 INFO:tasks.workunit.client.0.smithi110.stdout:6/287: fdatasync d0/d29/d2a/f2b 0 2024-09-16T02:05:52.655 INFO:tasks.workunit.client.1.smithi165.stdout:9/575: dread d7/df/d67/f9e [0,4194304] 0 2024-09-16T02:05:52.655 INFO:tasks.workunit.client.0.smithi110.stdout:6/288: truncate d0/d2/f1c 4763057 0 2024-09-16T02:05:52.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/199: rmdir d3/d12/d1a/d38 0 2024-09-16T02:05:52.658 INFO:tasks.workunit.client.1.smithi165.stdout:4/476: dread d4/dc/fe [0,4194304] 0 2024-09-16T02:05:52.658 INFO:tasks.workunit.client.0.smithi110.stdout:8/200: readlink d3/d12/l20 0 2024-09-16T02:05:52.659 INFO:tasks.workunit.client.0.smithi110.stdout:8/201: write d3/d12/f2f [3852745,129988] 0 2024-09-16T02:05:52.660 INFO:tasks.workunit.client.0.smithi110.stdout:6/289: mkdir d0/d2/d5/d55 0 2024-09-16T02:05:52.666 INFO:tasks.workunit.client.0.smithi110.stdout:6/290: symlink d0/d2/dc/d16/l56 0 2024-09-16T02:05:52.668 INFO:tasks.workunit.client.1.smithi165.stdout:6/546: rename d7/dc/d3b/d3a/d3d/c8e to d7/dc/c92 0 2024-09-16T02:05:52.669 INFO:tasks.workunit.client.1.smithi165.stdout:0/502: truncate d0/d1e/d39/f49 214312 0 2024-09-16T02:05:52.669 INFO:tasks.workunit.client.0.smithi110.stdout:8/202: creat d3/f44 x:0 0 0 2024-09-16T02:05:52.670 INFO:tasks.workunit.client.1.smithi165.stdout:6/547: write d7/dc/d3b/d3a/f49 [842693,93519] 0 2024-09-16T02:05:52.671 INFO:tasks.workunit.client.1.smithi165.stdout:6/548: chown d7/c2c 7421802 1 2024-09-16T02:05:52.671 INFO:tasks.workunit.client.0.smithi110.stdout:6/291: mkdir d0/d2/d57 0 2024-09-16T02:05:52.672 INFO:tasks.workunit.client.1.smithi165.stdout:9/576: creat d7/d87/fbf x:0 0 0 2024-09-16T02:05:52.673 INFO:tasks.workunit.client.0.smithi110.stdout:8/203: unlink d3/d2b/d27/f39 0 2024-09-16T02:05:52.675 INFO:tasks.workunit.client.1.smithi165.stdout:6/549: dread d7/dc/f72 [0,4194304] 0 2024-09-16T02:05:52.676 INFO:tasks.workunit.client.0.smithi110.stdout:6/292: creat d0/d29/d2a/d2f/f58 x:0 0 0 2024-09-16T02:05:52.676 INFO:tasks.workunit.client.1.smithi165.stdout:4/477: rmdir d4/dc/d28/d2b 39 2024-09-16T02:05:52.677 INFO:tasks.workunit.client.1.smithi165.stdout:4/478: chown d4/dc/d18 2513 1 2024-09-16T02:05:52.677 INFO:tasks.workunit.client.1.smithi165.stdout:2/596: dwrite df/d23/d28/d9a/d86/fae [0,4194304] 0 2024-09-16T02:05:52.677 INFO:tasks.workunit.client.0.smithi110.stdout:8/204: mkdir d3/d2b/d27/d45 0 2024-09-16T02:05:52.677 INFO:tasks.workunit.client.0.smithi110.stdout:6/293: stat d0/d2/dc/f54 0 2024-09-16T02:05:52.681 INFO:tasks.workunit.client.0.smithi110.stdout:8/205: dread d3/d12/d1d/f1f [0,4194304] 0 2024-09-16T02:05:52.683 INFO:tasks.workunit.client.1.smithi165.stdout:9/577: symlink d7/d32/d38/d53/d56/d95/lc0 0 2024-09-16T02:05:52.684 INFO:tasks.workunit.client.1.smithi165.stdout:8/553: getdents dd/d11/d14/d3f/db3 0 2024-09-16T02:05:52.686 INFO:tasks.workunit.client.1.smithi165.stdout:7/520: rename d0/df/d33/c1c to d0/df/d33/c9d 0 2024-09-16T02:05:52.687 INFO:tasks.workunit.client.1.smithi165.stdout:4/479: chown d4/dc/d28/d2b/c50 6898 1 2024-09-16T02:05:52.688 INFO:tasks.workunit.client.1.smithi165.stdout:2/597: write df/d23/d28/d3b/f56 [4790966,39450] 0 2024-09-16T02:05:52.688 INFO:tasks.workunit.client.1.smithi165.stdout:5/533: link fa de/d60/fb2 0 2024-09-16T02:05:52.689 INFO:tasks.workunit.client.0.smithi110.stdout:8/206: dwrite d3/d2b/f1e [0,4194304] 0 2024-09-16T02:05:52.690 INFO:tasks.workunit.client.1.smithi165.stdout:8/554: dwrite dd/d13/f71 [0,4194304] 0 2024-09-16T02:05:52.694 INFO:tasks.workunit.client.0.smithi110.stdout:8/207: rename d3/d12/d1a/f23 to d3/d2b/d27/f46 0 2024-09-16T02:05:52.697 INFO:tasks.workunit.client.1.smithi165.stdout:6/550: symlink d7/dc/l93 0 2024-09-16T02:05:52.701 INFO:tasks.workunit.client.0.smithi110.stdout:8/208: dwrite d3/f44 [0,4194304] 0 2024-09-16T02:05:52.701 INFO:tasks.workunit.client.0.smithi110.stdout:6/294: write d0/d2/dc/ff [3758852,49403] 0 2024-09-16T02:05:52.702 INFO:tasks.workunit.client.1.smithi165.stdout:5/534: dwrite de/d19/d1c/d84/d92/fa7 [0,4194304] 0 2024-09-16T02:05:52.704 INFO:tasks.workunit.client.1.smithi165.stdout:3/606: rename da/d20/d26/d52/c63 to da/d17/d78/d2c/d2d/cdb 0 2024-09-16T02:05:52.707 INFO:tasks.workunit.client.0.smithi110.stdout:6/295: creat d0/d2/d18/f59 x:0 0 0 2024-09-16T02:05:52.709 INFO:tasks.workunit.client.0.smithi110.stdout:6/296: truncate d0/d2/f25 4593473 0 2024-09-16T02:05:52.709 INFO:tasks.workunit.client.1.smithi165.stdout:8/555: stat dd/c26 0 2024-09-16T02:05:52.709 INFO:tasks.workunit.client.1.smithi165.stdout:9/578: getdents d7/d1f/d54 0 2024-09-16T02:05:52.712 INFO:tasks.workunit.client.1.smithi165.stdout:2/598: symlink df/lb6 0 2024-09-16T02:05:52.715 INFO:tasks.workunit.client.1.smithi165.stdout:1/540: rename d1/d22/l4c to d1/dd/d11/d33/d3f/d6c/lae 0 2024-09-16T02:05:52.715 INFO:tasks.workunit.client.1.smithi165.stdout:0/503: getdents d0/d1e/d39/d48/d5f/d96/dac 0 2024-09-16T02:05:52.717 INFO:tasks.workunit.client.0.smithi110.stdout:6/297: dwrite d0/d2/d5/d1e/f44 [0,4194304] 0 2024-09-16T02:05:52.720 INFO:tasks.workunit.client.1.smithi165.stdout:2/599: symlink df/d23/d28/d87/lb7 0 2024-09-16T02:05:52.723 INFO:tasks.workunit.client.1.smithi165.stdout:0/504: mkdir d0/d1e/d20/d28/d6d/daf 0 2024-09-16T02:05:52.724 INFO:tasks.workunit.client.1.smithi165.stdout:0/505: write d0/d1e/d39/f6a [6658826,39969] 0 2024-09-16T02:05:52.725 INFO:tasks.workunit.client.1.smithi165.stdout:0/506: rename d0 to d0/d1e/d39/d48/d5f/d96/db0 22 2024-09-16T02:05:52.726 INFO:tasks.workunit.client.0.smithi110.stdout:6/298: dwrite d0/d2/d5/d1e/f40 [0,4194304] 0 2024-09-16T02:05:52.726 INFO:tasks.workunit.client.1.smithi165.stdout:0/507: write d0/d1e/d39/f6a [2394868,105737] 0 2024-09-16T02:05:52.727 INFO:tasks.workunit.client.1.smithi165.stdout:0/508: chown d0/d1e/d39/l92 84847 1 2024-09-16T02:05:52.728 INFO:tasks.workunit.client.0.smithi110.stdout:6/299: write d0/d2/d18/f46 [714269,130265] 0 2024-09-16T02:05:52.729 INFO:tasks.workunit.client.0.smithi110.stdout:6/300: dread - d0/d2/d18/f59 zero size 2024-09-16T02:05:52.730 INFO:tasks.workunit.client.1.smithi165.stdout:6/551: creat d7/dc/f94 x:0 0 0 2024-09-16T02:05:52.730 INFO:tasks.workunit.client.1.smithi165.stdout:4/480: getdents d4/dc/d20 0 2024-09-16T02:05:52.733 INFO:tasks.workunit.client.1.smithi165.stdout:3/607: creat da/d17/d78/d2c/d2d/fdc x:0 0 0 2024-09-16T02:05:52.734 INFO:tasks.workunit.client.1.smithi165.stdout:3/608: stat da/d17/f4a 0 2024-09-16T02:05:52.735 INFO:tasks.workunit.client.1.smithi165.stdout:3/609: write da/d17/d78/d2c/d2d/d6c/f5a [897456,38757] 0 2024-09-16T02:05:52.737 INFO:tasks.workunit.client.0.smithi110.stdout:6/301: mknod d0/d29/d2a/d2f/d49/c5a 0 2024-09-16T02:05:52.740 INFO:tasks.workunit.client.1.smithi165.stdout:7/521: truncate d0/f60 3564991 0 2024-09-16T02:05:52.740 INFO:tasks.workunit.client.0.smithi110.stdout:6/302: truncate d0/d2/d5/f4e 552588 0 2024-09-16T02:05:52.740 INFO:tasks.workunit.client.0.smithi110.stdout:6/303: fdatasync d0/d2/f42 0 2024-09-16T02:05:52.741 INFO:tasks.workunit.client.0.smithi110.stdout:6/304: fsync d0/d2/dc/f54 0 2024-09-16T02:05:52.741 INFO:tasks.workunit.client.1.smithi165.stdout:6/552: symlink d7/dc/d3b/d3a/d3d/d5d/d73/l95 0 2024-09-16T02:05:52.741 INFO:tasks.workunit.client.1.smithi165.stdout:7/522: truncate d0/d2c/f8d 913472 0 2024-09-16T02:05:52.744 INFO:tasks.workunit.client.1.smithi165.stdout:6/553: dread - d7/d17/d75/f7d zero size 2024-09-16T02:05:52.744 INFO:tasks.workunit.client.1.smithi165.stdout:3/610: dwrite da/d17/d78/d2c/d2d/d6c/db5/fbb [4194304,4194304] 0 2024-09-16T02:05:52.745 INFO:tasks.workunit.client.1.smithi165.stdout:1/541: dread d1/dd/d11/f15 [0,4194304] 0 2024-09-16T02:05:52.762 INFO:tasks.workunit.client.0.smithi110.stdout:6/305: truncate d0/d2/dc/d16/f3b 3511399 0 2024-09-16T02:05:52.764 INFO:tasks.workunit.client.0.smithi110.stdout:6/306: mknod d0/d29/d2a/d2f/c5b 0 2024-09-16T02:05:52.765 INFO:tasks.workunit.client.0.smithi110.stdout:6/307: symlink d0/d2/d5/l5c 0 2024-09-16T02:05:52.766 INFO:tasks.workunit.client.0.smithi110.stdout:6/308: creat d0/d2/dc/f5d x:0 0 0 2024-09-16T02:05:52.767 INFO:tasks.workunit.client.1.smithi165.stdout:6/554: write d7/dc/d3b/d3a/f78 [483253,124672] 0 2024-09-16T02:05:52.768 INFO:tasks.workunit.client.1.smithi165.stdout:0/509: truncate d0/f15 368729 0 2024-09-16T02:05:52.768 INFO:tasks.workunit.client.0.smithi110.stdout:6/309: mknod d0/d29/d2a/d2f/d34/c5e 0 2024-09-16T02:05:52.770 INFO:tasks.workunit.client.0.smithi110.stdout:6/310: creat d0/d29/d2a/d2f/f5f x:0 0 0 2024-09-16T02:05:52.773 INFO:tasks.workunit.client.1.smithi165.stdout:5/535: dwrite f7 [4194304,4194304] 0 2024-09-16T02:05:52.774 INFO:tasks.workunit.client.1.smithi165.stdout:4/481: creat d4/dc/d28/d2b/d42/d99/f9c x:0 0 0 2024-09-16T02:05:52.774 INFO:tasks.workunit.client.1.smithi165.stdout:0/510: fsync d0/d1e/d39/f7c 0 2024-09-16T02:05:52.776 INFO:tasks.workunit.client.1.smithi165.stdout:8/556: dwrite dd/f67 [0,4194304] 0 2024-09-16T02:05:52.778 INFO:tasks.workunit.client.1.smithi165.stdout:6/555: fsync d7/d17/d75/f77 0 2024-09-16T02:05:52.782 INFO:tasks.workunit.client.1.smithi165.stdout:9/579: dwrite d7/f22 [0,4194304] 0 2024-09-16T02:05:52.783 INFO:tasks.workunit.client.1.smithi165.stdout:3/611: mknod da/d17/d78/d2c/d2d/d6c/db5/cdd 0 2024-09-16T02:05:52.785 INFO:tasks.workunit.client.1.smithi165.stdout:0/511: mknod d0/d2a/cb1 0 2024-09-16T02:05:52.786 INFO:tasks.workunit.client.1.smithi165.stdout:6/556: write d7/d1f/f8c [1031415,31608] 0 2024-09-16T02:05:52.787 INFO:tasks.workunit.client.1.smithi165.stdout:4/482: symlink d4/d40/l9d 0 2024-09-16T02:05:52.787 INFO:tasks.workunit.client.1.smithi165.stdout:3/612: stat da/d17/d7a/l94 0 2024-09-16T02:05:52.788 INFO:tasks.workunit.client.1.smithi165.stdout:1/542: dwrite d1/d22/f2c [4194304,4194304] 0 2024-09-16T02:05:52.788 INFO:tasks.workunit.client.1.smithi165.stdout:2/600: dwrite df/d10/d1a/d2d/f58 [0,4194304] 0 2024-09-16T02:05:52.789 INFO:tasks.workunit.client.1.smithi165.stdout:8/557: rename dd/d11/d38/f4b to dd/d62/fc0 0 2024-09-16T02:05:52.796 INFO:tasks.workunit.client.1.smithi165.stdout:9/580: symlink d7/d32/d38/d68/d7f/lc1 0 2024-09-16T02:05:52.797 INFO:tasks.workunit.client.1.smithi165.stdout:8/558: rename dd/d11/d14/d3f to dd/d11/d14/d3f/db3/dbe/dc1 22 2024-09-16T02:05:52.797 INFO:tasks.workunit.client.1.smithi165.stdout:3/613: mknod da/d17/d7a/dab/cde 0 2024-09-16T02:05:52.799 INFO:tasks.workunit.client.1.smithi165.stdout:6/557: mknod d7/c96 0 2024-09-16T02:05:52.804 INFO:tasks.workunit.client.1.smithi165.stdout:2/601: mknod df/d10/d1a/d68/cb8 0 2024-09-16T02:05:52.804 INFO:tasks.workunit.client.1.smithi165.stdout:5/536: dwrite de/d19/d1c/d84/d92/fa7 [0,4194304] 0 2024-09-16T02:05:52.804 INFO:tasks.workunit.client.1.smithi165.stdout:1/543: dread d1/dd/d11/d33/d3f/d59/f90 [0,4194304] 0 2024-09-16T02:05:52.804 INFO:tasks.workunit.client.1.smithi165.stdout:8/559: chown dd/d11/d38/da6/db0/fbf 14782701 1 2024-09-16T02:05:52.806 INFO:tasks.workunit.client.1.smithi165.stdout:5/537: write de/d21/f8b [1090765,67799] 0 2024-09-16T02:05:52.807 INFO:tasks.workunit.client.1.smithi165.stdout:0/512: dwrite d0/d1e/d39/d48/d45/f95 [0,4194304] 0 2024-09-16T02:05:52.808 INFO:tasks.workunit.client.1.smithi165.stdout:0/513: chown d0/d1e/d39/f6c 405194 1 2024-09-16T02:05:52.813 INFO:tasks.workunit.client.1.smithi165.stdout:1/544: dwrite d1/f3a [0,4194304] 0 2024-09-16T02:05:52.815 INFO:tasks.workunit.client.1.smithi165.stdout:1/545: dread - d1/d19/d4d/fab zero size 2024-09-16T02:05:52.815 INFO:tasks.workunit.client.1.smithi165.stdout:3/614: rmdir da/d17/d78/d2c/d2d/d6c/db5 39 2024-09-16T02:05:52.816 INFO:tasks.workunit.client.1.smithi165.stdout:6/558: mkdir d7/d17/d75/d97 0 2024-09-16T02:05:52.817 INFO:tasks.workunit.client.1.smithi165.stdout:1/546: read d1/d19/d24/d30/d72/f93 [3146580,114874] 0 2024-09-16T02:05:52.817 INFO:tasks.workunit.client.0.smithi110.stdout:6/311: dwrite d0/f47 [0,4194304] 0 2024-09-16T02:05:52.819 INFO:tasks.workunit.client.0.smithi110.stdout:6/312: dread - d0/d2/d18/d1d/f3d zero size 2024-09-16T02:05:52.858 INFO:tasks.workunit.client.1.smithi165.stdout:7/523: sync 2024-09-16T02:05:52.880 INFO:tasks.workunit.client.1.smithi165.stdout:0/514: mkdir d0/d1e/d20/db2 0 2024-09-16T02:05:52.883 INFO:tasks.workunit.client.1.smithi165.stdout:5/538: dread fa [0,4194304] 0 2024-09-16T02:05:52.883 INFO:tasks.workunit.client.1.smithi165.stdout:1/547: creat d1/dd/d11/d42/faf x:0 0 0 2024-09-16T02:05:52.884 INFO:tasks.workunit.client.0.smithi110.stdout:6/313: symlink d0/d2/d5/d1e/d48/l60 0 2024-09-16T02:05:52.885 INFO:tasks.workunit.client.1.smithi165.stdout:3/615: creat da/d20/d26/d52/d9c/da6/fdf x:0 0 0 2024-09-16T02:05:52.885 INFO:tasks.workunit.client.1.smithi165.stdout:1/548: chown d1/d68/l99 82715575 1 2024-09-16T02:05:52.885 INFO:tasks.workunit.client.1.smithi165.stdout:7/524: fsync d0/df/f27 0 2024-09-16T02:05:52.887 INFO:tasks.workunit.client.1.smithi165.stdout:0/515: mkdir d0/d1e/d39/d48/d45/db3 0 2024-09-16T02:05:52.888 INFO:tasks.workunit.client.1.smithi165.stdout:8/560: write dd/d11/f47 [491115,107112] 0 2024-09-16T02:05:52.888 INFO:tasks.workunit.client.1.smithi165.stdout:9/581: dwrite d7/d32/d38/f73 [0,4194304] 0 2024-09-16T02:05:52.888 INFO:tasks.workunit.client.1.smithi165.stdout:7/525: chown d0/f3 4538800 1 2024-09-16T02:05:52.889 INFO:tasks.workunit.client.1.smithi165.stdout:5/539: truncate de/d21/d26/d3a/d6d/d95/fae 21374 0 2024-09-16T02:05:52.891 INFO:tasks.workunit.client.1.smithi165.stdout:8/561: chown dd/d34/fb4 14102 1 2024-09-16T02:05:52.892 INFO:tasks.workunit.client.1.smithi165.stdout:1/549: symlink d1/dd/d11/d33/d3f/d7e/lb0 0 2024-09-16T02:05:52.892 INFO:tasks.workunit.client.1.smithi165.stdout:5/540: chown de/d21/d51/f5f 12 1 2024-09-16T02:05:52.893 INFO:tasks.workunit.client.1.smithi165.stdout:0/516: write d0/ff [6491307,91361] 0 2024-09-16T02:05:52.894 INFO:tasks.workunit.client.1.smithi165.stdout:9/582: creat d7/d32/d85/d8a/fc2 x:0 0 0 2024-09-16T02:05:52.896 INFO:tasks.workunit.client.0.smithi110.stdout:6/314: rename d0/d2/f23 to d0/d2/dc/d16/f61 0 2024-09-16T02:05:52.897 INFO:tasks.workunit.client.1.smithi165.stdout:3/616: dwrite da/d17/d78/d2c/d2d/fbf [0,4194304] 0 2024-09-16T02:05:52.898 INFO:tasks.workunit.client.1.smithi165.stdout:3/617: chown da/d17/d7a/d7d 16149051 1 2024-09-16T02:05:52.899 INFO:tasks.workunit.client.1.smithi165.stdout:3/618: fdatasync da/d20/f3d 0 2024-09-16T02:05:52.899 INFO:tasks.workunit.client.1.smithi165.stdout:4/483: sync 2024-09-16T02:05:52.900 INFO:tasks.workunit.client.1.smithi165.stdout:8/562: symlink dd/d9e/lc2 0 2024-09-16T02:05:52.902 INFO:tasks.workunit.client.1.smithi165.stdout:3/619: dread - da/d17/d78/d2c/db7/fc1 zero size 2024-09-16T02:05:52.903 INFO:tasks.workunit.client.1.smithi165.stdout:4/484: dread - d4/dc/d18/d37/d53/d64/d8b/d71/f9a zero size 2024-09-16T02:05:52.903 INFO:tasks.workunit.client.1.smithi165.stdout:8/563: write dd/d11/d14/d3f/db3/dbe/f88 [517615,100078] 0 2024-09-16T02:05:52.905 INFO:tasks.workunit.client.1.smithi165.stdout:5/541: dwrite de/d21/d26/d3a/f91 [0,4194304] 0 2024-09-16T02:05:52.913 INFO:tasks.workunit.client.0.smithi110.stdout:6/315: dwrite d0/d2/dc/d16/f3b [0,4194304] 0 2024-09-16T02:05:52.924 INFO:tasks.workunit.client.0.smithi110.stdout:6/316: truncate d0/d2/f12 1867924 0 2024-09-16T02:05:52.926 INFO:tasks.workunit.client.0.smithi110.stdout:6/317: write d0/d2/dc/ff [4711632,115536] 0 2024-09-16T02:05:52.928 INFO:tasks.workunit.client.0.smithi110.stdout:6/318: fsync d0/d2/f14 0 2024-09-16T02:05:52.930 INFO:tasks.workunit.client.0.smithi110.stdout:6/319: truncate d0/d2/dc/d16/f13 1077838 0 2024-09-16T02:05:52.931 INFO:tasks.workunit.client.0.smithi110.stdout:6/320: mkdir d0/d2/dc/d62 0 2024-09-16T02:05:52.932 INFO:tasks.workunit.client.0.smithi110.stdout:6/321: write d0/d2/d5/f4e [1445215,76851] 0 2024-09-16T02:05:52.938 INFO:tasks.workunit.client.0.smithi110.stdout:6/322: dwrite d0/d2/dc/d16/f3b [0,4194304] 0 2024-09-16T02:05:52.941 INFO:tasks.workunit.client.0.smithi110.stdout:6/323: mknod d0/d29/d2a/d2f/d49/c63 0 2024-09-16T02:05:52.943 INFO:tasks.workunit.client.1.smithi165.stdout:4/485: symlink d4/dc/d18/d37/l9e 0 2024-09-16T02:05:52.944 INFO:tasks.workunit.client.1.smithi165.stdout:9/583: truncate d7/f35 408627 0 2024-09-16T02:05:52.945 INFO:tasks.workunit.client.1.smithi165.stdout:7/526: dread d0/f41 [0,4194304] 0 2024-09-16T02:05:52.947 INFO:tasks.workunit.client.1.smithi165.stdout:4/486: mknod d4/dc/d18/d37/d53/c9f 0 2024-09-16T02:05:52.948 INFO:tasks.workunit.client.1.smithi165.stdout:9/584: rmdir d7/d1f/d27/d49 39 2024-09-16T02:05:52.949 INFO:tasks.workunit.client.0.smithi110.stdout:6/324: dwrite d0/d29/f32 [0,4194304] 0 2024-09-16T02:05:52.952 INFO:tasks.workunit.client.1.smithi165.stdout:4/487: write d4/dc/d28/f4a [3128971,37464] 0 2024-09-16T02:05:52.954 INFO:tasks.workunit.client.1.smithi165.stdout:7/527: rmdir d0/df/d33/d2a 39 2024-09-16T02:05:52.956 INFO:tasks.workunit.client.1.smithi165.stdout:9/585: dread d7/df/f10 [0,4194304] 0 2024-09-16T02:05:52.956 INFO:tasks.workunit.client.1.smithi165.stdout:9/586: readlink d7/df/l94 0 2024-09-16T02:05:52.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/488: mkdir d4/dc/d18/d37/d53/d64/da0 0 2024-09-16T02:05:52.959 INFO:tasks.workunit.client.0.smithi110.stdout:6/325: getdents d0/d2/d5 0 2024-09-16T02:05:52.959 INFO:tasks.workunit.client.1.smithi165.stdout:4/489: read d4/dc/d20/d4e/f54 [2777360,18311] 0 2024-09-16T02:05:52.961 INFO:tasks.workunit.client.1.smithi165.stdout:4/490: fsync d4/dc/d28/d2b/d42/f87 0 2024-09-16T02:05:52.962 INFO:tasks.workunit.client.0.smithi110.stdout:6/326: rmdir d0 39 2024-09-16T02:05:52.962 INFO:tasks.workunit.client.1.smithi165.stdout:8/564: dread dd/d34/fb4 [0,4194304] 0 2024-09-16T02:05:52.962 INFO:tasks.workunit.client.1.smithi165.stdout:7/528: rename d0/f59 to d0/d4b/d63/f9e 0 2024-09-16T02:05:52.963 INFO:tasks.workunit.client.1.smithi165.stdout:9/587: creat d7/d32/d38/d58/fc3 x:0 0 0 2024-09-16T02:05:52.963 INFO:tasks.workunit.client.1.smithi165.stdout:9/588: stat d7/c13 0 2024-09-16T02:05:52.963 INFO:tasks.workunit.client.0.smithi110.stdout:6/327: stat d0/d2/d18/d1d/f3d 0 2024-09-16T02:05:52.964 INFO:tasks.workunit.client.1.smithi165.stdout:9/589: read d7/df/d67/f9e [568352,16508] 0 2024-09-16T02:05:52.968 INFO:tasks.workunit.client.1.smithi165.stdout:7/529: mkdir d0/d3d/d9f 0 2024-09-16T02:05:52.969 INFO:tasks.workunit.client.1.smithi165.stdout:5/542: dread de/d19/d1c/f56 [0,4194304] 0 2024-09-16T02:05:52.971 INFO:tasks.workunit.client.0.smithi110.stdout:6/328: getdents d0/d2/d5 0 2024-09-16T02:05:52.972 INFO:tasks.workunit.client.1.smithi165.stdout:7/530: chown d0/df/d33/d2a/c45 364123 1 2024-09-16T02:05:52.973 INFO:tasks.workunit.client.1.smithi165.stdout:8/565: dwrite dd/d11/fbd [4194304,4194304] 0 2024-09-16T02:05:52.973 INFO:tasks.workunit.client.1.smithi165.stdout:9/590: link d7/df/d67/d92/d93/fa0 d7/d1f/d54/fc4 0 2024-09-16T02:05:52.973 INFO:tasks.workunit.client.0.smithi110.stdout:6/329: write d0/d2/f3a [160630,87292] 0 2024-09-16T02:05:52.974 INFO:tasks.workunit.client.1.smithi165.stdout:6/559: sync 2024-09-16T02:05:52.974 INFO:tasks.workunit.client.1.smithi165.stdout:2/602: sync 2024-09-16T02:05:52.975 INFO:tasks.workunit.client.1.smithi165.stdout:2/603: chown df/d23/d28/d3b/d6d/l75 1 1 2024-09-16T02:05:52.977 INFO:tasks.workunit.client.0.smithi110.stdout:6/330: rmdir d0/d2/d5/d1e/d48 39 2024-09-16T02:05:52.978 INFO:tasks.workunit.client.0.smithi110.stdout:6/331: stat d0/d2/f42 0 2024-09-16T02:05:52.981 INFO:tasks.workunit.client.1.smithi165.stdout:7/531: mknod d0/df/d7/d67/ca0 0 2024-09-16T02:05:52.981 INFO:tasks.workunit.client.1.smithi165.stdout:7/532: chown d0/df/d7/l2f 7294999 1 2024-09-16T02:05:52.982 INFO:tasks.workunit.client.0.smithi110.stdout:6/332: creat d0/d29/d2a/d2f/d34/f64 x:0 0 0 2024-09-16T02:05:52.983 INFO:tasks.workunit.client.1.smithi165.stdout:4/491: write d4/dc/d18/d37/d53/d64/d8b/f61 [75970,67151] 0 2024-09-16T02:05:52.983 INFO:tasks.workunit.client.1.smithi165.stdout:7/533: write d0/d2c/f7c [292984,5120] 0 2024-09-16T02:05:52.983 INFO:tasks.workunit.client.1.smithi165.stdout:7/534: chown d0/d3d 21936 1 2024-09-16T02:05:52.983 INFO:tasks.workunit.client.0.smithi110.stdout:6/333: read d0/d2/f14 [7687863,22700] 0 2024-09-16T02:05:52.991 INFO:tasks.workunit.client.0.smithi110.stdout:6/334: dwrite d0/d2/dc/f54 [0,4194304] 0 2024-09-16T02:05:52.992 INFO:tasks.workunit.client.1.smithi165.stdout:9/591: write d7/d14/f89 [920633,94766] 0 2024-09-16T02:05:52.996 INFO:tasks.workunit.client.1.smithi165.stdout:8/566: creat dd/d11/d14/d3f/d25/d36/d85/fc3 x:0 0 0 2024-09-16T02:05:52.997 INFO:tasks.workunit.client.1.smithi165.stdout:6/560: creat d7/dc/d3b/d86/f98 x:0 0 0 2024-09-16T02:05:52.997 INFO:tasks.workunit.client.1.smithi165.stdout:5/543: getdents de/d21/d26/d98 0 2024-09-16T02:05:52.998 INFO:tasks.workunit.client.1.smithi165.stdout:4/492: unlink f2 0 2024-09-16T02:05:52.999 INFO:tasks.workunit.client.1.smithi165.stdout:7/535: rename d0/df/d65/l9a to d0/df/d68/la1 0 2024-09-16T02:05:52.999 INFO:tasks.workunit.client.1.smithi165.stdout:9/592: dread d7/d1f/d27/f3c [0,4194304] 0 2024-09-16T02:05:53.000 INFO:tasks.workunit.client.1.smithi165.stdout:2/604: mkdir df/d10/d1a/d68/db9 0 2024-09-16T02:05:53.000 INFO:tasks.workunit.client.1.smithi165.stdout:2/605: readlink df/l7b 0 2024-09-16T02:05:53.001 INFO:tasks.workunit.client.1.smithi165.stdout:9/593: chown d7/df/d37/f3b 1703765 1 2024-09-16T02:05:53.002 INFO:tasks.workunit.client.1.smithi165.stdout:5/544: symlink de/d19/d1c/d84/lb3 0 2024-09-16T02:05:53.005 INFO:tasks.workunit.client.1.smithi165.stdout:5/545: fsync de/d19/f25 0 2024-09-16T02:05:53.006 INFO:tasks.workunit.client.1.smithi165.stdout:9/594: mkdir d7/d32/d4a/dc5 0 2024-09-16T02:05:53.008 INFO:tasks.workunit.client.1.smithi165.stdout:1/550: sync 2024-09-16T02:05:53.010 INFO:tasks.workunit.client.1.smithi165.stdout:7/536: link d0/df/d33/c64 d0/df/d33/ca2 0 2024-09-16T02:05:53.011 INFO:tasks.workunit.client.1.smithi165.stdout:9/595: creat d7/df/d67/d92/fc6 x:0 0 0 2024-09-16T02:05:53.011 INFO:tasks.workunit.client.1.smithi165.stdout:4/493: dwrite d4/dc/d20/d45/f97 [0,4194304] 0 2024-09-16T02:05:53.015 INFO:tasks.workunit.client.1.smithi165.stdout:1/551: creat d1/dd/d11/d33/fb1 x:0 0 0 2024-09-16T02:05:53.017 INFO:tasks.workunit.client.1.smithi165.stdout:2/606: dwrite df/d10/f9f [0,4194304] 0 2024-09-16T02:05:53.020 INFO:tasks.workunit.client.1.smithi165.stdout:2/607: chown df/l6c 427215 1 2024-09-16T02:05:53.020 INFO:tasks.workunit.client.1.smithi165.stdout:7/537: creat d0/df/d42/fa3 x:0 0 0 2024-09-16T02:05:53.023 INFO:tasks.workunit.client.1.smithi165.stdout:1/552: read d1/dd/d11/d33/f56 [777878,74958] 0 2024-09-16T02:05:53.023 INFO:tasks.workunit.client.1.smithi165.stdout:5/546: dwrite de/d19/d1c/f4f [0,4194304] 0 2024-09-16T02:05:53.024 INFO:tasks.workunit.client.1.smithi165.stdout:7/538: chown d0/d2c/l30 434 1 2024-09-16T02:05:53.024 INFO:tasks.workunit.client.1.smithi165.stdout:4/494: link d4/dc/d18/d37/l4d d4/dc/d28/d2b/la1 0 2024-09-16T02:05:53.026 INFO:tasks.workunit.client.1.smithi165.stdout:9/596: getdents d7/d32/d38/d53/d5c/d61/d97 0 2024-09-16T02:05:53.027 INFO:tasks.workunit.client.1.smithi165.stdout:5/547: chown de/d19/l2c 181 1 2024-09-16T02:05:53.029 INFO:tasks.workunit.client.1.smithi165.stdout:8/567: dread dd/d11/f30 [0,4194304] 0 2024-09-16T02:05:53.029 INFO:tasks.workunit.client.1.smithi165.stdout:4/495: chown d4/dc/d28/d3b/l81 0 1 2024-09-16T02:05:53.030 INFO:tasks.workunit.client.1.smithi165.stdout:6/561: dread d7/dc/df/d1a/d4d/d5f/f6e [0,4194304] 0 2024-09-16T02:05:53.031 INFO:tasks.workunit.client.0.smithi110.stdout:4/215: sync 2024-09-16T02:05:53.031 INFO:tasks.workunit.client.1.smithi165.stdout:9/597: write d7/df/d67/f9e [4434256,32781] 0 2024-09-16T02:05:53.033 INFO:tasks.workunit.client.1.smithi165.stdout:1/553: creat d1/dd/d11/d46/d57/fb2 x:0 0 0 2024-09-16T02:05:53.034 INFO:tasks.workunit.client.1.smithi165.stdout:7/539: mknod d0/df/d33/d2a/ca4 0 2024-09-16T02:05:53.034 INFO:tasks.workunit.client.1.smithi165.stdout:8/568: write dd/d11/d14/d3f/f6a [2674618,11435] 0 2024-09-16T02:05:53.035 INFO:tasks.workunit.client.1.smithi165.stdout:5/548: creat de/d21/d51/fb4 x:0 0 0 2024-09-16T02:05:53.035 INFO:tasks.workunit.client.1.smithi165.stdout:2/608: dread df/f16 [0,4194304] 0 2024-09-16T02:05:53.035 INFO:tasks.workunit.client.1.smithi165.stdout:6/562: fsync d7/dc/d3b/f6f 0 2024-09-16T02:05:53.035 INFO:tasks.workunit.client.0.smithi110.stdout:4/216: unlink d4/d8/d17/d23/c2e 0 2024-09-16T02:05:53.036 INFO:tasks.workunit.client.1.smithi165.stdout:6/563: chown d7/dc/df/d1a/f4f 119060 1 2024-09-16T02:05:53.037 INFO:tasks.workunit.client.1.smithi165.stdout:4/496: symlink d4/dc/d28/d2b/d42/la2 0 2024-09-16T02:05:53.037 INFO:tasks.workunit.client.1.smithi165.stdout:4/497: write d4/f1e [5516997,61544] 0 2024-09-16T02:05:53.039 INFO:tasks.workunit.client.0.smithi110.stdout:4/217: chown d4/d8/c30 57762499 1 2024-09-16T02:05:53.043 INFO:tasks.workunit.client.0.smithi110.stdout:4/218: mknod d4/d8/d31/c41 0 2024-09-16T02:05:53.046 INFO:tasks.workunit.client.1.smithi165.stdout:8/569: write dd/d13/f65 [4715293,12703] 0 2024-09-16T02:05:53.047 INFO:tasks.workunit.client.0.smithi110.stdout:4/219: creat d4/d8/d17/d23/d35/f42 x:0 0 0 2024-09-16T02:05:53.047 INFO:tasks.workunit.client.1.smithi165.stdout:0/517: sync 2024-09-16T02:05:53.048 INFO:tasks.workunit.client.1.smithi165.stdout:3/620: sync 2024-09-16T02:05:53.048 INFO:tasks.workunit.client.1.smithi165.stdout:6/564: rmdir d7/d1f 39 2024-09-16T02:05:53.050 INFO:tasks.workunit.client.1.smithi165.stdout:5/549: dwrite de/f5b [0,4194304] 0 2024-09-16T02:05:53.051 INFO:tasks.workunit.client.1.smithi165.stdout:1/554: fsync d1/f39 0 2024-09-16T02:05:53.053 INFO:tasks.workunit.client.1.smithi165.stdout:1/555: chown d1/d19/d24/d97/da5/cac 0 1 2024-09-16T02:05:53.054 INFO:tasks.workunit.client.1.smithi165.stdout:7/540: rmdir d0/df/d83/d84 39 2024-09-16T02:05:53.055 INFO:tasks.workunit.client.1.smithi165.stdout:1/556: write d1/dd/d11/d33/d67/fa8 [276980,124028] 0 2024-09-16T02:05:53.059 INFO:tasks.workunit.client.1.smithi165.stdout:4/498: dread d4/dc/d28/d2b/d42/f69 [0,4194304] 0 2024-09-16T02:05:53.063 INFO:tasks.workunit.client.1.smithi165.stdout:7/541: dwrite d0/d4b/d63/f8f [0,4194304] 0 2024-09-16T02:05:53.065 INFO:tasks.workunit.client.1.smithi165.stdout:1/557: mkdir d1/dd/d11/d33/d3f/d47/d7d/db3 0 2024-09-16T02:05:53.065 INFO:tasks.workunit.client.1.smithi165.stdout:2/609: rename df/f16 to df/fba 0 2024-09-16T02:05:53.066 INFO:tasks.workunit.client.1.smithi165.stdout:1/558: dread - d1/d19/d24/d30/d72/faa zero size 2024-09-16T02:05:53.067 INFO:tasks.workunit.client.1.smithi165.stdout:9/598: rename d7/d14/l20 to d7/d32/d38/d68/lc7 0 2024-09-16T02:05:53.070 INFO:tasks.workunit.client.1.smithi165.stdout:8/570: truncate dd/d13/d53/fba 2665002 0 2024-09-16T02:05:53.072 INFO:tasks.workunit.client.1.smithi165.stdout:4/499: creat d4/dc/d18/fa3 x:0 0 0 2024-09-16T02:05:53.072 INFO:tasks.workunit.client.1.smithi165.stdout:1/559: fsync d1/dd/d11/d33/fb1 0 2024-09-16T02:05:53.072 INFO:tasks.workunit.client.1.smithi165.stdout:5/550: dread de/d21/d26/d3a/d54/f79 [0,4194304] 0 2024-09-16T02:05:53.073 INFO:tasks.workunit.client.1.smithi165.stdout:7/542: dread - d0/df/d33/f34 zero size 2024-09-16T02:05:53.074 INFO:tasks.workunit.client.1.smithi165.stdout:4/500: write d4/dc/f19 [1808602,112968] 0 2024-09-16T02:05:53.074 INFO:tasks.workunit.client.1.smithi165.stdout:3/621: rename da/d20/d26/f9a to da/d20/d26/d52/fe0 0 2024-09-16T02:05:53.075 INFO:tasks.workunit.client.1.smithi165.stdout:1/560: write d1/dd/d11/d42/faf [631511,71015] 0 2024-09-16T02:05:53.076 INFO:tasks.workunit.client.1.smithi165.stdout:5/551: write de/d19/d1c/d84/d92/fa7 [4538825,22946] 0 2024-09-16T02:05:53.078 INFO:tasks.workunit.client.1.smithi165.stdout:9/599: creat d7/d14/d7a/fc8 x:0 0 0 2024-09-16T02:05:53.079 INFO:tasks.workunit.client.1.smithi165.stdout:6/565: creat d7/dc/f99 x:0 0 0 2024-09-16T02:05:53.084 INFO:tasks.workunit.client.1.smithi165.stdout:3/622: unlink da/d20/d26/d52/d9c/ld5 0 2024-09-16T02:05:53.084 INFO:tasks.workunit.client.0.smithi110.stdout:4/220: write d4/d12/d18/f27 [3944500,118342] 0 2024-09-16T02:05:53.085 INFO:tasks.workunit.client.1.smithi165.stdout:1/561: dwrite d1/d32/f34 [0,4194304] 0 2024-09-16T02:05:53.085 INFO:tasks.workunit.client.1.smithi165.stdout:3/623: fsync da/d57/f7c 0 2024-09-16T02:05:53.085 INFO:tasks.workunit.client.1.smithi165.stdout:0/518: mkdir d0/d1e/d20/d28/da7/db4 0 2024-09-16T02:05:53.087 INFO:tasks.workunit.client.0.smithi110.stdout:4/221: read d4/d8/d31/f39 [1175914,31657] 0 2024-09-16T02:05:53.087 INFO:tasks.workunit.client.1.smithi165.stdout:1/562: dread - d1/d19/d4d/fab zero size 2024-09-16T02:05:53.087 INFO:tasks.workunit.client.1.smithi165.stdout:5/552: creat de/d19/d67/d74/fb5 x:0 0 0 2024-09-16T02:05:53.087 INFO:tasks.workunit.client.1.smithi165.stdout:3/624: fdatasync da/d17/d7a/d7d/fb3 0 2024-09-16T02:05:53.088 INFO:tasks.workunit.client.1.smithi165.stdout:8/571: creat dd/d13/d89/fc4 x:0 0 0 2024-09-16T02:05:53.089 INFO:tasks.workunit.client.1.smithi165.stdout:9/600: fsync d7/d32/d38/d53/d56/d95/f6a 0 2024-09-16T02:05:53.090 INFO:tasks.workunit.client.0.smithi110.stdout:4/222: rmdir d4/d8 39 2024-09-16T02:05:53.092 INFO:tasks.workunit.client.1.smithi165.stdout:6/566: fdatasync d7/dc/df/d1a/d4d/f6b 0 2024-09-16T02:05:53.094 INFO:tasks.workunit.client.1.smithi165.stdout:6/567: dread - d7/dc/d3b/f6f zero size 2024-09-16T02:05:53.094 INFO:tasks.workunit.client.1.smithi165.stdout:0/519: symlink d0/d61/lb5 0 2024-09-16T02:05:53.094 INFO:tasks.workunit.client.1.smithi165.stdout:6/568: chown d7/d17/d75 77 1 2024-09-16T02:05:53.095 INFO:tasks.workunit.client.1.smithi165.stdout:0/520: write d0/f30 [1598226,102609] 0 2024-09-16T02:05:53.097 INFO:tasks.workunit.client.1.smithi165.stdout:5/553: mknod de/d21/d26/cb6 0 2024-09-16T02:05:53.098 INFO:tasks.workunit.client.0.smithi110.stdout:4/223: dread d4/f10 [0,4194304] 0 2024-09-16T02:05:53.098 INFO:tasks.workunit.client.1.smithi165.stdout:6/569: chown d7/dc/df/c12 87080 1 2024-09-16T02:05:53.098 INFO:tasks.workunit.client.1.smithi165.stdout:0/521: read - d0/d1e/d20/d28/d6d/d87/f88 zero size 2024-09-16T02:05:53.098 INFO:tasks.workunit.client.1.smithi165.stdout:8/572: dwrite dd/d11/d14/d3f/db3/dbe/f88 [0,4194304] 0 2024-09-16T02:05:53.101 INFO:tasks.workunit.client.1.smithi165.stdout:1/563: rename d1/d19/d4d/d84/l63 to d1/d19/d24/d30/d72/lb4 0 2024-09-16T02:05:53.102 INFO:tasks.workunit.client.1.smithi165.stdout:9/601: symlink d7/df/d37/d43/lc9 0 2024-09-16T02:05:53.105 INFO:tasks.workunit.client.1.smithi165.stdout:5/554: creat de/d19/d1c/d84/fb7 x:0 0 0 2024-09-16T02:05:53.108 INFO:tasks.workunit.client.0.smithi110.stdout:4/224: link d4/d8/d17/d23/f37 d4/d12/d18/f43 0 2024-09-16T02:05:53.109 INFO:tasks.workunit.client.1.smithi165.stdout:0/522: symlink d0/d1e/d20/d28/d9a/lb6 0 2024-09-16T02:05:53.109 INFO:tasks.workunit.client.1.smithi165.stdout:9/602: write d7/df/d67/d92/d93/f96 [687179,52684] 0 2024-09-16T02:05:53.110 INFO:tasks.workunit.client.0.smithi110.stdout:4/225: mkdir d4/d8/d44 0 2024-09-16T02:05:53.110 INFO:tasks.workunit.client.0.smithi110.stdout:4/226: fdatasync d4/f11 0 2024-09-16T02:05:53.111 INFO:tasks.workunit.client.1.smithi165.stdout:5/555: write de/d19/f25 [5105560,68423] 0 2024-09-16T02:05:53.115 INFO:tasks.workunit.client.1.smithi165.stdout:7/543: dwrite d0/d2c/d85/f97 [0,4194304] 0 2024-09-16T02:05:53.115 INFO:tasks.workunit.client.1.smithi165.stdout:8/573: fdatasync dd/d11/f55 0 2024-09-16T02:05:53.115 INFO:tasks.workunit.client.1.smithi165.stdout:4/501: dwrite d4/dc/d20/d4e/f54 [0,4194304] 0 2024-09-16T02:05:53.115 INFO:tasks.workunit.client.1.smithi165.stdout:3/625: creat da/d17/d78/d2c/d2d/d6c/fe1 x:0 0 0 2024-09-16T02:05:53.117 INFO:tasks.workunit.client.0.smithi110.stdout:4/227: dread d4/f15 [0,4194304] 0 2024-09-16T02:05:53.118 INFO:tasks.workunit.client.1.smithi165.stdout:1/564: dwrite d1/d22/f2c [0,4194304] 0 2024-09-16T02:05:53.119 INFO:tasks.workunit.client.1.smithi165.stdout:4/502: chown d4/dc/d18/d37/d53/c5b 3 1 2024-09-16T02:05:53.121 INFO:tasks.workunit.client.1.smithi165.stdout:0/523: rename d0/d1e/d39/d48/d6e/fa1 to d0/d61/fb7 0 2024-09-16T02:05:53.123 INFO:tasks.workunit.client.1.smithi165.stdout:9/603: rmdir d7/df/d37/d43 39 2024-09-16T02:05:53.127 INFO:tasks.workunit.client.1.smithi165.stdout:3/626: fdatasync da/d17/dcc/f77 0 2024-09-16T02:05:53.134 INFO:tasks.workunit.client.1.smithi165.stdout:1/565: unlink d1/d22/l27 0 2024-09-16T02:05:53.134 INFO:tasks.workunit.client.1.smithi165.stdout:9/604: readlink d7/d32/d38/d53/d5c/d61/l86 0 2024-09-16T02:05:53.135 INFO:tasks.workunit.client.1.smithi165.stdout:1/566: write d1/f79 [3939799,55603] 0 2024-09-16T02:05:53.135 INFO:tasks.workunit.client.1.smithi165.stdout:0/524: rename d0/d1e/d39/d48/d45/c83 to d0/d1e/d39/d48/d5f/d96/dac/cb8 0 2024-09-16T02:05:53.136 INFO:tasks.workunit.client.1.smithi165.stdout:5/556: link de/d60/d65/ca2 de/d21/d51/cb8 0 2024-09-16T02:05:53.136 INFO:tasks.workunit.client.1.smithi165.stdout:9/605: mkdir d7/d32/d38/d53/d56/dca 0 2024-09-16T02:05:53.139 INFO:tasks.workunit.client.1.smithi165.stdout:9/606: read d7/d32/f39 [226045,17032] 0 2024-09-16T02:05:53.140 INFO:tasks.workunit.client.1.smithi165.stdout:9/607: readlink d7/d14/l1a 0 2024-09-16T02:05:53.142 INFO:tasks.workunit.client.1.smithi165.stdout:6/570: dread d7/d1f/f42 [0,4194304] 0 2024-09-16T02:05:53.143 INFO:tasks.workunit.client.0.smithi110.stdout:4/228: truncate f3 522010 0 2024-09-16T02:05:53.145 INFO:tasks.workunit.client.1.smithi165.stdout:0/525: link d0/d1e/d39/d48/d45/f44 d0/d1e/d39/d48/d45/fb9 0 2024-09-16T02:05:53.146 INFO:tasks.workunit.client.1.smithi165.stdout:6/571: rename d7/c96 to d7/d17/d75/d97/c9a 0 2024-09-16T02:05:53.146 INFO:tasks.workunit.client.0.smithi110.stdout:4/229: symlink d4/d8/d17/d23/l45 0 2024-09-16T02:05:53.148 INFO:tasks.workunit.client.1.smithi165.stdout:1/567: dread d1/dd/d11/d33/d35/f9a [0,4194304] 0 2024-09-16T02:05:53.149 INFO:tasks.workunit.client.1.smithi165.stdout:8/574: dread dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:53.150 INFO:tasks.workunit.client.1.smithi165.stdout:6/572: creat d7/d17/d75/d97/f9b x:0 0 0 2024-09-16T02:05:53.152 INFO:tasks.workunit.client.1.smithi165.stdout:6/573: read d7/f9 [416738,17857] 0 2024-09-16T02:05:53.152 INFO:tasks.workunit.client.0.smithi110.stdout:4/230: dwrite d4/d12/d18/f34 [0,4194304] 0 2024-09-16T02:05:53.153 INFO:tasks.workunit.client.1.smithi165.stdout:8/575: mkdir dd/d13/d89/dc5 0 2024-09-16T02:05:53.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/568: mkdir d1/dd/d11/d33/d3f/d59/db5 0 2024-09-16T02:05:53.155 INFO:tasks.workunit.client.1.smithi165.stdout:0/526: creat d0/fba x:0 0 0 2024-09-16T02:05:53.157 INFO:tasks.workunit.client.1.smithi165.stdout:3/627: dread da/d20/d26/d52/f6d [0,4194304] 0 2024-09-16T02:05:53.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/569: chown d1/dd/d11/d33/d3f/f55 2287623 1 2024-09-16T02:05:53.159 INFO:tasks.workunit.client.1.smithi165.stdout:5/557: dwrite de/d21/d26/d3a/f5a [4194304,4194304] 0 2024-09-16T02:05:53.159 INFO:tasks.workunit.client.1.smithi165.stdout:9/608: dread d7/d32/faf [0,4194304] 0 2024-09-16T02:05:53.160 INFO:tasks.workunit.client.1.smithi165.stdout:1/570: readlink d1/d19/d24/d30/d72/l8b 0 2024-09-16T02:05:53.160 INFO:tasks.workunit.client.0.smithi110.stdout:4/231: dwrite d4/f2c [0,4194304] 0 2024-09-16T02:05:53.160 INFO:tasks.workunit.client.1.smithi165.stdout:6/574: rename d7/c37 to d7/d17/d75/d97/c9c 0 2024-09-16T02:05:53.162 INFO:tasks.workunit.client.1.smithi165.stdout:0/527: read - d0/d1e/d39/f4f zero size 2024-09-16T02:05:53.164 INFO:tasks.workunit.client.1.smithi165.stdout:3/628: unlink da/d17/d78/l43 0 2024-09-16T02:05:53.166 INFO:tasks.workunit.client.1.smithi165.stdout:5/558: mkdir de/d19/d67/db9 0 2024-09-16T02:05:53.168 INFO:tasks.workunit.client.1.smithi165.stdout:9/609: dread d7/d32/d38/f73 [0,4194304] 0 2024-09-16T02:05:53.170 INFO:tasks.workunit.client.0.smithi110.stdout:4/232: dwrite d4/d12/d18/f29 [4194304,4194304] 0 2024-09-16T02:05:53.170 INFO:tasks.workunit.client.1.smithi165.stdout:9/610: readlink d7/df/d37/d65/l8b 0 2024-09-16T02:05:53.173 INFO:tasks.workunit.client.1.smithi165.stdout:3/629: creat da/d17/d78/d2c/d2d/d6c/db5/fe2 x:0 0 0 2024-09-16T02:05:53.173 INFO:tasks.workunit.client.1.smithi165.stdout:3/630: chown da/d17/f8b 257821 1 2024-09-16T02:05:53.174 INFO:tasks.workunit.client.0.smithi110.stdout:4/233: mknod d4/d8/d31/d36/d3c/c46 0 2024-09-16T02:05:53.174 INFO:tasks.workunit.client.1.smithi165.stdout:3/631: chown da/d17/f9f 3028 1 2024-09-16T02:05:53.177 INFO:tasks.workunit.client.1.smithi165.stdout:9/611: creat d7/d14/d7a/fcb x:0 0 0 2024-09-16T02:05:53.177 INFO:tasks.workunit.client.1.smithi165.stdout:8/576: write dd/d11/d14/d3f/d25/f6f [1046879,66050] 0 2024-09-16T02:05:53.179 INFO:tasks.workunit.client.1.smithi165.stdout:1/571: getdents d1/d19/d24/d97 0 2024-09-16T02:05:53.179 INFO:tasks.workunit.client.1.smithi165.stdout:8/577: readlink dd/d11/d38/l4a 0 2024-09-16T02:05:53.182 INFO:tasks.workunit.client.1.smithi165.stdout:3/632: unlink da/d17/ld3 0 2024-09-16T02:05:53.183 INFO:tasks.workunit.client.1.smithi165.stdout:8/578: rmdir dd/d11/d14/d3f 39 2024-09-16T02:05:53.187 INFO:tasks.workunit.client.1.smithi165.stdout:3/633: fsync da/fb 0 2024-09-16T02:05:53.188 INFO:tasks.workunit.client.1.smithi165.stdout:8/579: getdents dd/d11/daa/db9 0 2024-09-16T02:05:53.192 INFO:tasks.workunit.client.1.smithi165.stdout:3/634: getdents da/d17/d78/d2c 0 2024-09-16T02:05:53.192 INFO:tasks.workunit.client.1.smithi165.stdout:9/612: dread d7/fa [0,4194304] 0 2024-09-16T02:05:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:52 smithi165 ceph-mon[34621]: pgmap v20: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 23 MiB/s rd, 152 MiB/s wr, 268 op/s 2024-09-16T02:05:53.201 INFO:tasks.workunit.client.0.smithi110.stdout:4/234: dread f3 [0,4194304] 0 2024-09-16T02:05:53.202 INFO:tasks.workunit.client.0.smithi110.stdout:4/235: write d4/d8/d31/d36/f3a [116761,46737] 0 2024-09-16T02:05:53.202 INFO:tasks.workunit.client.0.smithi110.stdout:4/236: readlink d4/d8/l2d 0 2024-09-16T02:05:53.203 INFO:tasks.workunit.client.1.smithi165.stdout:1/572: dwrite d1/d19/d24/d30/d72/f93 [4194304,4194304] 0 2024-09-16T02:05:53.206 INFO:tasks.workunit.client.1.smithi165.stdout:5/559: dread de/d21/d51/f5f [0,4194304] 0 2024-09-16T02:05:53.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:52 smithi110 ceph-mon[27634]: pgmap v20: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 23 MiB/s rd, 152 MiB/s wr, 268 op/s 2024-09-16T02:05:53.211 INFO:tasks.workunit.client.0.smithi110.stdout:4/237: dwrite d4/f15 [0,4194304] 0 2024-09-16T02:05:53.212 INFO:tasks.workunit.client.1.smithi165.stdout:5/560: link de/d21/d26/cb6 de/d21/d26/cba 0 2024-09-16T02:05:53.212 INFO:tasks.workunit.client.0.smithi110.stdout:4/238: write d4/d8/d17/f26 [117028,71162] 0 2024-09-16T02:05:53.214 INFO:tasks.workunit.client.0.smithi110.stdout:4/239: write d4/d12/d18/f34 [1682955,121515] 0 2024-09-16T02:05:53.215 INFO:tasks.workunit.client.1.smithi165.stdout:5/561: write de/d19/d67/f7f [1896839,104516] 0 2024-09-16T02:05:53.215 INFO:tasks.workunit.client.1.smithi165.stdout:1/573: dwrite d1/dd/d11/d33/d92/f96 [0,4194304] 0 2024-09-16T02:05:53.217 INFO:tasks.workunit.client.1.smithi165.stdout:1/574: fsync d1/dd/d11/f1b 0 2024-09-16T02:05:53.219 INFO:tasks.workunit.client.0.smithi110.stdout:4/240: creat d4/d8/d31/d36/d3c/d3d/f47 x:0 0 0 2024-09-16T02:05:53.220 INFO:tasks.workunit.client.1.smithi165.stdout:5/562: symlink de/d19/d1c/d49/da5/lbb 0 2024-09-16T02:05:53.220 INFO:tasks.workunit.client.0.smithi110.stdout:4/241: mknod d4/d8/d17/c48 0 2024-09-16T02:05:53.221 INFO:tasks.workunit.client.1.smithi165.stdout:8/580: dread dd/d11/d38/f3c [0,4194304] 0 2024-09-16T02:05:53.221 INFO:tasks.workunit.client.1.smithi165.stdout:1/575: symlink d1/dd/lb6 0 2024-09-16T02:05:53.222 INFO:tasks.workunit.client.0.smithi110.stdout:4/242: dread - d4/d8/d31/d36/d3c/d3d/f47 zero size 2024-09-16T02:05:53.222 INFO:tasks.workunit.client.1.smithi165.stdout:5/563: rmdir de/d19/d1c/d4d 39 2024-09-16T02:05:53.223 INFO:tasks.workunit.client.1.smithi165.stdout:9/613: dread d7/d32/f47 [0,4194304] 0 2024-09-16T02:05:53.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/581: dread - dd/d11/f69 zero size 2024-09-16T02:05:53.225 INFO:tasks.workunit.client.1.smithi165.stdout:8/582: read - dd/fb1 zero size 2024-09-16T02:05:53.226 INFO:tasks.workunit.client.1.smithi165.stdout:5/564: write de/d19/d1c/d4d/f72 [260654,84837] 0 2024-09-16T02:05:53.227 INFO:tasks.workunit.client.1.smithi165.stdout:1/576: creat d1/dd/d11/d46/d57/fb7 x:0 0 0 2024-09-16T02:05:53.230 INFO:tasks.workunit.client.1.smithi165.stdout:3/635: dread da/d20/d26/f31 [0,4194304] 0 2024-09-16T02:05:53.230 INFO:tasks.workunit.client.1.smithi165.stdout:5/565: write de/d19/d67/f7f [536937,103532] 0 2024-09-16T02:05:53.233 INFO:tasks.workunit.client.1.smithi165.stdout:8/583: mknod dd/d11/d14/d3f/d25/d36/d85/cc6 0 2024-09-16T02:05:53.233 INFO:tasks.workunit.client.1.smithi165.stdout:3/636: write da/d17/d78/d2c/d2d/d6c/fc8 [506284,126925] 0 2024-09-16T02:05:53.233 INFO:tasks.workunit.client.1.smithi165.stdout:2/610: sync 2024-09-16T02:05:53.234 INFO:tasks.workunit.client.1.smithi165.stdout:5/566: mkdir de/d60/dbc 0 2024-09-16T02:05:53.234 INFO:tasks.workunit.client.0.smithi110.stdout:4/243: write d4/f10 [1735910,86105] 0 2024-09-16T02:05:53.235 INFO:tasks.workunit.client.1.smithi165.stdout:5/567: chown de/d60/d65/faf 464397 1 2024-09-16T02:05:53.235 INFO:tasks.workunit.client.0.smithi110.stdout:4/244: stat d4 0 2024-09-16T02:05:53.236 INFO:tasks.workunit.client.1.smithi165.stdout:8/584: read dd/d13/f32 [729207,78774] 0 2024-09-16T02:05:53.236 INFO:tasks.workunit.client.1.smithi165.stdout:3/637: symlink da/d20/d26/d8c/le3 0 2024-09-16T02:05:53.239 INFO:tasks.workunit.client.1.smithi165.stdout:5/568: mknod de/d21/d26/d3a/cbd 0 2024-09-16T02:05:53.242 INFO:tasks.workunit.client.1.smithi165.stdout:3/638: rename da/d17/d7a/dab/cde to da/d17/d7a/dab/ce4 0 2024-09-16T02:05:53.243 INFO:tasks.workunit.client.0.smithi110.stdout:4/245: dwrite d4/d8/d31/f39 [0,4194304] 0 2024-09-16T02:05:53.244 INFO:tasks.workunit.client.1.smithi165.stdout:2/611: dwrite df/d10/d1a/f22 [0,4194304] 0 2024-09-16T02:05:53.244 INFO:tasks.workunit.client.1.smithi165.stdout:9/614: dread d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:53.246 INFO:tasks.workunit.client.0.smithi110.stdout:4/246: dread d4/f10 [0,4194304] 0 2024-09-16T02:05:53.247 INFO:tasks.workunit.client.1.smithi165.stdout:1/577: dwrite d1/dd/f2e [0,4194304] 0 2024-09-16T02:05:53.252 INFO:tasks.workunit.client.1.smithi165.stdout:9/615: write d7/d14/f16 [4536323,11307] 0 2024-09-16T02:05:53.254 INFO:tasks.workunit.client.1.smithi165.stdout:8/585: dread dd/d11/d14/f54 [0,4194304] 0 2024-09-16T02:05:53.254 INFO:tasks.workunit.client.1.smithi165.stdout:3/639: dwrite da/d17/dcc/f71 [0,4194304] 0 2024-09-16T02:05:53.255 INFO:tasks.workunit.client.1.smithi165.stdout:9/616: fsync d7/df/d67/fab 0 2024-09-16T02:05:53.256 INFO:tasks.workunit.client.1.smithi165.stdout:1/578: creat d1/dd/d11/d46/d57/fb8 x:0 0 0 2024-09-16T02:05:53.262 INFO:tasks.workunit.client.1.smithi165.stdout:1/579: rmdir d1/dd/d11/d33/d3f/d47 39 2024-09-16T02:05:53.265 INFO:tasks.workunit.client.1.smithi165.stdout:5/569: symlink de/d21/d26/d3a/d6d/dad/lbe 0 2024-09-16T02:05:53.266 INFO:tasks.workunit.client.1.smithi165.stdout:1/580: creat d1/dd/d11/d33/d35/fb9 x:0 0 0 2024-09-16T02:05:53.268 INFO:tasks.workunit.client.1.smithi165.stdout:9/617: dwrite d7/d32/d38/f73 [0,4194304] 0 2024-09-16T02:05:53.269 INFO:tasks.workunit.client.1.smithi165.stdout:1/581: readlink d1/d68/l29 0 2024-09-16T02:05:53.271 INFO:tasks.workunit.client.1.smithi165.stdout:5/570: rename de/d19/c3b to de/d21/d26/d94/cbf 0 2024-09-16T02:05:53.274 INFO:tasks.workunit.client.1.smithi165.stdout:1/582: creat d1/d19/d4d/d84/fba x:0 0 0 2024-09-16T02:05:53.276 INFO:tasks.workunit.client.1.smithi165.stdout:1/583: chown d1/d22/f3d 46 1 2024-09-16T02:05:53.277 INFO:tasks.workunit.client.1.smithi165.stdout:9/618: dwrite d7/d32/d38/d68/d7f/f6e [0,4194304] 0 2024-09-16T02:05:53.279 INFO:tasks.workunit.client.1.smithi165.stdout:1/584: rename d1/dd/d11/c3e to d1/dd/d11/d42/cbb 0 2024-09-16T02:05:53.281 INFO:tasks.workunit.client.1.smithi165.stdout:9/619: mknod d7/df/d37/ccc 0 2024-09-16T02:05:53.281 INFO:tasks.workunit.client.1.smithi165.stdout:1/585: read d1/dd/d11/d46/f73 [63823,122143] 0 2024-09-16T02:05:53.282 INFO:tasks.workunit.client.1.smithi165.stdout:1/586: chown d1/d68/c65 4 1 2024-09-16T02:05:53.282 INFO:tasks.workunit.client.1.smithi165.stdout:9/620: fsync d7/d55/f4c 0 2024-09-16T02:05:53.283 INFO:tasks.workunit.client.1.smithi165.stdout:1/587: write d1/d19/d24/d30/f40 [1283938,112622] 0 2024-09-16T02:05:53.285 INFO:tasks.workunit.client.1.smithi165.stdout:9/621: creat d7/d32/d38/d53/d5c/d61/fcd x:0 0 0 2024-09-16T02:05:53.286 INFO:tasks.workunit.client.1.smithi165.stdout:1/588: write d1/dd/d11/d33/f3b [5470011,65309] 0 2024-09-16T02:05:53.289 INFO:tasks.workunit.client.1.smithi165.stdout:1/589: chown d1/dd/d11/d33/d3f/d59/f90 62234 1 2024-09-16T02:05:53.289 INFO:tasks.workunit.client.0.smithi110.stdout:4/247: dread d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:53.290 INFO:tasks.workunit.client.1.smithi165.stdout:9/622: fdatasync d7/d32/d38/d58/d99/f9c 0 2024-09-16T02:05:53.290 INFO:tasks.workunit.client.1.smithi165.stdout:1/590: fdatasync d1/d19/d4d/f81 0 2024-09-16T02:05:53.293 INFO:tasks.workunit.client.1.smithi165.stdout:8/586: write dd/f6c [29943,29026] 0 2024-09-16T02:05:53.298 INFO:tasks.workunit.client.1.smithi165.stdout:1/591: dread d1/dd/d11/d33/f56 [0,4194304] 0 2024-09-16T02:05:53.306 INFO:tasks.workunit.client.1.smithi165.stdout:1/592: dread d1/dd/d11/d33/f3b [4194304,4194304] 0 2024-09-16T02:05:53.321 INFO:tasks.workunit.client.1.smithi165.stdout:7/544: sync 2024-09-16T02:05:53.347 INFO:tasks.workunit.client.1.smithi165.stdout:9/623: creat d7/d32/d85/fce x:0 0 0 2024-09-16T02:05:53.347 INFO:tasks.workunit.client.1.smithi165.stdout:9/624: readlink d7/d1f/l6f 0 2024-09-16T02:05:53.348 INFO:tasks.workunit.client.1.smithi165.stdout:9/625: rename d7/d32 to d7/d32/d38/d53/d56/dcf 22 2024-09-16T02:05:53.348 INFO:tasks.workunit.client.1.smithi165.stdout:9/626: chown d7/d55/c78 7739 1 2024-09-16T02:05:53.350 INFO:tasks.workunit.client.1.smithi165.stdout:9/627: read d7/d14/f16 [1275901,47542] 0 2024-09-16T02:05:53.352 INFO:tasks.workunit.client.1.smithi165.stdout:5/571: truncate de/d21/f8b 1006276 0 2024-09-16T02:05:53.357 INFO:tasks.workunit.client.1.smithi165.stdout:9/628: chown d7/d14/c2c 219 1 2024-09-16T02:05:53.363 INFO:tasks.workunit.client.1.smithi165.stdout:1/593: link d1/d19/d24/d30/d72/f91 d1/dd/d11/d33/d3f/d47/d7d/db3/fbc 0 2024-09-16T02:05:53.365 INFO:tasks.workunit.client.1.smithi165.stdout:5/572: creat de/d21/d26/d9a/fc0 x:0 0 0 2024-09-16T02:05:53.367 INFO:tasks.workunit.client.0.smithi110.stdout:4/248: write d4/d12/d18/f43 [20458,38767] 0 2024-09-16T02:05:53.368 INFO:tasks.workunit.client.1.smithi165.stdout:9/629: creat d7/df/d37/d43/d88/fd0 x:0 0 0 2024-09-16T02:05:53.368 INFO:tasks.workunit.client.0.smithi110.stdout:4/249: write d4/d12/d18/f29 [7641496,80100] 0 2024-09-16T02:05:53.369 INFO:tasks.workunit.client.0.smithi110.stdout:4/250: readlink d4/d8/d17/d23/l45 0 2024-09-16T02:05:53.370 INFO:tasks.workunit.client.1.smithi165.stdout:1/594: creat d1/dd/d11/d33/d3f/d6c/fbd x:0 0 0 2024-09-16T02:05:53.371 INFO:tasks.workunit.client.1.smithi165.stdout:1/595: readlink d1/dd/d11/l78 0 2024-09-16T02:05:53.374 INFO:tasks.workunit.client.1.smithi165.stdout:5/573: mkdir de/d19/d1c/d4d/dc1 0 2024-09-16T02:05:53.375 INFO:tasks.workunit.client.1.smithi165.stdout:1/596: dread d1/dd/d11/d33/d67/fa8 [0,4194304] 0 2024-09-16T02:05:53.376 INFO:tasks.workunit.client.0.smithi110.stdout:4/251: mkdir d4/d8/d17/d23/d35/d49 0 2024-09-16T02:05:53.377 INFO:tasks.workunit.client.0.smithi110.stdout:4/252: fsync d4/d12/d18/f34 0 2024-09-16T02:05:53.378 INFO:tasks.workunit.client.1.smithi165.stdout:1/597: write d1/dd/d11/d46/f70 [106776,25679] 0 2024-09-16T02:05:53.378 INFO:tasks.workunit.client.1.smithi165.stdout:1/598: write d1/d32/f88 [743359,29808] 0 2024-09-16T02:05:53.379 INFO:tasks.workunit.client.1.smithi165.stdout:9/630: symlink d7/d32/d38/d53/d56/ld1 0 2024-09-16T02:05:53.380 INFO:tasks.workunit.client.1.smithi165.stdout:9/631: dread - d7/df/d37/d43/d88/fa6 zero size 2024-09-16T02:05:53.381 INFO:tasks.workunit.client.1.smithi165.stdout:9/632: write d7/d87/fba [435183,105888] 0 2024-09-16T02:05:53.381 INFO:tasks.workunit.client.1.smithi165.stdout:7/545: rename d0/df/d42/f5e to d0/df/d42/fa5 0 2024-09-16T02:05:53.386 INFO:tasks.workunit.client.0.smithi110.stdout:4/253: unlink d4/d12/d18/l1b 0 2024-09-16T02:05:53.386 INFO:tasks.workunit.client.0.smithi110.stdout:4/254: readlink d4/d8/l2d 0 2024-09-16T02:05:53.387 INFO:tasks.workunit.client.1.smithi165.stdout:1/599: dwrite d1/d19/d24/d30/d72/f93 [0,4194304] 0 2024-09-16T02:05:53.388 INFO:tasks.workunit.client.1.smithi165.stdout:5/574: unlink de/d19/d67/d74/fb5 0 2024-09-16T02:05:53.390 INFO:tasks.workunit.client.0.smithi110.stdout:4/255: creat d4/d8/d17/d23/f4a x:0 0 0 2024-09-16T02:05:53.394 INFO:tasks.workunit.client.1.smithi165.stdout:9/633: rename d7/d87 to d7/d32/d38/d53/d56/dca/dd2 0 2024-09-16T02:05:53.395 INFO:tasks.workunit.client.1.smithi165.stdout:9/634: chown d7/df/d37/ccc 3363 1 2024-09-16T02:05:53.400 INFO:tasks.workunit.client.1.smithi165.stdout:9/635: fdatasync d7/fd 0 2024-09-16T02:05:53.402 INFO:tasks.workunit.client.1.smithi165.stdout:7/546: dread d0/d2c/f2e [0,4194304] 0 2024-09-16T02:05:53.410 INFO:tasks.workunit.client.1.smithi165.stdout:7/547: link d0/df/d68/c71 d0/d3d/d9f/ca6 0 2024-09-16T02:05:53.411 INFO:tasks.workunit.client.1.smithi165.stdout:4/503: sync 2024-09-16T02:05:53.411 INFO:tasks.workunit.client.1.smithi165.stdout:1/600: dread d1/d68/f64 [0,4194304] 0 2024-09-16T02:05:53.412 INFO:tasks.workunit.client.1.smithi165.stdout:5/575: dread fc [0,4194304] 0 2024-09-16T02:05:53.413 INFO:tasks.workunit.client.1.smithi165.stdout:7/548: mknod d0/d4b/d58/ca7 0 2024-09-16T02:05:53.415 INFO:tasks.workunit.client.1.smithi165.stdout:5/576: mkdir de/d21/d26/d94/dc2 0 2024-09-16T02:05:53.417 INFO:tasks.workunit.client.0.smithi110.stdout:9/130: sync 2024-09-16T02:05:53.417 INFO:tasks.workunit.client.0.smithi110.stdout:5/204: sync 2024-09-16T02:05:53.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/549: mkdir d0/df/d7/d67/da8 0 2024-09-16T02:05:53.423 INFO:tasks.workunit.client.1.smithi165.stdout:5/577: dread de/fa4 [4194304,4194304] 0 2024-09-16T02:05:53.425 INFO:tasks.workunit.client.0.smithi110.stdout:5/205: mkdir d5/d36/d45/d47 0 2024-09-16T02:05:53.426 INFO:tasks.workunit.client.0.smithi110.stdout:5/206: fdatasync d5/dd/f23 0 2024-09-16T02:05:53.428 INFO:tasks.workunit.client.1.smithi165.stdout:7/550: fdatasync d0/f60 0 2024-09-16T02:05:53.432 INFO:tasks.workunit.client.0.smithi110.stdout:5/207: mknod d5/d36/d3d/c48 0 2024-09-16T02:05:53.432 INFO:tasks.workunit.client.1.smithi165.stdout:4/504: getdents d4/dc/d28/d3b 0 2024-09-16T02:05:53.433 INFO:tasks.workunit.client.0.smithi110.stdout:5/208: truncate d5/dd/f2b 2052902 0 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:7/551: mknod d0/df/d65/ca9 0 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:7/552: dread - d0/df/d7/f93 zero size 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:0/528: sync 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:6/575: sync 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:2/612: sync 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:3/640: sync 2024-09-16T02:05:53.434 INFO:tasks.workunit.client.1.smithi165.stdout:8/587: sync 2024-09-16T02:05:53.435 INFO:tasks.workunit.client.1.smithi165.stdout:4/505: creat d4/dc/d18/d37/fa4 x:0 0 0 2024-09-16T02:05:53.435 INFO:tasks.workunit.client.1.smithi165.stdout:7/553: truncate d0/d2c/d85/f88 1192085 0 2024-09-16T02:05:53.436 INFO:tasks.workunit.client.0.smithi110.stdout:5/209: readlink d5/dd/df/d11/l22 0 2024-09-16T02:05:53.436 INFO:tasks.workunit.client.1.smithi165.stdout:4/506: chown d4/dc/d28/d2b/f89 3997 1 2024-09-16T02:05:53.440 INFO:tasks.workunit.client.1.smithi165.stdout:6/576: mknod d7/d1f/c9d 0 2024-09-16T02:05:53.441 INFO:tasks.workunit.client.1.smithi165.stdout:6/577: chown d7/dc/d3b/d86 797 1 2024-09-16T02:05:53.442 INFO:tasks.workunit.client.1.smithi165.stdout:8/588: mknod dd/d11/d38/da6/db0/cc7 0 2024-09-16T02:05:53.443 INFO:tasks.workunit.client.0.smithi110.stdout:5/210: fsync f0 0 2024-09-16T02:05:53.444 INFO:tasks.workunit.client.1.smithi165.stdout:2/613: truncate df/d23/d28/f32 2527347 0 2024-09-16T02:05:53.445 INFO:tasks.workunit.client.1.smithi165.stdout:2/614: dread - df/d23/d28/d3b/fab zero size 2024-09-16T02:05:53.445 INFO:tasks.workunit.client.1.smithi165.stdout:7/554: mknod d0/df/d33/d2a/caa 0 2024-09-16T02:05:53.448 INFO:tasks.workunit.client.1.smithi165.stdout:0/529: dread d0/d1e/f93 [0,4194304] 0 2024-09-16T02:05:53.453 INFO:tasks.workunit.client.1.smithi165.stdout:2/615: mkdir df/dbb 0 2024-09-16T02:05:53.454 INFO:tasks.workunit.client.0.smithi110.stdout:5/211: creat d5/d36/d45/d47/f49 x:0 0 0 2024-09-16T02:05:53.456 INFO:tasks.workunit.client.1.smithi165.stdout:8/589: link f9 dd/fc8 0 2024-09-16T02:05:53.457 INFO:tasks.workunit.client.1.smithi165.stdout:6/578: dread d7/f9 [0,4194304] 0 2024-09-16T02:05:53.459 INFO:tasks.workunit.client.1.smithi165.stdout:0/530: mkdir d0/d1e/d39/d48/d5f/d96/da4/dbb 0 2024-09-16T02:05:53.459 INFO:tasks.workunit.client.1.smithi165.stdout:2/616: dwrite df/d23/d28/d3b/f7a [0,4194304] 0 2024-09-16T02:05:53.460 INFO:tasks.workunit.client.1.smithi165.stdout:6/579: dread d7/dc/f48 [0,4194304] 0 2024-09-16T02:05:53.463 INFO:tasks.workunit.client.1.smithi165.stdout:7/555: dread d0/d4b/d63/f9e [0,4194304] 0 2024-09-16T02:05:53.464 INFO:tasks.workunit.client.0.smithi110.stdout:5/212: symlink d5/dd/df/l4a 0 2024-09-16T02:05:53.467 INFO:tasks.workunit.client.1.smithi165.stdout:6/580: dread d7/d1f/f42 [0,4194304] 0 2024-09-16T02:05:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:0/227: sync 2024-09-16T02:05:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:7/180: sync 2024-09-16T02:05:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:6/335: sync 2024-09-16T02:05:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:8/209: sync 2024-09-16T02:05:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:1/290: sync 2024-09-16T02:05:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:2/210: sync 2024-09-16T02:05:53.477 INFO:tasks.workunit.client.0.smithi110.stdout:3/162: sync 2024-09-16T02:05:53.477 INFO:tasks.workunit.client.0.smithi110.stdout:5/213: dread d5/f13 [0,4194304] 0 2024-09-16T02:05:53.478 INFO:tasks.workunit.client.1.smithi165.stdout:8/590: creat dd/d11/d14/d3f/d25/d36/d81/fc9 x:0 0 0 2024-09-16T02:05:53.478 INFO:tasks.workunit.client.1.smithi165.stdout:6/581: rmdir d7/dc/df/d1a/d4d 39 2024-09-16T02:05:53.479 INFO:tasks.workunit.client.0.smithi110.stdout:7/181: read - d3/f34 zero size 2024-09-16T02:05:53.480 INFO:tasks.workunit.client.1.smithi165.stdout:0/531: dread d0/d1e/d39/d48/d74/f7b [0,4194304] 0 2024-09-16T02:05:53.481 INFO:tasks.workunit.client.0.smithi110.stdout:7/182: chown d3/f9 1 1 2024-09-16T02:05:53.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/291: readlink d0/d1/d8/l45 0 2024-09-16T02:05:53.484 INFO:tasks.workunit.client.0.smithi110.stdout:7/183: fsync d3/f19 0 2024-09-16T02:05:53.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/292: dread - d0/d1/f3f zero size 2024-09-16T02:05:53.485 INFO:tasks.workunit.client.0.smithi110.stdout:3/163: creat d8/d29/f32 x:0 0 0 2024-09-16T02:05:53.487 INFO:tasks.workunit.client.0.smithi110.stdout:0/228: creat d3/d4/d41/f48 x:0 0 0 2024-09-16T02:05:53.488 INFO:tasks.workunit.client.1.smithi165.stdout:8/591: read dd/d11/f47 [1879575,38448] 0 2024-09-16T02:05:53.489 INFO:tasks.workunit.client.0.smithi110.stdout:6/336: mknod d0/d29/c65 0 2024-09-16T02:05:53.489 INFO:tasks.workunit.client.1.smithi165.stdout:8/592: write dd/d11/d14/d3f/d72/fab [2344376,5664] 0 2024-09-16T02:05:53.490 INFO:tasks.workunit.client.1.smithi165.stdout:0/532: dread d0/f5a [0,4194304] 0 2024-09-16T02:05:53.492 INFO:tasks.workunit.client.0.smithi110.stdout:0/229: fdatasync d3/d4/f27 0 2024-09-16T02:05:53.496 INFO:tasks.workunit.client.0.smithi110.stdout:3/164: chown d8/dc 34538388 1 2024-09-16T02:05:53.496 INFO:tasks.workunit.client.0.smithi110.stdout:0/230: dread - d3/d4/d41/f48 zero size 2024-09-16T02:05:53.496 INFO:tasks.workunit.client.0.smithi110.stdout:2/211: mkdir d0/db/d33/d46 0 2024-09-16T02:05:53.496 INFO:tasks.workunit.client.1.smithi165.stdout:1/601: fsync d1/dd/d11/d33/d3f/d6c/fbd 0 2024-09-16T02:05:53.497 INFO:tasks.workunit.client.0.smithi110.stdout:6/337: fdatasync d0/d2/d18/d1d/f3d 0 2024-09-16T02:05:53.498 INFO:tasks.workunit.client.0.smithi110.stdout:7/184: truncate d3/da/d10/f29 7564134 0 2024-09-16T02:05:53.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/293: dwrite d0/d1/d4/d46/f5e [0,4194304] 0 2024-09-16T02:05:53.498 INFO:tasks.workunit.client.1.smithi165.stdout:8/593: creat dd/d11/d38/d74/d7d/fca x:0 0 0 2024-09-16T02:05:53.502 INFO:tasks.workunit.client.1.smithi165.stdout:0/533: mknod d0/d1e/d39/d48/d74/cbc 0 2024-09-16T02:05:53.506 INFO:tasks.workunit.client.1.smithi165.stdout:0/534: dread d0/d1e/d39/d48/f75 [0,4194304] 0 2024-09-16T02:05:53.508 INFO:tasks.workunit.client.0.smithi110.stdout:6/338: dread d0/d2/f3a [0,4194304] 0 2024-09-16T02:05:53.510 INFO:tasks.workunit.client.1.smithi165.stdout:1/602: creat d1/d32/fbe x:0 0 0 2024-09-16T02:05:53.514 INFO:tasks.workunit.client.1.smithi165.stdout:8/594: creat dd/d11/daa/fcb x:0 0 0 2024-09-16T02:05:53.516 INFO:tasks.workunit.client.1.smithi165.stdout:1/603: dwrite d1/f49 [0,4194304] 0 2024-09-16T02:05:53.517 INFO:tasks.workunit.client.0.smithi110.stdout:8/210: dread d3/d31/f3e [0,4194304] 0 2024-09-16T02:05:53.518 INFO:tasks.workunit.client.1.smithi165.stdout:1/604: dread - d1/dd/d11/d33/d67/f9b zero size 2024-09-16T02:05:53.518 INFO:tasks.workunit.client.1.smithi165.stdout:1/605: dread - d1/d68/f66 zero size 2024-09-16T02:05:53.521 INFO:tasks.workunit.client.0.smithi110.stdout:0/231: dread d3/d4/f11 [0,4194304] 0 2024-09-16T02:05:53.523 INFO:tasks.workunit.client.0.smithi110.stdout:0/232: read d3/d4/dc/d10/f3c [2158853,102043] 0 2024-09-16T02:05:53.524 INFO:tasks.workunit.client.0.smithi110.stdout:0/233: stat d3/d6/d43/l47 0 2024-09-16T02:05:53.525 INFO:tasks.workunit.client.1.smithi165.stdout:0/535: creat d0/d1e/d39/d99/fbd x:0 0 0 2024-09-16T02:05:53.528 INFO:tasks.workunit.client.1.smithi165.stdout:1/606: mkdir d1/d19/d24/dbf 0 2024-09-16T02:05:53.530 INFO:tasks.workunit.client.1.smithi165.stdout:0/536: creat d0/d1e/d39/d99/fbe x:0 0 0 2024-09-16T02:05:53.532 INFO:tasks.workunit.client.0.smithi110.stdout:3/165: symlink d8/l33 0 2024-09-16T02:05:53.532 INFO:tasks.workunit.client.0.smithi110.stdout:0/234: dwrite d3/d4/f1d [0,4194304] 0 2024-09-16T02:05:53.533 INFO:tasks.workunit.client.1.smithi165.stdout:1/607: symlink d1/dd/d11/d33/d67/lc0 0 2024-09-16T02:05:53.535 INFO:tasks.workunit.client.0.smithi110.stdout:8/211: creat d3/d2b/d27/f47 x:0 0 0 2024-09-16T02:05:53.536 INFO:tasks.workunit.client.1.smithi165.stdout:0/537: fsync d0/d1e/f57 0 2024-09-16T02:05:53.540 INFO:tasks.workunit.client.1.smithi165.stdout:1/608: creat d1/d19/d24/d97/fc1 x:0 0 0 2024-09-16T02:05:53.545 INFO:tasks.workunit.client.1.smithi165.stdout:0/538: mknod d0/d1e/d39/d48/d74/cbf 0 2024-09-16T02:05:53.549 INFO:tasks.workunit.client.1.smithi165.stdout:1/609: creat d1/d19/d24/d97/fc2 x:0 0 0 2024-09-16T02:05:53.550 INFO:tasks.workunit.client.1.smithi165.stdout:3/641: mkdir da/d17/de5 0 2024-09-16T02:05:53.551 INFO:tasks.workunit.client.1.smithi165.stdout:3/642: write da/d20/fae [134644,77516] 0 2024-09-16T02:05:53.553 INFO:tasks.workunit.client.1.smithi165.stdout:1/610: dread d1/d19/d24/d30/d72/f91 [0,4194304] 0 2024-09-16T02:05:53.554 INFO:tasks.workunit.client.1.smithi165.stdout:1/611: chown d1/d22/f85 8090577 1 2024-09-16T02:05:53.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/166: symlink d8/dc/d1b/d1c/l34 0 2024-09-16T02:05:53.555 INFO:tasks.workunit.client.1.smithi165.stdout:1/612: readlink d1/dd/d11/d33/d3f/d6c/l8f 0 2024-09-16T02:05:53.555 INFO:tasks.workunit.client.1.smithi165.stdout:1/613: chown d1 18586 1 2024-09-16T02:05:53.555 INFO:tasks.workunit.client.1.smithi165.stdout:0/539: rmdir d0/d1e/d39/d48 39 2024-09-16T02:05:53.556 INFO:tasks.workunit.client.0.smithi110.stdout:0/235: dread d3/f1b [0,4194304] 0 2024-09-16T02:05:53.556 INFO:tasks.workunit.client.1.smithi165.stdout:0/540: chown d0/d1e/d20/d28/l41 133358036 1 2024-09-16T02:05:53.556 INFO:tasks.workunit.client.1.smithi165.stdout:3/643: fdatasync da/d17/d78/d2c/f36 0 2024-09-16T02:05:53.557 INFO:tasks.workunit.client.1.smithi165.stdout:1/614: truncate d1/dd/d11/d33/d3f/d59/f9e 91101 0 2024-09-16T02:05:53.558 INFO:tasks.workunit.client.0.smithi110.stdout:0/236: write d3/d4/dc/d14/f19 [964105,16691] 0 2024-09-16T02:05:53.562 INFO:tasks.workunit.client.0.smithi110.stdout:1/294: getdents d0/d25 0 2024-09-16T02:05:53.563 INFO:tasks.workunit.client.1.smithi165.stdout:1/615: mknod d1/dd/d11/d33/d3f/d47/cc3 0 2024-09-16T02:05:53.565 INFO:tasks.workunit.client.1.smithi165.stdout:3/644: creat da/d20/d26/d8c/dd9/fe6 x:0 0 0 2024-09-16T02:05:53.566 INFO:tasks.workunit.client.0.smithi110.stdout:8/212: creat d3/d2b/d27/d3a/f48 x:0 0 0 2024-09-16T02:05:53.567 INFO:tasks.workunit.client.1.smithi165.stdout:3/645: truncate da/d20/d26/d8c/fa2 887360 0 2024-09-16T02:05:53.568 INFO:tasks.workunit.client.0.smithi110.stdout:8/213: readlink d3/d31/l3f 0 2024-09-16T02:05:53.568 INFO:tasks.workunit.client.0.smithi110.stdout:8/214: dread - d3/f3d zero size 2024-09-16T02:05:53.569 INFO:tasks.workunit.client.0.smithi110.stdout:0/237: unlink d3/d4/dc/d14/c15 0 2024-09-16T02:05:53.569 INFO:tasks.workunit.client.0.smithi110.stdout:3/167: dread d8/dc/d1b/d1c/f1f [0,4194304] 0 2024-09-16T02:05:53.570 INFO:tasks.workunit.client.0.smithi110.stdout:1/295: mkdir d0/d1/d8/d5f 0 2024-09-16T02:05:53.571 INFO:tasks.workunit.client.0.smithi110.stdout:8/215: chown d3/c1b 120 1 2024-09-16T02:05:53.574 INFO:tasks.workunit.client.0.smithi110.stdout:4/256: rename d4/f1c to d4/d8/d17/d23/d35/f4b 0 2024-09-16T02:05:53.575 INFO:tasks.workunit.client.0.smithi110.stdout:1/296: symlink d0/d1/d2a/l60 0 2024-09-16T02:05:53.576 INFO:tasks.workunit.client.0.smithi110.stdout:1/297: write d0/d1/d2a/f37 [194055,65747] 0 2024-09-16T02:05:53.577 INFO:tasks.workunit.client.1.smithi165.stdout:1/616: dwrite d1/d22/f3d [4194304,4194304] 0 2024-09-16T02:05:53.578 INFO:tasks.workunit.client.0.smithi110.stdout:9/131: rename d1/d5/c6 to d1/d5/d8/d29/c2c 0 2024-09-16T02:05:53.580 INFO:tasks.workunit.client.0.smithi110.stdout:4/257: mkdir d4/d8/d17/d23/d4c 0 2024-09-16T02:05:53.580 INFO:tasks.workunit.client.0.smithi110.stdout:0/238: getdents d3/d4/dc 0 2024-09-16T02:05:53.582 INFO:tasks.workunit.client.0.smithi110.stdout:3/168: dread f3 [0,4194304] 0 2024-09-16T02:05:53.588 INFO:tasks.workunit.client.0.smithi110.stdout:5/214: rename d5/dd/df/l4a to d5/dd/l4b 0 2024-09-16T02:05:53.591 INFO:tasks.workunit.client.0.smithi110.stdout:4/258: rmdir d4/d8 39 2024-09-16T02:05:53.591 INFO:tasks.workunit.client.1.smithi165.stdout:3/646: dread da/d17/f4a [0,4194304] 0 2024-09-16T02:05:53.592 INFO:tasks.workunit.client.1.smithi165.stdout:2/617: rmdir df 39 2024-09-16T02:05:53.592 INFO:tasks.workunit.client.1.smithi165.stdout:3/647: write da/d17/fa3 [5002477,31980] 0 2024-09-16T02:05:53.593 INFO:tasks.workunit.client.1.smithi165.stdout:1/617: getdents d1/d19/d24/d97/da5 0 2024-09-16T02:05:53.594 INFO:tasks.workunit.client.1.smithi165.stdout:1/618: write d1/f3a [248967,128901] 0 2024-09-16T02:05:53.595 INFO:tasks.workunit.client.1.smithi165.stdout:1/619: dread - d1/dd/d11/d46/d57/fb2 zero size 2024-09-16T02:05:53.597 INFO:tasks.workunit.client.0.smithi110.stdout:1/298: mkdir d0/d1/d4/d46/d61 0 2024-09-16T02:05:53.599 INFO:tasks.workunit.client.1.smithi165.stdout:2/618: dread - df/d23/d28/f81 zero size 2024-09-16T02:05:53.599 INFO:tasks.workunit.client.1.smithi165.stdout:2/619: read - df/d23/d28/d3b/fa1 zero size 2024-09-16T02:05:53.600 INFO:tasks.workunit.client.0.smithi110.stdout:9/132: creat d1/d2b/f2d x:0 0 0 2024-09-16T02:05:53.602 INFO:tasks.workunit.client.0.smithi110.stdout:5/215: creat d5/dd/f4c x:0 0 0 2024-09-16T02:05:53.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/259: dread d4/d12/d18/f1f [0,4194304] 0 2024-09-16T02:05:53.605 INFO:tasks.workunit.client.0.smithi110.stdout:8/216: rename d3/d2b/d27/d3a/f48 to d3/d31/f49 0 2024-09-16T02:05:53.606 INFO:tasks.workunit.client.1.smithi165.stdout:1/620: mknod d1/dd/d11/d33/d3f/d59/cc4 0 2024-09-16T02:05:53.606 INFO:tasks.workunit.client.0.smithi110.stdout:8/217: stat d3 0 2024-09-16T02:05:53.607 INFO:tasks.workunit.client.1.smithi165.stdout:1/621: dread - d1/dd/d11/d46/d57/fb8 zero size 2024-09-16T02:05:53.607 INFO:tasks.workunit.client.0.smithi110.stdout:8/218: read d3/d2b/f1e [2203816,120870] 0 2024-09-16T02:05:53.609 INFO:tasks.workunit.client.1.smithi165.stdout:1/622: write d1/dd/d11/f1b [4489182,7711] 0 2024-09-16T02:05:53.609 INFO:tasks.workunit.client.1.smithi165.stdout:3/648: unlink da/l22 0 2024-09-16T02:05:53.610 INFO:tasks.workunit.client.0.smithi110.stdout:1/299: symlink d0/d1/d2a/d32/l62 0 2024-09-16T02:05:53.612 INFO:tasks.workunit.client.0.smithi110.stdout:0/239: dread d3/f1a [0,4194304] 0 2024-09-16T02:05:53.613 INFO:tasks.workunit.client.1.smithi165.stdout:1/623: mknod d1/d32/cc5 0 2024-09-16T02:05:53.613 INFO:tasks.workunit.client.1.smithi165.stdout:1/624: write d1/d32/f34 [3766518,5744] 0 2024-09-16T02:05:53.614 INFO:tasks.workunit.client.1.smithi165.stdout:1/625: chown d1/dd/d11/d33 69447889 1 2024-09-16T02:05:53.617 INFO:tasks.workunit.client.0.smithi110.stdout:4/260: creat d4/d12/d18/f4d x:0 0 0 2024-09-16T02:05:53.617 INFO:tasks.workunit.client.0.smithi110.stdout:1/300: dwrite d0/da/f49 [0,4194304] 0 2024-09-16T02:05:53.619 INFO:tasks.workunit.client.1.smithi165.stdout:9/636: rename d7/df/d37/f6b to d7/d32/d38/d68/fd3 0 2024-09-16T02:05:53.620 INFO:tasks.workunit.client.1.smithi165.stdout:1/626: dwrite d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:53.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/627: readlink d1/dd/d11/d33/d67/l8c 0 2024-09-16T02:05:53.624 INFO:tasks.workunit.client.0.smithi110.stdout:8/219: creat d3/d2b/f4a x:0 0 0 2024-09-16T02:05:53.625 INFO:tasks.workunit.client.0.smithi110.stdout:3/169: creat d8/dc/d1b/f35 x:0 0 0 2024-09-16T02:05:53.627 INFO:tasks.workunit.client.1.smithi165.stdout:2/620: getdents df/d23/d66 0 2024-09-16T02:05:53.636 INFO:tasks.workunit.client.1.smithi165.stdout:1/628: creat d1/dd/d11/d33/d92/fc6 x:0 0 0 2024-09-16T02:05:53.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/621: write df/d23/f38 [1346418,19324] 0 2024-09-16T02:05:53.638 INFO:tasks.workunit.client.1.smithi165.stdout:2/622: write df/d73/f9b [1281802,101753] 0 2024-09-16T02:05:53.639 INFO:tasks.workunit.client.1.smithi165.stdout:9/637: symlink d7/d1f/d27/ld4 0 2024-09-16T02:05:53.643 INFO:tasks.workunit.client.1.smithi165.stdout:0/541: sync 2024-09-16T02:05:53.646 INFO:tasks.workunit.client.1.smithi165.stdout:1/629: mkdir d1/dd/d11/d33/d3f/dc7 0 2024-09-16T02:05:53.646 INFO:tasks.workunit.client.1.smithi165.stdout:1/630: fdatasync d1/d32/fbe 0 2024-09-16T02:05:53.647 INFO:tasks.workunit.client.0.smithi110.stdout:7/185: dwrite d3/da/fe [0,4194304] 0 2024-09-16T02:05:53.649 INFO:tasks.workunit.client.1.smithi165.stdout:9/638: mkdir d7/d32/d38/d53/d5c/d61/dd5 0 2024-09-16T02:05:53.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/212: write d0/da/d18/dc/f1f [748886,57295] 0 2024-09-16T02:05:53.650 INFO:tasks.workunit.client.0.smithi110.stdout:2/213: write d0/f3 [963540,17727] 0 2024-09-16T02:05:53.652 INFO:tasks.workunit.client.0.smithi110.stdout:4/261: symlink d4/d8/d31/l4e 0 2024-09-16T02:05:53.655 INFO:tasks.workunit.client.1.smithi165.stdout:5/578: rename de/d21/d26/d3a/f93 to de/fc3 0 2024-09-16T02:05:53.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/170: mkdir d8/dc/d1b/d36 0 2024-09-16T02:05:53.660 INFO:tasks.workunit.client.0.smithi110.stdout:9/133: getdents d1/d5/d8 0 2024-09-16T02:05:53.663 INFO:tasks.workunit.client.0.smithi110.stdout:6/339: truncate d0/d2/dc/d16/f61 1436058 0 2024-09-16T02:05:53.665 INFO:tasks.workunit.client.1.smithi165.stdout:0/542: mkdir d0/d1e/d20/d28/d6d/daf/dc0 0 2024-09-16T02:05:53.666 INFO:tasks.workunit.client.0.smithi110.stdout:5/216: getdents d5/d36/d3d 0 2024-09-16T02:05:53.667 INFO:tasks.workunit.client.1.smithi165.stdout:4/507: rename d4/f26 to d4/dc/d28/d3b/fa5 0 2024-09-16T02:05:53.669 INFO:tasks.workunit.client.0.smithi110.stdout:7/186: creat d3/da/d10/f35 x:0 0 0 2024-09-16T02:05:53.669 INFO:tasks.workunit.client.1.smithi165.stdout:5/579: fsync de/d19/d1c/d49/fa3 0 2024-09-16T02:05:53.670 INFO:tasks.workunit.client.0.smithi110.stdout:7/187: write d3/f34 [880213,43869] 0 2024-09-16T02:05:53.670 INFO:tasks.workunit.client.0.smithi110.stdout:7/188: stat d3/f26 0 2024-09-16T02:05:53.673 INFO:tasks.workunit.client.0.smithi110.stdout:2/214: unlink d0/da/l37 0 2024-09-16T02:05:53.674 INFO:tasks.workunit.client.0.smithi110.stdout:2/215: write d0/db/fd [4950230,93516] 0 2024-09-16T02:05:53.677 INFO:tasks.workunit.client.0.smithi110.stdout:6/340: symlink d0/d29/d2a/d2f/d49/l66 0 2024-09-16T02:05:53.680 INFO:tasks.workunit.client.0.smithi110.stdout:0/240: getdents d3/d6/d43 0 2024-09-16T02:05:53.682 INFO:tasks.workunit.client.1.smithi165.stdout:7/556: rename d0/df/d65/c76 to d0/df/d83/d84/cab 0 2024-09-16T02:05:53.683 INFO:tasks.workunit.client.0.smithi110.stdout:1/301: rename d0/d1/d8 to d0/d25/d63 0 2024-09-16T02:05:53.683 INFO:tasks.workunit.client.0.smithi110.stdout:2/216: dwrite d0/da/d18/f31 [0,4194304] 0 2024-09-16T02:05:53.685 INFO:tasks.workunit.client.0.smithi110.stdout:5/217: mknod d5/d36/d3d/c4d 0 2024-09-16T02:05:53.686 INFO:tasks.workunit.client.0.smithi110.stdout:5/218: readlink d5/l18 0 2024-09-16T02:05:53.686 INFO:tasks.workunit.client.0.smithi110.stdout:7/189: mknod d3/da/d10/d2c/c36 0 2024-09-16T02:05:53.692 INFO:tasks.workunit.client.1.smithi165.stdout:9/639: creat d7/df/d37/fd6 x:0 0 0 2024-09-16T02:05:53.693 INFO:tasks.workunit.client.0.smithi110.stdout:3/171: creat d8/dc/d1b/d36/f37 x:0 0 0 2024-09-16T02:05:53.696 INFO:tasks.workunit.client.1.smithi165.stdout:9/640: dwrite d7/d14/d7a/fcb [0,4194304] 0 2024-09-16T02:05:53.698 INFO:tasks.workunit.client.1.smithi165.stdout:6/582: rename d7/dc/l56 to d7/dc/d3b/d3a/d3d/d5d/d87/l9e 0 2024-09-16T02:05:53.699 INFO:tasks.workunit.client.1.smithi165.stdout:6/583: chown f3 1919 1 2024-09-16T02:05:53.704 INFO:tasks.workunit.client.0.smithi110.stdout:2/217: mkdir d0/db/d47 0 2024-09-16T02:05:53.706 INFO:tasks.workunit.client.1.smithi165.stdout:1/631: link d1/d68/f64 d1/dd/d11/d33/d3f/fc8 0 2024-09-16T02:05:53.709 INFO:tasks.workunit.client.0.smithi110.stdout:5/219: symlink d5/d36/d3d/l4e 0 2024-09-16T02:05:53.710 INFO:tasks.workunit.client.1.smithi165.stdout:3/649: write da/d20/d26/d52/fe0 [297963,12544] 0 2024-09-16T02:05:53.712 INFO:tasks.workunit.client.1.smithi165.stdout:9/641: chown d7/d32/d38/d53/c44 634606018 1 2024-09-16T02:05:53.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/172: creat d8/dc/d1b/d1c/f38 x:0 0 0 2024-09-16T02:05:53.714 INFO:tasks.workunit.client.1.smithi165.stdout:3/650: dread da/d20/d26/f7f [0,4194304] 0 2024-09-16T02:05:53.714 INFO:tasks.workunit.client.0.smithi110.stdout:3/173: write d8/dc/f27 [818734,127322] 0 2024-09-16T02:05:53.715 INFO:tasks.workunit.client.1.smithi165.stdout:8/595: rename dd/fb1 to dd/d11/d14/d70/d7b/d9a/fcc 0 2024-09-16T02:05:53.716 INFO:tasks.workunit.client.1.smithi165.stdout:8/596: read dd/d11/d14/f54 [2390852,120566] 0 2024-09-16T02:05:53.717 INFO:tasks.workunit.client.0.smithi110.stdout:6/341: symlink d0/d2/dc/d62/l67 0 2024-09-16T02:05:53.718 INFO:tasks.workunit.client.0.smithi110.stdout:6/342: chown d0/d2/dc/f41 60074705 1 2024-09-16T02:05:53.718 INFO:tasks.workunit.client.0.smithi110.stdout:3/174: dread f3 [0,4194304] 0 2024-09-16T02:05:53.719 INFO:tasks.workunit.client.0.smithi110.stdout:6/343: readlink d0/d2/dc/d62/l67 0 2024-09-16T02:05:53.719 INFO:tasks.workunit.client.0.smithi110.stdout:6/344: fsync d0/d2/dc/f41 0 2024-09-16T02:05:53.724 INFO:tasks.workunit.client.1.smithi165.stdout:9/642: creat d7/d32/d85/fd7 x:0 0 0 2024-09-16T02:05:53.729 INFO:tasks.workunit.client.0.smithi110.stdout:6/345: dwrite d0/d2/d5/f4e [0,4194304] 0 2024-09-16T02:05:53.730 INFO:tasks.workunit.client.1.smithi165.stdout:3/651: rename da/d20/f3d to da/d17/d7a/d7d/fe7 0 2024-09-16T02:05:53.730 INFO:tasks.workunit.client.0.smithi110.stdout:5/220: dread d5/dd/f12 [0,4194304] 0 2024-09-16T02:05:53.733 INFO:tasks.workunit.client.0.smithi110.stdout:2/218: mkdir d0/db/d47/d48 0 2024-09-16T02:05:53.735 INFO:tasks.workunit.client.0.smithi110.stdout:8/220: truncate d3/d31/f3e 2196551 0 2024-09-16T02:05:53.738 INFO:tasks.workunit.client.1.smithi165.stdout:6/584: creat d7/dc/df/d1a/d4d/d5f/f9f x:0 0 0 2024-09-16T02:05:53.739 INFO:tasks.workunit.client.1.smithi165.stdout:2/623: truncate df/d73/f7c 314310 0 2024-09-16T02:05:53.742 INFO:tasks.workunit.client.0.smithi110.stdout:8/221: dwrite d3/d2b/d27/f2d [0,4194304] 0 2024-09-16T02:05:53.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/190: rename d3/da/d10/l24 to d3/da/l37 0 2024-09-16T02:05:53.748 INFO:tasks.workunit.client.1.smithi165.stdout:3/652: mkdir da/d17/d78/d2c/de8 0 2024-09-16T02:05:53.750 INFO:tasks.workunit.client.0.smithi110.stdout:5/221: readlink d5/dd/df/d11/l15 0 2024-09-16T02:05:53.751 INFO:tasks.workunit.client.0.smithi110.stdout:7/191: dread d3/f34 [0,4194304] 0 2024-09-16T02:05:53.752 INFO:tasks.workunit.client.0.smithi110.stdout:7/192: write d3/f9 [5850894,70039] 0 2024-09-16T02:05:53.755 INFO:tasks.workunit.client.1.smithi165.stdout:0/543: dwrite d0/d1e/d20/d28/f68 [0,4194304] 0 2024-09-16T02:05:53.755 INFO:tasks.workunit.client.0.smithi110.stdout:7/193: read d3/f14 [2611322,121302] 0 2024-09-16T02:05:53.756 INFO:tasks.workunit.client.0.smithi110.stdout:7/194: fsync d3/da/f22 0 2024-09-16T02:05:53.757 INFO:tasks.workunit.client.1.smithi165.stdout:2/624: chown df/d10/d1a/d68/lb0 50541 1 2024-09-16T02:05:53.759 INFO:tasks.workunit.client.1.smithi165.stdout:9/643: rename d7/df/d37/d43/lc9 to d7/d1f/d27/d49/ld8 0 2024-09-16T02:05:53.763 INFO:tasks.workunit.client.0.smithi110.stdout:1/302: getdents d0/da 0 2024-09-16T02:05:53.764 INFO:tasks.workunit.client.1.smithi165.stdout:3/653: symlink da/d17/d7a/dab/le9 0 2024-09-16T02:05:53.766 INFO:tasks.workunit.client.0.smithi110.stdout:8/222: write d3/d31/f49 [671850,44576] 0 2024-09-16T02:05:53.768 INFO:tasks.workunit.client.0.smithi110.stdout:8/223: truncate d3/d12/f26 20563 0 2024-09-16T02:05:53.768 INFO:tasks.workunit.client.1.smithi165.stdout:8/597: creat dd/d11/fcd x:0 0 0 2024-09-16T02:05:53.769 INFO:tasks.workunit.client.1.smithi165.stdout:8/598: dread - dd/d11/d14/fbc zero size 2024-09-16T02:05:53.770 INFO:tasks.workunit.client.1.smithi165.stdout:5/580: truncate de/d19/d1c/d4d/f7e 3304530 0 2024-09-16T02:05:53.774 INFO:tasks.workunit.client.1.smithi165.stdout:6/585: dread d7/dc/d3b/d3a/d3d/d5d/d73/d82/f8a [0,4194304] 0 2024-09-16T02:05:53.775 INFO:tasks.workunit.client.0.smithi110.stdout:1/303: dwrite d0/d1/d2a/d32/f3a [0,4194304] 0 2024-09-16T02:05:53.775 INFO:tasks.workunit.client.0.smithi110.stdout:5/222: rmdir d5 39 2024-09-16T02:05:53.777 INFO:tasks.workunit.client.1.smithi165.stdout:9/644: fdatasync d7/d32/d38/f77 0 2024-09-16T02:05:53.777 INFO:tasks.workunit.client.0.smithi110.stdout:1/304: fsync d0/f47 0 2024-09-16T02:05:53.780 INFO:tasks.workunit.client.0.smithi110.stdout:0/241: dwrite d3/f1a [0,4194304] 0 2024-09-16T02:05:53.782 INFO:tasks.workunit.client.0.smithi110.stdout:3/175: creat d8/f39 x:0 0 0 2024-09-16T02:05:53.784 INFO:tasks.workunit.client.0.smithi110.stdout:8/224: dwrite d3/d2b/f2e [0,4194304] 0 2024-09-16T02:05:53.786 INFO:tasks.workunit.client.1.smithi165.stdout:3/654: mknod da/d20/d26/d8c/cea 0 2024-09-16T02:05:53.786 INFO:tasks.workunit.client.0.smithi110.stdout:8/225: stat d3/d12/d1d 0 2024-09-16T02:05:53.793 INFO:tasks.workunit.client.1.smithi165.stdout:7/557: dwrite d0/df/d33/f29 [0,4194304] 0 2024-09-16T02:05:53.793 INFO:tasks.workunit.client.1.smithi165.stdout:8/599: creat dd/d13/d89/fce x:0 0 0 2024-09-16T02:05:53.793 INFO:tasks.workunit.client.0.smithi110.stdout:1/305: dread d0/d25/f3b [0,4194304] 0 2024-09-16T02:05:53.794 INFO:tasks.workunit.client.0.smithi110.stdout:0/242: dwrite d3/d4/f23 [0,4194304] 0 2024-09-16T02:05:53.794 INFO:tasks.workunit.client.1.smithi165.stdout:1/632: dwrite d1/dd/d11/d46/f73 [0,4194304] 0 2024-09-16T02:05:53.795 INFO:tasks.workunit.client.1.smithi165.stdout:7/558: stat d0/df/d33/d2a/f4d 0 2024-09-16T02:05:53.798 INFO:tasks.workunit.client.0.smithi110.stdout:7/195: mkdir d3/d15/d38 0 2024-09-16T02:05:53.802 INFO:tasks.workunit.client.1.smithi165.stdout:9/645: dread d7/df/f10 [0,4194304] 0 2024-09-16T02:05:53.809 INFO:tasks.workunit.client.1.smithi165.stdout:0/544: unlink d0/d1e/d20/d9c/ca6 0 2024-09-16T02:05:53.811 INFO:tasks.workunit.client.1.smithi165.stdout:4/508: mknod d4/d40/ca6 0 2024-09-16T02:05:53.812 INFO:tasks.workunit.client.1.smithi165.stdout:6/586: dread d7/d17/f69 [0,4194304] 0 2024-09-16T02:05:53.813 INFO:tasks.workunit.client.0.smithi110.stdout:6/346: creat d0/d2/f68 x:0 0 0 2024-09-16T02:05:53.814 INFO:tasks.workunit.client.0.smithi110.stdout:6/347: write d0/d2/d5/f52 [86473,68282] 0 2024-09-16T02:05:53.817 INFO:tasks.workunit.client.0.smithi110.stdout:6/348: chown d0/d2/dc/d62/l67 1 1 2024-09-16T02:05:53.819 INFO:tasks.workunit.client.1.smithi165.stdout:3/655: unlink da/d20/d26/d52/d9c/da6/lad 0 2024-09-16T02:05:53.826 INFO:tasks.workunit.client.1.smithi165.stdout:8/600: mknod dd/d11/d14/d3f/d72/ccf 0 2024-09-16T02:05:53.829 INFO:tasks.workunit.client.1.smithi165.stdout:5/581: readlink de/d21/d26/d3a/d6d/dad/lbe 0 2024-09-16T02:05:53.830 INFO:tasks.workunit.client.1.smithi165.stdout:5/582: write de/d19/d1c/d84/f88 [2117077,115341] 0 2024-09-16T02:05:53.836 INFO:tasks.workunit.client.1.smithi165.stdout:5/583: dwrite de/d21/d26/d9a/fc0 [0,4194304] 0 2024-09-16T02:05:53.836 INFO:tasks.workunit.client.1.smithi165.stdout:4/509: write d4/dc/d28/f4a [2144278,99223] 0 2024-09-16T02:05:53.841 INFO:tasks.workunit.client.1.smithi165.stdout:3/656: rename da/d17/d78/d2c/f70 to da/d17/d78/d2c/de8/feb 0 2024-09-16T02:05:53.843 INFO:tasks.workunit.client.1.smithi165.stdout:5/584: dread de/d19/d1c/d4d/f72 [0,4194304] 0 2024-09-16T02:05:53.846 INFO:tasks.workunit.client.1.smithi165.stdout:0/545: symlink d0/d1e/d20/d28/da7/db4/lc1 0 2024-09-16T02:05:53.850 INFO:tasks.workunit.client.0.smithi110.stdout:7/196: creat d3/da/d10/f39 x:0 0 0 2024-09-16T02:05:53.851 INFO:tasks.workunit.client.0.smithi110.stdout:3/176: read f7 [1302724,95561] 0 2024-09-16T02:05:53.855 INFO:tasks.workunit.client.0.smithi110.stdout:7/197: write d3/da/d10/d11/f2d [842523,89195] 0 2024-09-16T02:05:53.855 INFO:tasks.workunit.client.0.smithi110.stdout:5/223: dwrite d5/dd/f23 [0,4194304] 0 2024-09-16T02:05:53.855 INFO:tasks.workunit.client.1.smithi165.stdout:9/646: dwrite d7/d32/faf [0,4194304] 0 2024-09-16T02:05:53.861 INFO:tasks.workunit.client.0.smithi110.stdout:0/243: dwrite d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:53.863 INFO:tasks.workunit.client.1.smithi165.stdout:9/647: dwrite d7/df/d37/d43/d88/fa6 [0,4194304] 0 2024-09-16T02:05:53.866 INFO:tasks.workunit.client.0.smithi110.stdout:2/219: getdents d0/da/d18/d25/d3b 0 2024-09-16T02:05:53.870 INFO:tasks.workunit.client.1.smithi165.stdout:8/601: truncate dd/d13/f63 1835613 0 2024-09-16T02:05:53.870 INFO:tasks.workunit.client.1.smithi165.stdout:5/585: symlink de/d19/d1c/d84/d92/lc4 0 2024-09-16T02:05:53.873 INFO:tasks.workunit.client.1.smithi165.stdout:0/546: truncate d0/d47/f6f 468994 0 2024-09-16T02:05:53.873 INFO:tasks.workunit.client.0.smithi110.stdout:1/306: mkdir d0/d1/d4/d46/d64 0 2024-09-16T02:05:53.875 INFO:tasks.workunit.client.0.smithi110.stdout:1/307: dread - d0/d1/f3f zero size 2024-09-16T02:05:53.876 INFO:tasks.workunit.client.0.smithi110.stdout:2/220: dwrite d0/da/f2c [0,4194304] 0 2024-09-16T02:05:53.878 INFO:tasks.workunit.client.0.smithi110.stdout:7/198: mkdir d3/d15/d3a 0 2024-09-16T02:05:53.879 INFO:tasks.workunit.client.1.smithi165.stdout:2/625: sync 2024-09-16T02:05:53.880 INFO:tasks.workunit.client.0.smithi110.stdout:2/221: fsync d0/da/d18/d2d/f42 0 2024-09-16T02:05:53.881 INFO:tasks.workunit.client.1.smithi165.stdout:2/626: write df/d23/d66/faa [268956,69359] 0 2024-09-16T02:05:53.881 INFO:tasks.workunit.client.0.smithi110.stdout:5/224: creat d5/d36/d3d/f4f x:0 0 0 2024-09-16T02:05:53.882 INFO:tasks.workunit.client.1.smithi165.stdout:2/627: read df/d73/f9b [615085,118128] 0 2024-09-16T02:05:53.885 INFO:tasks.workunit.client.0.smithi110.stdout:0/244: creat d3/d4/dc/f49 x:0 0 0 2024-09-16T02:05:53.887 INFO:tasks.workunit.client.1.smithi165.stdout:8/602: mkdir dd/d9e/dd0 0 2024-09-16T02:05:53.888 INFO:tasks.workunit.client.1.smithi165.stdout:8/603: write dd/d13/d89/fce [440943,100246] 0 2024-09-16T02:05:53.889 INFO:tasks.workunit.client.0.smithi110.stdout:8/226: dread d3/d31/f3e [0,4194304] 0 2024-09-16T02:05:53.890 INFO:tasks.workunit.client.1.smithi165.stdout:3/657: write da/d17/d78/d2c/f74 [1080631,57662] 0 2024-09-16T02:05:53.890 INFO:tasks.workunit.client.1.smithi165.stdout:7/559: write d0/df/d42/fa5 [2636055,60717] 0 2024-09-16T02:05:53.891 INFO:tasks.workunit.client.1.smithi165.stdout:0/547: dread - d0/d1e/d39/d48/d5f/d82/f8a zero size 2024-09-16T02:05:53.892 INFO:tasks.workunit.client.0.smithi110.stdout:6/349: creat d0/d2/f69 x:0 0 0 2024-09-16T02:05:53.893 INFO:tasks.workunit.client.0.smithi110.stdout:6/350: dread - d0/d2/f69 zero size 2024-09-16T02:05:53.894 INFO:tasks.workunit.client.1.smithi165.stdout:9/648: mkdir d7/d32/d4a/da8/dd9 0 2024-09-16T02:05:53.901 INFO:tasks.workunit.client.1.smithi165.stdout:8/604: fdatasync f9 0 2024-09-16T02:05:53.901 INFO:tasks.workunit.client.1.smithi165.stdout:4/510: truncate d4/dc/d28/f4a 1328414 0 2024-09-16T02:05:53.902 INFO:tasks.workunit.client.0.smithi110.stdout:0/245: truncate d3/d4/dc/f1c 206549 0 2024-09-16T02:05:53.904 INFO:tasks.workunit.client.1.smithi165.stdout:7/560: unlink d0/df/d7/d67/ca0 0 2024-09-16T02:05:53.905 INFO:tasks.workunit.client.0.smithi110.stdout:0/246: write d3/d4/dc/d14/f19 [1626192,103293] 0 2024-09-16T02:05:53.907 INFO:tasks.workunit.client.0.smithi110.stdout:8/227: mknod d3/d2b/c4b 0 2024-09-16T02:05:53.907 INFO:tasks.workunit.client.1.smithi165.stdout:8/605: dread dd/d11/d14/d3f/d25/d36/f64 [0,4194304] 0 2024-09-16T02:05:53.907 INFO:tasks.workunit.client.1.smithi165.stdout:3/658: symlink da/d20/d26/d8c/lec 0 2024-09-16T02:05:53.910 INFO:tasks.workunit.client.0.smithi110.stdout:3/177: dwrite f3 [0,4194304] 0 2024-09-16T02:05:53.912 INFO:tasks.workunit.client.0.smithi110.stdout:0/247: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:53.913 INFO:tasks.workunit.client.0.smithi110.stdout:0/248: write d3/d4/dc/f3e [777688,65621] 0 2024-09-16T02:05:53.915 INFO:tasks.workunit.client.0.smithi110.stdout:7/199: creat d3/d15/d38/f3b x:0 0 0 2024-09-16T02:05:53.915 INFO:tasks.workunit.client.0.smithi110.stdout:0/249: truncate d3/d4/dc/f1e 4400777 0 2024-09-16T02:05:53.917 INFO:tasks.workunit.client.0.smithi110.stdout:5/225: link d5/d36/d45/d47/f49 d5/dd/df/d11/f50 0 2024-09-16T02:05:53.919 INFO:tasks.workunit.client.1.smithi165.stdout:9/649: mknod d7/d32/d38/d53/d56/dca/dd2/cda 0 2024-09-16T02:05:53.924 INFO:tasks.workunit.client.1.smithi165.stdout:5/586: creat de/d19/fc5 x:0 0 0 2024-09-16T02:05:53.925 INFO:tasks.workunit.client.0.smithi110.stdout:0/250: dwrite d3/d4/dc/f3e [0,4194304] 0 2024-09-16T02:05:53.925 INFO:tasks.workunit.client.0.smithi110.stdout:7/200: dwrite d3/f14 [0,4194304] 0 2024-09-16T02:05:53.926 INFO:tasks.workunit.client.1.smithi165.stdout:2/628: dwrite df/d23/f48 [0,4194304] 0 2024-09-16T02:05:53.927 INFO:tasks.workunit.client.1.smithi165.stdout:9/650: dwrite d7/df/d67/d92/fc6 [0,4194304] 0 2024-09-16T02:05:53.929 INFO:tasks.workunit.client.0.smithi110.stdout:7/201: fsync d3/da/f22 0 2024-09-16T02:05:53.929 INFO:tasks.workunit.client.1.smithi165.stdout:2/629: chown df/d23/d28/d3b/d6d/l75 2592537 1 2024-09-16T02:05:53.930 INFO:tasks.workunit.client.1.smithi165.stdout:9/651: readlink d7/d32/d38/d53/d56/d95/l1e 0 2024-09-16T02:05:53.933 INFO:tasks.workunit.client.0.smithi110.stdout:8/228: mkdir d3/d12/d1d/d4c 0 2024-09-16T02:05:53.938 INFO:tasks.workunit.client.1.smithi165.stdout:0/548: dwrite d0/d1e/d39/d48/f75 [0,4194304] 0 2024-09-16T02:05:53.940 INFO:tasks.workunit.client.0.smithi110.stdout:7/202: dwrite d3/da/fe [0,4194304] 0 2024-09-16T02:05:53.947 INFO:tasks.workunit.client.0.smithi110.stdout:8/229: dwrite d3/d12/d1a/f40 [0,4194304] 0 2024-09-16T02:05:53.948 INFO:tasks.workunit.client.0.smithi110.stdout:6/351: truncate d0/d29/f32 1761131 0 2024-09-16T02:05:53.948 INFO:tasks.workunit.client.1.smithi165.stdout:7/561: creat d0/d2c/d85/fac x:0 0 0 2024-09-16T02:05:53.951 INFO:tasks.workunit.client.1.smithi165.stdout:3/659: unlink da/d20/d26/l47 0 2024-09-16T02:05:53.952 INFO:tasks.workunit.client.1.smithi165.stdout:3/660: readlink da/d20/d26/d52/l87 0 2024-09-16T02:05:53.954 INFO:tasks.workunit.client.0.smithi110.stdout:0/251: truncate d3/d4/dc/d10/f3c 3659456 0 2024-09-16T02:05:53.955 INFO:tasks.workunit.client.1.smithi165.stdout:8/606: dwrite dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:53.956 INFO:tasks.workunit.client.0.smithi110.stdout:3/178: mkdir d8/dc/d1b/d3a 0 2024-09-16T02:05:53.957 INFO:tasks.workunit.client.0.smithi110.stdout:3/179: chown c6 54399 1 2024-09-16T02:05:53.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/630: mkdir df/d10/d1a/dbc 0 2024-09-16T02:05:53.959 INFO:tasks.workunit.client.0.smithi110.stdout:1/308: link d0/da/c59 d0/c65 0 2024-09-16T02:05:53.962 INFO:tasks.workunit.client.1.smithi165.stdout:1/633: sync 2024-09-16T02:05:53.962 INFO:tasks.workunit.client.1.smithi165.stdout:6/587: sync 2024-09-16T02:05:53.963 INFO:tasks.workunit.client.1.smithi165.stdout:1/634: stat d1/d6b 0 2024-09-16T02:05:53.968 INFO:tasks.workunit.client.0.smithi110.stdout:1/309: dwrite d0/d1/d4/d46/f5e [0,4194304] 0 2024-09-16T02:05:53.972 INFO:tasks.workunit.client.0.smithi110.stdout:1/310: chown d0/d1/l3c 249240 1 2024-09-16T02:05:53.973 INFO:tasks.workunit.client.1.smithi165.stdout:0/549: rmdir d0/d1e/d20/d28/d6d 39 2024-09-16T02:05:53.973 INFO:tasks.workunit.client.1.smithi165.stdout:2/631: dwrite df/d23/f48 [4194304,4194304] 0 2024-09-16T02:05:53.978 INFO:tasks.workunit.client.0.smithi110.stdout:1/311: truncate d0/f56 809282 0 2024-09-16T02:05:53.980 INFO:tasks.workunit.client.1.smithi165.stdout:3/661: rmdir da/d57/d8d/d97 39 2024-09-16T02:05:53.981 INFO:tasks.workunit.client.0.smithi110.stdout:8/230: dwrite d3/d12/d1d/f1f [0,4194304] 0 2024-09-16T02:05:53.984 INFO:tasks.workunit.client.0.smithi110.stdout:3/180: rmdir d8/d29 39 2024-09-16T02:05:53.986 INFO:tasks.workunit.client.0.smithi110.stdout:5/226: creat d5/f51 x:0 0 0 2024-09-16T02:05:53.990 INFO:tasks.workunit.client.0.smithi110.stdout:1/312: dread d0/d1/d4/f26 [0,4194304] 0 2024-09-16T02:05:53.991 INFO:tasks.workunit.client.0.smithi110.stdout:5/227: chown d5/d36/l39 13 1 2024-09-16T02:05:53.993 INFO:tasks.workunit.client.0.smithi110.stdout:8/231: creat d3/d2b/d27/f4d x:0 0 0 2024-09-16T02:05:53.993 INFO:tasks.workunit.client.1.smithi165.stdout:4/511: truncate d4/d40/d4f/f78 1709502 0 2024-09-16T02:05:53.995 INFO:tasks.workunit.client.0.smithi110.stdout:7/203: link d3/d15/c23 d3/da/d10/d2c/c3c 0 2024-09-16T02:05:53.996 INFO:tasks.workunit.client.1.smithi165.stdout:5/587: truncate de/d19/d1c/f56 1389266 0 2024-09-16T02:05:53.999 INFO:tasks.workunit.client.1.smithi165.stdout:9/652: truncate d7/d32/d38/d53/d5c/f81 3136645 0 2024-09-16T02:05:54.001 INFO:tasks.workunit.client.1.smithi165.stdout:9/653: write d7/df/d67/f7b [1538633,75424] 0 2024-09-16T02:05:54.001 INFO:tasks.workunit.client.0.smithi110.stdout:6/352: link d0/d2/f42 d0/d2/f6a 0 2024-09-16T02:05:54.003 INFO:tasks.workunit.client.0.smithi110.stdout:0/252: creat d3/d4/f4a x:0 0 0 2024-09-16T02:05:54.004 INFO:tasks.workunit.client.0.smithi110.stdout:5/228: symlink d5/dd/df/d28/l52 0 2024-09-16T02:05:54.004 INFO:tasks.workunit.client.0.smithi110.stdout:0/253: truncate d3/d4/d41/f48 623582 0 2024-09-16T02:05:54.005 INFO:tasks.workunit.client.0.smithi110.stdout:0/254: readlink d3/d6/l36 0 2024-09-16T02:05:54.007 INFO:tasks.workunit.client.0.smithi110.stdout:5/229: dread d5/dd/f43 [0,4194304] 0 2024-09-16T02:05:54.014 INFO:tasks.workunit.client.0.smithi110.stdout:6/353: creat d0/d29/d2a/d2f/d34/f6b x:0 0 0 2024-09-16T02:05:54.014 INFO:tasks.workunit.client.1.smithi165.stdout:2/632: write df/d23/d28/d3b/f96 [7818,89049] 0 2024-09-16T02:05:54.017 INFO:tasks.workunit.client.1.smithi165.stdout:3/662: dread da/d17/d78/d2c/d2d/d6c/db5/fbb [0,4194304] 0 2024-09-16T02:05:54.017 INFO:tasks.workunit.client.0.smithi110.stdout:1/313: creat d0/d1/d4/d46/d64/f66 x:0 0 0 2024-09-16T02:05:54.018 INFO:tasks.workunit.client.0.smithi110.stdout:0/255: mkdir d3/d6/d4b 0 2024-09-16T02:05:54.019 INFO:tasks.workunit.client.1.smithi165.stdout:3/663: read da/d20/d26/d52/fac [2983862,92022] 0 2024-09-16T02:05:54.020 INFO:tasks.workunit.client.0.smithi110.stdout:0/256: write d3/d4/f27 [464995,13370] 0 2024-09-16T02:05:54.020 INFO:tasks.workunit.client.0.smithi110.stdout:5/230: fdatasync d5/dd/f17 0 2024-09-16T02:05:54.026 INFO:tasks.workunit.client.1.smithi165.stdout:8/607: link dd/d11/f30 dd/d13/d53/db7/fd1 0 2024-09-16T02:05:54.030 INFO:tasks.workunit.client.0.smithi110.stdout:6/354: mknod d0/d2/c6c 0 2024-09-16T02:05:54.031 INFO:tasks.workunit.client.1.smithi165.stdout:4/512: creat d4/dc/d20/d4e/fa7 x:0 0 0 2024-09-16T02:05:54.031 INFO:tasks.workunit.client.0.smithi110.stdout:0/257: dwrite d3/d6/f44 [4194304,4194304] 0 2024-09-16T02:05:54.033 INFO:tasks.workunit.client.1.smithi165.stdout:6/588: mknod d7/d17/ca0 0 2024-09-16T02:05:54.033 INFO:tasks.workunit.client.0.smithi110.stdout:5/231: dwrite d5/dd/f4c [0,4194304] 0 2024-09-16T02:05:54.033 INFO:tasks.workunit.client.0.smithi110.stdout:6/355: readlink d0/d29/d2a/d2f/d49/l66 0 2024-09-16T02:05:54.035 INFO:tasks.workunit.client.0.smithi110.stdout:5/232: dread - d5/dd/df/f3f zero size 2024-09-16T02:05:54.035 INFO:tasks.workunit.client.0.smithi110.stdout:5/233: write d5/f1e [641033,117078] 0 2024-09-16T02:05:54.037 INFO:tasks.workunit.client.0.smithi110.stdout:8/232: truncate d3/d2b/d27/f2d 1630269 0 2024-09-16T02:05:54.037 INFO:tasks.workunit.client.1.smithi165.stdout:5/588: write de/d21/d51/f5f [104262,125417] 0 2024-09-16T02:05:54.043 INFO:tasks.workunit.client.1.smithi165.stdout:0/550: mknod d0/d1e/d20/d28/d6d/daf/cc2 0 2024-09-16T02:05:54.045 INFO:tasks.workunit.client.0.smithi110.stdout:5/234: creat d5/d36/f53 x:0 0 0 2024-09-16T02:05:54.047 INFO:tasks.workunit.client.1.smithi165.stdout:9/654: unlink d7/d14/d7a/fc8 0 2024-09-16T02:05:54.050 INFO:tasks.workunit.client.0.smithi110.stdout:8/233: symlink d3/d12/d1d/l4e 0 2024-09-16T02:05:54.053 INFO:tasks.workunit.client.0.smithi110.stdout:6/356: rename d0/d29/d2a/d2f/d34/f6b to d0/d2/dc/f6d 0 2024-09-16T02:05:54.054 INFO:tasks.workunit.client.0.smithi110.stdout:8/234: dread d3/d2b/f1e [0,4194304] 0 2024-09-16T02:05:54.056 INFO:tasks.workunit.client.0.smithi110.stdout:8/235: write d3/d2b/f4a [767638,88220] 0 2024-09-16T02:05:54.058 INFO:tasks.workunit.client.0.smithi110.stdout:8/236: dread - d3/d2b/d27/f47 zero size 2024-09-16T02:05:54.058 INFO:tasks.workunit.client.0.smithi110.stdout:1/314: getdents d0 0 2024-09-16T02:05:54.061 INFO:tasks.workunit.client.1.smithi165.stdout:3/664: mkdir da/d17/d7a/d7d/da8/ded 0 2024-09-16T02:05:54.063 INFO:tasks.workunit.client.0.smithi110.stdout:5/235: dread d5/dd/df/f1c [0,4194304] 0 2024-09-16T02:05:54.064 INFO:tasks.workunit.client.0.smithi110.stdout:5/236: chown d5/dd/df/d11/c46 2947 1 2024-09-16T02:05:54.067 INFO:tasks.workunit.client.0.smithi110.stdout:1/315: unlink d0/da/c3d 0 2024-09-16T02:05:54.070 INFO:tasks.workunit.client.0.smithi110.stdout:0/258: getdents d3/d4/dc 0 2024-09-16T02:05:54.072 INFO:tasks.workunit.client.1.smithi165.stdout:4/513: dread d4/dc/d28/f4a [0,4194304] 0 2024-09-16T02:05:54.074 INFO:tasks.workunit.client.1.smithi165.stdout:5/589: rename de/d19/d67/f7f to de/d19/d67/d74/fc6 0 2024-09-16T02:05:54.076 INFO:tasks.workunit.client.1.smithi165.stdout:0/551: mknod d0/d1e/d39/d48/d5f/d82/cc3 0 2024-09-16T02:05:54.078 INFO:tasks.workunit.client.1.smithi165.stdout:6/589: write d7/d1f/f33 [4572757,97073] 0 2024-09-16T02:05:54.079 INFO:tasks.workunit.client.0.smithi110.stdout:5/237: write d5/dd/df/d11/f50 [252765,38626] 0 2024-09-16T02:05:54.081 INFO:tasks.workunit.client.1.smithi165.stdout:7/562: getdents d0/df/d65 0 2024-09-16T02:05:54.081 INFO:tasks.workunit.client.1.smithi165.stdout:8/608: dwrite dd/d13/d53/db7/fd1 [0,4194304] 0 2024-09-16T02:05:54.082 INFO:tasks.workunit.client.0.smithi110.stdout:0/259: mknod d3/d6/d4b/c4c 0 2024-09-16T02:05:54.082 INFO:tasks.workunit.client.0.smithi110.stdout:8/237: dread d3/f2a [0,4194304] 0 2024-09-16T02:05:54.084 INFO:tasks.workunit.client.1.smithi165.stdout:1/635: getdents d1/dd/d11/d46/d57 0 2024-09-16T02:05:54.084 INFO:tasks.workunit.client.1.smithi165.stdout:1/636: chown d1/d22/fa2 3227709 1 2024-09-16T02:05:54.085 INFO:tasks.workunit.client.0.smithi110.stdout:8/238: readlink d3/d12/d1a/l28 0 2024-09-16T02:05:54.085 INFO:tasks.workunit.client.1.smithi165.stdout:4/514: creat d4/dc/d18/fa8 x:0 0 0 2024-09-16T02:05:54.086 INFO:tasks.workunit.client.1.smithi165.stdout:7/563: dread d0/df/d65/f6e [0,4194304] 0 2024-09-16T02:05:54.086 INFO:tasks.workunit.client.0.smithi110.stdout:5/238: dread d5/dd/df/f1d [0,4194304] 0 2024-09-16T02:05:54.087 INFO:tasks.workunit.client.0.smithi110.stdout:1/316: dwrite d0/d1/d2a/f34 [0,4194304] 0 2024-09-16T02:05:54.087 INFO:tasks.workunit.client.1.smithi165.stdout:6/590: rmdir d7/dc/df/d5b 39 2024-09-16T02:05:54.090 INFO:tasks.workunit.client.1.smithi165.stdout:0/552: symlink d0/d1e/d39/d48/d5f/d96/da4/dbb/lc4 0 2024-09-16T02:05:54.091 INFO:tasks.workunit.client.0.smithi110.stdout:8/239: fsync d3/d12/d1a/f40 0 2024-09-16T02:05:54.092 INFO:tasks.workunit.client.1.smithi165.stdout:7/564: chown d0/df/d33/c64 86943 1 2024-09-16T02:05:54.094 INFO:tasks.workunit.client.0.smithi110.stdout:1/317: dread d0/f56 [0,4194304] 0 2024-09-16T02:05:54.094 INFO:tasks.workunit.client.1.smithi165.stdout:2/633: sync 2024-09-16T02:05:54.096 INFO:tasks.workunit.client.1.smithi165.stdout:6/591: creat d7/dc/d3b/d3a/d3d/fa1 x:0 0 0 2024-09-16T02:05:54.097 INFO:tasks.workunit.client.1.smithi165.stdout:6/592: stat f2 0 2024-09-16T02:05:54.097 INFO:tasks.workunit.client.1.smithi165.stdout:4/515: rename d4/dc/d20/d45/l66 to d4/dc/d18/d37/d53/d64/d91/la9 0 2024-09-16T02:05:54.098 INFO:tasks.workunit.client.1.smithi165.stdout:1/637: dread d1/dd/d11/d33/d67/fa8 [0,4194304] 0 2024-09-16T02:05:54.098 INFO:tasks.workunit.client.1.smithi165.stdout:5/590: mkdir de/d21/d26/d3a/d54/d8c/dc7 0 2024-09-16T02:05:54.098 INFO:tasks.workunit.client.1.smithi165.stdout:5/591: fsync f7 0 2024-09-16T02:05:54.098 INFO:tasks.workunit.client.0.smithi110.stdout:0/260: dwrite d3/d4/d41/f48 [0,4194304] 0 2024-09-16T02:05:54.099 INFO:tasks.workunit.client.1.smithi165.stdout:2/634: mknod df/d23/d28/d9a/d86/cbd 0 2024-09-16T02:05:54.102 INFO:tasks.workunit.client.1.smithi165.stdout:9/655: dread d7/d32/d38/d53/d5c/f81 [0,4194304] 0 2024-09-16T02:05:54.105 INFO:tasks.workunit.client.1.smithi165.stdout:0/553: rename d0/d1e/d39/d48/d45/l78 to d0/d2a/lc5 0 2024-09-16T02:05:54.105 INFO:tasks.workunit.client.0.smithi110.stdout:8/240: dwrite d3/f9 [4194304,4194304] 0 2024-09-16T02:05:54.108 INFO:tasks.workunit.client.1.smithi165.stdout:7/565: symlink d0/d3d/d9f/lad 0 2024-09-16T02:05:54.111 INFO:tasks.workunit.client.1.smithi165.stdout:3/665: truncate da/d17/f9f 1291789 0 2024-09-16T02:05:54.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/239: mknod d5/c54 0 2024-09-16T02:05:54.116 INFO:tasks.workunit.client.1.smithi165.stdout:8/609: dwrite dd/d11/d14/f40 [0,4194304] 0 2024-09-16T02:05:54.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/240: dwrite d5/dd/f23 [0,4194304] 0 2024-09-16T02:05:54.121 INFO:tasks.workunit.client.1.smithi165.stdout:1/638: symlink d1/d19/d4d/lc9 0 2024-09-16T02:05:54.123 INFO:tasks.workunit.client.1.smithi165.stdout:5/592: read de/d21/d26/d3a/f5a [4521530,84644] 0 2024-09-16T02:05:54.125 INFO:tasks.workunit.client.0.smithi110.stdout:1/318: link d0/d1/d4/f18 d0/d1/d2a/d32/f67 0 2024-09-16T02:05:54.126 INFO:tasks.workunit.client.1.smithi165.stdout:2/635: chown df/d23/d28/f32 3882 1 2024-09-16T02:05:54.131 INFO:tasks.workunit.client.1.smithi165.stdout:0/554: chown d0/d1e/d39/d48/d5f/l66 281625620 1 2024-09-16T02:05:54.132 INFO:tasks.workunit.client.0.smithi110.stdout:8/241: creat d3/d12/d1a/d36/f4f x:0 0 0 2024-09-16T02:05:54.133 INFO:tasks.workunit.client.1.smithi165.stdout:7/566: creat d0/df/d7/d67/fae x:0 0 0 2024-09-16T02:05:54.134 INFO:tasks.workunit.client.1.smithi165.stdout:7/567: chown d0/d2c/f8d 356408851 1 2024-09-16T02:05:54.138 INFO:tasks.workunit.client.0.smithi110.stdout:8/242: creat d3/d31/f50 x:0 0 0 2024-09-16T02:05:54.140 INFO:tasks.workunit.client.1.smithi165.stdout:3/666: unlink da/d20/d26/d8c/cea 0 2024-09-16T02:05:54.140 INFO:tasks.workunit.client.1.smithi165.stdout:5/593: dread fa [0,4194304] 0 2024-09-16T02:05:54.141 INFO:tasks.workunit.client.1.smithi165.stdout:3/667: fsync da/d17/d78/d2c/d2d/d6c/fba 0 2024-09-16T02:05:54.142 INFO:tasks.workunit.client.1.smithi165.stdout:3/668: fsync da/d17/d78/d2c/d2d/d6c/fc6 0 2024-09-16T02:05:54.143 INFO:tasks.workunit.client.1.smithi165.stdout:8/610: rename dd/d13 to dd/d11/d14/d3f/d25/d36/d81/dd2 0 2024-09-16T02:05:54.144 INFO:tasks.workunit.client.1.smithi165.stdout:8/611: write dd/d11/d14/fbc [262432,92428] 0 2024-09-16T02:05:54.145 INFO:tasks.workunit.client.0.smithi110.stdout:0/261: truncate d3/d4/d41/f48 260170 0 2024-09-16T02:05:54.146 INFO:tasks.workunit.client.1.smithi165.stdout:9/656: write d7/fa [6296188,40254] 0 2024-09-16T02:05:54.146 INFO:tasks.workunit.client.1.smithi165.stdout:9/657: dread - d7/d1f/d54/fc4 zero size 2024-09-16T02:05:54.147 INFO:tasks.workunit.client.1.smithi165.stdout:9/658: chown d7/d1f/d54/l5b 6552889 1 2024-09-16T02:05:54.148 INFO:tasks.workunit.client.0.smithi110.stdout:8/243: creat d3/d2b/d27/f51 x:0 0 0 2024-09-16T02:05:54.148 INFO:tasks.workunit.client.1.smithi165.stdout:1/639: unlink d1/d19/d4d/lc9 0 2024-09-16T02:05:54.150 INFO:tasks.workunit.client.0.smithi110.stdout:1/319: creat d0/d1/f68 x:0 0 0 2024-09-16T02:05:54.152 INFO:tasks.workunit.client.1.smithi165.stdout:1/640: dread d1/f49 [0,4194304] 0 2024-09-16T02:05:54.152 INFO:tasks.workunit.client.0.smithi110.stdout:0/262: dwrite d3/d6/f3b [0,4194304] 0 2024-09-16T02:05:54.155 INFO:tasks.workunit.client.1.smithi165.stdout:2/636: creat df/d10/d1a/d2d/fbe x:0 0 0 2024-09-16T02:05:54.156 INFO:tasks.workunit.client.0.smithi110.stdout:8/244: creat d3/d2b/f52 x:0 0 0 2024-09-16T02:05:54.160 INFO:tasks.workunit.client.1.smithi165.stdout:0/555: mkdir d0/d1e/d39/d48/d74/dc6 0 2024-09-16T02:05:54.160 INFO:tasks.workunit.client.0.smithi110.stdout:1/320: symlink d0/d25/l69 0 2024-09-16T02:05:54.160 INFO:tasks.workunit.client.1.smithi165.stdout:7/568: mknod d0/df/d33/d2a/caf 0 2024-09-16T02:05:54.161 INFO:tasks.workunit.client.1.smithi165.stdout:6/593: creat d7/dc/df/fa2 x:0 0 0 2024-09-16T02:05:54.162 INFO:tasks.workunit.client.0.smithi110.stdout:0/263: dwrite d3/d4/f27 [0,4194304] 0 2024-09-16T02:05:54.163 INFO:tasks.workunit.client.1.smithi165.stdout:5/594: mknod de/d19/d1c/d49/da5/cc8 0 2024-09-16T02:05:54.165 INFO:tasks.workunit.client.0.smithi110.stdout:1/321: chown d0/da/f36 103 1 2024-09-16T02:05:54.165 INFO:tasks.workunit.client.0.smithi110.stdout:8/245: creat d3/d2b/f53 x:0 0 0 2024-09-16T02:05:54.168 INFO:tasks.workunit.client.0.smithi110.stdout:1/322: chown d0/d1/d2a/d32/f41 8111468 1 2024-09-16T02:05:54.171 INFO:tasks.workunit.client.1.smithi165.stdout:9/659: rmdir d7 39 2024-09-16T02:05:54.173 INFO:tasks.workunit.client.1.smithi165.stdout:6/594: dread d7/dc/df/d1a/d4d/d5f/f6e [0,4194304] 0 2024-09-16T02:05:54.178 INFO:tasks.workunit.client.0.smithi110.stdout:0/264: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:54.178 INFO:tasks.workunit.client.0.smithi110.stdout:1/323: dwrite d0/da/f2c [0,4194304] 0 2024-09-16T02:05:54.178 INFO:tasks.workunit.client.1.smithi165.stdout:1/641: mkdir d1/d68/dca 0 2024-09-16T02:05:54.179 INFO:tasks.workunit.client.1.smithi165.stdout:1/642: fdatasync d1/dd/d11/d33/d92/f96 0 2024-09-16T02:05:54.179 INFO:tasks.workunit.client.1.smithi165.stdout:2/637: symlink df/d73/d79/lbf 0 2024-09-16T02:05:54.183 INFO:tasks.workunit.client.1.smithi165.stdout:4/516: truncate d4/dc/d18/d37/d53/d64/d8b/f63 3654392 0 2024-09-16T02:05:54.185 INFO:tasks.workunit.client.1.smithi165.stdout:4/517: truncate d4/dc/d20/f62 44972 0 2024-09-16T02:05:54.187 INFO:tasks.workunit.client.0.smithi110.stdout:8/246: symlink d3/d12/d1d/d4c/l54 0 2024-09-16T02:05:54.187 INFO:tasks.workunit.client.0.smithi110.stdout:8/247: write d3/f9 [2761210,6585] 0 2024-09-16T02:05:54.188 INFO:tasks.workunit.client.0.smithi110.stdout:0/265: creat d3/d6/d4b/f4d x:0 0 0 2024-09-16T02:05:54.188 INFO:tasks.workunit.client.1.smithi165.stdout:7/569: dwrite d0/f19 [4194304,4194304] 0 2024-09-16T02:05:54.192 INFO:tasks.workunit.client.1.smithi165.stdout:8/612: link dd/d11/d14/d3f/d25/d36/d81/dd2/f71 dd/d34/fd3 0 2024-09-16T02:05:54.199 INFO:tasks.workunit.client.1.smithi165.stdout:6/595: creat d7/dc/d3b/d3a/d3d/d5d/d73/d82/fa3 x:0 0 0 2024-09-16T02:05:54.203 INFO:tasks.workunit.client.1.smithi165.stdout:1/643: unlink d1/dd/d11/d33/d67/l7c 0 2024-09-16T02:05:54.204 INFO:tasks.workunit.client.0.smithi110.stdout:8/248: symlink d3/d2b/d27/d45/l55 0 2024-09-16T02:05:54.205 INFO:tasks.workunit.client.0.smithi110.stdout:8/249: dread - d3/d31/f50 zero size 2024-09-16T02:05:54.206 INFO:tasks.workunit.client.0.smithi110.stdout:8/250: write d3/d2b/f4a [1155298,35329] 0 2024-09-16T02:05:54.208 INFO:tasks.workunit.client.0.smithi110.stdout:1/324: rmdir d0/d1/d4/d46/d61 0 2024-09-16T02:05:54.208 INFO:tasks.workunit.client.1.smithi165.stdout:1/644: dwrite d1/dd/d11/f1b [4194304,4194304] 0 2024-09-16T02:05:54.212 INFO:tasks.workunit.client.1.smithi165.stdout:3/669: creat da/d17/d7a/fee x:0 0 0 2024-09-16T02:05:54.215 INFO:tasks.workunit.client.1.smithi165.stdout:4/518: creat d4/dc/d18/d37/d53/d64/faa x:0 0 0 2024-09-16T02:05:54.216 INFO:tasks.workunit.client.0.smithi110.stdout:1/325: dwrite d0/d1/d2a/f5d [0,4194304] 0 2024-09-16T02:05:54.217 INFO:tasks.workunit.client.0.smithi110.stdout:8/251: write d3/d2b/d27/f46 [2742059,16827] 0 2024-09-16T02:05:54.218 INFO:tasks.workunit.client.1.smithi165.stdout:3/670: dwrite da/d17/d78/fca [0,4194304] 0 2024-09-16T02:05:54.220 INFO:tasks.workunit.client.1.smithi165.stdout:5/595: creat de/d19/d1c/d49/da5/db1/fc9 x:0 0 0 2024-09-16T02:05:54.220 INFO:tasks.workunit.client.1.smithi165.stdout:3/671: dread da/d20/d26/d8c/fa2 [0,4194304] 0 2024-09-16T02:05:54.222 INFO:tasks.workunit.client.0.smithi110.stdout:1/326: chown d0/da/f5c 1 1 2024-09-16T02:05:54.223 INFO:tasks.workunit.client.0.smithi110.stdout:0/266: link d3/d4/dc/d10/l3a d3/d4/l4e 0 2024-09-16T02:05:54.223 INFO:tasks.workunit.client.0.smithi110.stdout:0/267: stat d3/f28 0 2024-09-16T02:05:54.224 INFO:tasks.workunit.client.0.smithi110.stdout:0/268: readlink d3/lb 0 2024-09-16T02:05:54.224 INFO:tasks.workunit.client.0.smithi110.stdout:0/269: chown d3/d6/f21 28 1 2024-09-16T02:05:54.225 INFO:tasks.workunit.client.1.smithi165.stdout:7/570: creat d0/df/d33/d2a/fb0 x:0 0 0 2024-09-16T02:05:54.225 INFO:tasks.workunit.client.1.smithi165.stdout:9/660: mkdir d7/d1f/ddb 0 2024-09-16T02:05:54.225 INFO:tasks.workunit.client.1.smithi165.stdout:6/596: mkdir d7/d1f/da4 0 2024-09-16T02:05:54.226 INFO:tasks.workunit.client.0.smithi110.stdout:8/252: chown c0 848 1 2024-09-16T02:05:54.226 INFO:tasks.workunit.client.1.smithi165.stdout:0/556: rmdir d0/d1e/d20/db2 0 2024-09-16T02:05:54.227 INFO:tasks.workunit.client.1.smithi165.stdout:9/661: fsync d7/d55/f66 0 2024-09-16T02:05:54.228 INFO:tasks.workunit.client.1.smithi165.stdout:4/519: mknod d4/dc/d18/d37/cab 0 2024-09-16T02:05:54.231 INFO:tasks.workunit.client.1.smithi165.stdout:0/557: dread d0/d1e/d20/d28/f68 [0,4194304] 0 2024-09-16T02:05:54.232 INFO:tasks.workunit.client.1.smithi165.stdout:8/613: fsync dd/d11/d38/f39 0 2024-09-16T02:05:54.234 INFO:tasks.workunit.client.0.smithi110.stdout:1/327: creat d0/da/f6a x:0 0 0 2024-09-16T02:05:54.234 INFO:tasks.workunit.client.1.smithi165.stdout:6/597: creat d7/dc/d3b/d86/fa5 x:0 0 0 2024-09-16T02:05:54.236 INFO:tasks.workunit.client.0.smithi110.stdout:0/270: symlink d3/d4/dc/d14/l4f 0 2024-09-16T02:05:54.237 INFO:tasks.workunit.client.1.smithi165.stdout:7/571: rename d0/d2c/c8e to d0/df/d33/d2a/cb1 0 2024-09-16T02:05:54.238 INFO:tasks.workunit.client.0.smithi110.stdout:8/253: dwrite d3/d12/d1a/f40 [0,4194304] 0 2024-09-16T02:05:54.240 INFO:tasks.workunit.client.1.smithi165.stdout:5/596: mknod de/d21/d26/d3a/d6d/d95/dab/cca 0 2024-09-16T02:05:54.241 INFO:tasks.workunit.client.0.smithi110.stdout:1/328: creat d0/d25/d63/f6b x:0 0 0 2024-09-16T02:05:54.243 INFO:tasks.workunit.client.1.smithi165.stdout:3/672: mkdir da/d17/d78/d2c/d2d/d6c/def 0 2024-09-16T02:05:54.245 INFO:tasks.workunit.client.0.smithi110.stdout:1/329: dread d0/d1/d2a/f34 [0,4194304] 0 2024-09-16T02:05:54.246 INFO:tasks.workunit.client.0.smithi110.stdout:1/330: chown d0/da/f17 26 1 2024-09-16T02:05:54.248 INFO:tasks.workunit.client.1.smithi165.stdout:8/614: dread dd/f41 [0,4194304] 0 2024-09-16T02:05:54.249 INFO:tasks.workunit.client.1.smithi165.stdout:8/615: write dd/d11/fbd [4641538,48130] 0 2024-09-16T02:05:54.252 INFO:tasks.workunit.client.1.smithi165.stdout:0/558: truncate d0/d1e/d39/f6c 3583962 0 2024-09-16T02:05:54.253 INFO:tasks.workunit.client.0.smithi110.stdout:1/331: dwrite d0/d25/d63/f19 [4194304,4194304] 0 2024-09-16T02:05:54.257 INFO:tasks.workunit.client.1.smithi165.stdout:2/638: truncate df/f90 1624260 0 2024-09-16T02:05:54.260 INFO:tasks.workunit.client.1.smithi165.stdout:9/662: rename d7/d32/d38/d53/d56/lad to d7/d32/d38/d58/d99/ldc 0 2024-09-16T02:05:54.262 INFO:tasks.workunit.client.1.smithi165.stdout:4/520: truncate d4/dc/d18/d37/d53/d64/d8b/d71/f7d 1040781 0 2024-09-16T02:05:54.264 INFO:tasks.workunit.client.1.smithi165.stdout:5/597: symlink de/d19/d67/lcb 0 2024-09-16T02:05:54.265 INFO:tasks.workunit.client.1.smithi165.stdout:4/521: chown d4/dc/d28/d2b/d42/f87 4749907 1 2024-09-16T02:05:54.266 INFO:tasks.workunit.client.1.smithi165.stdout:3/673: mknod da/d17/d7a/d7d/da8/cf0 0 2024-09-16T02:05:54.268 INFO:tasks.workunit.client.1.smithi165.stdout:1/645: dwrite d1/d19/d24/d30/d72/f91 [0,4194304] 0 2024-09-16T02:05:54.268 INFO:tasks.workunit.client.0.smithi110.stdout:8/254: link d3/c5 d3/d31/c56 0 2024-09-16T02:05:54.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/255: write d3/d2b/f4a [543668,120944] 0 2024-09-16T02:05:54.270 INFO:tasks.workunit.client.0.smithi110.stdout:1/332: symlink d0/d1/d2a/d32/d40/l6c 0 2024-09-16T02:05:54.271 INFO:tasks.workunit.client.0.smithi110.stdout:8/256: write d3/d2b/d27/f51 [276510,103414] 0 2024-09-16T02:05:54.271 INFO:tasks.workunit.client.1.smithi165.stdout:8/616: creat dd/d11/d14/d3f/d72/fd4 x:0 0 0 2024-09-16T02:05:54.274 INFO:tasks.workunit.client.0.smithi110.stdout:8/257: dread d3/d31/f3e [0,4194304] 0 2024-09-16T02:05:54.280 INFO:tasks.workunit.client.1.smithi165.stdout:7/572: rename d0/c17 to d0/df/d83/d84/cb2 0 2024-09-16T02:05:54.281 INFO:tasks.workunit.client.0.smithi110.stdout:8/258: dwrite d3/d12/f2f [0,4194304] 0 2024-09-16T02:05:54.281 INFO:tasks.workunit.client.0.smithi110.stdout:8/259: chown d3/f2a 2146240227 1 2024-09-16T02:05:54.284 INFO:tasks.workunit.client.1.smithi165.stdout:9/663: mknod d7/d32/d38/d53/d56/dca/cdd 0 2024-09-16T02:05:54.286 INFO:tasks.workunit.client.0.smithi110.stdout:8/260: mknod d3/d12/c57 0 2024-09-16T02:05:54.287 INFO:tasks.workunit.client.0.smithi110.stdout:0/271: truncate d3/d4/dc/f3e 1568876 0 2024-09-16T02:05:54.288 INFO:tasks.workunit.client.1.smithi165.stdout:5/598: rmdir de/d21/d26/d3a/d54/d8c 39 2024-09-16T02:05:54.288 INFO:tasks.workunit.client.1.smithi165.stdout:1/646: dread d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:54.291 INFO:tasks.workunit.client.1.smithi165.stdout:3/674: dread da/d17/d78/d2c/d2d/d6c/f5a [0,4194304] 0 2024-09-16T02:05:54.292 INFO:tasks.workunit.client.0.smithi110.stdout:8/261: creat d3/d2b/f58 x:0 0 0 2024-09-16T02:05:54.294 INFO:tasks.workunit.client.0.smithi110.stdout:0/272: dwrite d3/d6/d4b/f4d [0,4194304] 0 2024-09-16T02:05:54.299 INFO:tasks.workunit.client.1.smithi165.stdout:8/617: creat dd/d11/d38/d74/fd5 x:0 0 0 2024-09-16T02:05:54.301 INFO:tasks.workunit.client.0.smithi110.stdout:8/262: creat d3/d2b/d27/f59 x:0 0 0 2024-09-16T02:05:54.306 INFO:tasks.workunit.client.1.smithi165.stdout:6/598: link d7/d17/d75/f76 d7/dc/df/d1a/d4d/fa6 0 2024-09-16T02:05:54.310 INFO:tasks.workunit.client.0.smithi110.stdout:8/263: link d3/d2b/d27/f47 d3/d31/f5a 0 2024-09-16T02:05:54.312 INFO:tasks.workunit.client.1.smithi165.stdout:0/559: dwrite d0/d1e/d20/d28/f33 [0,4194304] 0 2024-09-16T02:05:54.314 INFO:tasks.workunit.client.1.smithi165.stdout:6/599: dread d7/dc/d3b/f59 [0,4194304] 0 2024-09-16T02:05:54.315 INFO:tasks.workunit.client.0.smithi110.stdout:8/264: dwrite d3/fd [0,4194304] 0 2024-09-16T02:05:54.315 INFO:tasks.workunit.client.1.smithi165.stdout:6/600: stat d7/dc/df/d1a/d4d/fa6 0 2024-09-16T02:05:54.316 INFO:tasks.workunit.client.1.smithi165.stdout:6/601: chown d7/d17/ca0 11120312 1 2024-09-16T02:05:54.319 INFO:tasks.workunit.client.1.smithi165.stdout:4/522: write d4/dc/d18/d37/d53/f5a [974153,108226] 0 2024-09-16T02:05:54.321 INFO:tasks.workunit.client.1.smithi165.stdout:3/675: dread da/d17/d78/d2c/de8/feb [0,4194304] 0 2024-09-16T02:05:54.321 INFO:tasks.workunit.client.1.smithi165.stdout:3/676: chown da/d57/d8d 2 1 2024-09-16T02:05:54.326 INFO:tasks.workunit.client.0.smithi110.stdout:8/265: creat d3/d2b/d27/d45/f5b x:0 0 0 2024-09-16T02:05:54.327 INFO:tasks.workunit.client.1.smithi165.stdout:4/523: dwrite d4/dc/d18/d37/d53/f5a [0,4194304] 0 2024-09-16T02:05:54.327 INFO:tasks.workunit.client.1.smithi165.stdout:0/560: dread - d0/d1e/d20/f97 zero size 2024-09-16T02:05:54.327 INFO:tasks.workunit.client.0.smithi110.stdout:0/273: write d3/d4/dc/f1c [1019361,68825] 0 2024-09-16T02:05:54.329 INFO:tasks.workunit.client.1.smithi165.stdout:6/602: unlink d7/d1f/f42 0 2024-09-16T02:05:54.331 INFO:tasks.workunit.client.1.smithi165.stdout:8/618: link dd/d11/d14/d3f/d25/d36/d85/fc3 dd/d11/d14/d70/d7b/d9a/fd6 0 2024-09-16T02:05:54.337 INFO:tasks.workunit.client.1.smithi165.stdout:7/573: link d0/df/d33/d2a/c45 d0/cb3 0 2024-09-16T02:05:54.341 INFO:tasks.workunit.client.0.smithi110.stdout:8/266: getdents d3/d31 0 2024-09-16T02:05:54.342 INFO:tasks.workunit.client.1.smithi165.stdout:9/664: creat d7/df/d37/fde x:0 0 0 2024-09-16T02:05:54.344 INFO:tasks.workunit.client.1.smithi165.stdout:5/599: write de/d19/d1c/f56 [132931,98769] 0 2024-09-16T02:05:54.344 INFO:tasks.workunit.client.1.smithi165.stdout:5/600: read - de/d19/d1c/d4d/f7a zero size 2024-09-16T02:05:54.350 INFO:tasks.workunit.client.0.smithi110.stdout:8/267: creat d3/d12/f5c x:0 0 0 2024-09-16T02:05:54.350 INFO:tasks.workunit.client.0.smithi110.stdout:8/268: fsync d3/f44 0 2024-09-16T02:05:54.351 INFO:tasks.workunit.client.0.smithi110.stdout:8/269: stat d3/d12/d1d/l4e 0 2024-09-16T02:05:54.352 INFO:tasks.workunit.client.0.smithi110.stdout:8/270: chown d3/d2b/d27 213890 1 2024-09-16T02:05:54.352 INFO:tasks.workunit.client.1.smithi165.stdout:0/561: mknod d0/d1e/d39/d48/d5f/d96/dac/cc7 0 2024-09-16T02:05:54.356 INFO:tasks.workunit.client.1.smithi165.stdout:8/619: fdatasync dd/d11/d14/d3f/d25/d36/f64 0 2024-09-16T02:05:54.358 INFO:tasks.workunit.client.0.smithi110.stdout:8/271: rename d3/d2b/d27/f51 to d3/d12/d1a/f5d 0 2024-09-16T02:05:54.360 INFO:tasks.workunit.client.1.smithi165.stdout:7/574: mkdir d0/d4b/db4 0 2024-09-16T02:05:54.360 INFO:tasks.workunit.client.0.smithi110.stdout:8/272: write d3/d2b/f53 [382799,17291] 0 2024-09-16T02:05:54.360 INFO:tasks.workunit.client.1.smithi165.stdout:7/575: chown d0/df/d7/c51 50 1 2024-09-16T02:05:54.361 INFO:tasks.workunit.client.1.smithi165.stdout:2/639: sync 2024-09-16T02:05:54.361 INFO:tasks.workunit.client.0.smithi110.stdout:8/273: read d3/d31/f49 [16486,69867] 0 2024-09-16T02:05:54.363 INFO:tasks.workunit.client.1.smithi165.stdout:9/665: creat d7/df/d37/d65/fdf x:0 0 0 2024-09-16T02:05:54.365 INFO:tasks.workunit.client.1.smithi165.stdout:5/601: fdatasync de/d19/d67/d74/fc6 0 2024-09-16T02:05:54.366 INFO:tasks.workunit.client.0.smithi110.stdout:8/274: mkdir d3/d12/d5e 0 2024-09-16T02:05:54.366 INFO:tasks.workunit.client.1.smithi165.stdout:6/603: write d7/dc/d3b/f59 [280802,74891] 0 2024-09-16T02:05:54.370 INFO:tasks.workunit.client.0.smithi110.stdout:8/275: mkdir d3/d12/d1d/d4c/d5f 0 2024-09-16T02:05:54.372 INFO:tasks.workunit.client.1.smithi165.stdout:8/620: mkdir dd/d34/dd7 0 2024-09-16T02:05:54.373 INFO:tasks.workunit.client.1.smithi165.stdout:6/604: dwrite d7/d1f/f32 [0,4194304] 0 2024-09-16T02:05:54.373 INFO:tasks.workunit.client.1.smithi165.stdout:7/576: mknod d0/d4b/cb5 0 2024-09-16T02:05:54.374 INFO:tasks.workunit.client.1.smithi165.stdout:2/640: chown df/d23/d28/d9a/d86/ca9 56669 1 2024-09-16T02:05:54.375 INFO:tasks.workunit.client.1.smithi165.stdout:9/666: symlink d7/d1f/d27/d49/le0 0 2024-09-16T02:05:54.375 INFO:tasks.workunit.client.0.smithi110.stdout:0/274: write d3/d4/dc/f3e [1743201,85377] 0 2024-09-16T02:05:54.376 INFO:tasks.workunit.client.0.smithi110.stdout:8/276: getdents d3/d12/d5e 0 2024-09-16T02:05:54.378 INFO:tasks.workunit.client.1.smithi165.stdout:4/524: rename d4/dc/d20/f27 to d4/dc/fac 0 2024-09-16T02:05:54.379 INFO:tasks.workunit.client.0.smithi110.stdout:0/275: symlink d3/d4/dc/d14/l50 0 2024-09-16T02:05:54.381 INFO:tasks.workunit.client.1.smithi165.stdout:8/621: creat dd/d11/d38/da6/fd8 x:0 0 0 2024-09-16T02:05:54.383 INFO:tasks.workunit.client.1.smithi165.stdout:7/577: mknod d0/d4b/d63/cb6 0 2024-09-16T02:05:54.384 INFO:tasks.workunit.client.0.smithi110.stdout:0/276: creat d3/d6/d4b/f51 x:0 0 0 2024-09-16T02:05:54.385 INFO:tasks.workunit.client.1.smithi165.stdout:6/605: mkdir d7/dc/df/d1a/d4d/d5f/da7 0 2024-09-16T02:05:54.386 INFO:tasks.workunit.client.1.smithi165.stdout:9/667: dread d7/d32/d38/d68/d7f/f70 [0,4194304] 0 2024-09-16T02:05:54.388 INFO:tasks.workunit.client.0.smithi110.stdout:0/277: dread d3/d6/f3b [0,4194304] 0 2024-09-16T02:05:54.393 INFO:tasks.workunit.client.0.smithi110.stdout:0/278: dread d3/d4/dc/d14/f19 [0,4194304] 0 2024-09-16T02:05:54.394 INFO:tasks.workunit.client.1.smithi165.stdout:8/622: rename dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/fd1 to dd/d11/d38/d74/d7d/fd9 0 2024-09-16T02:05:54.409 INFO:tasks.workunit.client.1.smithi165.stdout:1/647: sync 2024-09-16T02:05:54.414 INFO:tasks.workunit.client.1.smithi165.stdout:2/641: symlink df/dbb/lc0 0 2024-09-16T02:05:54.414 INFO:tasks.workunit.client.0.smithi110.stdout:4/262: sync 2024-09-16T02:05:54.415 INFO:tasks.workunit.client.0.smithi110.stdout:0/279: unlink d3/d4/l4e 0 2024-09-16T02:05:54.415 INFO:tasks.workunit.client.0.smithi110.stdout:0/280: fsync d3/d4/dc/f1e 0 2024-09-16T02:05:54.418 INFO:tasks.workunit.client.0.smithi110.stdout:4/263: mkdir d4/d8/d31/d36/d4f 0 2024-09-16T02:05:54.420 INFO:tasks.workunit.client.0.smithi110.stdout:0/281: symlink d3/d4/d41/l52 0 2024-09-16T02:05:54.422 INFO:tasks.workunit.client.1.smithi165.stdout:0/562: getdents d0/d1e/d39/d48 0 2024-09-16T02:05:54.422 INFO:tasks.workunit.client.0.smithi110.stdout:4/264: symlink d4/d12/d18/l50 0 2024-09-16T02:05:54.423 INFO:tasks.workunit.client.1.smithi165.stdout:5/602: dwrite de/d21/f8b [0,4194304] 0 2024-09-16T02:05:54.424 INFO:tasks.workunit.client.1.smithi165.stdout:0/563: read d0/d1e/d39/d48/d5f/f73 [4138342,87009] 0 2024-09-16T02:05:54.424 INFO:tasks.workunit.client.1.smithi165.stdout:9/668: write d7/d32/f64 [901908,115136] 0 2024-09-16T02:05:54.424 INFO:tasks.workunit.client.1.smithi165.stdout:0/564: readlink d0/le 0 2024-09-16T02:05:54.426 INFO:tasks.workunit.client.1.smithi165.stdout:0/565: write d0/d1e/d39/d48/d5f/f73 [4981188,120790] 0 2024-09-16T02:05:54.426 INFO:tasks.workunit.client.0.smithi110.stdout:4/265: creat d4/d8/d17/d23/f51 x:0 0 0 2024-09-16T02:05:54.427 INFO:tasks.workunit.client.1.smithi165.stdout:0/566: dread - d0/d1e/d39/d48/d5f/d82/fa5 zero size 2024-09-16T02:05:54.428 INFO:tasks.workunit.client.1.smithi165.stdout:0/567: write d0/d1e/d39/d99/fbd [162939,48742] 0 2024-09-16T02:05:54.428 INFO:tasks.workunit.client.1.smithi165.stdout:6/606: mkdir d7/dc/df/d1a/d4d/da8 0 2024-09-16T02:05:54.430 INFO:tasks.workunit.client.0.smithi110.stdout:4/266: mkdir d4/d8/d17/d23/d35/d52 0 2024-09-16T02:05:54.431 INFO:tasks.workunit.client.1.smithi165.stdout:6/607: truncate d7/d17/d75/f76 2925 0 2024-09-16T02:05:54.432 INFO:tasks.workunit.client.1.smithi165.stdout:4/525: creat d4/fad x:0 0 0 2024-09-16T02:05:54.433 INFO:tasks.workunit.client.0.smithi110.stdout:4/267: mknod d4/d8/d31/c53 0 2024-09-16T02:05:54.433 INFO:tasks.workunit.client.0.smithi110.stdout:4/268: chown f3 0 1 2024-09-16T02:05:54.434 INFO:tasks.workunit.client.1.smithi165.stdout:6/608: write d7/d17/d75/d97/f9b [961374,17121] 0 2024-09-16T02:05:54.434 INFO:tasks.workunit.client.0.smithi110.stdout:4/269: fdatasync d4/d12/d18/f34 0 2024-09-16T02:05:54.434 INFO:tasks.workunit.client.1.smithi165.stdout:1/648: dwrite d1/f49 [0,4194304] 0 2024-09-16T02:05:54.435 INFO:tasks.workunit.client.1.smithi165.stdout:5/603: fsync de/f14 0 2024-09-16T02:05:54.437 INFO:tasks.workunit.client.1.smithi165.stdout:8/623: creat dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/fda x:0 0 0 2024-09-16T02:05:54.445 INFO:tasks.workunit.client.1.smithi165.stdout:7/578: link d0/df/d7/l2f d0/df/d83/lb7 0 2024-09-16T02:05:54.452 INFO:tasks.workunit.client.0.smithi110.stdout:4/270: truncate d4/f14 328266 0 2024-09-16T02:05:54.454 INFO:tasks.workunit.client.1.smithi165.stdout:9/669: truncate d7/df/d67/f7b 2910088 0 2024-09-16T02:05:54.455 INFO:tasks.workunit.client.1.smithi165.stdout:4/526: mkdir d4/dc/d18/dae 0 2024-09-16T02:05:54.455 INFO:tasks.workunit.client.1.smithi165.stdout:0/568: truncate d0/d2a/d70/f8b 914289 0 2024-09-16T02:05:54.456 INFO:tasks.workunit.client.1.smithi165.stdout:3/677: sync 2024-09-16T02:05:54.456 INFO:tasks.workunit.client.1.smithi165.stdout:6/609: mkdir d7/dc/d3b/da9 0 2024-09-16T02:05:54.457 INFO:tasks.workunit.client.0.smithi110.stdout:4/271: mkdir d4/d54 0 2024-09-16T02:05:54.458 INFO:tasks.workunit.client.1.smithi165.stdout:6/610: write d7/dc/df/d1a/d4d/f4e [2308635,61836] 0 2024-09-16T02:05:54.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/272: dread f3 [0,4194304] 0 2024-09-16T02:05:54.460 INFO:tasks.workunit.client.1.smithi165.stdout:5/604: mknod de/d21/d26/d3a/d54/d8c/ccc 0 2024-09-16T02:05:54.463 INFO:tasks.workunit.client.1.smithi165.stdout:2/642: link df/d10/d37/c47 df/d23/d28/d3b/d82/cc1 0 2024-09-16T02:05:54.465 INFO:tasks.workunit.client.0.smithi110.stdout:4/273: mkdir d4/d12/d3b/d55 0 2024-09-16T02:05:54.466 INFO:tasks.workunit.client.1.smithi165.stdout:9/670: mknod d7/d1f/d54/ce1 0 2024-09-16T02:05:54.468 INFO:tasks.workunit.client.1.smithi165.stdout:0/569: readlink d0/d1e/l4c 0 2024-09-16T02:05:54.469 INFO:tasks.workunit.client.0.smithi110.stdout:4/274: mknod d4/d8/c56 0 2024-09-16T02:05:54.470 INFO:tasks.workunit.client.1.smithi165.stdout:1/649: truncate d1/d22/f2c 2710704 0 2024-09-16T02:05:54.473 INFO:tasks.workunit.client.1.smithi165.stdout:9/671: dwrite d7/d32/d38/d58/fc3 [0,4194304] 0 2024-09-16T02:05:54.474 INFO:tasks.workunit.client.1.smithi165.stdout:6/611: stat d7/dc/d3b/d3a/d3d/c81 0 2024-09-16T02:05:54.476 INFO:tasks.workunit.client.1.smithi165.stdout:7/579: symlink d0/df/d33/lb8 0 2024-09-16T02:05:54.476 INFO:tasks.workunit.client.1.smithi165.stdout:0/570: dwrite d0/fba [0,4194304] 0 2024-09-16T02:05:54.479 INFO:tasks.workunit.client.1.smithi165.stdout:5/605: unlink de/d19/d1c/d84/d92/f97 0 2024-09-16T02:05:54.480 INFO:tasks.workunit.client.1.smithi165.stdout:8/624: link dd/d11/d14/l52 dd/d34/ldb 0 2024-09-16T02:05:54.481 INFO:tasks.workunit.client.0.smithi110.stdout:4/275: rmdir d4/d8/d17/d23/d35/d52 0 2024-09-16T02:05:54.482 INFO:tasks.workunit.client.1.smithi165.stdout:2/643: rmdir df/d23/d28/d3b 39 2024-09-16T02:05:54.484 INFO:tasks.workunit.client.1.smithi165.stdout:3/678: write da/d17/dcc/f77 [778463,55381] 0 2024-09-16T02:05:54.485 INFO:tasks.workunit.client.0.smithi110.stdout:4/276: creat d4/d12/d18/f57 x:0 0 0 2024-09-16T02:05:54.489 INFO:tasks.workunit.client.1.smithi165.stdout:1/650: symlink d1/dd/d11/d33/d3f/d59/lcb 0 2024-09-16T02:05:54.490 INFO:tasks.workunit.client.1.smithi165.stdout:3/679: dwrite da/d17/d78/d2c/db7/fcd [0,4194304] 0 2024-09-16T02:05:54.492 INFO:tasks.workunit.client.0.smithi110.stdout:4/277: creat d4/d8/d31/d36/d4f/f58 x:0 0 0 2024-09-16T02:05:54.496 INFO:tasks.workunit.client.0.smithi110.stdout:4/278: mknod d4/d8/d31/d36/d3c/d3d/c59 0 2024-09-16T02:05:54.497 INFO:tasks.workunit.client.0.smithi110.stdout:4/279: stat d4/d8/l20 0 2024-09-16T02:05:54.503 INFO:tasks.workunit.client.1.smithi165.stdout:8/625: rename dd/d11/d14/d70/f73 to dd/d11/d14/d3f/d25/fdc 0 2024-09-16T02:05:54.505 INFO:tasks.workunit.client.1.smithi165.stdout:6/612: write d7/dc/f48 [924832,17201] 0 2024-09-16T02:05:54.506 INFO:tasks.workunit.client.0.smithi110.stdout:4/280: dwrite d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:54.506 INFO:tasks.workunit.client.1.smithi165.stdout:3/680: chown da/d17/d7a/dab/ce4 23 1 2024-09-16T02:05:54.509 INFO:tasks.workunit.client.1.smithi165.stdout:7/580: link d0/df/d33/d2a/f94 d0/d4b/fb9 0 2024-09-16T02:05:54.511 INFO:tasks.workunit.client.1.smithi165.stdout:5/606: creat de/d19/d1c/d84/daa/fcd x:0 0 0 2024-09-16T02:05:54.511 INFO:tasks.workunit.client.1.smithi165.stdout:5/607: fdatasync de/d21/d51/f5f 0 2024-09-16T02:05:54.513 INFO:tasks.workunit.client.1.smithi165.stdout:5/608: fdatasync de/d19/d1c/f3e 0 2024-09-16T02:05:54.513 INFO:tasks.workunit.client.0.smithi110.stdout:4/281: dwrite d4/d12/d18/f29 [4194304,4194304] 0 2024-09-16T02:05:54.514 INFO:tasks.workunit.client.1.smithi165.stdout:2/644: rename df/d23/ca4 to df/d10/db4/cc2 0 2024-09-16T02:05:54.514 INFO:tasks.workunit.client.1.smithi165.stdout:5/609: chown de/d21/d26/d3a/d54/d8c 993290 1 2024-09-16T02:05:54.515 INFO:tasks.workunit.client.0.smithi110.stdout:4/282: write d4/f21 [452287,76684] 0 2024-09-16T02:05:54.516 INFO:tasks.workunit.client.0.smithi110.stdout:4/283: fdatasync d4/d12/d18/f57 0 2024-09-16T02:05:54.516 INFO:tasks.workunit.client.1.smithi165.stdout:4/527: creat d4/d40/faf x:0 0 0 2024-09-16T02:05:54.519 INFO:tasks.workunit.client.1.smithi165.stdout:0/571: creat d0/d1e/d39/fc8 x:0 0 0 2024-09-16T02:05:54.520 INFO:tasks.workunit.client.1.smithi165.stdout:9/672: write d7/df/d67/f7b [1383010,85442] 0 2024-09-16T02:05:54.523 INFO:tasks.workunit.client.1.smithi165.stdout:7/581: chown d0/df/d33/d2a/c45 15967 1 2024-09-16T02:05:54.525 INFO:tasks.workunit.client.1.smithi165.stdout:7/582: dread d0/d2c/f8d [0,4194304] 0 2024-09-16T02:05:54.526 INFO:tasks.workunit.client.0.smithi110.stdout:4/284: rmdir d4/d8/d44 0 2024-09-16T02:05:54.527 INFO:tasks.workunit.client.1.smithi165.stdout:1/651: rename d1/d19/d24/dbf to d1/dd/d11/d33/d67/dcc 0 2024-09-16T02:05:54.529 INFO:tasks.workunit.client.1.smithi165.stdout:5/610: mknod de/d60/cce 0 2024-09-16T02:05:54.531 INFO:tasks.workunit.client.1.smithi165.stdout:3/681: link da/d17/f8b da/d17/d7a/d7d/da8/ff1 0 2024-09-16T02:05:54.532 INFO:tasks.workunit.client.1.smithi165.stdout:9/673: mkdir d7/d14/d7a/de2 0 2024-09-16T02:05:54.532 INFO:tasks.workunit.client.1.smithi165.stdout:3/682: write da/d17/dcc/f71 [2396569,46486] 0 2024-09-16T02:05:54.532 INFO:tasks.workunit.client.1.smithi165.stdout:8/626: dread f9 [0,4194304] 0 2024-09-16T02:05:54.534 INFO:tasks.workunit.client.1.smithi165.stdout:2/645: truncate df/d23/d28/d9a/f9d 1224685 0 2024-09-16T02:05:54.535 INFO:tasks.workunit.client.1.smithi165.stdout:3/683: write da/d17/d78/d2c/d2d/d6c/fba [212261,101451] 0 2024-09-16T02:05:54.536 INFO:tasks.workunit.client.1.smithi165.stdout:5/611: creat de/d21/d26/d3a/d6d/d95/fcf x:0 0 0 2024-09-16T02:05:54.537 INFO:tasks.workunit.client.1.smithi165.stdout:7/583: mkdir d0/d4b/db4/dba 0 2024-09-16T02:05:54.538 INFO:tasks.workunit.client.1.smithi165.stdout:5/612: read - de/d21/d26/d3a/d6d/d95/fcf zero size 2024-09-16T02:05:54.538 INFO:tasks.workunit.client.1.smithi165.stdout:9/674: mkdir d7/d32/d38/d68/d7f/de3 0 2024-09-16T02:05:54.540 INFO:tasks.workunit.client.1.smithi165.stdout:8/627: unlink dd/d11/d14/d3f/d25/f6f 0 2024-09-16T02:05:54.540 INFO:tasks.workunit.client.0.smithi110.stdout:4/285: dread d4/f14 [0,4194304] 0 2024-09-16T02:05:54.542 INFO:tasks.workunit.client.1.smithi165.stdout:8/628: chown dd/d11/d14/d3f/d25/d36/fb6 102942426 1 2024-09-16T02:05:54.542 INFO:tasks.workunit.client.1.smithi165.stdout:2/646: mknod df/d73/d79/cc3 0 2024-09-16T02:05:54.542 INFO:tasks.workunit.client.1.smithi165.stdout:2/647: chown fa 722429804 1 2024-09-16T02:05:54.544 INFO:tasks.workunit.client.1.smithi165.stdout:3/684: dread da/d17/d78/d2c/d2d/d6c/fc8 [0,4194304] 0 2024-09-16T02:05:54.545 INFO:tasks.workunit.client.1.smithi165.stdout:7/584: fdatasync d0/df/d33/d2a/f5a 0 2024-09-16T02:05:54.545 INFO:tasks.workunit.client.1.smithi165.stdout:9/675: dwrite d7/df/d67/f9e [0,4194304] 0 2024-09-16T02:05:54.547 INFO:tasks.workunit.client.0.smithi110.stdout:4/286: dwrite d4/d8/d17/d23/d35/f42 [0,4194304] 0 2024-09-16T02:05:54.553 INFO:tasks.workunit.client.1.smithi165.stdout:4/528: getdents d4/d40/d4f 0 2024-09-16T02:05:54.555 INFO:tasks.workunit.client.1.smithi165.stdout:4/529: write d4/dc/d18/fa3 [935548,57275] 0 2024-09-16T02:05:54.557 INFO:tasks.workunit.client.0.smithi110.stdout:4/287: dread d4/d12/d18/f1f [0,4194304] 0 2024-09-16T02:05:54.558 INFO:tasks.workunit.client.1.smithi165.stdout:2/648: unlink df/d10/l54 0 2024-09-16T02:05:54.560 INFO:tasks.workunit.client.1.smithi165.stdout:3/685: mkdir da/d20/d26/d6e/df2 0 2024-09-16T02:05:54.564 INFO:tasks.workunit.client.0.smithi110.stdout:4/288: dread d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:54.565 INFO:tasks.workunit.client.1.smithi165.stdout:7/585: symlink d0/df/d68/lbb 0 2024-09-16T02:05:54.566 INFO:tasks.workunit.client.1.smithi165.stdout:1/652: dread d1/fc [0,4194304] 0 2024-09-16T02:05:54.568 INFO:tasks.workunit.client.1.smithi165.stdout:0/572: rename d0/d1e/d20/l32 to d0/d1e/d39/d48/d5f/lc9 0 2024-09-16T02:05:54.569 INFO:tasks.workunit.client.1.smithi165.stdout:5/613: fsync de/d19/d1c/d4d/f7e 0 2024-09-16T02:05:54.570 INFO:tasks.workunit.client.1.smithi165.stdout:2/649: dwrite df/d10/d37/f74 [0,4194304] 0 2024-09-16T02:05:54.572 INFO:tasks.workunit.client.0.smithi110.stdout:4/289: creat d4/d8/f5a x:0 0 0 2024-09-16T02:05:54.574 INFO:tasks.workunit.client.0.smithi110.stdout:4/290: truncate d4/d8/d31/d36/d4f/f58 520912 0 2024-09-16T02:05:54.577 INFO:tasks.workunit.client.1.smithi165.stdout:0/573: dwrite d0/d1e/d39/d48/f8f [0,4194304] 0 2024-09-16T02:05:54.581 INFO:tasks.workunit.client.0.smithi110.stdout:4/291: creat d4/d8/d17/d23/d4c/f5b x:0 0 0 2024-09-16T02:05:54.584 INFO:tasks.workunit.client.1.smithi165.stdout:5/614: rename de/d19/d1c/d49/f73 to de/d21/d26/d94/da8/fd0 0 2024-09-16T02:05:54.585 INFO:tasks.workunit.client.1.smithi165.stdout:2/650: write df/d23/d28/d3b/f56 [3220163,15324] 0 2024-09-16T02:05:54.587 INFO:tasks.workunit.client.1.smithi165.stdout:0/574: fdatasync d0/d47/f59 0 2024-09-16T02:05:54.588 INFO:tasks.workunit.client.1.smithi165.stdout:8/629: truncate dd/f67 3555646 0 2024-09-16T02:05:54.590 INFO:tasks.workunit.client.1.smithi165.stdout:4/530: dread d4/dc/d28/d2b/d42/f69 [0,4194304] 0 2024-09-16T02:05:54.591 INFO:tasks.workunit.client.1.smithi165.stdout:1/653: rmdir d1/d19/d24/d30/d72/d95 0 2024-09-16T02:05:54.591 INFO:tasks.workunit.client.1.smithi165.stdout:9/676: write d7/f35 [50866,91879] 0 2024-09-16T02:05:54.591 INFO:tasks.workunit.client.1.smithi165.stdout:3/686: write da/d20/d26/d52/fac [4526843,36176] 0 2024-09-16T02:05:54.594 INFO:tasks.workunit.client.1.smithi165.stdout:0/575: fsync d0/d1e/d39/d48/d5f/d82/f9b 0 2024-09-16T02:05:54.597 INFO:tasks.workunit.client.1.smithi165.stdout:5/615: dwrite de/d19/d1c/d49/f99 [0,4194304] 0 2024-09-16T02:05:54.598 INFO:tasks.workunit.client.1.smithi165.stdout:9/677: symlink d7/d14/d80/le4 0 2024-09-16T02:05:54.599 INFO:tasks.workunit.client.1.smithi165.stdout:3/687: creat da/d17/dcc/ff3 x:0 0 0 2024-09-16T02:05:54.600 INFO:tasks.workunit.client.1.smithi165.stdout:3/688: readlink da/l6a 0 2024-09-16T02:05:54.600 INFO:tasks.workunit.client.1.smithi165.stdout:3/689: chown da/d57/fa4 15350 1 2024-09-16T02:05:54.602 INFO:tasks.workunit.client.1.smithi165.stdout:7/586: dread d0/d2c/d85/f97 [0,4194304] 0 2024-09-16T02:05:54.604 INFO:tasks.workunit.client.1.smithi165.stdout:6/613: sync 2024-09-16T02:05:54.605 INFO:tasks.workunit.client.1.smithi165.stdout:6/614: write d7/dc/f48 [549079,49539] 0 2024-09-16T02:05:54.606 INFO:tasks.workunit.client.1.smithi165.stdout:0/576: creat d0/d2a/fca x:0 0 0 2024-09-16T02:05:54.609 INFO:tasks.workunit.client.1.smithi165.stdout:7/587: dwrite d0/d4b/d63/f8b [0,4194304] 0 2024-09-16T02:05:54.609 INFO:tasks.workunit.client.1.smithi165.stdout:5/616: creat de/d21/d26/d3a/d6d/dad/fd1 x:0 0 0 2024-09-16T02:05:54.613 INFO:tasks.workunit.client.1.smithi165.stdout:8/630: creat dd/fdd x:0 0 0 2024-09-16T02:05:54.618 INFO:tasks.workunit.client.1.smithi165.stdout:8/631: fdatasync dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fce 0 2024-09-16T02:05:54.620 INFO:tasks.workunit.client.1.smithi165.stdout:4/531: dwrite d4/dc/d20/d4e/d73/f8e [0,4194304] 0 2024-09-16T02:05:54.621 INFO:tasks.workunit.client.1.smithi165.stdout:1/654: link d1/dd/d11/f1b d1/dd/d11/d46/d57/fcd 0 2024-09-16T02:05:54.621 INFO:tasks.workunit.client.1.smithi165.stdout:3/690: write da/d17/d7a/d7d/da8/ff1 [2729963,62600] 0 2024-09-16T02:05:54.622 INFO:tasks.workunit.client.1.smithi165.stdout:6/615: mknod d7/dc/df/d1a/d4d/d5f/da7/caa 0 2024-09-16T02:05:54.625 INFO:tasks.workunit.client.1.smithi165.stdout:5/617: rename de/d21/d26/d3a/l3d to de/d19/d1c/d49/da5/db1/ld2 0 2024-09-16T02:05:54.627 INFO:tasks.workunit.client.1.smithi165.stdout:8/632: creat dd/d7f/fde x:0 0 0 2024-09-16T02:05:54.628 INFO:tasks.workunit.client.1.smithi165.stdout:8/633: dread - dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fc4 zero size 2024-09-16T02:05:54.629 INFO:tasks.workunit.client.1.smithi165.stdout:3/691: rmdir da/d20 39 2024-09-16T02:05:54.630 INFO:tasks.workunit.client.1.smithi165.stdout:4/532: write d4/dc/d28/d2b/d42/f69 [3579756,981] 0 2024-09-16T02:05:54.631 INFO:tasks.workunit.client.1.smithi165.stdout:7/588: creat d0/df/d42/fbc x:0 0 0 2024-09-16T02:05:54.633 INFO:tasks.workunit.client.1.smithi165.stdout:2/651: dread df/d23/d28/d3b/f56 [0,4194304] 0 2024-09-16T02:05:54.635 INFO:tasks.workunit.client.1.smithi165.stdout:1/655: rename d1/dd/d11/d33/d35/f9a to d1/dd/d11/d46/fce 0 2024-09-16T02:05:54.635 INFO:tasks.workunit.client.1.smithi165.stdout:7/589: dread d0/d3d/f6b [0,4194304] 0 2024-09-16T02:05:54.636 INFO:tasks.workunit.client.1.smithi165.stdout:8/634: write dd/d11/d38/f3c [1366576,98017] 0 2024-09-16T02:05:54.637 INFO:tasks.workunit.client.1.smithi165.stdout:1/656: write d1/dd/d11/d46/d57/fb7 [659488,99611] 0 2024-09-16T02:05:54.638 INFO:tasks.workunit.client.1.smithi165.stdout:4/533: write d4/dc/d28/d3b/fa5 [911972,83201] 0 2024-09-16T02:05:54.641 INFO:tasks.workunit.client.1.smithi165.stdout:8/635: read - dd/d11/d14/d3f/d72/fa4 zero size 2024-09-16T02:05:54.641 INFO:tasks.workunit.client.1.smithi165.stdout:2/652: getdents df/d23/d66 0 2024-09-16T02:05:54.642 INFO:tasks.workunit.client.1.smithi165.stdout:4/534: chown d4/dc/d18/l7c 840 1 2024-09-16T02:05:54.643 INFO:tasks.workunit.client.1.smithi165.stdout:5/618: getdents de/d19 0 2024-09-16T02:05:54.644 INFO:tasks.workunit.client.1.smithi165.stdout:7/590: link d0/df/d33/d2a/f4d d0/d4b/db4/dba/fbd 0 2024-09-16T02:05:54.646 INFO:tasks.workunit.client.1.smithi165.stdout:5/619: read de/d19/d1c/f56 [1245494,65817] 0 2024-09-16T02:05:54.646 INFO:tasks.workunit.client.1.smithi165.stdout:6/616: rename d7/dc/c30 to d7/dc/df/d1a/d4d/cab 0 2024-09-16T02:05:54.646 INFO:tasks.workunit.client.1.smithi165.stdout:7/591: chown d0/df/d33/d2a/f94 40376 1 2024-09-16T02:05:54.648 INFO:tasks.workunit.client.1.smithi165.stdout:8/636: creat dd/d11/d14/d3f/d25/d36/d4f/fdf x:0 0 0 2024-09-16T02:05:54.650 INFO:tasks.workunit.client.1.smithi165.stdout:3/692: dread da/d17/f4b [0,4194304] 0 2024-09-16T02:05:54.652 INFO:tasks.workunit.client.1.smithi165.stdout:2/653: rename df/d10/d1a/d2d/l30 to df/dbb/lc4 0 2024-09-16T02:05:54.652 INFO:tasks.workunit.client.1.smithi165.stdout:4/535: dwrite d4/dc/d18/fa8 [0,4194304] 0 2024-09-16T02:05:54.654 INFO:tasks.workunit.client.1.smithi165.stdout:2/654: dread - df/d23/d28/d3b/d6d/d8b/fb2 zero size 2024-09-16T02:05:54.654 INFO:tasks.workunit.client.1.smithi165.stdout:5/620: rmdir de/d19/d67 39 2024-09-16T02:05:54.657 INFO:tasks.workunit.client.1.smithi165.stdout:6/617: dwrite d7/dc/d3b/d3a/d3d/d5d/d73/d82/f89 [0,4194304] 0 2024-09-16T02:05:54.661 INFO:tasks.workunit.client.1.smithi165.stdout:1/657: truncate d1/d22/f82 1456755 0 2024-09-16T02:05:54.662 INFO:tasks.workunit.client.1.smithi165.stdout:1/658: chown d1/d19/d24/d30/c53 5923 1 2024-09-16T02:05:54.662 INFO:tasks.workunit.client.1.smithi165.stdout:8/637: mknod dd/d11/d14/d3f/d25/d36/d85/ce0 0 2024-09-16T02:05:54.663 INFO:tasks.workunit.client.1.smithi165.stdout:8/638: truncate dd/d11/d14/d3f/f9c 1325548 0 2024-09-16T02:05:54.665 INFO:tasks.workunit.client.1.smithi165.stdout:4/536: symlink d4/dc/d18/d37/d53/d64/d8b/d71/lb0 0 2024-09-16T02:05:54.669 INFO:tasks.workunit.client.1.smithi165.stdout:6/618: rename d7/dc/df/d1a/l55 to d7/dc/d3b/d3a/d3d/d5d/d73/lac 0 2024-09-16T02:05:54.669 INFO:tasks.workunit.client.1.smithi165.stdout:4/537: dread d4/dc/d20/d4e/d73/f8e [0,4194304] 0 2024-09-16T02:05:54.669 INFO:tasks.workunit.client.1.smithi165.stdout:7/592: write d0/d3d/f5b [2977058,73732] 0 2024-09-16T02:05:54.674 INFO:tasks.workunit.client.1.smithi165.stdout:8/639: creat dd/d11/d14/d3f/d25/fe1 x:0 0 0 2024-09-16T02:05:54.678 INFO:tasks.workunit.client.1.smithi165.stdout:6/619: mknod d7/dc/df/d5b/cad 0 2024-09-16T02:05:54.678 INFO:tasks.workunit.client.1.smithi165.stdout:6/620: fdatasync d7/d1f/f8c 0 2024-09-16T02:05:54.679 INFO:tasks.workunit.client.1.smithi165.stdout:2/655: creat df/fc5 x:0 0 0 2024-09-16T02:05:54.679 INFO:tasks.workunit.client.1.smithi165.stdout:3/693: truncate da/d20/f3b 893886 0 2024-09-16T02:05:54.680 INFO:tasks.workunit.client.1.smithi165.stdout:2/656: chown df/d23/f50 419973807 1 2024-09-16T02:05:54.683 INFO:tasks.workunit.client.1.smithi165.stdout:5/621: creat de/fd3 x:0 0 0 2024-09-16T02:05:54.687 INFO:tasks.workunit.client.1.smithi165.stdout:3/694: dwrite da/d17/d78/d2c/d2d/fbf [4194304,4194304] 0 2024-09-16T02:05:54.689 INFO:tasks.workunit.client.1.smithi165.stdout:7/593: write d0/df/d33/d2a/f4d [5725880,71451] 0 2024-09-16T02:05:54.694 INFO:tasks.workunit.client.1.smithi165.stdout:3/695: rmdir da/d17/d7a/d7d 39 2024-09-16T02:05:54.697 INFO:tasks.workunit.client.1.smithi165.stdout:7/594: dwrite d0/df/d42/fa5 [0,4194304] 0 2024-09-16T02:05:54.697 INFO:tasks.workunit.client.1.smithi165.stdout:4/538: write d4/dc/d18/d37/d53/d64/d8b/f63 [1743267,68826] 0 2024-09-16T02:05:54.698 INFO:tasks.workunit.client.1.smithi165.stdout:5/622: dread de/fa4 [0,4194304] 0 2024-09-16T02:05:54.699 INFO:tasks.workunit.client.1.smithi165.stdout:1/659: link d1/d19/d24/d30/d72/lb4 d1/dd/d11/d33/d3f/d6c/lcf 0 2024-09-16T02:05:54.700 INFO:tasks.workunit.client.1.smithi165.stdout:2/657: fdatasync df/d23/f84 0 2024-09-16T02:05:54.701 INFO:tasks.workunit.client.1.smithi165.stdout:8/640: dwrite f9 [0,4194304] 0 2024-09-16T02:05:54.701 INFO:tasks.workunit.client.1.smithi165.stdout:4/539: dread - d4/dc/d18/d37/d53/d64/faa zero size 2024-09-16T02:05:54.703 INFO:tasks.workunit.client.1.smithi165.stdout:2/658: readlink df/l63 0 2024-09-16T02:05:54.703 INFO:tasks.workunit.client.1.smithi165.stdout:3/696: creat da/d20/d26/d52/ff4 x:0 0 0 2024-09-16T02:05:54.703 INFO:tasks.workunit.client.1.smithi165.stdout:4/540: dread - d4/dc/d20/d4e/f72 zero size 2024-09-16T02:05:54.704 INFO:tasks.workunit.client.1.smithi165.stdout:1/660: write d1/f3a [4724084,123124] 0 2024-09-16T02:05:54.704 INFO:tasks.workunit.client.1.smithi165.stdout:7/595: creat d0/d3d/d9f/fbe x:0 0 0 2024-09-16T02:05:54.705 INFO:tasks.workunit.client.1.smithi165.stdout:8/641: dread - dd/d34/f48 zero size 2024-09-16T02:05:54.706 INFO:tasks.workunit.client.1.smithi165.stdout:3/697: write da/d20/fae [233200,81218] 0 2024-09-16T02:05:54.708 INFO:tasks.workunit.client.1.smithi165.stdout:2/659: mknod df/dbb/cc6 0 2024-09-16T02:05:54.708 INFO:tasks.workunit.client.1.smithi165.stdout:1/661: rmdir d1/d19 39 2024-09-16T02:05:54.710 INFO:tasks.workunit.client.1.smithi165.stdout:4/541: read - d4/dc/d18/d37/d53/d64/d8b/d71/f9a zero size 2024-09-16T02:05:54.712 INFO:tasks.workunit.client.1.smithi165.stdout:3/698: symlink da/d17/d78/d2c/d2d/lf5 0 2024-09-16T02:05:54.713 INFO:tasks.workunit.client.1.smithi165.stdout:3/699: readlink da/d17/dcc/l12 0 2024-09-16T02:05:54.715 INFO:tasks.workunit.client.1.smithi165.stdout:1/662: symlink d1/dd/d11/d33/d3f/d7e/ld0 0 2024-09-16T02:05:54.716 INFO:tasks.workunit.client.1.smithi165.stdout:7/596: link d0/df/d65/l86 d0/d3d/d9f/lbf 0 2024-09-16T02:05:54.718 INFO:tasks.workunit.client.1.smithi165.stdout:3/700: rename da/d17/dcc/c65 to da/d17/d78/d2c/cf6 0 2024-09-16T02:05:54.718 INFO:tasks.workunit.client.1.smithi165.stdout:3/701: readlink da/d17/dcc/l12 0 2024-09-16T02:05:54.719 INFO:tasks.workunit.client.1.smithi165.stdout:1/663: creat d1/d32/fd1 x:0 0 0 2024-09-16T02:05:54.720 INFO:tasks.workunit.client.1.smithi165.stdout:7/597: symlink d0/lc0 0 2024-09-16T02:05:54.721 INFO:tasks.workunit.client.1.smithi165.stdout:2/660: getdents df/d23/d28/d9a/d86 0 2024-09-16T02:05:54.722 INFO:tasks.workunit.client.1.smithi165.stdout:7/598: chown d0/df/c20 15902742 1 2024-09-16T02:05:54.723 INFO:tasks.workunit.client.1.smithi165.stdout:7/599: readlink d0/d2c/l31 0 2024-09-16T02:05:54.725 INFO:tasks.workunit.client.1.smithi165.stdout:1/664: mkdir d1/dd/d11/d33/d3f/d47/d7d/db3/dd2 0 2024-09-16T02:05:54.726 INFO:tasks.workunit.client.1.smithi165.stdout:3/702: mkdir da/d57/d8d/d97/df7 0 2024-09-16T02:05:54.727 INFO:tasks.workunit.client.1.smithi165.stdout:8/642: write dd/d11/d14/d3f/d25/d36/f64 [293320,31481] 0 2024-09-16T02:05:54.728 INFO:tasks.workunit.client.1.smithi165.stdout:5/623: dread de/f1d [0,4194304] 0 2024-09-16T02:05:54.729 INFO:tasks.workunit.client.1.smithi165.stdout:8/643: dread - dd/d11/daa/fb2 zero size 2024-09-16T02:05:54.729 INFO:tasks.workunit.client.1.smithi165.stdout:1/665: symlink d1/dd/d11/d33/d67/dcc/ld3 0 2024-09-16T02:05:54.732 INFO:tasks.workunit.client.1.smithi165.stdout:3/703: creat da/d20/d26/ff8 x:0 0 0 2024-09-16T02:05:54.734 INFO:tasks.workunit.client.1.smithi165.stdout:4/542: dread d4/dc/d18/f34 [0,4194304] 0 2024-09-16T02:05:54.734 INFO:tasks.workunit.client.1.smithi165.stdout:8/644: symlink dd/d11/d14/d3f/db3/le2 0 2024-09-16T02:05:54.735 INFO:tasks.workunit.client.1.smithi165.stdout:2/661: dread df/d10/f13 [0,4194304] 0 2024-09-16T02:05:54.737 INFO:tasks.workunit.client.1.smithi165.stdout:7/600: dread d0/df/d7/f23 [0,4194304] 0 2024-09-16T02:05:54.737 INFO:tasks.workunit.client.1.smithi165.stdout:5/624: rename de/d19/d1c/d84/f88 to de/d19/d1c/d49/fd4 0 2024-09-16T02:05:54.737 INFO:tasks.workunit.client.1.smithi165.stdout:8/645: rmdir dd/d62 39 2024-09-16T02:05:54.738 INFO:tasks.workunit.client.1.smithi165.stdout:5/625: readlink de/d21/d26/d3a/d54/l87 0 2024-09-16T02:05:54.740 INFO:tasks.workunit.client.1.smithi165.stdout:3/704: symlink da/d17/d7a/lf9 0 2024-09-16T02:05:54.742 INFO:tasks.workunit.client.1.smithi165.stdout:4/543: creat d4/d40/d4f/fb1 x:0 0 0 2024-09-16T02:05:54.745 INFO:tasks.workunit.client.1.smithi165.stdout:3/705: symlink da/d17/dcc/lfa 0 2024-09-16T02:05:54.746 INFO:tasks.workunit.client.1.smithi165.stdout:2/662: mknod df/d10/d37/cc7 0 2024-09-16T02:05:54.747 INFO:tasks.workunit.client.1.smithi165.stdout:8/646: mknod dd/d11/daa/db9/ce3 0 2024-09-16T02:05:54.749 INFO:tasks.workunit.client.1.smithi165.stdout:5/626: mkdir de/d21/d26/d3a/dd5 0 2024-09-16T02:05:54.749 INFO:tasks.workunit.client.1.smithi165.stdout:1/666: write d1/d22/f2c [64465,116223] 0 2024-09-16T02:05:54.752 INFO:tasks.workunit.client.1.smithi165.stdout:4/544: truncate d4/dc/d28/d2b/d42/f87 387672 0 2024-09-16T02:05:54.754 INFO:tasks.workunit.client.1.smithi165.stdout:3/706: mkdir da/d17/d78/d2c/d2d/d6c/dfb 0 2024-09-16T02:05:54.760 INFO:tasks.workunit.client.1.smithi165.stdout:4/545: dread d4/dc/d28/d3b/fa5 [0,4194304] 0 2024-09-16T02:05:54.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/627: mkdir de/d19/d67/db9/dd6 0 2024-09-16T02:05:54.761 INFO:tasks.workunit.client.1.smithi165.stdout:2/663: getdents df/d23/d28/d9a 0 2024-09-16T02:05:54.761 INFO:tasks.workunit.client.1.smithi165.stdout:3/707: creat da/d57/d8d/d97/df7/ffc x:0 0 0 2024-09-16T02:05:54.761 INFO:tasks.workunit.client.1.smithi165.stdout:1/667: link d1/dd/d11/d42/l7b d1/dd/d11/d33/d67/ld4 0 2024-09-16T02:05:54.762 INFO:tasks.workunit.client.1.smithi165.stdout:4/546: rmdir d4/dc/d20 39 2024-09-16T02:05:54.763 INFO:tasks.workunit.client.1.smithi165.stdout:5/628: creat de/d21/d26/d3a/dd5/fd7 x:0 0 0 2024-09-16T02:05:54.763 INFO:tasks.workunit.client.1.smithi165.stdout:2/664: truncate df/d23/d28/f81 15980 0 2024-09-16T02:05:54.763 INFO:tasks.workunit.client.1.smithi165.stdout:4/547: read d4/dc/d18/fa8 [367429,2717] 0 2024-09-16T02:05:54.763 INFO:tasks.workunit.client.1.smithi165.stdout:1/668: chown d1/dd/d11/d33/d35/fb9 128 1 2024-09-16T02:05:54.764 INFO:tasks.workunit.client.1.smithi165.stdout:3/708: rmdir da/d20/d26 39 2024-09-16T02:05:54.764 INFO:tasks.workunit.client.1.smithi165.stdout:4/548: chown d4/d40/c6b 376 1 2024-09-16T02:05:54.768 INFO:tasks.workunit.client.1.smithi165.stdout:4/549: read d4/dc/d28/d30/f80 [3059843,71069] 0 2024-09-16T02:05:54.768 INFO:tasks.workunit.client.1.smithi165.stdout:3/709: dread da/d17/d7a/f96 [0,4194304] 0 2024-09-16T02:05:54.771 INFO:tasks.workunit.client.1.smithi165.stdout:5/629: creat de/d21/d26/d3a/d6d/dad/fd8 x:0 0 0 2024-09-16T02:05:54.778 INFO:tasks.workunit.client.1.smithi165.stdout:1/669: getdents d1/dd/d11/d33 0 2024-09-16T02:05:54.778 INFO:tasks.workunit.client.1.smithi165.stdout:3/710: creat da/d17/d78/d2c/d2d/d6c/ffd x:0 0 0 2024-09-16T02:05:54.779 INFO:tasks.workunit.client.1.smithi165.stdout:4/550: getdents d4/dc/d28/d2b/d42 0 2024-09-16T02:05:54.780 INFO:tasks.workunit.client.1.smithi165.stdout:2/665: dread df/d23/d28/d9a/f41 [4194304,4194304] 0 2024-09-16T02:05:54.781 INFO:tasks.workunit.client.1.smithi165.stdout:1/670: write d1/dd/d11/d42/faf [1539846,4554] 0 2024-09-16T02:05:54.782 INFO:tasks.workunit.client.1.smithi165.stdout:5/630: dwrite de/d21/d26/d3a/f3c [0,4194304] 0 2024-09-16T02:05:54.783 INFO:tasks.workunit.client.1.smithi165.stdout:1/671: creat d1/d32/fd5 x:0 0 0 2024-09-16T02:05:54.784 INFO:tasks.workunit.client.1.smithi165.stdout:2/666: unlink df/d23/d28/d9a/f41 0 2024-09-16T02:05:54.785 INFO:tasks.workunit.client.1.smithi165.stdout:1/672: chown d1/dd/d11/d46/d57/fb8 1880 1 2024-09-16T02:05:54.787 INFO:tasks.workunit.client.1.smithi165.stdout:2/667: creat df/d73/d79/d98/fc8 x:0 0 0 2024-09-16T02:05:54.787 INFO:tasks.workunit.client.1.smithi165.stdout:1/673: unlink d1/f39 0 2024-09-16T02:05:54.788 INFO:tasks.workunit.client.1.smithi165.stdout:4/551: dread d4/dc/d18/fa3 [0,4194304] 0 2024-09-16T02:05:54.792 INFO:tasks.workunit.client.1.smithi165.stdout:2/668: write df/d10/f13 [1598343,33211] 0 2024-09-16T02:05:54.793 INFO:tasks.workunit.client.1.smithi165.stdout:1/674: write d1/dd/d11/d33/d3f/f55 [1667788,89959] 0 2024-09-16T02:05:54.794 INFO:tasks.workunit.client.1.smithi165.stdout:5/631: dwrite de/d19/d1c/d49/f99 [0,4194304] 0 2024-09-16T02:05:54.796 INFO:tasks.workunit.client.1.smithi165.stdout:5/632: dread - de/d19/d67/d74/f9e zero size 2024-09-16T02:05:54.800 INFO:tasks.workunit.client.1.smithi165.stdout:5/633: write de/d19/fc5 [658037,110102] 0 2024-09-16T02:05:54.803 INFO:tasks.workunit.client.1.smithi165.stdout:2/669: dwrite df/d10/f9f [0,4194304] 0 2024-09-16T02:05:54.804 INFO:tasks.workunit.client.1.smithi165.stdout:2/670: write df/fc5 [656698,75247] 0 2024-09-16T02:05:54.806 INFO:tasks.workunit.client.1.smithi165.stdout:5/634: rename de/d21/d26/l4b to de/d60/dbc/ld9 0 2024-09-16T02:05:54.807 INFO:tasks.workunit.client.1.smithi165.stdout:4/552: dread d4/f44 [0,4194304] 0 2024-09-16T02:05:54.809 INFO:tasks.workunit.client.1.smithi165.stdout:5/635: chown de/d21/d26/d3a/d6d/dad/lbe 3440392 1 2024-09-16T02:05:54.811 INFO:tasks.workunit.client.1.smithi165.stdout:4/553: truncate d4/dc/d28/d2b/f89 918529 0 2024-09-16T02:05:54.813 INFO:tasks.workunit.client.1.smithi165.stdout:5/636: creat de/d21/d51/fda x:0 0 0 2024-09-16T02:05:54.813 INFO:tasks.workunit.client.1.smithi165.stdout:2/671: dwrite df/fba [0,4194304] 0 2024-09-16T02:05:54.816 INFO:tasks.workunit.client.1.smithi165.stdout:5/637: mknod de/d19/d1c/d84/d92/cdb 0 2024-09-16T02:05:54.817 INFO:tasks.workunit.client.1.smithi165.stdout:1/675: dread d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:54.818 INFO:tasks.workunit.client.1.smithi165.stdout:2/672: link df/d73/d79/d98/fc8 df/d10/d1a/d68/fc9 0 2024-09-16T02:05:54.824 INFO:tasks.workunit.client.1.smithi165.stdout:1/676: rename d1/dd/d11/d33/d3f/d59/db5 to d1/d22/dd6 0 2024-09-16T02:05:54.825 INFO:tasks.workunit.client.1.smithi165.stdout:1/677: chown d1/dd/d11/d33/d3f/d47/d7d/db3/dd2 4266000 1 2024-09-16T02:05:54.826 INFO:tasks.workunit.client.1.smithi165.stdout:5/638: getdents de/d19/d1c/d49 0 2024-09-16T02:05:54.834 INFO:tasks.workunit.client.1.smithi165.stdout:1/678: dwrite d1/dd/d11/d46/d57/fb8 [0,4194304] 0 2024-09-16T02:05:54.834 INFO:tasks.workunit.client.1.smithi165.stdout:5/639: dwrite de/d19/d1c/d49/fa3 [0,4194304] 0 2024-09-16T02:05:54.836 INFO:tasks.workunit.client.1.smithi165.stdout:4/554: dread d4/dc/f19 [0,4194304] 0 2024-09-16T02:05:54.840 INFO:tasks.workunit.client.1.smithi165.stdout:1/679: truncate d1/dd/d11/d33/f56 1143738 0 2024-09-16T02:05:54.844 INFO:tasks.workunit.client.1.smithi165.stdout:1/680: fsync d1/dd/d11/d33/d67/f9b 0 2024-09-16T02:05:54.844 INFO:tasks.workunit.client.1.smithi165.stdout:4/555: symlink d4/dc/d18/d37/d53/d64/d8b/lb2 0 2024-09-16T02:05:54.848 INFO:tasks.workunit.client.1.smithi165.stdout:5/640: dwrite de/d19/f32 [0,4194304] 0 2024-09-16T02:05:54.849 INFO:tasks.workunit.client.1.smithi165.stdout:5/641: chown de/d19/d1c/d4d/f72 276 1 2024-09-16T02:05:54.850 INFO:tasks.workunit.client.1.smithi165.stdout:2/673: dread df/d23/f84 [0,4194304] 0 2024-09-16T02:05:54.851 INFO:tasks.workunit.client.1.smithi165.stdout:1/681: rename d1/d19/d24/d97/da5 to d1/d6b/dd7 0 2024-09-16T02:05:54.852 INFO:tasks.workunit.client.1.smithi165.stdout:4/556: symlink d4/dc/d20/d4e/lb3 0 2024-09-16T02:05:54.855 INFO:tasks.workunit.client.1.smithi165.stdout:2/674: mkdir df/d10/d1a/dca 0 2024-09-16T02:05:54.858 INFO:tasks.workunit.client.1.smithi165.stdout:4/557: symlink d4/dc/d20/d67/lb4 0 2024-09-16T02:05:54.859 INFO:tasks.workunit.client.1.smithi165.stdout:5/642: creat de/d19/d1c/d4d/dc1/fdc x:0 0 0 2024-09-16T02:05:54.859 INFO:tasks.workunit.client.1.smithi165.stdout:4/558: chown d4/dc/d28/d30/c35 1838675093 1 2024-09-16T02:05:54.866 INFO:tasks.workunit.client.1.smithi165.stdout:4/559: readlink d4/dc/d18/d37/d53/l55 0 2024-09-16T02:05:54.869 INFO:tasks.workunit.client.1.smithi165.stdout:4/560: readlink d4/dc/d20/l96 0 2024-09-16T02:05:54.869 INFO:tasks.workunit.client.1.smithi165.stdout:4/561: chown d4/dc/d28/d2b/c32 102 1 2024-09-16T02:05:54.873 INFO:tasks.workunit.client.1.smithi165.stdout:4/562: chown d4/dc/d18/d37/d53/d64/d8b/d71/f7d 19370817 1 2024-09-16T02:05:54.874 INFO:tasks.workunit.client.1.smithi165.stdout:1/682: dwrite d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:54.877 INFO:tasks.workunit.client.1.smithi165.stdout:4/563: read d4/dc/d20/d45/f77 [502240,117154] 0 2024-09-16T02:05:54.878 INFO:tasks.workunit.client.1.smithi165.stdout:5/643: write de/d19/d1c/f56 [974970,38546] 0 2024-09-16T02:05:54.878 INFO:tasks.workunit.client.1.smithi165.stdout:4/564: read d4/dc/d18/f34 [4615895,118717] 0 2024-09-16T02:05:54.879 INFO:tasks.workunit.client.1.smithi165.stdout:5/644: chown de/d19/d1c/d84/lb3 5529 1 2024-09-16T02:05:54.879 INFO:tasks.workunit.client.1.smithi165.stdout:5/645: chown de/la6 1 1 2024-09-16T02:05:54.880 INFO:tasks.workunit.client.1.smithi165.stdout:5/646: chown de/d60/fb2 11835 1 2024-09-16T02:05:54.882 INFO:tasks.workunit.client.1.smithi165.stdout:4/565: rmdir d4/dc/d28/d2b 39 2024-09-16T02:05:54.883 INFO:tasks.workunit.client.1.smithi165.stdout:2/675: truncate df/d23/d66/f7d 518011 0 2024-09-16T02:05:54.885 INFO:tasks.workunit.client.1.smithi165.stdout:1/683: getdents d1/dd/d11/d33/d3f 0 2024-09-16T02:05:54.887 INFO:tasks.workunit.client.1.smithi165.stdout:5/647: dwrite de/fd3 [0,4194304] 0 2024-09-16T02:05:54.887 INFO:tasks.workunit.client.1.smithi165.stdout:2/676: fsync df/d23/d28/d3b/f96 0 2024-09-16T02:05:54.888 INFO:tasks.workunit.client.1.smithi165.stdout:4/566: creat d4/dc/d28/fb5 x:0 0 0 2024-09-16T02:05:54.890 INFO:tasks.workunit.client.1.smithi165.stdout:4/567: readlink d4/dc/d18/d37/d53/d64/d8b/d71/lb0 0 2024-09-16T02:05:54.892 INFO:tasks.workunit.client.1.smithi165.stdout:2/677: write df/d10/d64/f91 [1350261,105098] 0 2024-09-16T02:05:54.895 INFO:tasks.workunit.client.1.smithi165.stdout:5/648: creat de/d19/d1c/fdd x:0 0 0 2024-09-16T02:05:54.896 INFO:tasks.workunit.client.1.smithi165.stdout:4/568: creat d4/dc/d28/d2b/d42/d99/fb6 x:0 0 0 2024-09-16T02:05:54.897 INFO:tasks.workunit.client.1.smithi165.stdout:1/684: link d1/dd/d11/d33/d3f/d6c/lae d1/d6b/dd7/ld8 0 2024-09-16T02:05:54.899 INFO:tasks.workunit.client.1.smithi165.stdout:5/649: mknod de/d19/d1c/cde 0 2024-09-16T02:05:54.899 INFO:tasks.workunit.client.1.smithi165.stdout:4/569: write d4/dc/d20/f62 [2093291,85757] 0 2024-09-16T02:05:54.900 INFO:tasks.workunit.client.1.smithi165.stdout:2/678: rename df/l70 to df/d10/d37/lcb 0 2024-09-16T02:05:54.901 INFO:tasks.workunit.client.1.smithi165.stdout:2/679: write df/d23/d28/f94 [443259,90036] 0 2024-09-16T02:05:54.901 INFO:tasks.workunit.client.1.smithi165.stdout:1/685: creat d1/fd9 x:0 0 0 2024-09-16T02:05:54.903 INFO:tasks.workunit.client.1.smithi165.stdout:4/570: rename d4/dc/d28/d30/l38 to d4/dc/d20/lb7 0 2024-09-16T02:05:54.907 INFO:tasks.workunit.client.1.smithi165.stdout:5/650: getdents de/d21/d26/d3a/d6d/d95 0 2024-09-16T02:05:54.909 INFO:tasks.workunit.client.1.smithi165.stdout:4/571: truncate d4/dc/d20/d67/f76 1801029 0 2024-09-16T02:05:54.909 INFO:tasks.workunit.client.1.smithi165.stdout:1/686: dread d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:54.909 INFO:tasks.workunit.client.1.smithi165.stdout:5/651: read de/d21/d26/d9a/fc0 [234001,87490] 0 2024-09-16T02:05:54.910 INFO:tasks.workunit.client.1.smithi165.stdout:4/572: readlink d4/d40/l7b 0 2024-09-16T02:05:54.910 INFO:tasks.workunit.client.1.smithi165.stdout:4/573: fsync d4/dc/d28/d2b/f89 0 2024-09-16T02:05:54.912 INFO:tasks.workunit.client.1.smithi165.stdout:2/680: getdents df/d10/d1a/d68 0 2024-09-16T02:05:54.914 INFO:tasks.workunit.client.1.smithi165.stdout:4/574: truncate d4/dc/d18/d37/d53/d64/d8b/f8a 1025898 0 2024-09-16T02:05:54.915 INFO:tasks.workunit.client.1.smithi165.stdout:4/575: dread - d4/dc/d28/d2b/d42/d99/f9c zero size 2024-09-16T02:05:54.916 INFO:tasks.workunit.client.1.smithi165.stdout:5/652: dwrite de/d19/d1c/d4d/dc1/fdc [0,4194304] 0 2024-09-16T02:05:54.917 INFO:tasks.workunit.client.1.smithi165.stdout:1/687: link d1/f79 d1/dd/d11/d42/fda 0 2024-09-16T02:05:54.919 INFO:tasks.workunit.client.1.smithi165.stdout:2/681: write df/f34 [596794,5453] 0 2024-09-16T02:05:54.921 INFO:tasks.workunit.client.1.smithi165.stdout:2/682: chown df/dbb/cc6 0 1 2024-09-16T02:05:54.922 INFO:tasks.workunit.client.1.smithi165.stdout:1/688: dread d1/f3a [4194304,4194304] 0 2024-09-16T02:05:54.923 INFO:tasks.workunit.client.0.smithi110.stdout:9/134: sync 2024-09-16T02:05:54.924 INFO:tasks.workunit.client.1.smithi165.stdout:1/689: write d1/dd/d11/d33/d92/fc6 [290337,12780] 0 2024-09-16T02:05:54.926 INFO:tasks.workunit.client.1.smithi165.stdout:1/690: rmdir d1/d19/d24/d30 39 2024-09-16T02:05:54.929 INFO:tasks.workunit.client.1.smithi165.stdout:1/691: read d1/dd/d11/d46/d57/fb7 [597801,114204] 0 2024-09-16T02:05:54.934 INFO:tasks.workunit.client.0.smithi110.stdout:9/135: dwrite d1/dd/f10 [4194304,4194304] 0 2024-09-16T02:05:54.946 INFO:tasks.workunit.client.1.smithi165.stdout:0/577: sync 2024-09-16T02:05:54.946 INFO:tasks.workunit.client.1.smithi165.stdout:9/678: sync 2024-09-16T02:05:54.963 INFO:tasks.workunit.client.0.smithi110.stdout:9/136: dread d1/d5/d8/de/f1c [0,4194304] 0 2024-09-16T02:05:54.964 INFO:tasks.workunit.client.0.smithi110.stdout:9/137: stat d1/dd/f12 0 2024-09-16T02:05:54.965 INFO:tasks.workunit.client.1.smithi165.stdout:9/679: creat d7/d32/d38/fe5 x:0 0 0 2024-09-16T02:05:54.965 INFO:tasks.workunit.client.1.smithi165.stdout:2/683: dread df/d10/d1a/d2d/f4e [0,4194304] 0 2024-09-16T02:05:54.966 INFO:tasks.workunit.client.1.smithi165.stdout:9/680: chown d7/d1f/d27 0 1 2024-09-16T02:05:54.966 INFO:tasks.workunit.client.0.smithi110.stdout:9/138: rename d1/d5/d20/d27 to d1/d2b/d2e 0 2024-09-16T02:05:54.967 INFO:tasks.workunit.client.1.smithi165.stdout:1/692: rename d1/d68/l9f to d1/d22/ldb 0 2024-09-16T02:05:54.968 INFO:tasks.workunit.client.1.smithi165.stdout:9/681: unlink d7/df/d67/la2 0 2024-09-16T02:05:54.968 INFO:tasks.workunit.client.1.smithi165.stdout:1/693: dread - d1/d19/d4d/d84/fba zero size 2024-09-16T02:05:54.969 INFO:tasks.workunit.client.1.smithi165.stdout:9/682: write d7/df/d37/fde [165250,54766] 0 2024-09-16T02:05:54.972 INFO:tasks.workunit.client.1.smithi165.stdout:2/684: symlink df/d10/d1a/d68/lcc 0 2024-09-16T02:05:54.972 INFO:tasks.workunit.client.1.smithi165.stdout:0/578: rename d0/d61/fb7 to d0/d2a/d70/fcb 0 2024-09-16T02:05:54.972 INFO:tasks.workunit.client.1.smithi165.stdout:1/694: mknod d1/d22/dd6/cdc 0 2024-09-16T02:05:54.973 INFO:tasks.workunit.client.1.smithi165.stdout:9/683: symlink d7/df/d37/d65/le6 0 2024-09-16T02:05:54.975 INFO:tasks.workunit.client.1.smithi165.stdout:0/579: rename d0/c12 to d0/d1e/d20/d28/d6d/ccc 0 2024-09-16T02:05:54.977 INFO:tasks.workunit.client.1.smithi165.stdout:1/695: dwrite d1/dd/d11/d33/d3f/d47/d7d/db3/fbc [0,4194304] 0 2024-09-16T02:05:54.978 INFO:tasks.workunit.client.1.smithi165.stdout:9/684: creat d7/df/d37/d43/fe7 x:0 0 0 2024-09-16T02:05:54.978 INFO:tasks.workunit.client.1.smithi165.stdout:0/580: write d0/d2a/d70/fcb [897354,6129] 0 2024-09-16T02:05:54.979 INFO:tasks.workunit.client.0.smithi110.stdout:9/139: dwrite d1/d5/f18 [0,4194304] 0 2024-09-16T02:05:54.979 INFO:tasks.workunit.client.1.smithi165.stdout:2/685: getdents df/d23/d28 0 2024-09-16T02:05:54.980 INFO:tasks.workunit.client.1.smithi165.stdout:1/696: chown d1/dd/d11/d33/d3f/d59/f90 14931 1 2024-09-16T02:05:54.981 INFO:tasks.workunit.client.1.smithi165.stdout:9/685: write d7/d32/d38/d53/d56/dca/dd2/fba [203430,78727] 0 2024-09-16T02:05:54.982 INFO:tasks.workunit.client.1.smithi165.stdout:0/581: truncate d0/d2a/d70/fcb 1663718 0 2024-09-16T02:05:54.983 INFO:tasks.workunit.client.0.smithi110.stdout:9/140: symlink d1/d5/d8/de/d1f/l2f 0 2024-09-16T02:05:54.983 INFO:tasks.workunit.client.1.smithi165.stdout:1/697: write d1/dd/d11/d33/d92/fc6 [628870,130691] 0 2024-09-16T02:05:54.985 INFO:tasks.workunit.client.1.smithi165.stdout:0/582: truncate d0/d1e/f2c 4940578 0 2024-09-16T02:05:54.993 INFO:tasks.workunit.client.1.smithi165.stdout:2/686: rename df/dbb/cc6 to df/d23/d28/d3b/d6d/d8b/ccd 0 2024-09-16T02:05:54.993 INFO:tasks.workunit.client.0.smithi110.stdout:9/141: link d1/d5/d8/c9 d1/dd/c30 0 2024-09-16T02:05:54.995 INFO:tasks.workunit.client.0.smithi110.stdout:9/142: symlink d1/l31 0 2024-09-16T02:05:54.998 INFO:tasks.workunit.client.1.smithi165.stdout:9/686: dwrite d7/d14/f16 [4194304,4194304] 0 2024-09-16T02:05:55.001 INFO:tasks.workunit.client.1.smithi165.stdout:1/698: dread d1/dd/d11/d33/d3f/f55 [0,4194304] 0 2024-09-16T02:05:55.007 INFO:tasks.workunit.client.1.smithi165.stdout:0/583: read d0/d1e/d39/d48/d45/f44 [14793,67308] 0 2024-09-16T02:05:55.007 INFO:tasks.workunit.client.1.smithi165.stdout:2/687: chown df/d10/d1a/d68 259 1 2024-09-16T02:05:55.007 INFO:tasks.workunit.client.1.smithi165.stdout:0/584: readlink d0/d1e/d39/l52 0 2024-09-16T02:05:55.008 INFO:tasks.workunit.client.1.smithi165.stdout:2/688: chown df/d73/d79 359628029 1 2024-09-16T02:05:55.008 INFO:tasks.workunit.client.1.smithi165.stdout:0/585: readlink d0/d1e/l2b 0 2024-09-16T02:05:55.009 INFO:tasks.workunit.client.1.smithi165.stdout:1/699: rename d1/dd/d11/d33/d3f/d7e/lb0 to d1/dd/d11/d46/d57/ldd 0 2024-09-16T02:05:55.010 INFO:tasks.workunit.client.1.smithi165.stdout:6/621: sync 2024-09-16T02:05:55.010 INFO:tasks.workunit.client.1.smithi165.stdout:7/601: sync 2024-09-16T02:05:55.012 INFO:tasks.workunit.client.1.smithi165.stdout:0/586: rename d0/c18 to d0/d1e/d39/d48/d45/ccd 0 2024-09-16T02:05:55.017 INFO:tasks.workunit.client.1.smithi165.stdout:1/700: rename d1/d22/dd6 to d1/dd/d11/d33/d3f/d6c/dde 0 2024-09-16T02:05:55.018 INFO:tasks.workunit.client.1.smithi165.stdout:9/687: dread d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:55.018 INFO:tasks.workunit.client.0.smithi110.stdout:9/143: dwrite d1/d1b/f1d [0,4194304] 0 2024-09-16T02:05:55.020 INFO:tasks.workunit.client.1.smithi165.stdout:2/689: getdents df/d23/d28/d3b 0 2024-09-16T02:05:55.021 INFO:tasks.workunit.client.1.smithi165.stdout:0/587: dwrite d0/fba [4194304,4194304] 0 2024-09-16T02:05:55.021 INFO:tasks.workunit.client.0.smithi110.stdout:9/144: write d1/d5/d8/f17 [4783039,29865] 0 2024-09-16T02:05:55.021 INFO:tasks.workunit.client.1.smithi165.stdout:7/602: creat d0/df/fc1 x:0 0 0 2024-09-16T02:05:55.022 INFO:tasks.workunit.client.0.smithi110.stdout:9/145: readlink d1/d1b/l24 0 2024-09-16T02:05:55.022 INFO:tasks.workunit.client.0.smithi110.stdout:9/146: write d1/fc [4080724,25985] 0 2024-09-16T02:05:55.023 INFO:tasks.workunit.client.1.smithi165.stdout:6/622: dwrite d7/dc/d3b/d3c/f70 [0,4194304] 0 2024-09-16T02:05:55.026 INFO:tasks.workunit.client.1.smithi165.stdout:1/701: creat d1/dd/d11/d46/fdf x:0 0 0 2024-09-16T02:05:55.026 INFO:tasks.workunit.client.1.smithi165.stdout:9/688: fsync d7/d32/f39 0 2024-09-16T02:05:55.026 INFO:tasks.workunit.client.1.smithi165.stdout:6/623: chown d7/dc/df/d1a/d4d/f4e 18282 1 2024-09-16T02:05:55.027 INFO:tasks.workunit.client.1.smithi165.stdout:6/624: fsync d7/dc/df/d1a/f47 0 2024-09-16T02:05:55.030 INFO:tasks.workunit.client.1.smithi165.stdout:7/603: write d0/df/f5f [1972889,73536] 0 2024-09-16T02:05:55.032 INFO:tasks.workunit.client.0.smithi110.stdout:9/147: getdents d1/d1b/d23 0 2024-09-16T02:05:55.032 INFO:tasks.workunit.client.1.smithi165.stdout:9/689: dread d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:55.038 INFO:tasks.workunit.client.1.smithi165.stdout:1/702: rename d1/dd/d11/d46/d57 to d1/dd/d11/d33/d3f/d47/d7d/db3/de0 0 2024-09-16T02:05:55.040 INFO:tasks.workunit.client.0.smithi110.stdout:9/148: symlink d1/l32 0 2024-09-16T02:05:55.041 INFO:tasks.workunit.client.1.smithi165.stdout:6/625: unlink d7/dc/df/d1a/d4d/d5f/f91 0 2024-09-16T02:05:55.042 INFO:tasks.workunit.client.1.smithi165.stdout:7/604: rmdir d0/d4b/db4 39 2024-09-16T02:05:55.043 INFO:tasks.workunit.client.0.smithi110.stdout:9/149: mknod d1/d5/d20/c33 0 2024-09-16T02:05:55.043 INFO:tasks.workunit.client.1.smithi165.stdout:9/690: rmdir d7/d32/d85/d8a 39 2024-09-16T02:05:55.044 INFO:tasks.workunit.client.1.smithi165.stdout:9/691: stat d7/d32/d38/f77 0 2024-09-16T02:05:55.045 INFO:tasks.workunit.client.1.smithi165.stdout:9/692: chown d7/df/d37 7956143 1 2024-09-16T02:05:55.046 INFO:tasks.workunit.client.1.smithi165.stdout:1/703: creat d1/dd/d11/d33/d3f/d47/d7d/db3/de0/fe1 x:0 0 0 2024-09-16T02:05:55.046 INFO:tasks.workunit.client.0.smithi110.stdout:9/150: mknod d1/d5/c34 0 2024-09-16T02:05:55.047 INFO:tasks.workunit.client.1.smithi165.stdout:6/626: dwrite f2 [0,4194304] 0 2024-09-16T02:05:55.047 INFO:tasks.workunit.client.1.smithi165.stdout:9/693: truncate d7/d32/d85/fd7 335268 0 2024-09-16T02:05:55.051 INFO:tasks.workunit.client.1.smithi165.stdout:0/588: getdents d0/d1e 0 2024-09-16T02:05:55.052 INFO:tasks.workunit.client.1.smithi165.stdout:6/627: dread d7/dc/d3b/f59 [0,4194304] 0 2024-09-16T02:05:55.054 INFO:tasks.workunit.client.1.smithi165.stdout:0/589: truncate d0/d1e/d20/d28/d6d/d87/fa9 810786 0 2024-09-16T02:05:55.054 INFO:tasks.workunit.client.1.smithi165.stdout:0/590: readlink d0/l17 0 2024-09-16T02:05:55.054 INFO:tasks.workunit.client.1.smithi165.stdout:0/591: read d0/d1e/d39/d48/f38 [595929,28199] 0 2024-09-16T02:05:55.055 INFO:tasks.workunit.client.1.smithi165.stdout:0/592: chown d0/le 205929 1 2024-09-16T02:05:55.056 INFO:tasks.workunit.client.0.smithi110.stdout:9/151: rename d1/dd/c30 to d1/d1b/d23/c35 0 2024-09-16T02:05:55.057 INFO:tasks.workunit.client.1.smithi165.stdout:9/694: truncate d7/d32/d38/d53/d5c/f81 1446785 0 2024-09-16T02:05:55.058 INFO:tasks.workunit.client.1.smithi165.stdout:9/695: write d7/d32/d38/f77 [2767141,52208] 0 2024-09-16T02:05:55.059 INFO:tasks.workunit.client.1.smithi165.stdout:9/696: chown d7/d32/d38/d68/d7f/de3 17963792 1 2024-09-16T02:05:55.060 INFO:tasks.workunit.client.0.smithi110.stdout:9/152: chown d1/d5/d8/d29/c2c 1072606 1 2024-09-16T02:05:55.060 INFO:tasks.workunit.client.1.smithi165.stdout:7/605: write d0/d3d/f6b [2026032,17553] 0 2024-09-16T02:05:55.061 INFO:tasks.workunit.client.1.smithi165.stdout:9/697: write d7/d32/d85/fd7 [1142536,102082] 0 2024-09-16T02:05:55.063 INFO:tasks.workunit.client.1.smithi165.stdout:0/593: creat d0/d1e/d39/d48/d6e/fce x:0 0 0 2024-09-16T02:05:55.066 INFO:tasks.workunit.client.1.smithi165.stdout:6/628: rmdir d7/dc/d3b/da9 0 2024-09-16T02:05:55.067 INFO:tasks.workunit.client.1.smithi165.stdout:6/629: readlink d7/d1f/l36 0 2024-09-16T02:05:55.068 INFO:tasks.workunit.client.1.smithi165.stdout:7/606: mkdir d0/df/d33/dc2 0 2024-09-16T02:05:55.068 INFO:tasks.workunit.client.1.smithi165.stdout:1/704: dread d1/dd/d11/d46/fce [0,4194304] 0 2024-09-16T02:05:55.070 INFO:tasks.workunit.client.1.smithi165.stdout:9/698: dwrite d7/d32/d38/d53/d56/dca/dd2/fba [0,4194304] 0 2024-09-16T02:05:55.071 INFO:tasks.workunit.client.1.smithi165.stdout:9/699: readlink d7/d32/d38/d53/d5c/d61/l86 0 2024-09-16T02:05:55.072 INFO:tasks.workunit.client.0.smithi110.stdout:9/153: rename d1/d1b/d23/c35 to d1/d1b/d23/c36 0 2024-09-16T02:05:55.073 INFO:tasks.workunit.client.0.smithi110.stdout:9/154: fdatasync d1/dd/f12 0 2024-09-16T02:05:55.077 INFO:tasks.workunit.client.1.smithi165.stdout:7/607: truncate d0/d2c/f8d 1284780 0 2024-09-16T02:05:55.078 INFO:tasks.workunit.client.1.smithi165.stdout:7/608: chown d0/df/d33/d2a/f5a 136120032 1 2024-09-16T02:05:55.079 INFO:tasks.workunit.client.0.smithi110.stdout:9/155: dwrite d1/dd/f10 [4194304,4194304] 0 2024-09-16T02:05:55.080 INFO:tasks.workunit.client.1.smithi165.stdout:9/700: chown d7/c3d 28283523 1 2024-09-16T02:05:55.081 INFO:tasks.workunit.client.1.smithi165.stdout:6/630: mknod d7/dc/cae 0 2024-09-16T02:05:55.081 INFO:tasks.workunit.client.1.smithi165.stdout:6/631: chown l1 889 1 2024-09-16T02:05:55.083 INFO:tasks.workunit.client.1.smithi165.stdout:0/594: rename d0/c1a to d0/d1e/d20/ccf 0 2024-09-16T02:05:55.084 INFO:tasks.workunit.client.1.smithi165.stdout:1/705: mknod d1/ce2 0 2024-09-16T02:05:55.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/156: rename d1/l19 to d1/d5/d8/de/l37 0 2024-09-16T02:05:55.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/157: chown d1/d5/f18 15922753 1 2024-09-16T02:05:55.086 INFO:tasks.workunit.client.1.smithi165.stdout:7/609: write d0/d4b/d63/f9e [120745,2119] 0 2024-09-16T02:05:55.088 INFO:tasks.workunit.client.0.smithi110.stdout:9/158: rmdir d1/d5/d8/d29 39 2024-09-16T02:05:55.088 INFO:tasks.workunit.client.1.smithi165.stdout:0/595: creat d0/d1e/d20/d28/da7/db4/fd0 x:0 0 0 2024-09-16T02:05:55.089 INFO:tasks.workunit.client.1.smithi165.stdout:0/596: chown d0/d2a/d70/f84 111351804 1 2024-09-16T02:05:55.089 INFO:tasks.workunit.client.1.smithi165.stdout:1/706: unlink d1/dd/d11/d33/d3f/d47/d7d/db3/de0/l98 0 2024-09-16T02:05:55.090 INFO:tasks.workunit.client.1.smithi165.stdout:1/707: chown d1/d19/d4d 412698 1 2024-09-16T02:05:55.091 INFO:tasks.workunit.client.0.smithi110.stdout:9/159: mkdir d1/d2b/d2e/d38 0 2024-09-16T02:05:55.092 INFO:tasks.workunit.client.1.smithi165.stdout:7/610: mkdir d0/dc3 0 2024-09-16T02:05:55.092 INFO:tasks.workunit.client.1.smithi165.stdout:9/701: link d7/d32/d38/d68/fd3 d7/d32/d4a/da8/dd9/fe8 0 2024-09-16T02:05:55.096 INFO:tasks.workunit.client.1.smithi165.stdout:3/711: sync 2024-09-16T02:05:55.096 INFO:tasks.workunit.client.1.smithi165.stdout:8/647: sync 2024-09-16T02:05:55.097 INFO:tasks.workunit.client.1.smithi165.stdout:6/632: rename d7/l58 to d7/dc/laf 0 2024-09-16T02:05:55.098 INFO:tasks.workunit.client.1.smithi165.stdout:0/597: dwrite d0/d1e/d39/d48/d45/f95 [0,4194304] 0 2024-09-16T02:05:55.098 INFO:tasks.workunit.client.1.smithi165.stdout:9/702: mkdir d7/d32/d38/d53/d5c/de9 0 2024-09-16T02:05:55.099 INFO:tasks.workunit.client.0.smithi110.stdout:9/160: link d1/d1b/f22 d1/d5/d20/f39 0 2024-09-16T02:05:55.099 INFO:tasks.workunit.client.1.smithi165.stdout:0/598: chown d0/d1e/d20/d9c 0 1 2024-09-16T02:05:55.100 INFO:tasks.workunit.client.1.smithi165.stdout:1/708: mknod d1/dd/d11/d33/d3f/d47/d7d/db3/dd2/ce3 0 2024-09-16T02:05:55.103 INFO:tasks.workunit.client.0.smithi110.stdout:9/161: unlink d1/dd/f25 0 2024-09-16T02:05:55.105 INFO:tasks.workunit.client.1.smithi165.stdout:8/648: dwrite dd/d11/d14/d3f/d72/fab [0,4194304] 0 2024-09-16T02:05:55.106 INFO:tasks.workunit.client.1.smithi165.stdout:8/649: dread - dd/d11/d14/d3f/d25/d36/d4f/fdf zero size 2024-09-16T02:05:55.109 INFO:tasks.workunit.client.1.smithi165.stdout:6/633: fsync d7/dc/df/d1a/d4d/d5f/f88 0 2024-09-16T02:05:55.109 INFO:tasks.workunit.client.1.smithi165.stdout:9/703: truncate d7/d32/d85/d8a/fb2 1002043 0 2024-09-16T02:05:55.111 INFO:tasks.workunit.client.0.smithi110.stdout:9/162: dwrite d1/d2b/f2d [0,4194304] 0 2024-09-16T02:05:55.111 INFO:tasks.workunit.client.1.smithi165.stdout:7/611: mkdir d0/d4b/db4/dba/dc4 0 2024-09-16T02:05:55.115 INFO:tasks.workunit.client.1.smithi165.stdout:0/599: unlink d0/d1e/d39/d48/d45/f44 0 2024-09-16T02:05:55.115 INFO:tasks.workunit.client.1.smithi165.stdout:1/709: mknod d1/dd/d11/d33/d67/dcc/ce4 0 2024-09-16T02:05:55.117 INFO:tasks.workunit.client.1.smithi165.stdout:3/712: mkdir da/dfe 0 2024-09-16T02:05:55.120 INFO:tasks.workunit.client.1.smithi165.stdout:8/650: unlink dd/d11/d14/d3f/db3/dbe/f88 0 2024-09-16T02:05:55.122 INFO:tasks.workunit.client.1.smithi165.stdout:1/710: dwrite d1/d19/d24/d97/fc1 [0,4194304] 0 2024-09-16T02:05:55.123 INFO:tasks.workunit.client.0.smithi110.stdout:9/163: rmdir d1/dd 39 2024-09-16T02:05:55.123 INFO:tasks.workunit.client.1.smithi165.stdout:6/634: mknod d7/dc/df/d1a/d4d/d5f/da7/cb0 0 2024-09-16T02:05:55.134 INFO:tasks.workunit.client.1.smithi165.stdout:9/704: creat d7/d1f/ddb/fea x:0 0 0 2024-09-16T02:05:55.135 INFO:tasks.workunit.client.1.smithi165.stdout:1/711: mknod d1/d19/ce5 0 2024-09-16T02:05:55.136 INFO:tasks.workunit.client.0.smithi110.stdout:9/164: write d1/d5/d20/f39 [812839,52983] 0 2024-09-16T02:05:55.136 INFO:tasks.workunit.client.1.smithi165.stdout:6/635: symlink d7/d17/d75/d97/lb1 0 2024-09-16T02:05:55.137 INFO:tasks.workunit.client.0.smithi110.stdout:9/165: chown d1/d5/d20/c33 14 1 2024-09-16T02:05:55.137 INFO:tasks.workunit.client.0.smithi110.stdout:9/166: chown d1/d5/d8/de 58522965 1 2024-09-16T02:05:55.138 INFO:tasks.workunit.client.1.smithi165.stdout:3/713: mkdir da/d57/d8d/dff 0 2024-09-16T02:05:55.140 INFO:tasks.workunit.client.1.smithi165.stdout:7/612: dwrite d0/d3d/f4f [0,4194304] 0 2024-09-16T02:05:55.140 INFO:tasks.workunit.client.1.smithi165.stdout:8/651: mkdir dd/d11/de4 0 2024-09-16T02:05:55.141 INFO:tasks.workunit.client.1.smithi165.stdout:5/653: sync 2024-09-16T02:05:55.141 INFO:tasks.workunit.client.1.smithi165.stdout:2/690: sync 2024-09-16T02:05:55.141 INFO:tasks.workunit.client.1.smithi165.stdout:4/576: sync 2024-09-16T02:05:55.144 INFO:tasks.workunit.client.1.smithi165.stdout:0/600: dwrite d0/f2e [0,4194304] 0 2024-09-16T02:05:55.144 INFO:tasks.workunit.client.1.smithi165.stdout:7/613: dread - d0/df/d7/f93 zero size 2024-09-16T02:05:55.145 INFO:tasks.workunit.client.0.smithi110.stdout:9/167: dwrite d1/d5/d20/f39 [0,4194304] 0 2024-09-16T02:05:55.147 INFO:tasks.workunit.client.1.smithi165.stdout:5/654: write de/d19/d1c/d4d/f7a [500403,19647] 0 2024-09-16T02:05:55.151 INFO:tasks.workunit.client.1.smithi165.stdout:1/712: symlink d1/dd/d11/d33/d3f/d6c/le6 0 2024-09-16T02:05:55.151 INFO:tasks.workunit.client.1.smithi165.stdout:3/714: creat da/d17/d78/d91/f100 x:0 0 0 2024-09-16T02:05:55.151 INFO:tasks.workunit.client.1.smithi165.stdout:9/705: mkdir d7/deb 0 2024-09-16T02:05:55.152 INFO:tasks.workunit.client.1.smithi165.stdout:2/691: read - df/d10/d1a/d68/fc9 zero size 2024-09-16T02:05:55.152 INFO:tasks.workunit.client.1.smithi165.stdout:1/713: chown d1/dd/d11/d33/d3f/d6c/dde 2 1 2024-09-16T02:05:55.153 INFO:tasks.workunit.client.1.smithi165.stdout:1/714: chown d1/dd/d11/d33/d3f/d7e 1 1 2024-09-16T02:05:55.154 INFO:tasks.workunit.client.1.smithi165.stdout:7/614: mkdir d0/d3d/d9f/dc5 0 2024-09-16T02:05:55.155 INFO:tasks.workunit.client.1.smithi165.stdout:7/615: truncate d0/d3d/f5b 3358134 0 2024-09-16T02:05:55.156 INFO:tasks.workunit.client.0.smithi110.stdout:9/168: dwrite d1/dd/f12 [0,4194304] 0 2024-09-16T02:05:55.156 INFO:tasks.workunit.client.1.smithi165.stdout:4/577: unlink d4/dc/d18/d37/d53/d64/f7e 0 2024-09-16T02:05:55.159 INFO:tasks.workunit.client.1.smithi165.stdout:4/578: truncate d4/dc/d28/d3b/fa5 2985237 0 2024-09-16T02:05:55.164 INFO:tasks.workunit.client.1.smithi165.stdout:3/715: write da/d20/d26/d52/d9c/da6/fdf [686003,51093] 0 2024-09-16T02:05:55.164 INFO:tasks.workunit.client.1.smithi165.stdout:8/652: dread dd/d11/d14/d3f/d25/d36/d81/dd2/f63 [0,4194304] 0 2024-09-16T02:05:55.165 INFO:tasks.workunit.client.1.smithi165.stdout:0/601: dread d0/d1e/d39/d48/f38 [0,4194304] 0 2024-09-16T02:05:55.165 INFO:tasks.workunit.client.1.smithi165.stdout:3/716: chown da/d57/c66 0 1 2024-09-16T02:05:55.166 INFO:tasks.workunit.client.1.smithi165.stdout:2/692: creat df/d23/d66/fce x:0 0 0 2024-09-16T02:05:55.167 INFO:tasks.workunit.client.1.smithi165.stdout:1/715: write d1/f3a [1543170,5365] 0 2024-09-16T02:05:55.168 INFO:tasks.workunit.client.1.smithi165.stdout:7/616: symlink d0/d3d/lc6 0 2024-09-16T02:05:55.171 INFO:tasks.workunit.client.1.smithi165.stdout:4/579: chown f1 0 1 2024-09-16T02:05:55.175 INFO:tasks.workunit.client.1.smithi165.stdout:4/580: stat d4/dc/d18/c1c 0 2024-09-16T02:05:55.176 INFO:tasks.workunit.client.1.smithi165.stdout:3/717: fsync da/d17/dcc/f21 0 2024-09-16T02:05:55.176 INFO:tasks.workunit.client.1.smithi165.stdout:4/581: fdatasync d4/dc/d18/d37/d53/d64/d8b/d71/f9a 0 2024-09-16T02:05:55.176 INFO:tasks.workunit.client.1.smithi165.stdout:1/716: dwrite d1/d22/f3d [0,4194304] 0 2024-09-16T02:05:55.176 INFO:tasks.workunit.client.1.smithi165.stdout:2/693: rename df/d23/d28/d87/lb7 to df/d73/d79/db1/lcf 0 2024-09-16T02:05:55.178 INFO:tasks.workunit.client.1.smithi165.stdout:6/636: link d7/dc/c29 d7/dc/d3b/d3a/d3d/d5d/d87/cb2 0 2024-09-16T02:05:55.182 INFO:tasks.workunit.client.1.smithi165.stdout:8/653: link dd/d11/d14/d3f/d25/fe1 dd/d11/d14/d70/d7b/d9a/fe5 0 2024-09-16T02:05:55.185 INFO:tasks.workunit.client.1.smithi165.stdout:9/706: dread d7/df/f1c [0,4194304] 0 2024-09-16T02:05:55.186 INFO:tasks.workunit.client.1.smithi165.stdout:7/617: creat d0/df/d33/dc2/fc7 x:0 0 0 2024-09-16T02:05:55.189 INFO:tasks.workunit.client.1.smithi165.stdout:7/618: fdatasync d0/df/d33/dc2/fc7 0 2024-09-16T02:05:55.189 INFO:tasks.workunit.client.1.smithi165.stdout:4/582: symlink d4/dc/d18/lb8 0 2024-09-16T02:05:55.189 INFO:tasks.workunit.client.1.smithi165.stdout:0/602: write d0/f15 [854126,58361] 0 2024-09-16T02:05:55.191 INFO:tasks.workunit.client.1.smithi165.stdout:8/654: dwrite dd/d11/d14/d3f/d25/fdc [0,4194304] 0 2024-09-16T02:05:55.191 INFO:tasks.workunit.client.1.smithi165.stdout:5/655: getdents de/d19/d67/db9 0 2024-09-16T02:05:55.193 INFO:tasks.workunit.client.0.smithi110.stdout:9/169: dread d1/fc [0,4194304] 0 2024-09-16T02:05:55.194 INFO:tasks.workunit.client.1.smithi165.stdout:4/583: write d4/dc/d18/d37/d53/d64/d8b/d71/f9a [989315,1500] 0 2024-09-16T02:05:55.194 INFO:tasks.workunit.client.1.smithi165.stdout:9/707: mkdir d7/d32/d38/d53/d56/d95/dec 0 2024-09-16T02:05:55.197 INFO:tasks.workunit.client.1.smithi165.stdout:9/708: dread - d7/d32/d38/d53/d5c/d61/fb9 zero size 2024-09-16T02:05:55.198 INFO:tasks.workunit.client.1.smithi165.stdout:5/656: readlink de/l1b 0 2024-09-16T02:05:55.198 INFO:tasks.workunit.client.1.smithi165.stdout:7/619: dwrite d0/f12 [0,4194304] 0 2024-09-16T02:05:55.199 INFO:tasks.workunit.client.1.smithi165.stdout:7/620: readlink d0/d3d/lc6 0 2024-09-16T02:05:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:54 smithi165 ceph-mon[34621]: pgmap v21: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 52 MiB/s rd, 237 MiB/s wr, 451 op/s 2024-09-16T02:05:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:54 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:54 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:54 smithi165 ceph-mon[34621]: Reconfiguring alertmanager.smithi110 (dependencies changed)... 2024-09-16T02:05:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:54 smithi165 ceph-mon[34621]: Deploying daemon alertmanager.smithi110 on smithi110 2024-09-16T02:05:55.201 INFO:tasks.workunit.client.1.smithi165.stdout:8/655: mknod dd/d11/d14/d3f/db3/ce6 0 2024-09-16T02:05:55.203 INFO:tasks.workunit.client.1.smithi165.stdout:8/656: fsync dd/ff 0 2024-09-16T02:05:55.204 INFO:tasks.workunit.client.1.smithi165.stdout:2/694: link df/d10/l1e df/d73/d79/db1/ld0 0 2024-09-16T02:05:55.204 INFO:tasks.workunit.client.0.smithi110.stdout:9/170: getdents d1/d5/d20 0 2024-09-16T02:05:55.205 INFO:tasks.workunit.client.1.smithi165.stdout:1/717: write d1/d22/f82 [2335597,101249] 0 2024-09-16T02:05:55.205 INFO:tasks.workunit.client.1.smithi165.stdout:4/584: write d4/dc/f19 [2105607,21318] 0 2024-09-16T02:05:55.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:54 smithi110 ceph-mon[27634]: pgmap v21: 65 pgs: 65 active+clean; 1.5 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 52 MiB/s rd, 237 MiB/s wr, 451 op/s 2024-09-16T02:05:55.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:54 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:55.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:54 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:05:55.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:54 smithi110 ceph-mon[27634]: Reconfiguring alertmanager.smithi110 (dependencies changed)... 2024-09-16T02:05:55.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:54 smithi110 ceph-mon[27634]: Deploying daemon alertmanager.smithi110 on smithi110 2024-09-16T02:05:55.209 INFO:tasks.workunit.client.1.smithi165.stdout:3/718: truncate da/d17/d78/d2c/d2d/d6c/fba 168026 0 2024-09-16T02:05:55.209 INFO:tasks.workunit.client.1.smithi165.stdout:7/621: mkdir d0/d2c/dc8 0 2024-09-16T02:05:55.210 INFO:tasks.workunit.client.1.smithi165.stdout:6/637: dread d7/d1f/f33 [0,4194304] 0 2024-09-16T02:05:55.211 INFO:tasks.workunit.client.0.smithi110.stdout:9/171: rename d1/dd/f12 to d1/d2b/d2e/f3a 0 2024-09-16T02:05:55.211 INFO:tasks.workunit.client.1.smithi165.stdout:2/695: write df/d73/d79/f71 [3916564,125409] 0 2024-09-16T02:05:55.212 INFO:tasks.workunit.client.1.smithi165.stdout:9/709: dwrite d7/df/d67/d92/d93/f98 [0,4194304] 0 2024-09-16T02:05:55.213 INFO:tasks.workunit.client.1.smithi165.stdout:5/657: dwrite de/d21/d26/d3a/d6d/dad/fd8 [0,4194304] 0 2024-09-16T02:05:55.213 INFO:tasks.workunit.client.1.smithi165.stdout:7/622: chown d0/df/d42/fbc 527298291 1 2024-09-16T02:05:55.221 INFO:tasks.workunit.client.0.smithi110.stdout:9/172: write d1/d5/f1a [636922,43867] 0 2024-09-16T02:05:55.222 INFO:tasks.workunit.client.0.smithi110.stdout:9/173: read d1/f3 [3112448,96677] 0 2024-09-16T02:05:55.226 INFO:tasks.workunit.client.0.smithi110.stdout:9/174: creat d1/d5/d8/de/f3b x:0 0 0 2024-09-16T02:05:55.230 INFO:tasks.workunit.client.0.smithi110.stdout:9/175: dread d1/d2b/d2e/f3a [0,4194304] 0 2024-09-16T02:05:55.230 INFO:tasks.workunit.client.0.smithi110.stdout:9/176: read d1/d2b/f2d [2399245,45742] 0 2024-09-16T02:05:55.232 INFO:tasks.workunit.client.0.smithi110.stdout:9/177: mknod d1/d2b/c3c 0 2024-09-16T02:05:55.234 INFO:tasks.workunit.client.0.smithi110.stdout:9/178: unlink d1/dd/l14 0 2024-09-16T02:05:55.237 INFO:tasks.workunit.client.0.smithi110.stdout:9/179: mkdir d1/d2b/d2e/d38/d3d 0 2024-09-16T02:05:55.238 INFO:tasks.workunit.client.0.smithi110.stdout:9/180: truncate d1/d5/d8/de/f3b 40572 0 2024-09-16T02:05:55.238 INFO:tasks.workunit.client.1.smithi165.stdout:3/719: read da/d17/dcc/f71 [4043650,107279] 0 2024-09-16T02:05:55.239 INFO:tasks.workunit.client.1.smithi165.stdout:1/718: mkdir d1/d68/de7 0 2024-09-16T02:05:55.239 INFO:tasks.workunit.client.1.smithi165.stdout:6/638: write d7/dc/df/d1a/d4d/f4e [3070139,105472] 0 2024-09-16T02:05:55.240 INFO:tasks.workunit.client.0.smithi110.stdout:9/181: creat d1/d5/d8/de/d1f/f3e x:0 0 0 2024-09-16T02:05:55.243 INFO:tasks.workunit.client.1.smithi165.stdout:0/603: getdents d0/d1e/d39/d99 0 2024-09-16T02:05:55.243 INFO:tasks.workunit.client.1.smithi165.stdout:8/657: mknod dd/d11/d14/d3f/d25/d36/ce7 0 2024-09-16T02:05:55.244 INFO:tasks.workunit.client.0.smithi110.stdout:9/182: link d1/d5/f1a d1/f3f 0 2024-09-16T02:05:55.245 INFO:tasks.workunit.client.0.smithi110.stdout:9/183: truncate d1/d5/d8/de/f3b 807745 0 2024-09-16T02:05:55.246 INFO:tasks.workunit.client.0.smithi110.stdout:9/184: chown d1/d1b/f1d 21868 1 2024-09-16T02:05:55.246 INFO:tasks.workunit.client.1.smithi165.stdout:6/639: dread - d7/dc/df/d1a/d4d/d5f/f9f zero size 2024-09-16T02:05:55.246 INFO:tasks.workunit.client.1.smithi165.stdout:3/720: write da/d17/d78/d2c/d2d/d6c/f61 [358201,40123] 0 2024-09-16T02:05:55.248 INFO:tasks.workunit.client.1.smithi165.stdout:1/719: write d1/dd/f2e [2914403,13743] 0 2024-09-16T02:05:55.252 INFO:tasks.workunit.client.0.smithi110.stdout:9/185: creat d1/d5/d8/f40 x:0 0 0 2024-09-16T02:05:55.252 INFO:tasks.workunit.client.1.smithi165.stdout:0/604: unlink d0/d2a/lc5 0 2024-09-16T02:05:55.253 INFO:tasks.workunit.client.0.smithi110.stdout:9/186: read - d1/d5/d8/de/d1f/f3e zero size 2024-09-16T02:05:55.254 INFO:tasks.workunit.client.1.smithi165.stdout:2/696: dwrite df/d23/d28/f81 [0,4194304] 0 2024-09-16T02:05:55.254 INFO:tasks.workunit.client.1.smithi165.stdout:7/623: dwrite d0/df/d7/d67/fae [0,4194304] 0 2024-09-16T02:05:55.257 INFO:tasks.workunit.client.0.smithi110.stdout:9/187: rmdir d1/d1b/d23 39 2024-09-16T02:05:55.257 INFO:tasks.workunit.client.1.smithi165.stdout:5/658: dwrite de/d21/d26/d3a/d6d/dad/fd1 [0,4194304] 0 2024-09-16T02:05:55.257 INFO:tasks.workunit.client.1.smithi165.stdout:3/721: creat da/d20/d26/d6e/f101 x:0 0 0 2024-09-16T02:05:55.261 INFO:tasks.workunit.client.1.smithi165.stdout:5/659: fdatasync de/d60/d65/faf 0 2024-09-16T02:05:55.261 INFO:tasks.workunit.client.1.smithi165.stdout:0/605: unlink d0/d1e/d39/d99/fbe 0 2024-09-16T02:05:55.263 INFO:tasks.workunit.client.1.smithi165.stdout:7/624: mknod d0/d4b/db4/cc9 0 2024-09-16T02:05:55.266 INFO:tasks.workunit.client.1.smithi165.stdout:8/658: dread dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fce [0,4194304] 0 2024-09-16T02:05:55.267 INFO:tasks.workunit.client.1.smithi165.stdout:2/697: rename df/d73 to df/d10/d1a/d2d/dd1 0 2024-09-16T02:05:55.268 INFO:tasks.workunit.client.1.smithi165.stdout:6/640: dwrite d7/dc/df/d1a/d4d/f85 [0,4194304] 0 2024-09-16T02:05:55.269 INFO:tasks.workunit.client.0.smithi110.stdout:9/188: link d1/d1b/f1d d1/d2b/d2e/f41 0 2024-09-16T02:05:55.269 INFO:tasks.workunit.client.1.smithi165.stdout:8/659: fsync dd/d11/fcd 0 2024-09-16T02:05:55.269 INFO:tasks.workunit.client.1.smithi165.stdout:0/606: truncate d0/d1e/d20/d28/d9a/fa0 130623 0 2024-09-16T02:05:55.270 INFO:tasks.workunit.client.1.smithi165.stdout:0/607: dread - d0/d1e/d39/fc8 zero size 2024-09-16T02:05:55.272 INFO:tasks.workunit.client.0.smithi110.stdout:9/189: mknod d1/d2b/d2e/c42 0 2024-09-16T02:05:55.275 INFO:tasks.workunit.client.1.smithi165.stdout:7/625: creat d0/d4b/db4/dba/fca x:0 0 0 2024-09-16T02:05:55.276 INFO:tasks.workunit.client.1.smithi165.stdout:9/710: dwrite d7/d32/d4a/da8/dd9/fe8 [0,4194304] 0 2024-09-16T02:05:55.277 INFO:tasks.workunit.client.1.smithi165.stdout:1/720: creat d1/dd/d11/fe8 x:0 0 0 2024-09-16T02:05:55.279 INFO:tasks.workunit.client.1.smithi165.stdout:1/721: chown d1/dd/d11/d33/d3f/d47/d7d/la9 8417345 1 2024-09-16T02:05:55.279 INFO:tasks.workunit.client.1.smithi165.stdout:2/698: rmdir df/d23 39 2024-09-16T02:05:55.279 INFO:tasks.workunit.client.1.smithi165.stdout:1/722: fsync d1/d19/d24/d97/fc2 0 2024-09-16T02:05:55.283 INFO:tasks.workunit.client.1.smithi165.stdout:5/660: unlink de/d21/d26/d3a/d54/d8c/f8e 0 2024-09-16T02:05:55.286 INFO:tasks.workunit.client.0.smithi110.stdout:9/190: link d1/d2b/d2e/c42 d1/d2b/d2e/d38/d3d/c43 0 2024-09-16T02:05:55.289 INFO:tasks.workunit.client.1.smithi165.stdout:8/660: mkdir dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/de8 0 2024-09-16T02:05:55.290 INFO:tasks.workunit.client.1.smithi165.stdout:3/722: symlink da/d17/d7a/d7d/da8/l102 0 2024-09-16T02:05:55.291 INFO:tasks.workunit.client.1.smithi165.stdout:7/626: mkdir d0/df/d7/d67/dcb 0 2024-09-16T02:05:55.292 INFO:tasks.workunit.client.1.smithi165.stdout:7/627: fsync d0/df/d68/f70 0 2024-09-16T02:05:55.293 INFO:tasks.workunit.client.0.smithi110.stdout:9/191: dwrite d1/dd/f10 [8388608,4194304] 0 2024-09-16T02:05:55.295 INFO:tasks.workunit.client.1.smithi165.stdout:2/699: chown df/d10/d1a/c97 1904525 1 2024-09-16T02:05:55.296 INFO:tasks.workunit.client.1.smithi165.stdout:1/723: mknod d1/d6b/dd7/ce9 0 2024-09-16T02:05:55.297 INFO:tasks.workunit.client.0.smithi110.stdout:9/192: rename d1/d5 to d1/d5/d44 22 2024-09-16T02:05:55.298 INFO:tasks.workunit.client.1.smithi165.stdout:1/724: readlink d1/d19/d24/l6a 0 2024-09-16T02:05:55.299 INFO:tasks.workunit.client.1.smithi165.stdout:1/725: write d1/dd/d11/d33/fb1 [420544,90979] 0 2024-09-16T02:05:55.302 INFO:tasks.workunit.client.1.smithi165.stdout:1/726: dread d1/d22/f74 [0,4194304] 0 2024-09-16T02:05:55.303 INFO:tasks.workunit.client.1.smithi165.stdout:6/641: creat d7/dc/d3b/fb3 x:0 0 0 2024-09-16T02:05:55.303 INFO:tasks.workunit.client.1.smithi165.stdout:0/608: dwrite d0/f9 [4194304,4194304] 0 2024-09-16T02:05:55.304 INFO:tasks.workunit.client.1.smithi165.stdout:9/711: dread d7/d14/f16 [0,4194304] 0 2024-09-16T02:05:55.305 INFO:tasks.workunit.client.1.smithi165.stdout:3/723: creat da/d17/de5/f103 x:0 0 0 2024-09-16T02:05:55.306 INFO:tasks.workunit.client.1.smithi165.stdout:2/700: fsync df/d23/d28/d3b/fab 0 2024-09-16T02:05:55.308 INFO:tasks.workunit.client.0.smithi110.stdout:9/193: dwrite d1/f3 [4194304,4194304] 0 2024-09-16T02:05:55.308 INFO:tasks.workunit.client.1.smithi165.stdout:8/661: creat dd/d11/d14/d70/fe9 x:0 0 0 2024-09-16T02:05:55.309 INFO:tasks.workunit.client.1.smithi165.stdout:9/712: write d7/df/d67/f7b [2002320,20387] 0 2024-09-16T02:05:55.310 INFO:tasks.workunit.client.1.smithi165.stdout:6/642: creat d7/d17/d75/fb4 x:0 0 0 2024-09-16T02:05:55.311 INFO:tasks.workunit.client.1.smithi165.stdout:0/609: chown d0/d1e/d39/d48/d5f/d82/cc3 1659 1 2024-09-16T02:05:55.313 INFO:tasks.workunit.client.1.smithi165.stdout:6/643: readlink d7/d1f/l36 0 2024-09-16T02:05:55.313 INFO:tasks.workunit.client.0.smithi110.stdout:9/194: creat d1/d5/d8/d26/f45 x:0 0 0 2024-09-16T02:05:55.315 INFO:tasks.workunit.client.1.smithi165.stdout:0/610: write d0/f9 [8817561,85722] 0 2024-09-16T02:05:55.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/713: write d7/df/f10 [2238642,17017] 0 2024-09-16T02:05:55.318 INFO:tasks.workunit.client.1.smithi165.stdout:1/727: rename d1/d68/f66 to d1/d19/d24/d97/fea 0 2024-09-16T02:05:55.318 INFO:tasks.workunit.client.1.smithi165.stdout:8/662: dread dd/d11/d14/fbc [0,4194304] 0 2024-09-16T02:05:55.319 INFO:tasks.workunit.client.1.smithi165.stdout:7/628: dwrite d0/f60 [0,4194304] 0 2024-09-16T02:05:55.320 INFO:tasks.workunit.client.1.smithi165.stdout:9/714: chown d7/d32/d38/d58/dbb 15 1 2024-09-16T02:05:55.321 INFO:tasks.workunit.client.1.smithi165.stdout:1/728: truncate d1/dd/d11/fe8 250119 0 2024-09-16T02:05:55.322 INFO:tasks.workunit.client.0.smithi110.stdout:9/195: dread d1/d2b/f2d [0,4194304] 0 2024-09-16T02:05:55.322 INFO:tasks.workunit.client.1.smithi165.stdout:6/644: rmdir d7/dc/df/d5b 39 2024-09-16T02:05:55.324 INFO:tasks.workunit.client.1.smithi165.stdout:8/663: write dd/d11/d14/d3f/d25/d36/d81/fc9 [655171,66597] 0 2024-09-16T02:05:55.324 INFO:tasks.workunit.client.1.smithi165.stdout:9/715: fsync d7/d32/d38/d53/d5c/d61/d8f/fb4 0 2024-09-16T02:05:55.327 INFO:tasks.workunit.client.1.smithi165.stdout:6/645: write d7/dc/d3b/d3a/d3d/d5d/d73/d82/f7e [651664,56343] 0 2024-09-16T02:05:55.328 INFO:tasks.workunit.client.1.smithi165.stdout:0/611: symlink d0/d1e/d39/d99/ld1 0 2024-09-16T02:05:55.328 INFO:tasks.workunit.client.1.smithi165.stdout:3/724: truncate da/d17/d7a/d7d/fb3 742015 0 2024-09-16T02:05:55.329 INFO:tasks.workunit.client.1.smithi165.stdout:2/701: creat df/d23/d28/d9a/d86/fd2 x:0 0 0 2024-09-16T02:05:55.329 INFO:tasks.workunit.client.1.smithi165.stdout:6/646: fdatasync d7/dc/d3b/d3a/d3d/d5d/d73/d82/f89 0 2024-09-16T02:05:55.330 INFO:tasks.workunit.client.1.smithi165.stdout:1/729: creat d1/dd/d11/d46/feb x:0 0 0 2024-09-16T02:05:55.330 INFO:tasks.workunit.client.1.smithi165.stdout:2/702: chown df/d10/c21 50 1 2024-09-16T02:05:55.332 INFO:tasks.workunit.client.1.smithi165.stdout:8/664: fdatasync dd/d11/f30 0 2024-09-16T02:05:55.332 INFO:tasks.workunit.client.0.smithi110.stdout:9/196: write d1/f3f [300526,51403] 0 2024-09-16T02:05:55.333 INFO:tasks.workunit.client.1.smithi165.stdout:7/629: mknod d0/df/d33/ccc 0 2024-09-16T02:05:55.333 INFO:tasks.workunit.client.1.smithi165.stdout:6/647: chown d7/dc/df/d1a/f46 2 1 2024-09-16T02:05:55.334 INFO:tasks.workunit.client.1.smithi165.stdout:1/730: write d1/d32/f34 [4311665,81877] 0 2024-09-16T02:05:55.336 INFO:tasks.workunit.client.1.smithi165.stdout:3/725: rename da/d17/d78 to da/d17/de5/d104 0 2024-09-16T02:05:55.338 INFO:tasks.workunit.client.0.smithi110.stdout:9/197: creat d1/d5/d8/de/f46 x:0 0 0 2024-09-16T02:05:55.340 INFO:tasks.workunit.client.1.smithi165.stdout:6/648: truncate d7/d1f/f8c 1885196 0 2024-09-16T02:05:55.340 INFO:tasks.workunit.client.1.smithi165.stdout:0/612: dwrite d0/f15 [0,4194304] 0 2024-09-16T02:05:55.341 INFO:tasks.workunit.client.1.smithi165.stdout:3/726: write da/d20/d26/fc5 [994999,72027] 0 2024-09-16T02:05:55.342 INFO:tasks.workunit.client.1.smithi165.stdout:1/731: write d1/dd/d11/d33/d67/f9b [958934,25253] 0 2024-09-16T02:05:55.343 INFO:tasks.workunit.client.0.smithi110.stdout:9/198: readlink d1/d5/d8/de/l37 0 2024-09-16T02:05:55.347 INFO:tasks.workunit.client.0.smithi110.stdout:9/199: dread d1/d1b/f22 [0,4194304] 0 2024-09-16T02:05:55.348 INFO:tasks.workunit.client.1.smithi165.stdout:0/613: read - d0/d1e/d20/d28/da7/db4/fd0 zero size 2024-09-16T02:05:55.348 INFO:tasks.workunit.client.1.smithi165.stdout:2/703: dwrite df/d10/f9f [0,4194304] 0 2024-09-16T02:05:55.349 INFO:tasks.workunit.client.1.smithi165.stdout:8/665: write dd/d11/d14/d3f/d25/d36/d85/fc3 [553868,72678] 0 2024-09-16T02:05:55.350 INFO:tasks.workunit.client.1.smithi165.stdout:9/716: getdents d7/d32/d85/d8a 0 2024-09-16T02:05:55.351 INFO:tasks.workunit.client.1.smithi165.stdout:4/585: sync 2024-09-16T02:05:55.351 INFO:tasks.workunit.client.1.smithi165.stdout:7/630: dwrite d0/df/d33/d2a/f5a [0,4194304] 0 2024-09-16T02:05:55.353 INFO:tasks.workunit.client.1.smithi165.stdout:0/614: write d0/d1e/d20/d28/d6d/d87/f88 [300989,99214] 0 2024-09-16T02:05:55.353 INFO:tasks.workunit.client.1.smithi165.stdout:3/727: creat da/d20/d26/d52/d9c/da6/f105 x:0 0 0 2024-09-16T02:05:55.354 INFO:tasks.workunit.client.1.smithi165.stdout:3/728: fdatasync da/d20/d26/d52/fcf 0 2024-09-16T02:05:55.355 INFO:tasks.workunit.client.1.smithi165.stdout:3/729: chown da/d20/d26/d52/d9c 972522 1 2024-09-16T02:05:55.356 INFO:tasks.workunit.client.1.smithi165.stdout:6/649: symlink d7/d1f/da4/lb5 0 2024-09-16T02:05:55.356 INFO:tasks.workunit.client.1.smithi165.stdout:3/730: truncate da/d20/d26/d8c/dd9/fe6 481372 0 2024-09-16T02:05:55.357 INFO:tasks.workunit.client.1.smithi165.stdout:2/704: creat df/d10/d1a/fd3 x:0 0 0 2024-09-16T02:05:55.360 INFO:tasks.workunit.client.1.smithi165.stdout:8/666: fdatasync dd/d34/fd3 0 2024-09-16T02:05:55.361 INFO:tasks.workunit.client.1.smithi165.stdout:9/717: creat d7/df/d37/d65/fed x:0 0 0 2024-09-16T02:05:55.362 INFO:tasks.workunit.client.0.smithi110.stdout:9/200: getdents d1/d5/d8/de/d1f 0 2024-09-16T02:05:55.366 INFO:tasks.workunit.client.1.smithi165.stdout:1/732: creat d1/d68/dca/fec x:0 0 0 2024-09-16T02:05:55.366 INFO:tasks.workunit.client.1.smithi165.stdout:1/733: readlink d1/d68/l99 0 2024-09-16T02:05:55.367 INFO:tasks.workunit.client.0.smithi110.stdout:9/201: symlink d1/d2b/d2e/d38/l47 0 2024-09-16T02:05:55.369 INFO:tasks.workunit.client.1.smithi165.stdout:2/705: write df/d23/f48 [2277123,2639] 0 2024-09-16T02:05:55.373 INFO:tasks.workunit.client.0.smithi110.stdout:9/202: creat d1/d5/d8/de/d1f/f48 x:0 0 0 2024-09-16T02:05:55.375 INFO:tasks.workunit.client.1.smithi165.stdout:9/718: mknod d7/d32/d38/d53/d56/d95/cee 0 2024-09-16T02:05:55.375 INFO:tasks.workunit.client.1.smithi165.stdout:7/631: dread d0/d4b/f5d [0,4194304] 0 2024-09-16T02:05:55.377 INFO:tasks.workunit.client.1.smithi165.stdout:0/615: creat d0/d1e/d20/d28/d6d/daf/dc0/fd2 x:0 0 0 2024-09-16T02:05:55.380 INFO:tasks.workunit.client.1.smithi165.stdout:1/734: chown d1/dd/d11/d33/d3f/d47/d7d/db3/de0/ldd 93 1 2024-09-16T02:05:55.380 INFO:tasks.workunit.client.1.smithi165.stdout:9/719: dread d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:55.381 INFO:tasks.workunit.client.1.smithi165.stdout:9/720: readlink d7/df/l94 0 2024-09-16T02:05:55.383 INFO:tasks.workunit.client.1.smithi165.stdout:8/667: dread dd/d11/d14/f40 [0,4194304] 0 2024-09-16T02:05:55.383 INFO:tasks.workunit.client.1.smithi165.stdout:7/632: symlink d0/lcd 0 2024-09-16T02:05:55.385 INFO:tasks.workunit.client.1.smithi165.stdout:1/735: creat d1/d32/fed x:0 0 0 2024-09-16T02:05:55.385 INFO:tasks.workunit.client.1.smithi165.stdout:3/731: link da/d17/de5/d104/c49 da/d17/de5/d104/c106 0 2024-09-16T02:05:55.385 INFO:tasks.workunit.client.1.smithi165.stdout:1/736: chown d1/dd/d11/f15 1066899922 1 2024-09-16T02:05:55.390 INFO:tasks.workunit.client.1.smithi165.stdout:0/616: truncate d0/d1e/d39/d48/d45/f37 2762981 0 2024-09-16T02:05:55.390 INFO:tasks.workunit.client.1.smithi165.stdout:3/732: chown da/d17/de5/d104/d2c/cf6 107749 1 2024-09-16T02:05:55.391 INFO:tasks.workunit.client.1.smithi165.stdout:0/617: fsync d0/d1e/d39/d48/d5f/d82/f8a 0 2024-09-16T02:05:55.393 INFO:tasks.workunit.client.1.smithi165.stdout:1/737: dwrite d1/dd/d11/d46/f73 [0,4194304] 0 2024-09-16T02:05:55.394 INFO:tasks.workunit.client.1.smithi165.stdout:0/618: read d0/d1e/d39/d48/d5f/f73 [1806069,4713] 0 2024-09-16T02:05:55.394 INFO:tasks.workunit.client.1.smithi165.stdout:8/668: getdents dd/d11/d14/d3f/d25/d36/d4f 0 2024-09-16T02:05:55.395 INFO:tasks.workunit.client.1.smithi165.stdout:2/706: write df/d23/d28/f46 [1935125,46096] 0 2024-09-16T02:05:55.396 INFO:tasks.workunit.client.1.smithi165.stdout:2/707: stat df/d23/d28/d3b/f7a 0 2024-09-16T02:05:55.396 INFO:tasks.workunit.client.0.smithi110.stdout:9/203: dread d1/d5/d8/f17 [0,4194304] 0 2024-09-16T02:05:55.397 INFO:tasks.workunit.client.1.smithi165.stdout:3/733: rename da/d17/d7a/d7d/da8/cf0 to da/d17/d7a/c107 0 2024-09-16T02:05:55.397 INFO:tasks.workunit.client.1.smithi165.stdout:8/669: write dd/d11/d14/d3f/d25/d36/d81/dd2/f65 [5172935,74793] 0 2024-09-16T02:05:55.403 INFO:tasks.workunit.client.0.smithi110.stdout:9/204: rename d1/c2 to d1/d5/d8/c49 0 2024-09-16T02:05:55.405 INFO:tasks.workunit.client.0.smithi110.stdout:9/205: unlink d1/d2b/d2e/l2a 0 2024-09-16T02:05:55.408 INFO:tasks.workunit.client.0.smithi110.stdout:9/206: link d1/d5/d8/de/d1f/f48 d1/d5/d8/de/d1f/f4a 0 2024-09-16T02:05:55.409 INFO:tasks.workunit.client.0.smithi110.stdout:9/207: write d1/d5/d8/de/f3b [1212750,45151] 0 2024-09-16T02:05:55.411 INFO:tasks.workunit.client.0.smithi110.stdout:9/208: creat d1/d5/d20/f4b x:0 0 0 2024-09-16T02:05:55.412 INFO:tasks.workunit.client.0.smithi110.stdout:9/209: write d1/d5/f18 [4024783,74086] 0 2024-09-16T02:05:55.415 INFO:tasks.workunit.client.0.smithi110.stdout:9/210: getdents d1/d5/d8/de 0 2024-09-16T02:05:55.418 INFO:tasks.workunit.client.0.smithi110.stdout:9/211: rmdir d1/d5/d8/d29 39 2024-09-16T02:05:55.421 INFO:tasks.workunit.client.0.smithi110.stdout:9/212: fdatasync d1/d5/d8/de/d1f/f4a 0 2024-09-16T02:05:55.425 INFO:tasks.workunit.client.0.smithi110.stdout:9/213: dread d1/f3f [0,4194304] 0 2024-09-16T02:05:55.425 INFO:tasks.workunit.client.0.smithi110.stdout:9/214: chown d1/dd/f10 17 1 2024-09-16T02:05:55.427 INFO:tasks.workunit.client.0.smithi110.stdout:9/215: stat d1/d2b/d2e/d38/l47 0 2024-09-16T02:05:55.428 INFO:tasks.workunit.client.0.smithi110.stdout:9/216: creat d1/d1b/d23/f4c x:0 0 0 2024-09-16T02:05:55.437 INFO:tasks.workunit.client.1.smithi165.stdout:5/661: sync 2024-09-16T02:05:55.437 INFO:tasks.workunit.client.0.smithi110.stdout:9/217: dread f0 [0,4194304] 0 2024-09-16T02:05:55.438 INFO:tasks.workunit.client.0.smithi110.stdout:9/218: truncate d1/d5/d8/f40 491154 0 2024-09-16T02:05:55.440 INFO:tasks.workunit.client.1.smithi165.stdout:0/619: mknod d0/d1e/d20/d28/d6d/d87/cd3 0 2024-09-16T02:05:55.441 INFO:tasks.workunit.client.1.smithi165.stdout:7/633: truncate d0/df/f27 1107920 0 2024-09-16T02:05:55.441 INFO:tasks.workunit.client.1.smithi165.stdout:1/738: rename d1/fc to d1/dd/d11/d33/d3f/d47/d7d/fee 0 2024-09-16T02:05:55.442 INFO:tasks.workunit.client.1.smithi165.stdout:8/670: mknod dd/d34/cea 0 2024-09-16T02:05:55.442 INFO:tasks.workunit.client.1.smithi165.stdout:2/708: symlink df/d10/d1a/d2d/dd1/ld4 0 2024-09-16T02:05:55.443 INFO:tasks.workunit.client.1.smithi165.stdout:2/709: readlink df/d23/d28/d9a/d86/la8 0 2024-09-16T02:05:55.444 INFO:tasks.workunit.client.1.smithi165.stdout:7/634: unlink d0/df/d33/d2a/c87 0 2024-09-16T02:05:55.445 INFO:tasks.workunit.client.1.smithi165.stdout:3/734: symlink da/d20/d26/l108 0 2024-09-16T02:05:55.445 INFO:tasks.workunit.client.1.smithi165.stdout:7/635: chown d0/d4b/l74 17 1 2024-09-16T02:05:55.445 INFO:tasks.workunit.client.1.smithi165.stdout:5/662: unlink de/d19/d1c/d49/da5/db1/ld2 0 2024-09-16T02:05:55.447 INFO:tasks.workunit.client.1.smithi165.stdout:8/671: symlink dd/d11/d14/d3f/db3/leb 0 2024-09-16T02:05:55.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/663: write de/d21/d26/d3a/f3c [4883477,21405] 0 2024-09-16T02:05:55.449 INFO:tasks.workunit.client.1.smithi165.stdout:1/739: rename d1/d6b/dd7/ld8 to d1/dd/d11/d42/lef 0 2024-09-16T02:05:55.452 INFO:tasks.workunit.client.1.smithi165.stdout:3/735: read da/d17/d7a/d7d/fb3 [306716,64274] 0 2024-09-16T02:05:55.452 INFO:tasks.workunit.client.1.smithi165.stdout:7/636: chown d0/df/d33/d2a/cb1 18 1 2024-09-16T02:05:55.452 INFO:tasks.workunit.client.1.smithi165.stdout:2/710: truncate df/d10/d1a/d2d/f4e 2556633 0 2024-09-16T02:05:55.452 INFO:tasks.workunit.client.1.smithi165.stdout:5/664: fdatasync de/d19/d1c/d84/daa/fcd 0 2024-09-16T02:05:55.452 INFO:tasks.workunit.client.1.smithi165.stdout:2/711: readlink df/d10/la2 0 2024-09-16T02:05:55.452 INFO:tasks.workunit.client.1.smithi165.stdout:5/665: chown f7 410413234 1 2024-09-16T02:05:55.453 INFO:tasks.workunit.client.1.smithi165.stdout:8/672: symlink dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/lec 0 2024-09-16T02:05:55.453 INFO:tasks.workunit.client.1.smithi165.stdout:2/712: chown df/d23/d66/l9e 1800 1 2024-09-16T02:05:55.453 INFO:tasks.workunit.client.1.smithi165.stdout:5/666: truncate de/d21/f9f 254880 0 2024-09-16T02:05:55.455 INFO:tasks.workunit.client.1.smithi165.stdout:0/620: dread d0/d1e/d39/f6c [0,4194304] 0 2024-09-16T02:05:55.457 INFO:tasks.workunit.client.1.smithi165.stdout:1/740: rmdir d1/dd/d11/d33/d3f/dc7 0 2024-09-16T02:05:55.458 INFO:tasks.workunit.client.1.smithi165.stdout:2/713: creat df/d23/d28/d3b/d6d/d8b/fd5 x:0 0 0 2024-09-16T02:05:55.463 INFO:tasks.workunit.client.1.smithi165.stdout:2/714: write df/d10/d37/f74 [3469644,20405] 0 2024-09-16T02:05:55.464 INFO:tasks.workunit.client.1.smithi165.stdout:3/736: dwrite da/d17/de5/d104/d2c/de8/feb [4194304,4194304] 0 2024-09-16T02:05:55.468 INFO:tasks.workunit.client.1.smithi165.stdout:3/737: read da/d57/d8d/f98 [843486,13219] 0 2024-09-16T02:05:55.469 INFO:tasks.workunit.client.1.smithi165.stdout:0/621: dwrite d0/d1e/d20/d28/d6d/d87/fa9 [0,4194304] 0 2024-09-16T02:05:55.470 INFO:tasks.workunit.client.0.smithi110.stdout:2/222: sync 2024-09-16T02:05:55.470 INFO:tasks.workunit.client.1.smithi165.stdout:3/738: chown da/d57/d8d/f98 2984959 1 2024-09-16T02:05:55.470 INFO:tasks.workunit.client.1.smithi165.stdout:0/622: chown d0/d1e/d39/d48/c3f 52505 1 2024-09-16T02:05:55.474 INFO:tasks.workunit.client.1.smithi165.stdout:2/715: creat df/d10/d1a/d2d/dd1/d79/fd6 x:0 0 0 2024-09-16T02:05:55.475 INFO:tasks.workunit.client.0.smithi110.stdout:2/223: fdatasync d0/da/d18/f29 0 2024-09-16T02:05:55.476 INFO:tasks.workunit.client.1.smithi165.stdout:2/716: write df/d10/d1a/d2d/dd1/d79/fd6 [150199,111351] 0 2024-09-16T02:05:55.477 INFO:tasks.workunit.client.0.smithi110.stdout:2/224: write d0/f16 [3205252,67774] 0 2024-09-16T02:05:55.478 INFO:tasks.workunit.client.1.smithi165.stdout:8/673: truncate dd/d11/d14/d70/fa7 2021511 0 2024-09-16T02:05:55.480 INFO:tasks.workunit.client.1.smithi165.stdout:0/623: chown d0/d1e/d39/f49 70863295 1 2024-09-16T02:05:55.480 INFO:tasks.workunit.client.1.smithi165.stdout:8/674: chown dd/d11/d38 12171116 1 2024-09-16T02:05:55.480 INFO:tasks.workunit.client.1.smithi165.stdout:1/741: dwrite d1/d22/f87 [0,4194304] 0 2024-09-16T02:05:55.481 INFO:tasks.workunit.client.1.smithi165.stdout:8/675: fdatasync dd/ff 0 2024-09-16T02:05:55.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/667: dread de/f14 [0,4194304] 0 2024-09-16T02:05:55.487 INFO:tasks.workunit.client.1.smithi165.stdout:2/717: symlink df/d10/d1a/dca/ld7 0 2024-09-16T02:05:55.488 INFO:tasks.workunit.client.1.smithi165.stdout:8/676: creat dd/d9e/dd0/fed x:0 0 0 2024-09-16T02:05:55.489 INFO:tasks.workunit.client.1.smithi165.stdout:1/742: mknod d1/dd/d11/d33/d92/cf0 0 2024-09-16T02:05:55.492 INFO:tasks.workunit.client.1.smithi165.stdout:2/718: creat df/d23/d28/d3b/fd8 x:0 0 0 2024-09-16T02:05:55.492 INFO:tasks.workunit.client.1.smithi165.stdout:8/677: mknod dd/d11/d38/da6/cee 0 2024-09-16T02:05:55.495 INFO:tasks.workunit.client.1.smithi165.stdout:0/624: link d0/d1e/d39/d48/d5f/d82/f8a d0/d1e/d39/d48/d74/dc6/fd4 0 2024-09-16T02:05:55.495 INFO:tasks.workunit.client.0.smithi110.stdout:2/225: write d0/db/f2e [4681048,92254] 0 2024-09-16T02:05:55.496 INFO:tasks.workunit.client.1.smithi165.stdout:2/719: symlink df/dbb/ld9 0 2024-09-16T02:05:55.496 INFO:tasks.workunit.client.0.smithi110.stdout:2/226: dread - d0/da/d18/d2d/d41/f44 zero size 2024-09-16T02:05:55.499 INFO:tasks.workunit.client.1.smithi165.stdout:5/668: write de/d21/d26/d98/fa0 [1503311,81572] 0 2024-09-16T02:05:55.501 INFO:tasks.workunit.client.1.smithi165.stdout:5/669: readlink de/d21/d26/d3a/d54/l87 0 2024-09-16T02:05:55.502 INFO:tasks.workunit.client.0.smithi110.stdout:2/227: getdents d0/db/d34 0 2024-09-16T02:05:55.503 INFO:tasks.workunit.client.1.smithi165.stdout:3/739: dread da/d20/d26/d52/fac [0,4194304] 0 2024-09-16T02:05:55.507 INFO:tasks.workunit.client.1.smithi165.stdout:5/670: fdatasync de/f1d 0 2024-09-16T02:05:55.508 INFO:tasks.workunit.client.1.smithi165.stdout:4/586: sync 2024-09-16T02:05:55.508 INFO:tasks.workunit.client.1.smithi165.stdout:4/587: stat d4/dc/d18/f9b 0 2024-09-16T02:05:55.509 INFO:tasks.workunit.client.1.smithi165.stdout:8/678: truncate dd/d11/d14/d3f/f9c 74513 0 2024-09-16T02:05:55.510 INFO:tasks.workunit.client.1.smithi165.stdout:0/625: creat d0/d1e/d39/fd5 x:0 0 0 2024-09-16T02:05:55.512 INFO:tasks.workunit.client.0.smithi110.stdout:2/228: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:55.512 INFO:tasks.workunit.client.1.smithi165.stdout:2/720: dread df/d23/d28/d3b/d6d/d8b/f8e [0,4194304] 0 2024-09-16T02:05:55.513 INFO:tasks.workunit.client.0.smithi110.stdout:2/229: fdatasync d0/db/f2e 0 2024-09-16T02:05:55.513 INFO:tasks.workunit.client.0.smithi110.stdout:2/230: fdatasync d0/db/fd 0 2024-09-16T02:05:55.514 INFO:tasks.workunit.client.1.smithi165.stdout:2/721: write df/d23/f48 [235485,120595] 0 2024-09-16T02:05:55.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/743: dwrite d1/dd/d11/d33/d3f/d47/d7d/fee [0,4194304] 0 2024-09-16T02:05:55.516 INFO:tasks.workunit.client.1.smithi165.stdout:5/671: truncate f7 1145728 0 2024-09-16T02:05:55.518 INFO:tasks.workunit.client.1.smithi165.stdout:1/744: dread d1/dd/d11/d33/f8a [0,4194304] 0 2024-09-16T02:05:55.519 INFO:tasks.workunit.client.1.smithi165.stdout:8/679: mkdir dd/d11/d14/def 0 2024-09-16T02:05:55.519 INFO:tasks.workunit.client.0.smithi110.stdout:2/231: getdents d0/da/d18/d25/d3b 0 2024-09-16T02:05:55.521 INFO:tasks.workunit.client.1.smithi165.stdout:2/722: rmdir df/d10/d1a/dca 39 2024-09-16T02:05:55.522 INFO:tasks.workunit.client.1.smithi165.stdout:5/672: mkdir de/d21/d26/d94/ddf 0 2024-09-16T02:05:55.524 INFO:tasks.workunit.client.1.smithi165.stdout:2/723: write df/d23/d28/f65 [527066,61771] 0 2024-09-16T02:05:55.525 INFO:tasks.workunit.client.1.smithi165.stdout:1/745: fsync d1/d19/d24/d30/d72/faa 0 2024-09-16T02:05:55.526 INFO:tasks.workunit.client.1.smithi165.stdout:8/680: mknod dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/cf0 0 2024-09-16T02:05:55.526 INFO:tasks.workunit.client.0.smithi110.stdout:2/232: creat d0/f49 x:0 0 0 2024-09-16T02:05:55.527 INFO:tasks.workunit.client.1.smithi165.stdout:4/588: dwrite d4/dc/d18/fa8 [0,4194304] 0 2024-09-16T02:05:55.528 INFO:tasks.workunit.client.0.smithi110.stdout:2/233: write d0/da/d18/dc/f17 [1760971,54739] 0 2024-09-16T02:05:55.529 INFO:tasks.workunit.client.0.smithi110.stdout:2/234: read d0/da/f2c [212843,42955] 0 2024-09-16T02:05:55.532 INFO:tasks.workunit.client.1.smithi165.stdout:1/746: rmdir d1/dd/d11 39 2024-09-16T02:05:55.535 INFO:tasks.workunit.client.1.smithi165.stdout:8/681: fdatasync dd/d11/d14/f1e 0 2024-09-16T02:05:55.535 INFO:tasks.workunit.client.1.smithi165.stdout:8/682: fdatasync f6 0 2024-09-16T02:05:55.538 INFO:tasks.workunit.client.1.smithi165.stdout:2/724: rmdir df/d10/d1a/d2d/dd1/d79/db1 39 2024-09-16T02:05:55.539 INFO:tasks.workunit.client.0.smithi110.stdout:2/235: rmdir d0/da/d18/dc 39 2024-09-16T02:05:55.540 INFO:tasks.workunit.client.0.smithi110.stdout:2/236: readlink d0/da/d18/d25/l3c 0 2024-09-16T02:05:55.543 INFO:tasks.workunit.client.1.smithi165.stdout:8/683: creat dd/d11/d14/d3f/ff1 x:0 0 0 2024-09-16T02:05:55.544 INFO:tasks.workunit.client.1.smithi165.stdout:2/725: mknod df/d23/d28/d3b/d6d/d8b/cda 0 2024-09-16T02:05:55.545 INFO:tasks.workunit.client.1.smithi165.stdout:1/747: read - d1/dd/d11/d33/d3f/d6c/fbd zero size 2024-09-16T02:05:55.545 INFO:tasks.workunit.client.1.smithi165.stdout:2/726: symlink df/d10/d64/ldb 0 2024-09-16T02:05:55.546 INFO:tasks.workunit.client.0.smithi110.stdout:2/237: dwrite d0/db/fd [4194304,4194304] 0 2024-09-16T02:05:55.546 INFO:tasks.workunit.client.1.smithi165.stdout:4/589: getdents d4/dc 0 2024-09-16T02:05:55.548 INFO:tasks.workunit.client.0.smithi110.stdout:2/238: unlink d0/f16 0 2024-09-16T02:05:55.549 INFO:tasks.workunit.client.1.smithi165.stdout:4/590: stat d4/dc/d18/lb8 0 2024-09-16T02:05:55.550 INFO:tasks.workunit.client.1.smithi165.stdout:4/591: chown d4/dc/d18/d37/l9e 2684 1 2024-09-16T02:05:55.551 INFO:tasks.workunit.client.1.smithi165.stdout:8/684: dwrite dd/fdd [0,4194304] 0 2024-09-16T02:05:55.551 INFO:tasks.workunit.client.0.smithi110.stdout:2/239: rename d0/db/fd to d0/da/d18/d2d/f4a 0 2024-09-16T02:05:55.555 INFO:tasks.workunit.client.0.smithi110.stdout:2/240: creat d0/da/d18/d2d/d41/f4b x:0 0 0 2024-09-16T02:05:55.556 INFO:tasks.workunit.client.1.smithi165.stdout:1/748: rename d1/dd/d11/d33/d67/f9b to d1/d19/ff1 0 2024-09-16T02:05:55.557 INFO:tasks.workunit.client.0.smithi110.stdout:2/241: write d0/da/d18/f19 [5044222,102711] 0 2024-09-16T02:05:55.557 INFO:tasks.workunit.client.1.smithi165.stdout:8/685: mkdir dd/d11/d14/d70/d7b/df2 0 2024-09-16T02:05:55.563 INFO:tasks.workunit.client.0.smithi110.stdout:2/242: mknod d0/db/d47/d48/c4c 0 2024-09-16T02:05:55.565 INFO:tasks.workunit.client.0.smithi110.stdout:2/243: write d0/db/f36 [500767,127904] 0 2024-09-16T02:05:55.567 INFO:tasks.workunit.client.0.smithi110.stdout:2/244: symlink d0/db/d47/d48/l4d 0 2024-09-16T02:05:55.570 INFO:tasks.workunit.client.0.smithi110.stdout:2/245: link d0/da/l13 d0/db/l4e 0 2024-09-16T02:05:55.572 INFO:tasks.workunit.client.0.smithi110.stdout:2/246: write d0/da/d18/d2d/d41/f4b [723261,54191] 0 2024-09-16T02:05:55.580 INFO:tasks.workunit.client.1.smithi165.stdout:6/650: sync 2024-09-16T02:05:55.580 INFO:tasks.workunit.client.1.smithi165.stdout:9/721: sync 2024-09-16T02:05:55.582 INFO:tasks.workunit.client.0.smithi110.stdout:2/247: dwrite d0/da/d18/dc/f1c [0,4194304] 0 2024-09-16T02:05:55.583 INFO:tasks.workunit.client.0.smithi110.stdout:2/248: dread - d0/da/d18/d2d/d39/f3f zero size 2024-09-16T02:05:55.586 INFO:tasks.workunit.client.0.smithi110.stdout:2/249: creat d0/da/d18/d2d/d41/f4f x:0 0 0 2024-09-16T02:05:55.588 INFO:tasks.workunit.client.1.smithi165.stdout:4/592: truncate d4/dc/d18/d37/d53/d64/d8b/d71/f9a 98443 0 2024-09-16T02:05:55.588 INFO:tasks.workunit.client.0.smithi110.stdout:2/250: creat d0/db/d47/f50 x:0 0 0 2024-09-16T02:05:55.589 INFO:tasks.workunit.client.1.smithi165.stdout:8/686: chown dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fc4 192082320 1 2024-09-16T02:05:55.590 INFO:tasks.workunit.client.1.smithi165.stdout:9/722: write d7/d32/d38/d68/d7f/f70 [2967810,104159] 0 2024-09-16T02:05:55.591 INFO:tasks.workunit.client.0.smithi110.stdout:2/251: rmdir d0/db/d34 0 2024-09-16T02:05:55.594 INFO:tasks.workunit.client.1.smithi165.stdout:4/593: link d4/d40/faf d4/dc/d28/d30/fb9 0 2024-09-16T02:05:55.596 INFO:tasks.workunit.client.1.smithi165.stdout:2/727: dwrite df/d23/d28/d3b/d6d/d8b/fb3 [0,4194304] 0 2024-09-16T02:05:55.596 INFO:tasks.workunit.client.1.smithi165.stdout:8/687: stat dd/d11/d14/d3f/d25/d36/d81/dd2/f63 0 2024-09-16T02:05:55.596 INFO:tasks.workunit.client.0.smithi110.stdout:2/252: dwrite d0/da/f24 [0,4194304] 0 2024-09-16T02:05:55.597 INFO:tasks.workunit.client.1.smithi165.stdout:1/749: dwrite d1/dd/f10 [0,4194304] 0 2024-09-16T02:05:55.599 INFO:tasks.workunit.client.1.smithi165.stdout:6/651: dwrite d7/dc/df/d1a/d4d/f6b [0,4194304] 0 2024-09-16T02:05:55.600 INFO:tasks.workunit.client.0.smithi110.stdout:2/253: symlink d0/da/d18/d2d/l51 0 2024-09-16T02:05:55.601 INFO:tasks.workunit.client.0.smithi110.stdout:2/254: chown d0/da/d18/d2d/d39/c3e 19210 1 2024-09-16T02:05:55.603 INFO:tasks.workunit.client.1.smithi165.stdout:2/728: chown df/d10/d1a/d2d/dd1/f83 0 1 2024-09-16T02:05:55.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/255: mknod d0/db/d33/d46/c52 0 2024-09-16T02:05:55.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/256: chown d0/da/d18/dc 684868 1 2024-09-16T02:05:55.611 INFO:tasks.workunit.client.0.smithi110.stdout:2/257: readlink d0/db/d47/d48/l4d 0 2024-09-16T02:05:55.612 INFO:tasks.workunit.client.1.smithi165.stdout:4/594: getdents d4/dc/d18/d37 0 2024-09-16T02:05:55.613 INFO:tasks.workunit.client.1.smithi165.stdout:9/723: dread d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:55.613 INFO:tasks.workunit.client.1.smithi165.stdout:6/652: rename d7/dc/df/fa2 to d7/dc/df/d1a/d4d/d90/fb6 0 2024-09-16T02:05:55.614 INFO:tasks.workunit.client.1.smithi165.stdout:1/750: dread d1/d22/f87 [0,4194304] 0 2024-09-16T02:05:55.616 INFO:tasks.workunit.client.1.smithi165.stdout:4/595: symlink d4/d40/d4f/lba 0 2024-09-16T02:05:55.618 INFO:tasks.workunit.client.1.smithi165.stdout:1/751: write d1/dd/d11/d33/f8a [484200,77490] 0 2024-09-16T02:05:55.621 INFO:tasks.workunit.client.0.smithi110.stdout:2/258: dread d0/da/d18/dc/f17 [0,4194304] 0 2024-09-16T02:05:55.622 INFO:tasks.workunit.client.0.smithi110.stdout:7/204: sync 2024-09-16T02:05:55.622 INFO:tasks.workunit.client.0.smithi110.stdout:3/181: sync 2024-09-16T02:05:55.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/752: read - d1/dd/d11/d33/d3f/d47/f8d zero size 2024-09-16T02:05:55.622 INFO:tasks.workunit.client.1.smithi165.stdout:2/729: getdents df/d23/d28/d9a/d86 0 2024-09-16T02:05:55.622 INFO:tasks.workunit.client.1.smithi165.stdout:8/688: dwrite dd/d11/d14/f1d [0,4194304] 0 2024-09-16T02:05:55.625 INFO:tasks.workunit.client.0.smithi110.stdout:2/259: unlink d0/da/d18/dc/f30 0 2024-09-16T02:05:55.625 INFO:tasks.workunit.client.1.smithi165.stdout:8/689: read - dd/d11/d38/d74/d7d/fca zero size 2024-09-16T02:05:55.626 INFO:tasks.workunit.client.1.smithi165.stdout:4/596: read d4/dc/d20/d4e/f54 [1126088,39648] 0 2024-09-16T02:05:55.627 INFO:tasks.workunit.client.0.smithi110.stdout:7/205: creat d3/da/d10/f3d x:0 0 0 2024-09-16T02:05:55.627 INFO:tasks.workunit.client.0.smithi110.stdout:2/260: chown d0/da/d18/d2d/d41/f44 822 1 2024-09-16T02:05:55.627 INFO:tasks.workunit.client.0.smithi110.stdout:2/261: readlink d0/da/l22 0 2024-09-16T02:05:55.629 INFO:tasks.workunit.client.0.smithi110.stdout:3/182: mkdir d8/dc/d1b/d36/d3b 0 2024-09-16T02:05:55.629 INFO:tasks.workunit.client.1.smithi165.stdout:9/724: dwrite d7/d32/d38/d53/d56/d95/fa5 [0,4194304] 0 2024-09-16T02:05:55.630 INFO:tasks.workunit.client.1.smithi165.stdout:6/653: truncate d7/dc/df/d1a/d4d/f6b 3869134 0 2024-09-16T02:05:55.630 INFO:tasks.workunit.client.0.smithi110.stdout:3/183: chown d8/dc/d1b/f24 2 1 2024-09-16T02:05:55.631 INFO:tasks.workunit.client.0.smithi110.stdout:3/184: fsync d8/dc/d1b/d36/f37 0 2024-09-16T02:05:55.632 INFO:tasks.workunit.client.1.smithi165.stdout:6/654: write d7/dc/df/d1a/f47 [1816964,128747] 0 2024-09-16T02:05:55.633 INFO:tasks.workunit.client.0.smithi110.stdout:3/185: write d8/f39 [729731,116369] 0 2024-09-16T02:05:55.633 INFO:tasks.workunit.client.0.smithi110.stdout:7/206: mkdir d3/da/d10/d11/d3e 0 2024-09-16T02:05:55.633 INFO:tasks.workunit.client.1.smithi165.stdout:6/655: chown d7/dc/d3b/d3a 52473621 1 2024-09-16T02:05:55.634 INFO:tasks.workunit.client.1.smithi165.stdout:6/656: chown d7/dc/d3b/f44 3 1 2024-09-16T02:05:55.635 INFO:tasks.workunit.client.0.smithi110.stdout:2/262: creat d0/da/d18/d25/d3b/f53 x:0 0 0 2024-09-16T02:05:55.636 INFO:tasks.workunit.client.1.smithi165.stdout:6/657: dread d7/dc/d3b/f44 [0,4194304] 0 2024-09-16T02:05:55.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/730: mkdir df/d23/ddc 0 2024-09-16T02:05:55.637 INFO:tasks.workunit.client.1.smithi165.stdout:7/637: sync 2024-09-16T02:05:55.637 INFO:tasks.workunit.client.1.smithi165.stdout:6/658: write d7/dc/df/d1a/f47 [1789625,14071] 0 2024-09-16T02:05:55.638 INFO:tasks.workunit.client.1.smithi165.stdout:8/690: symlink dd/d11/d14/d70/d7b/d9a/lf3 0 2024-09-16T02:05:55.641 INFO:tasks.workunit.client.0.smithi110.stdout:3/186: write d8/d29/f32 [160032,11697] 0 2024-09-16T02:05:55.641 INFO:tasks.workunit.client.0.smithi110.stdout:3/187: read - d8/f16 zero size 2024-09-16T02:05:55.642 INFO:tasks.workunit.client.0.smithi110.stdout:2/263: creat d0/da/d18/d2d/d41/f54 x:0 0 0 2024-09-16T02:05:55.644 INFO:tasks.workunit.client.1.smithi165.stdout:9/725: symlink d7/d14/d80/lef 0 2024-09-16T02:05:55.644 INFO:tasks.workunit.client.1.smithi165.stdout:1/753: getdents d1/d68/de7 0 2024-09-16T02:05:55.645 INFO:tasks.workunit.client.1.smithi165.stdout:4/597: creat d4/dc/d18/dae/fbb x:0 0 0 2024-09-16T02:05:55.646 INFO:tasks.workunit.client.1.smithi165.stdout:3/740: sync 2024-09-16T02:05:55.647 INFO:tasks.workunit.client.0.smithi110.stdout:2/264: symlink d0/db/d47/d48/l55 0 2024-09-16T02:05:55.647 INFO:tasks.workunit.client.1.smithi165.stdout:3/741: fsync da/d17/d7a/fee 0 2024-09-16T02:05:55.651 INFO:tasks.workunit.client.1.smithi165.stdout:7/638: creat d0/d4b/db4/fce x:0 0 0 2024-09-16T02:05:55.652 INFO:tasks.workunit.client.0.smithi110.stdout:3/188: creat d8/dc/d1b/d3a/f3c x:0 0 0 2024-09-16T02:05:55.653 INFO:tasks.workunit.client.1.smithi165.stdout:8/691: chown dd/d11/d14/d3f/d25/d36/d81/dd2/d53/c93 73330778 1 2024-09-16T02:05:55.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/189: mknod d8/dc/d1b/d3a/c3d 0 2024-09-16T02:05:55.660 INFO:tasks.workunit.client.1.smithi165.stdout:3/742: unlink da/d17/f8b 0 2024-09-16T02:05:55.660 INFO:tasks.workunit.client.0.smithi110.stdout:7/207: write d3/f13 [3220890,48006] 0 2024-09-16T02:05:55.661 INFO:tasks.workunit.client.0.smithi110.stdout:7/208: chown d3/da 1647409 1 2024-09-16T02:05:55.661 INFO:tasks.workunit.client.0.smithi110.stdout:3/190: unlink d8/dc/d1b/d3a/f3c 0 2024-09-16T02:05:55.663 INFO:tasks.workunit.client.1.smithi165.stdout:2/731: write df/d23/d28/f32 [3035337,33592] 0 2024-09-16T02:05:55.663 INFO:tasks.workunit.client.1.smithi165.stdout:8/692: symlink dd/d11/d14/d3f/db3/lf4 0 2024-09-16T02:05:55.665 INFO:tasks.workunit.client.0.smithi110.stdout:7/209: rmdir d3/da 39 2024-09-16T02:05:55.670 INFO:tasks.workunit.client.0.smithi110.stdout:2/265: dwrite d0/da/d18/f29 [0,4194304] 0 2024-09-16T02:05:55.670 INFO:tasks.workunit.client.0.smithi110.stdout:7/210: read - d3/da/d10/d11/f28 zero size 2024-09-16T02:05:55.671 INFO:tasks.workunit.client.0.smithi110.stdout:2/266: chown d0/da/d18/dc 744078 1 2024-09-16T02:05:55.671 INFO:tasks.workunit.client.1.smithi165.stdout:7/639: mknod d0/d3d/d9f/dc5/ccf 0 2024-09-16T02:05:55.672 INFO:tasks.workunit.client.0.smithi110.stdout:3/191: creat d8/dc/d1b/f3e x:0 0 0 2024-09-16T02:05:55.676 INFO:tasks.workunit.client.1.smithi165.stdout:4/598: rename d4/dc/d18/dae to d4/dbc 0 2024-09-16T02:05:55.677 INFO:tasks.workunit.client.0.smithi110.stdout:2/267: mknod d0/db/d47/c56 0 2024-09-16T02:05:55.677 INFO:tasks.workunit.client.1.smithi165.stdout:1/754: link d1/dd/d11/d33/d3f/d6c/dde/cdc d1/d19/d4d/cf2 0 2024-09-16T02:05:55.678 INFO:tasks.workunit.client.1.smithi165.stdout:1/755: readlink d1/la0 0 2024-09-16T02:05:55.678 INFO:tasks.workunit.client.1.smithi165.stdout:1/756: stat d1/d19/d24/d30/la1 0 2024-09-16T02:05:55.678 INFO:tasks.workunit.client.0.smithi110.stdout:7/211: truncate d3/da/f18 1300550 0 2024-09-16T02:05:55.681 INFO:tasks.workunit.client.0.smithi110.stdout:3/192: rename d8/dc/d1b/d3a/c3d to d8/dc/d1b/d3a/c3f 0 2024-09-16T02:05:55.681 INFO:tasks.workunit.client.0.smithi110.stdout:2/268: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:55.683 INFO:tasks.workunit.client.1.smithi165.stdout:2/732: symlink df/d23/d28/d3b/ldd 0 2024-09-16T02:05:55.683 INFO:tasks.workunit.client.1.smithi165.stdout:8/693: symlink dd/d11/d14/d3f/d25/d36/lf5 0 2024-09-16T02:05:55.684 INFO:tasks.workunit.client.1.smithi165.stdout:8/694: chown dd/d11/fbd 141704883 1 2024-09-16T02:05:55.684 INFO:tasks.workunit.client.0.smithi110.stdout:3/193: dread - d8/dc/f21 zero size 2024-09-16T02:05:55.688 INFO:tasks.workunit.client.0.smithi110.stdout:6/357: sync 2024-09-16T02:05:55.688 INFO:tasks.workunit.client.0.smithi110.stdout:9/219: sync 2024-09-16T02:05:55.688 INFO:tasks.workunit.client.0.smithi110.stdout:0/282: sync 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.0.smithi110.stdout:8/277: sync 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.0.smithi110.stdout:5/241: sync 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.0.smithi110.stdout:1/333: sync 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.0.smithi110.stdout:4/292: sync 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.0.smithi110.stdout:2/269: write d0/db/f27 [4568,130011] 0 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.1.smithi165.stdout:3/743: link da/d17/c1f da/d17/de5/d104/d2c/d2d/d6c/def/c109 0 2024-09-16T02:05:55.689 INFO:tasks.workunit.client.1.smithi165.stdout:7/640: dread d0/df/d42/fa5 [0,4194304] 0 2024-09-16T02:05:55.692 INFO:tasks.workunit.client.0.smithi110.stdout:9/220: readlink d1/d5/d8/de/d1f/l2f 0 2024-09-16T02:05:55.692 INFO:tasks.workunit.client.0.smithi110.stdout:6/358: write d0/d2/f14 [3063059,60300] 0 2024-09-16T02:05:55.693 INFO:tasks.workunit.client.0.smithi110.stdout:4/293: dread - d4/d8/d17/d23/f51 zero size 2024-09-16T02:05:55.694 INFO:tasks.workunit.client.0.smithi110.stdout:1/334: symlink d0/d25/l6d 0 2024-09-16T02:05:55.695 INFO:tasks.workunit.client.0.smithi110.stdout:6/359: dread - d0/d2/d18/d1d/f3d zero size 2024-09-16T02:05:55.696 INFO:tasks.workunit.client.0.smithi110.stdout:4/294: stat d4/d12/d18/l22 0 2024-09-16T02:05:55.699 INFO:tasks.workunit.client.0.smithi110.stdout:9/221: rmdir d1/d2b/d2e 39 2024-09-16T02:05:55.701 INFO:tasks.workunit.client.0.smithi110.stdout:2/270: dread d0/da/f2c [0,4194304] 0 2024-09-16T02:05:55.704 INFO:tasks.workunit.client.0.smithi110.stdout:8/278: mkdir d3/d12/d1a/d36/d60 0 2024-09-16T02:05:55.704 INFO:tasks.workunit.client.0.smithi110.stdout:2/271: chown d0/da/f28 1 1 2024-09-16T02:05:55.706 INFO:tasks.workunit.client.1.smithi165.stdout:7/641: rmdir d0/d3d/d9f 39 2024-09-16T02:05:55.708 INFO:tasks.workunit.client.0.smithi110.stdout:1/335: mkdir d0/d1/d2a/d32/d6e 0 2024-09-16T02:05:55.708 INFO:tasks.workunit.client.0.smithi110.stdout:4/295: dwrite d4/d8/d17/d23/f37 [0,4194304] 0 2024-09-16T02:05:55.710 INFO:tasks.workunit.client.1.smithi165.stdout:1/757: truncate d1/dd/d11/d42/faf 72714 0 2024-09-16T02:05:55.712 INFO:tasks.workunit.client.0.smithi110.stdout:0/283: rename d3/d4/c8 to d3/d6/d43/c53 0 2024-09-16T02:05:55.714 INFO:tasks.workunit.client.1.smithi165.stdout:8/695: write dd/d62/fc0 [255659,1047] 0 2024-09-16T02:05:55.714 INFO:tasks.workunit.client.0.smithi110.stdout:9/222: dread d1/d5/d20/f39 [0,4194304] 0 2024-09-16T02:05:55.715 INFO:tasks.workunit.client.0.smithi110.stdout:3/194: dwrite d8/f15 [0,4194304] 0 2024-09-16T02:05:55.716 INFO:tasks.workunit.client.0.smithi110.stdout:0/284: write d3/d4/f4a [791349,71267] 0 2024-09-16T02:05:55.716 INFO:tasks.workunit.client.1.smithi165.stdout:5/673: sync 2024-09-16T02:05:55.716 INFO:tasks.workunit.client.1.smithi165.stdout:0/626: sync 2024-09-16T02:05:55.718 INFO:tasks.workunit.client.1.smithi165.stdout:9/726: rename d7/d14/f9d to d7/d32/d38/d53/ff0 0 2024-09-16T02:05:55.719 INFO:tasks.workunit.client.0.smithi110.stdout:9/223: write d1/d5/d20/f4b [773137,69796] 0 2024-09-16T02:05:55.719 INFO:tasks.workunit.client.0.smithi110.stdout:0/285: fdatasync d3/d6/d4b/f51 0 2024-09-16T02:05:55.723 INFO:tasks.workunit.client.0.smithi110.stdout:8/279: mknod d3/d12/d1d/d4c/c61 0 2024-09-16T02:05:55.723 INFO:tasks.workunit.client.0.smithi110.stdout:2/272: creat d0/da/d18/dc/f57 x:0 0 0 2024-09-16T02:05:55.725 INFO:tasks.workunit.client.0.smithi110.stdout:0/286: readlink d3/lb 0 2024-09-16T02:05:55.725 INFO:tasks.workunit.client.0.smithi110.stdout:7/212: dwrite d3/da/f18 [0,4194304] 0 2024-09-16T02:05:55.726 INFO:tasks.workunit.client.0.smithi110.stdout:1/336: readlink d0/da/l4d 0 2024-09-16T02:05:55.728 INFO:tasks.workunit.client.0.smithi110.stdout:4/296: creat d4/d8/d31/d36/d3c/f5c x:0 0 0 2024-09-16T02:05:55.729 INFO:tasks.workunit.client.0.smithi110.stdout:6/360: mknod d0/d2/c6e 0 2024-09-16T02:05:55.730 INFO:tasks.workunit.client.1.smithi165.stdout:0/627: rmdir d0/d1e 39 2024-09-16T02:05:55.732 INFO:tasks.workunit.client.1.smithi165.stdout:6/659: sync 2024-09-16T02:05:55.733 INFO:tasks.workunit.client.0.smithi110.stdout:3/195: dwrite f3 [0,4194304] 0 2024-09-16T02:05:55.740 INFO:tasks.workunit.client.0.smithi110.stdout:3/196: dread d8/dc/d1b/d1c/f26 [0,4194304] 0 2024-09-16T02:05:55.743 INFO:tasks.workunit.client.1.smithi165.stdout:4/599: rename d4/dc/d28/d30/fb9 to d4/dc/fbd 0 2024-09-16T02:05:55.743 INFO:tasks.workunit.client.0.smithi110.stdout:2/273: dwrite d0/db/d47/f50 [0,4194304] 0 2024-09-16T02:05:55.745 INFO:tasks.workunit.client.1.smithi165.stdout:9/727: unlink d7/d1f/d54/ce1 0 2024-09-16T02:05:55.746 INFO:tasks.workunit.client.1.smithi165.stdout:9/728: fdatasync d7/df/d37/fd6 0 2024-09-16T02:05:55.747 INFO:tasks.workunit.client.0.smithi110.stdout:6/361: dwrite d0/d2/d18/f59 [0,4194304] 0 2024-09-16T02:05:55.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/213: creat d3/da/d10/d11/f3f x:0 0 0 2024-09-16T02:05:55.747 INFO:tasks.workunit.client.1.smithi165.stdout:3/744: rmdir da/d17/d7a/d7d/da8/ded 0 2024-09-16T02:05:55.748 INFO:tasks.workunit.client.0.smithi110.stdout:7/214: readlink d3/d15/l1f 0 2024-09-16T02:05:55.748 INFO:tasks.workunit.client.1.smithi165.stdout:5/674: write de/d21/d26/d3a/f5a [7520727,101545] 0 2024-09-16T02:05:55.749 INFO:tasks.workunit.client.0.smithi110.stdout:7/215: dread - d3/da/d10/d11/f2b zero size 2024-09-16T02:05:55.750 INFO:tasks.workunit.client.0.smithi110.stdout:8/280: rename d3/d12/d1d/d4c to d3/d12/d1a/d36/d60/d62 0 2024-09-16T02:05:55.751 INFO:tasks.workunit.client.1.smithi165.stdout:2/733: getdents df/d23/d28/d87 0 2024-09-16T02:05:55.751 INFO:tasks.workunit.client.0.smithi110.stdout:8/281: write d3/fd [3157158,106949] 0 2024-09-16T02:05:55.751 INFO:tasks.workunit.client.0.smithi110.stdout:4/297: mkdir d4/d8/d31/d5d 0 2024-09-16T02:05:55.752 INFO:tasks.workunit.client.0.smithi110.stdout:4/298: chown d4/fc 1015306 1 2024-09-16T02:05:55.753 INFO:tasks.workunit.client.0.smithi110.stdout:8/282: chown d3/d2b/d27/f46 771083800 1 2024-09-16T02:05:55.754 INFO:tasks.workunit.client.0.smithi110.stdout:8/283: write d3/d2b/f4a [740243,87169] 0 2024-09-16T02:05:55.759 INFO:tasks.workunit.client.0.smithi110.stdout:9/224: creat d1/d2b/d2e/f4d x:0 0 0 2024-09-16T02:05:55.759 INFO:tasks.workunit.client.1.smithi165.stdout:6/660: mkdir d7/dc/d3b/d3a/d74/db7 0 2024-09-16T02:05:55.760 INFO:tasks.workunit.client.0.smithi110.stdout:1/337: creat d0/d1/d2a/d32/d6e/f6f x:0 0 0 2024-09-16T02:05:55.763 INFO:tasks.workunit.client.0.smithi110.stdout:0/287: mknod d3/d4/c54 0 2024-09-16T02:05:55.764 INFO:tasks.workunit.client.1.smithi165.stdout:0/628: dread d0/fba [0,4194304] 0 2024-09-16T02:05:55.765 INFO:tasks.workunit.client.1.smithi165.stdout:4/600: creat d4/d40/d4f/fbe x:0 0 0 2024-09-16T02:05:55.766 INFO:tasks.workunit.client.0.smithi110.stdout:3/197: creat d8/dc/d1b/d36/f40 x:0 0 0 2024-09-16T02:05:55.768 INFO:tasks.workunit.client.0.smithi110.stdout:2/274: mkdir d0/da/d18/d2d/d58 0 2024-09-16T02:05:55.771 INFO:tasks.workunit.client.1.smithi165.stdout:3/745: symlink da/d17/d7a/dab/l10a 0 2024-09-16T02:05:55.774 INFO:tasks.workunit.client.1.smithi165.stdout:1/758: dwrite d1/dd/d11/d33/f56 [0,4194304] 0 2024-09-16T02:05:55.776 INFO:tasks.workunit.client.1.smithi165.stdout:8/696: dwrite dd/d11/d14/d3f/f9c [0,4194304] 0 2024-09-16T02:05:55.776 INFO:tasks.workunit.client.0.smithi110.stdout:4/299: symlink d4/d12/d3b/l5e 0 2024-09-16T02:05:55.776 INFO:tasks.workunit.client.0.smithi110.stdout:4/300: readlink d4/d12/d18/l2a 0 2024-09-16T02:05:55.779 INFO:tasks.workunit.client.1.smithi165.stdout:7/642: getdents d0/d3d 0 2024-09-16T02:05:55.779 INFO:tasks.workunit.client.0.smithi110.stdout:8/284: symlink d3/d12/d1a/l63 0 2024-09-16T02:05:55.780 INFO:tasks.workunit.client.0.smithi110.stdout:7/216: write d3/f8 [1082452,4724] 0 2024-09-16T02:05:55.781 INFO:tasks.workunit.client.1.smithi165.stdout:7/643: dread - d0/d4b/db4/dba/fca zero size 2024-09-16T02:05:55.781 INFO:tasks.workunit.client.1.smithi165.stdout:7/644: chown d0/df/f27 5812 1 2024-09-16T02:05:55.782 INFO:tasks.workunit.client.1.smithi165.stdout:3/746: dwrite da/d17/de5/d104/d2c/d2d/fbf [4194304,4194304] 0 2024-09-16T02:05:55.786 INFO:tasks.workunit.client.1.smithi165.stdout:9/729: creat d7/d14/d7a/de2/ff1 x:0 0 0 2024-09-16T02:05:55.787 INFO:tasks.workunit.client.1.smithi165.stdout:9/730: chown d7/df/d67/d92/lb7 248502 1 2024-09-16T02:05:55.788 INFO:tasks.workunit.client.0.smithi110.stdout:0/288: mkdir d3/d6/d43/d55 0 2024-09-16T02:05:55.788 INFO:tasks.workunit.client.0.smithi110.stdout:1/338: mkdir d0/d1/d4/d70 0 2024-09-16T02:05:55.789 INFO:tasks.workunit.client.0.smithi110.stdout:3/198: creat d8/d29/f41 x:0 0 0 2024-09-16T02:05:55.792 INFO:tasks.workunit.client.0.smithi110.stdout:6/362: dwrite d0/d2/f42 [0,4194304] 0 2024-09-16T02:05:55.792 INFO:tasks.workunit.client.1.smithi165.stdout:5/675: rename de/d19/d1c/l20 to de/d21/d26/d3a/d6d/dad/le0 0 2024-09-16T02:05:55.794 INFO:tasks.workunit.client.1.smithi165.stdout:1/759: creat d1/d6b/ff3 x:0 0 0 2024-09-16T02:05:55.794 INFO:tasks.workunit.client.1.smithi165.stdout:6/661: symlink d7/dc/d3b/d3a/d74/db7/lb8 0 2024-09-16T02:05:55.797 INFO:tasks.workunit.client.0.smithi110.stdout:7/217: dwrite d3/da/d10/f30 [0,4194304] 0 2024-09-16T02:05:55.797 INFO:tasks.workunit.client.1.smithi165.stdout:8/697: unlink dd/d11/d38/d74/laf 0 2024-09-16T02:05:55.799 INFO:tasks.workunit.client.0.smithi110.stdout:6/363: stat d0/d29/d2a 0 2024-09-16T02:05:55.800 INFO:tasks.workunit.client.1.smithi165.stdout:5/676: dwrite de/d19/d1c/d49/da5/db1/fc9 [0,4194304] 0 2024-09-16T02:05:55.800 INFO:tasks.workunit.client.0.smithi110.stdout:6/364: chown d0/f10 41553 1 2024-09-16T02:05:55.802 INFO:tasks.workunit.client.1.smithi165.stdout:7/645: mknod d0/d2c/d85/cd0 0 2024-09-16T02:05:55.803 INFO:tasks.workunit.client.0.smithi110.stdout:8/285: creat d3/d12/d1a/d36/d60/f64 x:0 0 0 2024-09-16T02:05:55.805 INFO:tasks.workunit.client.0.smithi110.stdout:9/225: creat d1/d2b/d2e/d38/d3d/f4e x:0 0 0 2024-09-16T02:05:55.808 INFO:tasks.workunit.client.0.smithi110.stdout:2/275: symlink d0/da/d18/d2d/d58/l59 0 2024-09-16T02:05:55.808 INFO:tasks.workunit.client.1.smithi165.stdout:9/731: symlink d7/d32/d38/d53/d56/lf2 0 2024-09-16T02:05:55.811 INFO:tasks.workunit.client.0.smithi110.stdout:6/365: truncate d0/d29/d2a/d2f/f5f 667938 0 2024-09-16T02:05:55.813 INFO:tasks.workunit.client.0.smithi110.stdout:6/366: chown d0/d2/dc/f41 3180 1 2024-09-16T02:05:55.813 INFO:tasks.workunit.client.0.smithi110.stdout:9/226: fdatasync d1/d5/f1a 0 2024-09-16T02:05:55.816 INFO:tasks.workunit.client.0.smithi110.stdout:2/276: write d0/da/d18/d25/d3b/f43 [718049,92258] 0 2024-09-16T02:05:55.816 INFO:tasks.workunit.client.1.smithi165.stdout:1/760: dread d1/dd/d11/f1d [0,4194304] 0 2024-09-16T02:05:55.817 INFO:tasks.workunit.client.0.smithi110.stdout:4/301: link d4/d8/c30 d4/d8/d17/c5f 0 2024-09-16T02:05:55.819 INFO:tasks.workunit.client.0.smithi110.stdout:2/277: fsync d0/da/d18/d2d/f42 0 2024-09-16T02:05:55.819 INFO:tasks.workunit.client.0.smithi110.stdout:8/286: dwrite d3/d2b/f52 [0,4194304] 0 2024-09-16T02:05:55.820 INFO:tasks.workunit.client.1.smithi165.stdout:4/601: creat d4/dc/d18/d37/d53/d64/d91/fbf x:0 0 0 2024-09-16T02:05:55.820 INFO:tasks.workunit.client.0.smithi110.stdout:7/218: dwrite d3/da/d10/f39 [0,4194304] 0 2024-09-16T02:05:55.820 INFO:tasks.workunit.client.1.smithi165.stdout:4/602: stat d4/dc/d18/d37/d53/d64/d8b/lb2 0 2024-09-16T02:05:55.827 INFO:tasks.workunit.client.0.smithi110.stdout:6/367: symlink d0/d29/d2a/d2f/l6f 0 2024-09-16T02:05:55.829 INFO:tasks.workunit.client.1.smithi165.stdout:9/732: mknod d7/d1f/ddb/cf3 0 2024-09-16T02:05:55.829 INFO:tasks.workunit.client.0.smithi110.stdout:4/302: fsync d4/d8/d17/d23/d35/f4b 0 2024-09-16T02:05:55.831 INFO:tasks.workunit.client.1.smithi165.stdout:8/698: dread dd/d11/f30 [0,4194304] 0 2024-09-16T02:05:55.833 INFO:tasks.workunit.client.1.smithi165.stdout:2/734: rename df/d10/d1a/d2d/dd1/l8f to df/d23/ddc/lde 0 2024-09-16T02:05:55.833 INFO:tasks.workunit.client.1.smithi165.stdout:8/699: dread - dd/d11/daa/fad zero size 2024-09-16T02:05:55.834 INFO:tasks.workunit.client.0.smithi110.stdout:2/278: write d0/f3 [971934,105055] 0 2024-09-16T02:05:55.834 INFO:tasks.workunit.client.1.smithi165.stdout:0/629: sync 2024-09-16T02:05:55.838 INFO:tasks.workunit.client.0.smithi110.stdout:8/287: read d3/d2b/d27/f2d [1417493,39694] 0 2024-09-16T02:05:55.839 INFO:tasks.workunit.client.1.smithi165.stdout:7/646: unlink d0/df/d33/c9d 0 2024-09-16T02:05:55.840 INFO:tasks.workunit.client.0.smithi110.stdout:8/288: chown d3/d2b/d27/f46 1066444 1 2024-09-16T02:05:55.840 INFO:tasks.workunit.client.1.smithi165.stdout:7/647: chown d0/d2c/l31 6519 1 2024-09-16T02:05:55.841 INFO:tasks.workunit.client.1.smithi165.stdout:7/648: chown d0/df/d33/d2a/c45 0 1 2024-09-16T02:05:55.842 INFO:tasks.workunit.client.0.smithi110.stdout:4/303: creat d4/d8/d31/d36/d3c/d3d/f60 x:0 0 0 2024-09-16T02:05:55.843 INFO:tasks.workunit.client.1.smithi165.stdout:7/649: dread - d0/df/d68/f70 zero size 2024-09-16T02:05:55.843 INFO:tasks.workunit.client.0.smithi110.stdout:4/304: truncate d4/d8/f5a 219064 0 2024-09-16T02:05:55.843 INFO:tasks.workunit.client.1.smithi165.stdout:9/733: symlink d7/df/d37/d43/d88/lf4 0 2024-09-16T02:05:55.844 INFO:tasks.workunit.client.0.smithi110.stdout:4/305: fdatasync d4/d8/d17/d23/f4a 0 2024-09-16T02:05:55.844 INFO:tasks.workunit.client.1.smithi165.stdout:5/677: dwrite de/d21/d4e/f55 [0,4194304] 0 2024-09-16T02:05:55.845 INFO:tasks.workunit.client.0.smithi110.stdout:4/306: readlink d4/d8/d17/d23/d35/l40 0 2024-09-16T02:05:55.845 INFO:tasks.workunit.client.0.smithi110.stdout:7/219: mkdir d3/da/d10/d11/d3e/d40 0 2024-09-16T02:05:55.845 INFO:tasks.workunit.client.1.smithi165.stdout:5/678: write de/d19/d1c/f3e [2212187,11445] 0 2024-09-16T02:05:55.846 INFO:tasks.workunit.client.0.smithi110.stdout:3/199: dread d8/dc/d1b/f2c [0,4194304] 0 2024-09-16T02:05:55.849 INFO:tasks.workunit.client.1.smithi165.stdout:2/735: write df/d23/d28/d3b/fab [763169,54477] 0 2024-09-16T02:05:55.852 INFO:tasks.workunit.client.1.smithi165.stdout:8/700: creat dd/d11/d38/da6/ff6 x:0 0 0 2024-09-16T02:05:55.853 INFO:tasks.workunit.client.1.smithi165.stdout:4/603: mkdir d4/dc0 0 2024-09-16T02:05:55.853 INFO:tasks.workunit.client.0.smithi110.stdout:8/289: stat d3/d31/c32 0 2024-09-16T02:05:55.854 INFO:tasks.workunit.client.1.smithi165.stdout:3/747: getdents da/d20/d26/d52/d9c/da6 0 2024-09-16T02:05:55.855 INFO:tasks.workunit.client.1.smithi165.stdout:9/734: dwrite d7/d32/d38/d53/d5c/d61/fcd [0,4194304] 0 2024-09-16T02:05:55.856 INFO:tasks.workunit.client.1.smithi165.stdout:6/662: dread d7/f1e [4194304,4194304] 0 2024-09-16T02:05:55.856 INFO:tasks.workunit.client.0.smithi110.stdout:6/368: rmdir d0/d29/d2a/d2f/d34/d4a 0 2024-09-16T02:05:55.858 INFO:tasks.workunit.client.0.smithi110.stdout:4/307: dwrite d4/d12/d18/f57 [0,4194304] 0 2024-09-16T02:05:55.859 INFO:tasks.workunit.client.1.smithi165.stdout:5/679: readlink de/d21/d26/d3a/d6d/dad/le0 0 2024-09-16T02:05:55.861 INFO:tasks.workunit.client.0.smithi110.stdout:3/200: dwrite d8/f1d [0,4194304] 0 2024-09-16T02:05:55.861 INFO:tasks.workunit.client.1.smithi165.stdout:1/761: truncate d1/f3a 3706060 0 2024-09-16T02:05:55.863 INFO:tasks.workunit.client.0.smithi110.stdout:2/279: truncate d0/da/d18/f29 1681311 0 2024-09-16T02:05:55.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/308: write d4/d8/d17/d23/d35/f42 [1051679,90879] 0 2024-09-16T02:05:55.867 INFO:tasks.workunit.client.0.smithi110.stdout:4/309: stat d4/d12/c32 0 2024-09-16T02:05:55.868 INFO:tasks.workunit.client.0.smithi110.stdout:6/369: dwrite d0/d2/f6a [4194304,4194304] 0 2024-09-16T02:05:55.869 INFO:tasks.workunit.client.0.smithi110.stdout:4/310: write d4/d8/d31/d36/d3c/d3d/f60 [609579,56364] 0 2024-09-16T02:05:55.870 INFO:tasks.workunit.client.0.smithi110.stdout:4/311: chown d4/d12/d18/l50 34926077 1 2024-09-16T02:05:55.873 INFO:tasks.workunit.client.1.smithi165.stdout:8/701: creat dd/d11/d14/d3f/d72/ff7 x:0 0 0 2024-09-16T02:05:55.873 INFO:tasks.workunit.client.0.smithi110.stdout:7/220: getdents d3/d15/d3a 0 2024-09-16T02:05:55.876 INFO:tasks.workunit.client.0.smithi110.stdout:7/221: read - d3/da/d10/d11/f2b zero size 2024-09-16T02:05:55.878 INFO:tasks.workunit.client.0.smithi110.stdout:8/290: mkdir d3/d2b/d65 0 2024-09-16T02:05:55.879 INFO:tasks.workunit.client.0.smithi110.stdout:4/312: dwrite d4/f11 [0,4194304] 0 2024-09-16T02:05:55.879 INFO:tasks.workunit.client.0.smithi110.stdout:8/291: fsync d3/f9 0 2024-09-16T02:05:55.880 INFO:tasks.workunit.client.1.smithi165.stdout:9/735: unlink d7/d14/d80/le4 0 2024-09-16T02:05:55.881 INFO:tasks.workunit.client.1.smithi165.stdout:9/736: write d7/d32/d38/d58/fc3 [2107691,118027] 0 2024-09-16T02:05:55.883 INFO:tasks.workunit.client.0.smithi110.stdout:4/313: write d4/d12/d18/f29 [2801118,52438] 0 2024-09-16T02:05:55.884 INFO:tasks.workunit.client.1.smithi165.stdout:4/604: rename d4/dc/d18/d37/d53/d64/d8b/lb2 to d4/dc/d18/d37/d53/d64/d8b/d71/lc1 0 2024-09-16T02:05:55.886 INFO:tasks.workunit.client.1.smithi165.stdout:4/605: fdatasync d4/dc/d18/d37/d53/d64/d8b/f70 0 2024-09-16T02:05:55.888 INFO:tasks.workunit.client.1.smithi165.stdout:1/762: write d1/dd/d11/f15 [4612196,14332] 0 2024-09-16T02:05:55.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/314: dread d4/f11 [0,4194304] 0 2024-09-16T02:05:55.890 INFO:tasks.workunit.client.0.smithi110.stdout:3/201: chown d8/dc/d1b/d3a/c3f 3186 1 2024-09-16T02:05:55.890 INFO:tasks.workunit.client.1.smithi165.stdout:0/630: dwrite d0/d1e/d39/d48/d74/dc6/fd4 [0,4194304] 0 2024-09-16T02:05:55.891 INFO:tasks.workunit.client.0.smithi110.stdout:2/280: rename d0/f7 to d0/da/d18/d2d/f5a 0 2024-09-16T02:05:55.892 INFO:tasks.workunit.client.0.smithi110.stdout:6/370: chown d0/d2/d5/d1e/c27 176160 1 2024-09-16T02:05:55.893 INFO:tasks.workunit.client.1.smithi165.stdout:3/748: mknod da/dfe/c10b 0 2024-09-16T02:05:55.893 INFO:tasks.workunit.client.0.smithi110.stdout:6/371: write d0/d2/dc/d16/f3b [331237,90912] 0 2024-09-16T02:05:55.894 INFO:tasks.workunit.client.1.smithi165.stdout:3/749: chown da/d20/d26/d6e/f73 2434 1 2024-09-16T02:05:55.895 INFO:tasks.workunit.client.0.smithi110.stdout:6/372: write d0/d29/d2a/f37 [124979,102545] 0 2024-09-16T02:05:55.897 INFO:tasks.workunit.client.1.smithi165.stdout:9/737: symlink d7/d14/d80/lf5 0 2024-09-16T02:05:55.899 INFO:tasks.workunit.client.1.smithi165.stdout:6/663: rename d7/dc/d3b/d3a/d3d/d5d/d73/d82/f8a to d7/dc/d3b/d3a/d3d/d5d/d87/fb9 0 2024-09-16T02:05:55.899 INFO:tasks.workunit.client.1.smithi165.stdout:9/738: truncate d7/df/d67/f9e 5350526 0 2024-09-16T02:05:55.900 INFO:tasks.workunit.client.0.smithi110.stdout:4/315: mkdir d4/d8/d17/d23/d61 0 2024-09-16T02:05:55.902 INFO:tasks.workunit.client.0.smithi110.stdout:6/373: dwrite d0/d2/f6a [0,4194304] 0 2024-09-16T02:05:55.903 INFO:tasks.workunit.client.1.smithi165.stdout:5/680: dread de/d21/d51/f5f [0,4194304] 0 2024-09-16T02:05:55.904 INFO:tasks.workunit.client.1.smithi165.stdout:9/739: read d7/d32/d38/d58/d99/f9c [444249,91717] 0 2024-09-16T02:05:55.904 INFO:tasks.workunit.client.0.smithi110.stdout:3/202: creat d8/d29/f42 x:0 0 0 2024-09-16T02:05:55.905 INFO:tasks.workunit.client.1.smithi165.stdout:9/740: chown d7/d1f/l6f 296 1 2024-09-16T02:05:55.906 INFO:tasks.workunit.client.0.smithi110.stdout:2/281: symlink d0/da/d18/dc/l5b 0 2024-09-16T02:05:55.907 INFO:tasks.workunit.client.1.smithi165.stdout:4/606: dread d4/dc/d28/f5f [0,4194304] 0 2024-09-16T02:05:55.909 INFO:tasks.workunit.client.0.smithi110.stdout:7/222: symlink d3/da/l41 0 2024-09-16T02:05:55.909 INFO:tasks.workunit.client.0.smithi110.stdout:7/223: fsync d3/f9 0 2024-09-16T02:05:55.911 INFO:tasks.workunit.client.1.smithi165.stdout:2/736: creat df/d10/d1a/d68/fdf x:0 0 0 2024-09-16T02:05:55.918 INFO:tasks.workunit.client.1.smithi165.stdout:7/650: getdents d0/df/d42 0 2024-09-16T02:05:55.920 INFO:tasks.workunit.client.1.smithi165.stdout:7/651: truncate d0/df/d33/d2a/f94 929915 0 2024-09-16T02:05:55.920 INFO:tasks.workunit.client.1.smithi165.stdout:6/664: creat d7/d17/d75/d97/fba x:0 0 0 2024-09-16T02:05:55.921 INFO:tasks.workunit.client.1.smithi165.stdout:6/665: dread - d7/dc/df/d1a/d4d/d90/fb6 zero size 2024-09-16T02:05:55.921 INFO:tasks.workunit.client.1.smithi165.stdout:5/681: creat de/d19/d1c/d49/da5/db1/fe1 x:0 0 0 2024-09-16T02:05:55.922 INFO:tasks.workunit.client.1.smithi165.stdout:5/682: chown de/d60 824143850 1 2024-09-16T02:05:55.922 INFO:tasks.workunit.client.0.smithi110.stdout:3/203: mkdir d8/dc/d1b/d3a/d43 0 2024-09-16T02:05:55.924 INFO:tasks.workunit.client.0.smithi110.stdout:2/282: mknod d0/da/d18/dc/c5c 0 2024-09-16T02:05:55.925 INFO:tasks.workunit.client.1.smithi165.stdout:9/741: rmdir d7 39 2024-09-16T02:05:55.928 INFO:tasks.workunit.client.1.smithi165.stdout:3/750: write da/d20/d26/fa7 [459011,20925] 0 2024-09-16T02:05:55.929 INFO:tasks.workunit.client.1.smithi165.stdout:5/683: dwrite de/d19/d1c/d4d/f7e [0,4194304] 0 2024-09-16T02:05:55.931 INFO:tasks.workunit.client.0.smithi110.stdout:4/316: unlink d4/d8/c3e 0 2024-09-16T02:05:55.931 INFO:tasks.workunit.client.0.smithi110.stdout:2/283: dwrite d0/db/f36 [0,4194304] 0 2024-09-16T02:05:55.934 INFO:tasks.workunit.client.0.smithi110.stdout:6/374: rename d0/d2/d18/d1d/c45 to d0/d2/d5/c70 0 2024-09-16T02:05:55.936 INFO:tasks.workunit.client.0.smithi110.stdout:6/375: stat d0/d29/d2a/d2f/f5f 0 2024-09-16T02:05:55.938 INFO:tasks.workunit.client.0.smithi110.stdout:3/204: symlink d8/dc/d1b/d36/l44 0 2024-09-16T02:05:55.939 INFO:tasks.workunit.client.0.smithi110.stdout:3/205: read d8/d29/f2d [557500,13928] 0 2024-09-16T02:05:55.940 INFO:tasks.workunit.client.0.smithi110.stdout:2/284: dwrite d0/da/d18/dc/f57 [0,4194304] 0 2024-09-16T02:05:55.945 INFO:tasks.workunit.client.1.smithi165.stdout:5/684: dread de/d19/d1c/f56 [0,4194304] 0 2024-09-16T02:05:55.945 INFO:tasks.workunit.client.1.smithi165.stdout:7/652: creat d0/fd1 x:0 0 0 2024-09-16T02:05:55.950 INFO:tasks.workunit.client.0.smithi110.stdout:7/224: dwrite d3/da/fc [0,4194304] 0 2024-09-16T02:05:55.952 INFO:tasks.workunit.client.0.smithi110.stdout:3/206: mkdir d8/d29/d45 0 2024-09-16T02:05:55.954 INFO:tasks.workunit.client.0.smithi110.stdout:2/285: rename d0/da/d18/dc/f3d to d0/da/d18/d2d/f5d 0 2024-09-16T02:05:55.954 INFO:tasks.workunit.client.0.smithi110.stdout:3/207: read d8/dc/d1b/d1c/f2e [99314,33475] 0 2024-09-16T02:05:55.955 INFO:tasks.workunit.client.1.smithi165.stdout:9/742: chown d7/df/d67/d92/d93 115145 1 2024-09-16T02:05:55.955 INFO:tasks.workunit.client.0.smithi110.stdout:2/286: readlink d0/l4 0 2024-09-16T02:05:55.957 INFO:tasks.workunit.client.1.smithi165.stdout:2/737: fsync df/f3f 0 2024-09-16T02:05:55.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/607: dread d4/dc/d20/d45/f97 [0,4194304] 0 2024-09-16T02:05:55.961 INFO:tasks.workunit.client.1.smithi165.stdout:1/763: link d1/dd/l4a d1/dd/d11/d33/d92/da3/lf4 0 2024-09-16T02:05:55.964 INFO:tasks.workunit.client.0.smithi110.stdout:2/287: dwrite d0/da/d18/d2d/d41/f4b [0,4194304] 0 2024-09-16T02:05:55.966 INFO:tasks.workunit.client.0.smithi110.stdout:6/376: truncate d0/d2/dc/d16/f61 1354891 0 2024-09-16T02:05:55.966 INFO:tasks.workunit.client.1.smithi165.stdout:8/702: getdents dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7 0 2024-09-16T02:05:55.973 INFO:tasks.workunit.client.1.smithi165.stdout:5/685: fdatasync de/fc3 0 2024-09-16T02:05:55.974 INFO:tasks.workunit.client.0.smithi110.stdout:4/317: dwrite d4/d12/f24 [0,4194304] 0 2024-09-16T02:05:55.977 INFO:tasks.workunit.client.1.smithi165.stdout:7/653: write d0/d4b/f5d [3571035,9831] 0 2024-09-16T02:05:55.979 INFO:tasks.workunit.client.0.smithi110.stdout:6/377: dwrite d0/d2/d5/d1e/f44 [0,4194304] 0 2024-09-16T02:05:55.980 INFO:tasks.workunit.client.1.smithi165.stdout:4/608: mkdir d4/dc/d20/dc2 0 2024-09-16T02:05:55.983 INFO:tasks.workunit.client.0.smithi110.stdout:2/288: mknod d0/db/d33/d46/c5e 0 2024-09-16T02:05:55.984 INFO:tasks.workunit.client.0.smithi110.stdout:4/318: dwrite d4/d12/d18/f57 [0,4194304] 0 2024-09-16T02:05:55.985 INFO:tasks.workunit.client.1.smithi165.stdout:2/738: creat df/d10/d1a/d2d/dd1/d79/d98/fe0 x:0 0 0 2024-09-16T02:05:55.986 INFO:tasks.workunit.client.1.smithi165.stdout:0/631: getdents d0/d1e/d20/d28/d9a 0 2024-09-16T02:05:55.987 INFO:tasks.workunit.client.1.smithi165.stdout:8/703: symlink dd/d11/d38/da6/db0/lf8 0 2024-09-16T02:05:55.989 INFO:tasks.workunit.client.1.smithi165.stdout:8/704: write dd/d11/d38/d74/d7d/fd9 [1498287,75228] 0 2024-09-16T02:05:55.990 INFO:tasks.workunit.client.0.smithi110.stdout:6/378: creat d0/d29/d2a/d2f/d49/f71 x:0 0 0 2024-09-16T02:05:55.991 INFO:tasks.workunit.client.1.smithi165.stdout:5/686: mkdir de/d21/d26/d3a/d6d/de2 0 2024-09-16T02:05:55.992 INFO:tasks.workunit.client.1.smithi165.stdout:6/666: truncate d7/dc/d3b/d3a/f5a 68485 0 2024-09-16T02:05:55.993 INFO:tasks.workunit.client.0.smithi110.stdout:3/208: creat d8/dc/f46 x:0 0 0 2024-09-16T02:05:55.996 INFO:tasks.workunit.client.0.smithi110.stdout:3/209: dread - d8/dc/d1b/d1c/f38 zero size 2024-09-16T02:05:55.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/379: dwrite d0/d2/dc/f4b [0,4194304] 0 2024-09-16T02:05:55.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/380: fsync d0/d29/d2a/d2f/f58 0 2024-09-16T02:05:55.999 INFO:tasks.workunit.client.1.smithi165.stdout:9/743: symlink d7/d32/d38/d68/lf6 0 2024-09-16T02:05:56.000 INFO:tasks.workunit.client.0.smithi110.stdout:4/319: creat d4/d8/d31/d36/f62 x:0 0 0 2024-09-16T02:05:56.000 INFO:tasks.workunit.client.1.smithi165.stdout:7/654: unlink d0/df/d7/d67/fae 0 2024-09-16T02:05:56.001 INFO:tasks.workunit.client.1.smithi165.stdout:9/744: readlink d7/d14/d80/lef 0 2024-09-16T02:05:56.001 INFO:tasks.workunit.client.1.smithi165.stdout:7/655: read - d0/d3d/d9f/fbe zero size 2024-09-16T02:05:56.004 INFO:tasks.workunit.client.1.smithi165.stdout:0/632: dread d0/d1e/d39/d48/d45/f37 [0,4194304] 0 2024-09-16T02:05:56.005 INFO:tasks.workunit.client.0.smithi110.stdout:2/289: mkdir d0/d5f 0 2024-09-16T02:05:56.005 INFO:tasks.workunit.client.1.smithi165.stdout:1/764: rmdir d1/dd/d11/d33/d3f/d59 39 2024-09-16T02:05:56.009 INFO:tasks.workunit.client.1.smithi165.stdout:7/656: dwrite d0/d4b/db4/dba/fca [0,4194304] 0 2024-09-16T02:05:56.011 INFO:tasks.workunit.client.1.smithi165.stdout:7/657: readlink d0/df/d83/d84/l75 0 2024-09-16T02:05:56.013 INFO:tasks.workunit.client.0.smithi110.stdout:2/290: creat d0/db/d47/f60 x:0 0 0 2024-09-16T02:05:56.017 INFO:tasks.workunit.client.1.smithi165.stdout:7/658: dwrite d0/d3d/f4f [0,4194304] 0 2024-09-16T02:05:56.020 INFO:tasks.workunit.client.0.smithi110.stdout:2/291: rmdir d0/db/d33/d46 39 2024-09-16T02:05:56.022 INFO:tasks.workunit.client.0.smithi110.stdout:2/292: truncate d0/db/f27 2261204 0 2024-09-16T02:05:56.023 INFO:tasks.workunit.client.0.smithi110.stdout:3/210: rename d8/dc/d1b/d1c/l34 to d8/dc/l47 0 2024-09-16T02:05:56.023 INFO:tasks.workunit.client.0.smithi110.stdout:3/211: chown d8/d29/f2d 279 1 2024-09-16T02:05:56.026 INFO:tasks.workunit.client.0.smithi110.stdout:4/320: rmdir d4/d8/d17/d23/d35/d49 0 2024-09-16T02:05:56.027 INFO:tasks.workunit.client.0.smithi110.stdout:6/381: getdents d0/d29/d2a/d2f/d34 0 2024-09-16T02:05:56.028 INFO:tasks.workunit.client.0.smithi110.stdout:6/382: read - d0/d2/d18/d1d/f3d zero size 2024-09-16T02:05:56.038 INFO:tasks.workunit.client.1.smithi165.stdout:9/745: mknod d7/d32/d38/d53/d5c/cf7 0 2024-09-16T02:05:56.042 INFO:tasks.workunit.client.1.smithi165.stdout:3/751: sync 2024-09-16T02:05:56.043 INFO:tasks.workunit.client.1.smithi165.stdout:7/659: rename d0/df/d68 to d0/df/d33/d2a/dd2 0 2024-09-16T02:05:56.044 INFO:tasks.workunit.client.1.smithi165.stdout:5/687: creat de/d21/d26/d94/d9d/fe3 x:0 0 0 2024-09-16T02:05:56.045 INFO:tasks.workunit.client.1.smithi165.stdout:4/609: creat d4/fc3 x:0 0 0 2024-09-16T02:05:56.045 INFO:tasks.workunit.client.1.smithi165.stdout:9/746: rmdir d7/d32/d38/d53/d56/dca/dd2 39 2024-09-16T02:05:56.048 INFO:tasks.workunit.client.1.smithi165.stdout:0/633: truncate d0/f13 1498082 0 2024-09-16T02:05:56.048 INFO:tasks.workunit.client.1.smithi165.stdout:0/634: write d0/fb [3319513,55920] 0 2024-09-16T02:05:56.048 INFO:tasks.workunit.client.1.smithi165.stdout:2/739: unlink df/d23/d28/d3b/d82/l99 0 2024-09-16T02:05:56.049 INFO:tasks.workunit.client.1.smithi165.stdout:0/635: dread - d0/d1e/d20/d28/d6d/daf/dc0/fd2 zero size 2024-09-16T02:05:56.050 INFO:tasks.workunit.client.1.smithi165.stdout:8/705: link dd/d34/f48 dd/d11/d14/d3f/d25/d36/d81/dd2/ff9 0 2024-09-16T02:05:56.052 INFO:tasks.workunit.client.1.smithi165.stdout:3/752: rename da/d20/d26/d52 to da/d17/de5/d104/d2c/d10c 0 2024-09-16T02:05:56.052 INFO:tasks.workunit.client.1.smithi165.stdout:6/667: creat d7/dc/df/d1a/fbb x:0 0 0 2024-09-16T02:05:56.053 INFO:tasks.workunit.client.1.smithi165.stdout:5/688: creat de/d21/fe4 x:0 0 0 2024-09-16T02:05:56.053 INFO:tasks.workunit.client.1.smithi165.stdout:4/610: mkdir d4/dc/d20/dc4 0 2024-09-16T02:05:56.054 INFO:tasks.workunit.client.1.smithi165.stdout:1/765: dwrite d1/dd/d11/d33/d3f/f55 [0,4194304] 0 2024-09-16T02:05:56.058 INFO:tasks.workunit.client.1.smithi165.stdout:9/747: rename d7/d32/d38/d53/d5c/d61/f91 to d7/df/d67/ff8 0 2024-09-16T02:05:56.060 INFO:tasks.workunit.client.1.smithi165.stdout:7/660: link d0/df/c20 d0/d3d/d9f/cd3 0 2024-09-16T02:05:56.061 INFO:tasks.workunit.client.1.smithi165.stdout:4/611: dwrite d4/dbc/fbb [0,4194304] 0 2024-09-16T02:05:56.064 INFO:tasks.workunit.client.1.smithi165.stdout:3/753: creat da/d17/de5/d104/d2c/db7/f10d x:0 0 0 2024-09-16T02:05:56.065 INFO:tasks.workunit.client.1.smithi165.stdout:9/748: dread d7/d32/d38/d53/d56/d95/fa5 [0,4194304] 0 2024-09-16T02:05:56.067 INFO:tasks.workunit.client.1.smithi165.stdout:9/749: truncate d7/d32/d38/d68/d7f/f70 3847664 0 2024-09-16T02:05:56.073 INFO:tasks.workunit.client.1.smithi165.stdout:8/706: link dd/d11/d14/fbc dd/d11/d14/d70/d7b/df2/ffa 0 2024-09-16T02:05:56.076 INFO:tasks.workunit.client.1.smithi165.stdout:7/661: symlink d0/d3d/d9f/ld4 0 2024-09-16T02:05:56.077 INFO:tasks.workunit.client.1.smithi165.stdout:4/612: dread - d4/dc/d18/d37/d53/d64/f75 zero size 2024-09-16T02:05:56.079 INFO:tasks.workunit.client.1.smithi165.stdout:4/613: readlink d4/d40/l7b 0 2024-09-16T02:05:56.079 INFO:tasks.workunit.client.1.smithi165.stdout:1/766: unlink d1/dd/d11/d42/cbb 0 2024-09-16T02:05:56.080 INFO:tasks.workunit.client.1.smithi165.stdout:5/689: write de/d21/d51/f5e [80111,4145] 0 2024-09-16T02:05:56.080 INFO:tasks.workunit.client.1.smithi165.stdout:9/750: mkdir d7/d1f/d54/df9 0 2024-09-16T02:05:56.081 INFO:tasks.workunit.client.1.smithi165.stdout:0/636: dwrite d0/d1e/d39/d48/f38 [0,4194304] 0 2024-09-16T02:05:56.082 INFO:tasks.workunit.client.1.smithi165.stdout:9/751: write d7/d32/f39 [319816,99557] 0 2024-09-16T02:05:56.084 INFO:tasks.workunit.client.1.smithi165.stdout:8/707: mknod dd/d11/d14/d3f/d25/d36/d81/dd2/d53/cfb 0 2024-09-16T02:05:56.086 INFO:tasks.workunit.client.1.smithi165.stdout:2/740: getdents df/d10/d1a/d2d 0 2024-09-16T02:05:56.086 INFO:tasks.workunit.client.1.smithi165.stdout:7/662: stat d0/d4b/d63/c95 0 2024-09-16T02:05:56.090 INFO:tasks.workunit.client.1.smithi165.stdout:4/614: mknod d4/dc/d20/d4e/cc5 0 2024-09-16T02:05:56.092 INFO:tasks.workunit.client.1.smithi165.stdout:0/637: mknod d0/d1e/d39/d48/d5f/d96/da4/cd6 0 2024-09-16T02:05:56.092 INFO:tasks.workunit.client.1.smithi165.stdout:4/615: write d4/dc/d28/d2b/d42/d99/fb6 [865343,119363] 0 2024-09-16T02:05:56.092 INFO:tasks.workunit.client.1.smithi165.stdout:6/668: getdents d7/d1f 0 2024-09-16T02:05:56.093 INFO:tasks.workunit.client.1.smithi165.stdout:7/663: mkdir d0/d3d/dd5 0 2024-09-16T02:05:56.094 INFO:tasks.workunit.client.1.smithi165.stdout:3/754: link da/d17/de5/d104/d2c/d2d/lf5 da/d57/d8d/d97/l10e 0 2024-09-16T02:05:56.096 INFO:tasks.workunit.client.1.smithi165.stdout:0/638: mknod d0/d61/cd7 0 2024-09-16T02:05:56.096 INFO:tasks.workunit.client.1.smithi165.stdout:8/708: mkdir dd/d11/d14/d70/d7b/df2/dfc 0 2024-09-16T02:05:56.098 INFO:tasks.workunit.client.1.smithi165.stdout:3/755: write da/d17/dcc/f21 [863050,90156] 0 2024-09-16T02:05:56.098 INFO:tasks.workunit.client.1.smithi165.stdout:1/767: link d1/d19/d4d/f81 d1/dd/d11/ff5 0 2024-09-16T02:05:56.100 INFO:tasks.workunit.client.1.smithi165.stdout:8/709: stat dd/d11/d38/c3a 0 2024-09-16T02:05:56.101 INFO:tasks.workunit.client.1.smithi165.stdout:4/616: creat d4/dc0/fc6 x:0 0 0 2024-09-16T02:05:56.102 INFO:tasks.workunit.client.1.smithi165.stdout:5/690: dwrite de/d19/f25 [4194304,4194304] 0 2024-09-16T02:05:56.104 INFO:tasks.workunit.client.1.smithi165.stdout:1/768: read d1/dd/f14 [2824653,99537] 0 2024-09-16T02:05:56.105 INFO:tasks.workunit.client.1.smithi165.stdout:3/756: fsync da/d17/f5b 0 2024-09-16T02:05:56.106 INFO:tasks.workunit.client.1.smithi165.stdout:1/769: write d1/d22/f2c [1196039,86686] 0 2024-09-16T02:05:56.109 INFO:tasks.workunit.client.1.smithi165.stdout:3/757: dread - da/d20/d26/ff8 zero size 2024-09-16T02:05:56.113 INFO:tasks.workunit.client.1.smithi165.stdout:4/617: getdents d4/dc/d20/dc2 0 2024-09-16T02:05:56.114 INFO:tasks.workunit.client.1.smithi165.stdout:1/770: fsync d1/d19/d24/d97/fea 0 2024-09-16T02:05:56.116 INFO:tasks.workunit.client.1.smithi165.stdout:2/741: dwrite df/d10/d1a/d2d/dd1/f7c [0,4194304] 0 2024-09-16T02:05:56.116 INFO:tasks.workunit.client.1.smithi165.stdout:9/752: dread d7/d14/f24 [0,4194304] 0 2024-09-16T02:05:56.116 INFO:tasks.workunit.client.1.smithi165.stdout:8/710: creat dd/ffd x:0 0 0 2024-09-16T02:05:56.116 INFO:tasks.workunit.client.1.smithi165.stdout:0/639: link d0/d1e/d39/d48/d45/c5d d0/d47/cd8 0 2024-09-16T02:05:56.119 INFO:tasks.workunit.client.0.smithi110.stdout:3/212: write d8/dc/d1b/d1c/f1f [3975755,48261] 0 2024-09-16T02:05:56.119 INFO:tasks.workunit.client.0.smithi110.stdout:6/383: creat d0/d2/dc/d16/f72 x:0 0 0 2024-09-16T02:05:56.120 INFO:tasks.workunit.client.0.smithi110.stdout:4/321: mknod d4/d8/d17/d23/d61/c63 0 2024-09-16T02:05:56.121 INFO:tasks.workunit.client.0.smithi110.stdout:4/322: write d4/d12/d18/f34 [1780837,55105] 0 2024-09-16T02:05:56.123 INFO:tasks.workunit.client.1.smithi165.stdout:6/669: dwrite d7/dc/d3b/d3a/d3d/d5d/d87/fb9 [0,4194304] 0 2024-09-16T02:05:56.124 INFO:tasks.workunit.client.0.smithi110.stdout:4/323: write d4/d8/d31/d36/f3a [67962,118522] 0 2024-09-16T02:05:56.125 INFO:tasks.workunit.client.0.smithi110.stdout:4/324: readlink d4/d8/d31/l3f 0 2024-09-16T02:05:56.128 INFO:tasks.workunit.client.1.smithi165.stdout:1/771: rename d1/d32 to d1/d6b/df6 0 2024-09-16T02:05:56.129 INFO:tasks.workunit.client.1.smithi165.stdout:7/664: dread d0/d2c/f2e [0,4194304] 0 2024-09-16T02:05:56.130 INFO:tasks.workunit.client.1.smithi165.stdout:8/711: creat dd/d11/d14/d70/d7b/ffe x:0 0 0 2024-09-16T02:05:56.131 INFO:tasks.workunit.client.1.smithi165.stdout:5/691: truncate de/d19/d1c/d49/da5/db1/fc9 632651 0 2024-09-16T02:05:56.131 INFO:tasks.workunit.client.1.smithi165.stdout:2/742: dwrite df/d23/d28/f32 [0,4194304] 0 2024-09-16T02:05:56.132 INFO:tasks.workunit.client.1.smithi165.stdout:6/670: write d7/dc/df/d1a/d4d/d90/fb6 [191571,42763] 0 2024-09-16T02:05:56.134 INFO:tasks.workunit.client.1.smithi165.stdout:0/640: rename d0/d1e/d39/d48/d74/l98 to d0/d1e/d20/d28/da7/ld9 0 2024-09-16T02:05:56.134 INFO:tasks.workunit.client.1.smithi165.stdout:5/692: write de/d21/d26/d3a/f3c [596875,52013] 0 2024-09-16T02:05:56.136 INFO:tasks.workunit.client.1.smithi165.stdout:1/772: symlink d1/dd/d11/d33/d3f/d6c/dde/lf7 0 2024-09-16T02:05:56.138 INFO:tasks.workunit.client.1.smithi165.stdout:2/743: read - df/d10/d1a/d2d/dd1/d79/d98/fe0 zero size 2024-09-16T02:05:56.138 INFO:tasks.workunit.client.1.smithi165.stdout:8/712: creat dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/fff x:0 0 0 2024-09-16T02:05:56.140 INFO:tasks.workunit.client.1.smithi165.stdout:6/671: write d7/dc/df/d1a/d4d/d5f/f6e [3501028,86018] 0 2024-09-16T02:05:56.140 INFO:tasks.workunit.client.1.smithi165.stdout:8/713: chown dd/d11/daa/lb5 4876 1 2024-09-16T02:05:56.140 INFO:tasks.workunit.client.1.smithi165.stdout:4/618: getdents d4/dc/d20/d67 0 2024-09-16T02:05:56.142 INFO:tasks.workunit.client.1.smithi165.stdout:7/665: rename d0/fd1 to d0/d4b/db4/dba/fd6 0 2024-09-16T02:05:56.144 INFO:tasks.workunit.client.1.smithi165.stdout:1/773: mknod d1/d19/d24/cf8 0 2024-09-16T02:05:56.145 INFO:tasks.workunit.client.1.smithi165.stdout:4/619: fdatasync d4/dc/d28/f5f 0 2024-09-16T02:05:56.145 INFO:tasks.workunit.client.1.smithi165.stdout:8/714: write dd/d11/d14/f40 [1653133,75583] 0 2024-09-16T02:05:56.147 INFO:tasks.workunit.client.1.smithi165.stdout:9/753: dread d7/d32/d38/d58/d99/f9c [0,4194304] 0 2024-09-16T02:05:56.147 INFO:tasks.workunit.client.1.smithi165.stdout:0/641: rename d0/d1e/d20/d28/f68 to d0/d2a/fda 0 2024-09-16T02:05:56.147 INFO:tasks.workunit.client.0.smithi110.stdout:3/213: mkdir d8/d48 0 2024-09-16T02:05:56.148 INFO:tasks.workunit.client.0.smithi110.stdout:6/384: dwrite d0/d2/dc/f41 [4194304,4194304] 0 2024-09-16T02:05:56.148 INFO:tasks.workunit.client.0.smithi110.stdout:4/325: creat d4/d8/d31/d36/f64 x:0 0 0 2024-09-16T02:05:56.148 INFO:tasks.workunit.client.1.smithi165.stdout:1/774: fdatasync d1/dd/d11/d46/feb 0 2024-09-16T02:05:56.149 INFO:tasks.workunit.client.0.smithi110.stdout:6/385: fdatasync d0/d2/d5/f52 0 2024-09-16T02:05:56.149 INFO:tasks.workunit.client.1.smithi165.stdout:7/666: dread d0/df/f27 [0,4194304] 0 2024-09-16T02:05:56.152 INFO:tasks.workunit.client.0.smithi110.stdout:4/326: symlink d4/l65 0 2024-09-16T02:05:56.153 INFO:tasks.workunit.client.1.smithi165.stdout:3/758: dread da/f9d [0,4194304] 0 2024-09-16T02:05:56.155 INFO:tasks.workunit.client.0.smithi110.stdout:3/214: creat d8/dc/d1b/d36/d3b/f49 x:0 0 0 2024-09-16T02:05:56.155 INFO:tasks.workunit.client.0.smithi110.stdout:3/215: chown d8/dc/l2f 127207696 1 2024-09-16T02:05:56.157 INFO:tasks.workunit.client.0.smithi110.stdout:6/386: creat d0/d29/d2a/d2f/f73 x:0 0 0 2024-09-16T02:05:56.159 INFO:tasks.workunit.client.1.smithi165.stdout:8/715: unlink dd/d11/d14/d3f/d25/d36/d81/dd2/ff9 0 2024-09-16T02:05:56.160 INFO:tasks.workunit.client.1.smithi165.stdout:5/693: dread de/d19/d1c/d84/f96 [0,4194304] 0 2024-09-16T02:05:56.161 INFO:tasks.workunit.client.1.smithi165.stdout:5/694: dread - de/d19/d1c/fdd zero size 2024-09-16T02:05:56.161 INFO:tasks.workunit.client.0.smithi110.stdout:6/387: dread d0/d2/d5/d1e/f44 [0,4194304] 0 2024-09-16T02:05:56.162 INFO:tasks.workunit.client.1.smithi165.stdout:5/695: write de/d19/d67/d74/f9e [81767,80477] 0 2024-09-16T02:05:56.167 INFO:tasks.workunit.client.1.smithi165.stdout:6/672: dread d7/dc/d3b/d3a/d3d/d5d/d73/d82/f89 [0,4194304] 0 2024-09-16T02:05:56.167 INFO:tasks.workunit.client.1.smithi165.stdout:6/673: chown d7/d1f/l54 816120295 1 2024-09-16T02:05:56.169 INFO:tasks.workunit.client.1.smithi165.stdout:5/696: dwrite de/d21/fe4 [0,4194304] 0 2024-09-16T02:05:56.169 INFO:tasks.workunit.client.1.smithi165.stdout:4/620: rename d4/dc/fe to d4/dc/d20/d4e/d73/fc7 0 2024-09-16T02:05:56.171 INFO:tasks.workunit.client.0.smithi110.stdout:6/388: creat d0/d2/d5/d1e/d48/f74 x:0 0 0 2024-09-16T02:05:56.174 INFO:tasks.workunit.client.1.smithi165.stdout:2/744: truncate df/d23/f50 2878295 0 2024-09-16T02:05:56.175 INFO:tasks.workunit.client.1.smithi165.stdout:9/754: write d7/d1f/d27/f3e [545793,129575] 0 2024-09-16T02:05:56.176 INFO:tasks.workunit.client.0.smithi110.stdout:6/389: mkdir d0/d2/d57/d75 0 2024-09-16T02:05:56.178 INFO:tasks.workunit.client.1.smithi165.stdout:0/642: write d0/d1e/d39/f4f [622614,74660] 0 2024-09-16T02:05:56.179 INFO:tasks.workunit.client.1.smithi165.stdout:6/674: fdatasync d7/d17/f69 0 2024-09-16T02:05:56.180 INFO:tasks.workunit.client.1.smithi165.stdout:0/643: chown d0/d1e/d20/d28/l41 425264 1 2024-09-16T02:05:56.181 INFO:tasks.workunit.client.0.smithi110.stdout:6/390: dread d0/d29/d2a/f37 [0,4194304] 0 2024-09-16T02:05:56.183 INFO:tasks.workunit.client.1.smithi165.stdout:3/759: rename da/d17/de5/d104/d2c/d2d/c45 to da/d17/de5/d104/d2c/d2d/d6c/def/c10f 0 2024-09-16T02:05:56.183 INFO:tasks.workunit.client.0.smithi110.stdout:4/327: write d4/d8/d17/d23/d35/f4b [1227873,34893] 0 2024-09-16T02:05:56.184 INFO:tasks.workunit.client.1.smithi165.stdout:4/621: symlink d4/dc/d28/d3b/lc8 0 2024-09-16T02:05:56.186 INFO:tasks.workunit.client.0.smithi110.stdout:6/391: mknod d0/d2/dc/d16/c76 0 2024-09-16T02:05:56.186 INFO:tasks.workunit.client.1.smithi165.stdout:0/644: dwrite d0/d1e/d39/d48/f75 [0,4194304] 0 2024-09-16T02:05:56.187 INFO:tasks.workunit.client.1.smithi165.stdout:0/645: chown d0/f2e 60589968 1 2024-09-16T02:05:56.189 INFO:tasks.workunit.client.0.smithi110.stdout:6/392: symlink d0/d29/d2a/l77 0 2024-09-16T02:05:56.190 INFO:tasks.workunit.client.0.smithi110.stdout:6/393: chown d0/d2/d5/d55 2 1 2024-09-16T02:05:56.190 INFO:tasks.workunit.client.1.smithi165.stdout:8/716: write dd/d11/d14/d3f/d72/fa5 [444231,18733] 0 2024-09-16T02:05:56.191 INFO:tasks.workunit.client.1.smithi165.stdout:2/745: unlink df/l63 0 2024-09-16T02:05:56.193 INFO:tasks.workunit.client.0.smithi110.stdout:4/328: creat d4/d54/f66 x:0 0 0 2024-09-16T02:05:56.194 INFO:tasks.workunit.client.1.smithi165.stdout:7/667: truncate d0/f19 8075264 0 2024-09-16T02:05:56.195 INFO:tasks.workunit.client.1.smithi165.stdout:9/755: truncate d7/d14/f24 1934309 0 2024-09-16T02:05:56.197 INFO:tasks.workunit.client.0.smithi110.stdout:4/329: truncate d4/fc 2204391 0 2024-09-16T02:05:56.200 INFO:tasks.workunit.client.0.smithi110.stdout:6/394: mknod d0/d2/d5/d55/c78 0 2024-09-16T02:05:56.200 INFO:tasks.workunit.client.0.smithi110.stdout:4/330: creat d4/d8/f67 x:0 0 0 2024-09-16T02:05:56.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/756: dwrite d7/fa [4194304,4194304] 0 2024-09-16T02:05:56.201 INFO:tasks.workunit.client.0.smithi110.stdout:4/331: write d4/d8/d31/d36/d4f/f58 [1246772,89811] 0 2024-09-16T02:05:56.207 INFO:tasks.workunit.client.1.smithi165.stdout:4/622: mkdir d4/dc/d18/d37/dc9 0 2024-09-16T02:05:56.208 INFO:tasks.workunit.client.1.smithi165.stdout:0/646: rmdir d0/d1e/d20/d28/d6d/daf 39 2024-09-16T02:05:56.209 INFO:tasks.workunit.client.1.smithi165.stdout:1/775: link d1/f79 d1/dd/d11/ff9 0 2024-09-16T02:05:56.210 INFO:tasks.workunit.client.1.smithi165.stdout:1/776: fsync d1/d6b/df6/fd1 0 2024-09-16T02:05:56.211 INFO:tasks.workunit.client.0.smithi110.stdout:4/332: rename d4/l5 to d4/d12/l68 0 2024-09-16T02:05:56.212 INFO:tasks.workunit.client.0.smithi110.stdout:4/333: dread - d4/d8/d31/d36/f62 zero size 2024-09-16T02:05:56.212 INFO:tasks.workunit.client.1.smithi165.stdout:8/717: truncate dd/d11/d14/d3f/d25/d36/d81/dd2/d53/f58 1685643 0 2024-09-16T02:05:56.213 INFO:tasks.workunit.client.1.smithi165.stdout:7/668: mkdir d0/d4b/db4/dba/dd7 0 2024-09-16T02:05:56.216 INFO:tasks.workunit.client.1.smithi165.stdout:4/623: creat d4/dc0/fca x:0 0 0 2024-09-16T02:05:56.218 INFO:tasks.workunit.client.0.smithi110.stdout:6/395: dread d0/d29/d2a/f2b [0,4194304] 0 2024-09-16T02:05:56.220 INFO:tasks.workunit.client.1.smithi165.stdout:1/777: unlink d1/dd/d11/d46/feb 0 2024-09-16T02:05:56.222 INFO:tasks.workunit.client.0.smithi110.stdout:6/396: mknod d0/d2/dc/d16/c79 0 2024-09-16T02:05:56.224 INFO:tasks.workunit.client.0.smithi110.stdout:6/397: write d0/d29/d2a/d2f/d49/f71 [773840,16081] 0 2024-09-16T02:05:56.224 INFO:tasks.workunit.client.1.smithi165.stdout:5/697: link de/d60/d65/c70 de/d21/d26/d3a/d54/ce5 0 2024-09-16T02:05:56.226 INFO:tasks.workunit.client.0.smithi110.stdout:6/398: fsync d0/d2/dc/f6d 0 2024-09-16T02:05:56.229 INFO:tasks.workunit.client.1.smithi165.stdout:1/778: rename d1/dd/d11/d33/d3f/d47/d7d/db3/dd2 to d1/dd/d11/d33/dfa 0 2024-09-16T02:05:56.230 INFO:tasks.workunit.client.1.smithi165.stdout:1/779: chown d1/d6b/df6/fd1 130644386 1 2024-09-16T02:05:56.230 INFO:tasks.workunit.client.1.smithi165.stdout:7/669: creat d0/dc3/fd8 x:0 0 0 2024-09-16T02:05:56.230 INFO:tasks.workunit.client.1.smithi165.stdout:6/675: truncate d7/dc/df/d1a/d4d/f4e 863254 0 2024-09-16T02:05:56.231 INFO:tasks.workunit.client.1.smithi165.stdout:6/676: write d7/d17/d75/d97/f9b [1749973,724] 0 2024-09-16T02:05:56.232 INFO:tasks.workunit.client.1.smithi165.stdout:5/698: mkdir de/d21/d26/de6 0 2024-09-16T02:05:56.233 INFO:tasks.workunit.client.1.smithi165.stdout:3/760: getdents da/d17/de5/d104/d2c/d2d/d6c/def 0 2024-09-16T02:05:56.234 INFO:tasks.workunit.client.1.smithi165.stdout:2/746: getdents df/d10/d1a/d2d/dd1 0 2024-09-16T02:05:56.235 INFO:tasks.workunit.client.0.smithi110.stdout:6/399: getdents d0 0 2024-09-16T02:05:56.236 INFO:tasks.workunit.client.0.smithi110.stdout:6/400: write d0/d2/d18/f59 [4052880,69393] 0 2024-09-16T02:05:56.239 INFO:tasks.workunit.client.1.smithi165.stdout:7/670: symlink d0/df/d7/ld9 0 2024-09-16T02:05:56.240 INFO:tasks.workunit.client.1.smithi165.stdout:9/757: link d7/d32/d38/d53/l6d d7/d32/d38/d68/lfa 0 2024-09-16T02:05:56.241 INFO:tasks.workunit.client.1.smithi165.stdout:9/758: stat d7/df/d37/d43/d88 0 2024-09-16T02:05:56.241 INFO:tasks.workunit.client.1.smithi165.stdout:6/677: mkdir d7/d1f/dbc 0 2024-09-16T02:05:56.242 INFO:tasks.workunit.client.1.smithi165.stdout:5/699: creat de/d21/d26/d3a/d6d/d95/dab/fe7 x:0 0 0 2024-09-16T02:05:56.243 INFO:tasks.workunit.client.1.smithi165.stdout:9/759: dread d7/d32/d85/d8a/fb2 [0,4194304] 0 2024-09-16T02:05:56.244 INFO:tasks.workunit.client.1.smithi165.stdout:3/761: mknod da/d17/de5/d104/d2c/c110 0 2024-09-16T02:05:56.245 INFO:tasks.workunit.client.1.smithi165.stdout:2/747: fsync df/d10/d1a/d2d/dd1/f9b 0 2024-09-16T02:05:56.246 INFO:tasks.workunit.client.1.smithi165.stdout:3/762: truncate da/d17/de5/d104/d2c/d10c/fcf 992640 0 2024-09-16T02:05:56.247 INFO:tasks.workunit.client.0.smithi110.stdout:6/401: dread d0/d2/dc/d16/f61 [0,4194304] 0 2024-09-16T02:05:56.247 INFO:tasks.workunit.client.1.smithi165.stdout:8/718: link dd/d34/l82 dd/l100 0 2024-09-16T02:05:56.249 INFO:tasks.workunit.client.1.smithi165.stdout:8/719: write dd/d11/d38/da6/ff6 [884091,4923] 0 2024-09-16T02:05:56.249 INFO:tasks.workunit.client.0.smithi110.stdout:6/402: write d0/d2/d5/d1e/d48/f74 [372908,125022] 0 2024-09-16T02:05:56.249 INFO:tasks.workunit.client.1.smithi165.stdout:7/671: mkdir d0/d4b/db4/dda 0 2024-09-16T02:05:56.250 INFO:tasks.workunit.client.1.smithi165.stdout:3/763: read da/d17/f5b [2187094,130226] 0 2024-09-16T02:05:56.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/672: write d0/df/d42/fa3 [497661,62544] 0 2024-09-16T02:05:56.252 INFO:tasks.workunit.client.1.smithi165.stdout:6/678: rename d7/dc/d3b/d3a/d3d/d5d/d87 to d7/dc/d3b/d3a/d3d/dbd 0 2024-09-16T02:05:56.255 INFO:tasks.workunit.client.1.smithi165.stdout:9/760: mkdir d7/d1f/d54/dfb 0 2024-09-16T02:05:56.257 INFO:tasks.workunit.client.1.smithi165.stdout:1/780: creat d1/d22/ffb x:0 0 0 2024-09-16T02:05:56.258 INFO:tasks.workunit.client.1.smithi165.stdout:8/720: fsync dd/d11/d14/d70/d7b/d9a/fcc 0 2024-09-16T02:05:56.259 INFO:tasks.workunit.client.1.smithi165.stdout:1/781: write d1/d6b/df6/f34 [2374958,28826] 0 2024-09-16T02:05:56.260 INFO:tasks.workunit.client.1.smithi165.stdout:6/679: dwrite d7/dc/df/d1a/f47 [0,4194304] 0 2024-09-16T02:05:56.261 INFO:tasks.workunit.client.1.smithi165.stdout:7/673: write d0/df/d33/f34 [17765,59622] 0 2024-09-16T02:05:56.262 INFO:tasks.workunit.client.1.smithi165.stdout:9/761: creat d7/df/d67/d92/d93/db6/ffc x:0 0 0 2024-09-16T02:05:56.262 INFO:tasks.workunit.client.1.smithi165.stdout:1/782: fdatasync d1/dd/d11/d33/f56 0 2024-09-16T02:05:56.268 INFO:tasks.workunit.client.1.smithi165.stdout:8/721: rename dd/d9e/lc2 to dd/d11/d14/d3f/d25/d36/d81/dd2/d89/l101 0 2024-09-16T02:05:56.269 INFO:tasks.workunit.client.1.smithi165.stdout:1/783: readlink d1/d22/l28 0 2024-09-16T02:05:56.270 INFO:tasks.workunit.client.0.smithi110.stdout:6/403: dwrite d0/d2/f3a [0,4194304] 0 2024-09-16T02:05:56.270 INFO:tasks.workunit.client.1.smithi165.stdout:9/762: dwrite d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:56.271 INFO:tasks.workunit.client.1.smithi165.stdout:5/700: dwrite de/d21/d26/d3a/f7b [0,4194304] 0 2024-09-16T02:05:56.272 INFO:tasks.workunit.client.1.smithi165.stdout:9/763: chown d7/d32/d85/d8a/fb2 33877841 1 2024-09-16T02:05:56.273 INFO:tasks.workunit.client.1.smithi165.stdout:3/764: write da/d20/d26/d6e/f73 [266614,50369] 0 2024-09-16T02:05:56.273 INFO:tasks.workunit.client.1.smithi165.stdout:6/680: mknod d7/dc/cbe 0 2024-09-16T02:05:56.275 INFO:tasks.workunit.client.1.smithi165.stdout:9/764: chown d7/d55/caa 417251840 1 2024-09-16T02:05:56.276 INFO:tasks.workunit.client.1.smithi165.stdout:5/701: write de/d19/d1c/d4d/f7e [3224263,67638] 0 2024-09-16T02:05:56.280 INFO:tasks.workunit.client.1.smithi165.stdout:7/674: truncate d0/d2c/f2e 1049865 0 2024-09-16T02:05:56.280 INFO:tasks.workunit.client.1.smithi165.stdout:3/765: write da/d20/d26/fa7 [4298034,68248] 0 2024-09-16T02:05:56.283 INFO:tasks.workunit.client.1.smithi165.stdout:1/784: dread d1/dd/d11/d42/faf [0,4194304] 0 2024-09-16T02:05:56.284 INFO:tasks.workunit.client.1.smithi165.stdout:5/702: creat de/d21/fe8 x:0 0 0 2024-09-16T02:05:56.284 INFO:tasks.workunit.client.1.smithi165.stdout:3/766: dread - da/d17/de5/d104/d2c/d10c/d6b/f90 zero size 2024-09-16T02:05:56.285 INFO:tasks.workunit.client.1.smithi165.stdout:1/785: chown d1/dd/d11/d33/d3f/d6c 16755668 1 2024-09-16T02:05:56.285 INFO:tasks.workunit.client.1.smithi165.stdout:6/681: truncate d7/dc/df/d1a/d4d/d90/fb6 468271 0 2024-09-16T02:05:56.285 INFO:tasks.workunit.client.1.smithi165.stdout:7/675: rmdir d0/df/d33 39 2024-09-16T02:05:56.287 INFO:tasks.workunit.client.1.smithi165.stdout:9/765: chown d7/d32/d38/d53/d56/dca/dd2/fba 3022116 1 2024-09-16T02:05:56.289 INFO:tasks.workunit.client.1.smithi165.stdout:5/703: creat de/d19/d1c/d84/fe9 x:0 0 0 2024-09-16T02:05:56.292 INFO:tasks.workunit.client.1.smithi165.stdout:1/786: chown d1/dd/d11/d33/d3f/d59/cc4 115108 1 2024-09-16T02:05:56.292 INFO:tasks.workunit.client.1.smithi165.stdout:9/766: unlink d7/df/l94 0 2024-09-16T02:05:56.293 INFO:tasks.workunit.client.1.smithi165.stdout:5/704: write de/d19/d1c/d4d/f7a [878408,34467] 0 2024-09-16T02:05:56.294 INFO:tasks.workunit.client.1.smithi165.stdout:7/676: rename d0/df/d33/f90 to d0/df/d42/fdb 0 2024-09-16T02:05:56.295 INFO:tasks.workunit.client.1.smithi165.stdout:9/767: chown d7/df/d67/ff8 0 1 2024-09-16T02:05:56.298 INFO:tasks.workunit.client.1.smithi165.stdout:3/767: dwrite da/d17/d7a/d7d/fe7 [0,4194304] 0 2024-09-16T02:05:56.298 INFO:tasks.workunit.client.1.smithi165.stdout:7/677: read d0/df/d65/f6e [14406,10714] 0 2024-09-16T02:05:56.298 INFO:tasks.workunit.client.1.smithi165.stdout:5/705: mkdir de/d19/d1c/d49/da5/db1/dea 0 2024-09-16T02:05:56.301 INFO:tasks.workunit.client.1.smithi165.stdout:9/768: chown d7/d32/d38/d58/d99/ldc 9 1 2024-09-16T02:05:56.302 INFO:tasks.workunit.client.1.smithi165.stdout:1/787: link d1/dd/d11/d33/d67/lc0 d1/dd/d11/lfc 0 2024-09-16T02:05:56.302 INFO:tasks.workunit.client.1.smithi165.stdout:8/722: dwrite dd/d34/fd3 [0,4194304] 0 2024-09-16T02:05:56.303 INFO:tasks.workunit.client.1.smithi165.stdout:7/678: chown d0/d2c/l30 10918496 1 2024-09-16T02:05:56.304 INFO:tasks.workunit.client.1.smithi165.stdout:1/788: dread - d1/d19/d24/d97/fc2 zero size 2024-09-16T02:05:56.306 INFO:tasks.workunit.client.1.smithi165.stdout:7/679: chown d0/df/d7/l26 106221 1 2024-09-16T02:05:56.306 INFO:tasks.workunit.client.1.smithi165.stdout:3/768: rmdir da/d20/d26/d6e/df2 0 2024-09-16T02:05:56.309 INFO:tasks.workunit.client.1.smithi165.stdout:8/723: creat dd/d11/d14/def/f102 x:0 0 0 2024-09-16T02:05:56.309 INFO:tasks.workunit.client.1.smithi165.stdout:1/789: write d1/d19/d24/d30/d72/faa [929562,74359] 0 2024-09-16T02:05:56.310 INFO:tasks.workunit.client.1.smithi165.stdout:3/769: dread - da/d17/de5/d104/d2c/f36 zero size 2024-09-16T02:05:56.313 INFO:tasks.workunit.client.1.smithi165.stdout:9/769: dread d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:56.314 INFO:tasks.workunit.client.1.smithi165.stdout:8/724: chown dd/d11/d14/d3f/c77 250084 1 2024-09-16T02:05:56.315 INFO:tasks.workunit.client.1.smithi165.stdout:1/790: creat d1/d19/d24/d30/d72/ffd x:0 0 0 2024-09-16T02:05:56.315 INFO:tasks.workunit.client.1.smithi165.stdout:5/706: dread f6 [0,4194304] 0 2024-09-16T02:05:56.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/770: stat d7/d32/d38/d53/d56/d95/dec 0 2024-09-16T02:05:56.317 INFO:tasks.workunit.client.1.smithi165.stdout:7/680: rename d0/df/d7/d67 to d0/d3d/d9f/ddc 0 2024-09-16T02:05:56.318 INFO:tasks.workunit.client.1.smithi165.stdout:3/770: creat da/d20/d26/d8c/dd9/f111 x:0 0 0 2024-09-16T02:05:56.319 INFO:tasks.workunit.client.1.smithi165.stdout:8/725: symlink dd/d34/l103 0 2024-09-16T02:05:56.319 INFO:tasks.workunit.client.1.smithi165.stdout:8/726: readlink dd/d11/d14/l52 0 2024-09-16T02:05:56.322 INFO:tasks.workunit.client.1.smithi165.stdout:9/771: mknod d7/d1f/d27/d49/cfd 0 2024-09-16T02:05:56.324 INFO:tasks.workunit.client.1.smithi165.stdout:7/681: rename d0/df/d83/d84 to d0/d3d/d9f/ddc/da8/ddd 0 2024-09-16T02:05:56.325 INFO:tasks.workunit.client.1.smithi165.stdout:5/707: truncate f7 2157260 0 2024-09-16T02:05:56.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/727: dwrite dd/d11/daa/fb2 [0,4194304] 0 2024-09-16T02:05:56.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/772: rmdir d7/d1f/ddb 39 2024-09-16T02:05:56.329 INFO:tasks.workunit.client.1.smithi165.stdout:9/773: chown d7/df/d67/d92 156 1 2024-09-16T02:05:56.330 INFO:tasks.workunit.client.1.smithi165.stdout:9/774: fsync d7/df/d37/fd6 0 2024-09-16T02:05:56.330 INFO:tasks.workunit.client.1.smithi165.stdout:7/682: unlink d0/df/d33/d2a/f54 0 2024-09-16T02:05:56.331 INFO:tasks.workunit.client.1.smithi165.stdout:9/775: chown d7/df/l48 46271 1 2024-09-16T02:05:56.331 INFO:tasks.workunit.client.1.smithi165.stdout:3/771: dwrite da/d57/d8d/d97/f76 [0,4194304] 0 2024-09-16T02:05:56.332 INFO:tasks.workunit.client.1.smithi165.stdout:8/728: mknod dd/d11/d38/da6/c104 0 2024-09-16T02:05:56.333 INFO:tasks.workunit.client.1.smithi165.stdout:3/772: dread - da/d57/f7c zero size 2024-09-16T02:05:56.334 INFO:tasks.workunit.client.1.smithi165.stdout:8/729: write dd/d11/d38/d74/d7d/fca [228350,34532] 0 2024-09-16T02:05:56.335 INFO:tasks.workunit.client.1.smithi165.stdout:8/730: read - dd/ffd zero size 2024-09-16T02:05:56.338 INFO:tasks.workunit.client.1.smithi165.stdout:3/773: chown da/d17/dcc/lcb 298 1 2024-09-16T02:05:56.341 INFO:tasks.workunit.client.1.smithi165.stdout:8/731: creat dd/d11/d14/d3f/db3/dbe/f105 x:0 0 0 2024-09-16T02:05:56.344 INFO:tasks.workunit.client.1.smithi165.stdout:9/776: creat d7/d1f/d27/ffe x:0 0 0 2024-09-16T02:05:56.345 INFO:tasks.workunit.client.1.smithi165.stdout:8/732: fdatasync dd/d11/d14/d70/d7b/f84 0 2024-09-16T02:05:56.345 INFO:tasks.workunit.client.1.smithi165.stdout:1/791: write d1/dd/f14 [3600780,101033] 0 2024-09-16T02:05:56.348 INFO:tasks.workunit.client.1.smithi165.stdout:9/777: truncate d7/df/d37/fa9 333312 0 2024-09-16T02:05:56.348 INFO:tasks.workunit.client.1.smithi165.stdout:3/774: dwrite da/d17/de5/d104/d2c/d10c/fcf [0,4194304] 0 2024-09-16T02:05:56.349 INFO:tasks.workunit.client.1.smithi165.stdout:8/733: creat dd/d7f/f106 x:0 0 0 2024-09-16T02:05:56.350 INFO:tasks.workunit.client.1.smithi165.stdout:1/792: symlink d1/dd/d11/d33/d3f/d6c/lfe 0 2024-09-16T02:05:56.350 INFO:tasks.workunit.client.1.smithi165.stdout:3/775: write da/d17/dcc/f3c [5085286,85877] 0 2024-09-16T02:05:56.353 INFO:tasks.workunit.client.1.smithi165.stdout:7/683: write d0/d4b/fb9 [510443,47559] 0 2024-09-16T02:05:56.355 INFO:tasks.workunit.client.1.smithi165.stdout:3/776: creat da/d17/de5/d104/d2c/d10c/f112 x:0 0 0 2024-09-16T02:05:56.360 INFO:tasks.workunit.client.1.smithi165.stdout:3/777: chown da/d17/de5/d104/d2c/d10c/fcf 75 1 2024-09-16T02:05:56.363 INFO:tasks.workunit.client.1.smithi165.stdout:7/684: dwrite d0/d4b/fb9 [0,4194304] 0 2024-09-16T02:05:56.363 INFO:tasks.workunit.client.1.smithi165.stdout:1/793: write d1/dd/d11/d33/f3b [2510568,4038] 0 2024-09-16T02:05:56.365 INFO:tasks.workunit.client.1.smithi165.stdout:3/778: creat da/d17/de5/f113 x:0 0 0 2024-09-16T02:05:56.365 INFO:tasks.workunit.client.1.smithi165.stdout:1/794: mknod d1/dd/d11/d33/cff 0 2024-09-16T02:05:56.366 INFO:tasks.workunit.client.1.smithi165.stdout:7/685: mkdir d0/d2c/d85/d8c/dde 0 2024-09-16T02:05:56.368 INFO:tasks.workunit.client.1.smithi165.stdout:1/795: mknod d1/d6b/c100 0 2024-09-16T02:05:56.371 INFO:tasks.workunit.client.1.smithi165.stdout:7/686: mknod d0/d4b/db4/dba/dc4/cdf 0 2024-09-16T02:05:56.373 INFO:tasks.workunit.client.1.smithi165.stdout:7/687: mknod d0/d2c/dc8/ce0 0 2024-09-16T02:05:56.376 INFO:tasks.workunit.client.1.smithi165.stdout:7/688: rename d0/df/d33/c35 to d0/d4b/db4/ce1 0 2024-09-16T02:05:56.377 INFO:tasks.workunit.client.1.smithi165.stdout:7/689: fsync d0/df/d42/fa3 0 2024-09-16T02:05:56.378 INFO:tasks.workunit.client.1.smithi165.stdout:9/778: dread d7/df/f1c [0,4194304] 0 2024-09-16T02:05:56.379 INFO:tasks.workunit.client.1.smithi165.stdout:7/690: chown d0/d3d/lc6 3204980 1 2024-09-16T02:05:56.379 INFO:tasks.workunit.client.1.smithi165.stdout:7/691: dread - d0/d4b/db4/fce zero size 2024-09-16T02:05:56.382 INFO:tasks.workunit.client.1.smithi165.stdout:3/779: write da/d20/d26/f4f [3903694,184] 0 2024-09-16T02:05:56.385 INFO:tasks.workunit.client.1.smithi165.stdout:3/780: write da/d17/fa3 [2224200,56918] 0 2024-09-16T02:05:56.385 INFO:tasks.workunit.client.1.smithi165.stdout:7/692: write d0/f3 [3499692,7499] 0 2024-09-16T02:05:56.386 INFO:tasks.workunit.client.1.smithi165.stdout:9/779: dwrite d7/f35 [0,4194304] 0 2024-09-16T02:05:56.389 INFO:tasks.workunit.client.1.smithi165.stdout:3/781: truncate da/d17/d7a/fee 814896 0 2024-09-16T02:05:56.390 INFO:tasks.workunit.client.1.smithi165.stdout:9/780: fsync f2 0 2024-09-16T02:05:56.390 INFO:tasks.workunit.client.1.smithi165.stdout:1/796: dwrite d1/d19/d4d/f81 [0,4194304] 0 2024-09-16T02:05:56.391 INFO:tasks.workunit.client.1.smithi165.stdout:7/693: truncate d0/d2c/f2e 1741755 0 2024-09-16T02:05:56.391 INFO:tasks.workunit.client.1.smithi165.stdout:9/781: fdatasync d7/d55/f66 0 2024-09-16T02:05:56.392 INFO:tasks.workunit.client.1.smithi165.stdout:3/782: chown da/d57/d8d/d97/lc7 162 1 2024-09-16T02:05:56.393 INFO:tasks.workunit.client.1.smithi165.stdout:9/782: write d7/d1f/d27/ffe [353207,50748] 0 2024-09-16T02:05:56.394 INFO:tasks.workunit.client.1.smithi165.stdout:7/694: chown d0/df/d42/fa5 12 1 2024-09-16T02:05:56.395 INFO:tasks.workunit.client.1.smithi165.stdout:0/647: sync 2024-09-16T02:05:56.395 INFO:tasks.workunit.client.1.smithi165.stdout:3/783: unlink da/d17/de5/d104/d2c/c110 0 2024-09-16T02:05:56.396 INFO:tasks.workunit.client.1.smithi165.stdout:0/648: stat d0/d1e/d39/d48/d45 0 2024-09-16T02:05:56.397 INFO:tasks.workunit.client.1.smithi165.stdout:9/783: mkdir d7/d32/d4a/dff 0 2024-09-16T02:05:56.397 INFO:tasks.workunit.client.1.smithi165.stdout:3/784: chown da/d17/d7a/f96 0 1 2024-09-16T02:05:56.398 INFO:tasks.workunit.client.1.smithi165.stdout:1/797: symlink d1/dd/d11/d33/d3f/l101 0 2024-09-16T02:05:56.399 INFO:tasks.workunit.client.1.smithi165.stdout:7/695: creat d0/df/d33/dc2/fe2 x:0 0 0 2024-09-16T02:05:56.400 INFO:tasks.workunit.client.1.smithi165.stdout:3/785: dread - da/d17/de5/d104/d2c/d2d/fdc zero size 2024-09-16T02:05:56.400 INFO:tasks.workunit.client.1.smithi165.stdout:9/784: truncate d7/df/d67/ff8 956598 0 2024-09-16T02:05:56.403 INFO:tasks.workunit.client.1.smithi165.stdout:1/798: mknod d1/dd/d11/d33/d3f/d6c/c102 0 2024-09-16T02:05:56.405 INFO:tasks.workunit.client.1.smithi165.stdout:3/786: creat da/d17/de5/d104/d2c/d2d/d6c/def/f114 x:0 0 0 2024-09-16T02:05:56.405 INFO:tasks.workunit.client.1.smithi165.stdout:9/785: unlink d7/d32/d38/d58/lac 0 2024-09-16T02:05:56.406 INFO:tasks.workunit.client.1.smithi165.stdout:1/799: chown d1/d22/c50 1072789 1 2024-09-16T02:05:56.408 INFO:tasks.workunit.client.1.smithi165.stdout:1/800: write d1/d6b/df6/fd5 [649558,4096] 0 2024-09-16T02:05:56.409 INFO:tasks.workunit.client.1.smithi165.stdout:7/696: getdents d0/d2c 0 2024-09-16T02:05:56.411 INFO:tasks.workunit.client.1.smithi165.stdout:7/697: symlink d0/d2c/le3 0 2024-09-16T02:05:56.411 INFO:tasks.workunit.client.1.smithi165.stdout:9/786: dread d7/d32/d85/d8a/fb1 [0,4194304] 0 2024-09-16T02:05:56.412 INFO:tasks.workunit.client.1.smithi165.stdout:1/801: creat d1/dd/f103 x:0 0 0 2024-09-16T02:05:56.413 INFO:tasks.workunit.client.1.smithi165.stdout:1/802: dread - d1/d68/dca/fec zero size 2024-09-16T02:05:56.414 INFO:tasks.workunit.client.1.smithi165.stdout:9/787: truncate d7/d32/d85/d8a/fc2 903700 0 2024-09-16T02:05:56.414 INFO:tasks.workunit.client.1.smithi165.stdout:7/698: creat d0/d3d/d9f/ddc/da8/ddd/fe4 x:0 0 0 2024-09-16T02:05:56.416 INFO:tasks.workunit.client.1.smithi165.stdout:9/788: unlink d7/df/c3f 0 2024-09-16T02:05:56.416 INFO:tasks.workunit.client.1.smithi165.stdout:7/699: getdents d0/d3d/dd5 0 2024-09-16T02:05:56.418 INFO:tasks.workunit.client.1.smithi165.stdout:9/789: unlink d7/d32/d38/d58/d99/f9c 0 2024-09-16T02:05:56.421 INFO:tasks.workunit.client.1.smithi165.stdout:0/649: dread d0/d1e/f2c [0,4194304] 0 2024-09-16T02:05:56.421 INFO:tasks.workunit.client.1.smithi165.stdout:7/700: rename d0/d3d/f4f to d0/d4b/db4/dda/fe5 0 2024-09-16T02:05:56.423 INFO:tasks.workunit.client.1.smithi165.stdout:9/790: rename d7/d32/d38/d53/d56/d95/lc0 to d7/d14/d7a/de2/l100 0 2024-09-16T02:05:56.424 INFO:tasks.workunit.client.1.smithi165.stdout:9/791: chown d7/df/d37/fde 17 1 2024-09-16T02:05:56.425 INFO:tasks.workunit.client.1.smithi165.stdout:0/650: dread d0/d1e/d39/d48/f38 [0,4194304] 0 2024-09-16T02:05:56.426 INFO:tasks.workunit.client.1.smithi165.stdout:7/701: mkdir d0/d3d/d9f/ddc/dcb/de6 0 2024-09-16T02:05:56.435 INFO:tasks.workunit.client.1.smithi165.stdout:0/651: dwrite d0/d1e/d39/f4f [0,4194304] 0 2024-09-16T02:05:56.438 INFO:tasks.workunit.client.1.smithi165.stdout:3/787: dwrite da/d17/de5/d104/d2c/f36 [0,4194304] 0 2024-09-16T02:05:56.439 INFO:tasks.workunit.client.1.smithi165.stdout:7/702: dwrite d0/d4b/fb9 [0,4194304] 0 2024-09-16T02:05:56.440 INFO:tasks.workunit.client.1.smithi165.stdout:3/788: chown da/d17/de5/f103 155336 1 2024-09-16T02:05:56.440 INFO:tasks.workunit.client.1.smithi165.stdout:0/652: unlink d0/d1e/f2c 0 2024-09-16T02:05:56.446 INFO:tasks.workunit.client.1.smithi165.stdout:9/792: dread d7/d32/d38/d58/f79 [0,4194304] 0 2024-09-16T02:05:56.450 INFO:tasks.workunit.client.1.smithi165.stdout:9/793: write d7/d32/f64 [790093,94267] 0 2024-09-16T02:05:56.452 INFO:tasks.workunit.client.1.smithi165.stdout:7/703: dwrite d0/df/d33/dc2/fc7 [0,4194304] 0 2024-09-16T02:05:56.455 INFO:tasks.workunit.client.1.smithi165.stdout:3/789: write da/d17/de5/d104/d2c/f4e [5366261,25194] 0 2024-09-16T02:05:56.457 INFO:tasks.workunit.client.1.smithi165.stdout:9/794: truncate d7/d14/f6c 3201969 0 2024-09-16T02:05:56.458 INFO:tasks.workunit.client.1.smithi165.stdout:7/704: creat d0/d3d/dd5/fe7 x:0 0 0 2024-09-16T02:05:56.462 INFO:tasks.workunit.client.1.smithi165.stdout:3/790: dwrite da/d17/d7a/d7d/da8/ff1 [0,4194304] 0 2024-09-16T02:05:56.475 INFO:tasks.workunit.client.1.smithi165.stdout:0/653: getdents d0/d1e/d39/d48/d74 0 2024-09-16T02:05:56.476 INFO:tasks.workunit.client.1.smithi165.stdout:0/654: readlink d0/d1e/d39/d48/d45/l40 0 2024-09-16T02:05:56.480 INFO:tasks.workunit.client.1.smithi165.stdout:0/655: fsync d0/d1e/d39/f6c 0 2024-09-16T02:05:56.481 INFO:tasks.workunit.client.1.smithi165.stdout:7/705: dread d0/df/d7/f7e [0,4194304] 0 2024-09-16T02:05:56.483 INFO:tasks.workunit.client.1.smithi165.stdout:7/706: readlink d0/df/d33/d2a/dd2/lbb 0 2024-09-16T02:05:56.485 INFO:tasks.workunit.client.1.smithi165.stdout:7/707: write d0/df/d7/f23 [301133,37061] 0 2024-09-16T02:05:56.485 INFO:tasks.workunit.client.1.smithi165.stdout:9/795: dread d7/d55/f66 [0,4194304] 0 2024-09-16T02:05:56.485 INFO:tasks.workunit.client.1.smithi165.stdout:3/791: dwrite da/f9d [0,4194304] 0 2024-09-16T02:05:56.490 INFO:tasks.workunit.client.1.smithi165.stdout:9/796: fsync d7/d32/d38/d53/ff0 0 2024-09-16T02:05:56.492 INFO:tasks.workunit.client.1.smithi165.stdout:7/708: dread d0/d4b/fb9 [0,4194304] 0 2024-09-16T02:05:56.493 INFO:tasks.workunit.client.1.smithi165.stdout:3/792: link da/fd7 da/f115 0 2024-09-16T02:05:56.494 INFO:tasks.workunit.client.1.smithi165.stdout:9/797: unlink d7/d1f/l6f 0 2024-09-16T02:05:56.495 INFO:tasks.workunit.client.1.smithi165.stdout:3/793: rename da/d17/d7a/fee to da/d17/d7a/dab/f116 0 2024-09-16T02:05:56.496 INFO:tasks.workunit.client.1.smithi165.stdout:0/656: dread d0/d2a/d70/f8e [0,4194304] 0 2024-09-16T02:05:56.497 INFO:tasks.workunit.client.1.smithi165.stdout:3/794: fsync da/d17/de5/d104/d2c/db7/fc1 0 2024-09-16T02:05:56.497 INFO:tasks.workunit.client.1.smithi165.stdout:9/798: creat d7/d14/d7a/f101 x:0 0 0 2024-09-16T02:05:56.497 INFO:tasks.workunit.client.1.smithi165.stdout:7/709: creat d0/df/d83/fe8 x:0 0 0 2024-09-16T02:05:56.498 INFO:tasks.workunit.client.1.smithi165.stdout:2/748: sync 2024-09-16T02:05:56.498 INFO:tasks.workunit.client.1.smithi165.stdout:4/624: sync 2024-09-16T02:05:56.499 INFO:tasks.workunit.client.1.smithi165.stdout:0/657: mknod d0/d1e/d39/d48/d5f/d96/dac/cdb 0 2024-09-16T02:05:56.500 INFO:tasks.workunit.client.1.smithi165.stdout:7/710: mkdir d0/dc3/de9 0 2024-09-16T02:05:56.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/625: chown d4/dc/d18/f23 944 1 2024-09-16T02:05:56.500 INFO:tasks.workunit.client.1.smithi165.stdout:3/795: write da/d17/de5/d104/d2c/d2d/fbd [4620489,124401] 0 2024-09-16T02:05:56.501 INFO:tasks.workunit.client.1.smithi165.stdout:0/658: rmdir d0/d47 39 2024-09-16T02:05:56.505 INFO:tasks.workunit.client.1.smithi165.stdout:3/796: read - da/d20/d26/d8c/dd9/f111 zero size 2024-09-16T02:05:56.506 INFO:tasks.workunit.client.1.smithi165.stdout:7/711: mkdir d0/d2c/dc8/dea 0 2024-09-16T02:05:56.508 INFO:tasks.workunit.client.1.smithi165.stdout:9/799: dwrite d7/d1f/d27/d49/f5e [0,4194304] 0 2024-09-16T02:05:56.509 INFO:tasks.workunit.client.1.smithi165.stdout:2/749: rename df/d23/d28/d3b/d6d/l75 to df/d10/d1a/d2d/dd1/le1 0 2024-09-16T02:05:56.509 INFO:tasks.workunit.client.1.smithi165.stdout:3/797: stat da/d17/de5/d104/d2c/d10c/lc9 0 2024-09-16T02:05:56.510 INFO:tasks.workunit.client.1.smithi165.stdout:0/659: mknod d0/d1e/d39/d48/d5f/d96/da4/dbb/cdc 0 2024-09-16T02:05:56.512 INFO:tasks.workunit.client.1.smithi165.stdout:9/800: mkdir d7/d14/d80/d102 0 2024-09-16T02:05:56.513 INFO:tasks.workunit.client.1.smithi165.stdout:4/626: dwrite d4/dc/d28/d3b/f90 [0,4194304] 0 2024-09-16T02:05:56.515 INFO:tasks.workunit.client.1.smithi165.stdout:4/627: write d4/dc/d18/d37/d53/d64/d8b/f70 [1190629,98389] 0 2024-09-16T02:05:56.517 INFO:tasks.workunit.client.1.smithi165.stdout:7/712: link d0/df/d33/d2a/caa d0/d2c/d85/ceb 0 2024-09-16T02:05:56.519 INFO:tasks.workunit.client.1.smithi165.stdout:2/750: mknod df/d10/d1a/d68/ce2 0 2024-09-16T02:05:56.538 INFO:tasks.workunit.client.1.smithi165.stdout:3/798: dwrite da/d17/de5/d104/d2c/d2d/d6c/db5/fbb [0,4194304] 0 2024-09-16T02:05:56.538 INFO:tasks.workunit.client.1.smithi165.stdout:0/660: creat d0/d1e/d39/d48/d74/dc6/fdd x:0 0 0 2024-09-16T02:05:56.540 INFO:tasks.workunit.client.1.smithi165.stdout:7/713: mknod d0/d3d/d9f/dc5/cec 0 2024-09-16T02:05:56.541 INFO:tasks.workunit.client.1.smithi165.stdout:3/799: dread - da/d17/de5/d104/d2c/d10c/d9c/da6/f105 zero size 2024-09-16T02:05:56.543 INFO:tasks.workunit.client.1.smithi165.stdout:7/714: chown d0/dc3/fd8 0 1 2024-09-16T02:05:56.544 INFO:tasks.workunit.client.1.smithi165.stdout:0/661: symlink d0/d1e/d39/d48/d5f/d96/da4/dbb/lde 0 2024-09-16T02:05:56.545 INFO:tasks.workunit.client.1.smithi165.stdout:0/662: stat d0/fba 0 2024-09-16T02:05:56.545 INFO:tasks.workunit.client.1.smithi165.stdout:2/751: link df/d10/d1a/d2d/c5d df/d10/d1a/d2d/dd1/d79/db1/ce3 0 2024-09-16T02:05:56.547 INFO:tasks.workunit.client.1.smithi165.stdout:2/752: fdatasync df/d23/d28/f32 0 2024-09-16T02:05:56.547 INFO:tasks.workunit.client.1.smithi165.stdout:7/715: mknod d0/df/d42/ced 0 2024-09-16T02:05:56.547 INFO:tasks.workunit.client.1.smithi165.stdout:4/628: dwrite d4/dc/d18/f22 [0,4194304] 0 2024-09-16T02:05:56.549 INFO:tasks.workunit.client.1.smithi165.stdout:2/753: chown df/d23/lac 19 1 2024-09-16T02:05:56.550 INFO:tasks.workunit.client.1.smithi165.stdout:3/800: getdents da/d17/de5/d104/d2c/db7 0 2024-09-16T02:05:56.551 INFO:tasks.workunit.client.1.smithi165.stdout:4/629: creat d4/dc/d18/d37/d53/d64/fcb x:0 0 0 2024-09-16T02:05:56.557 INFO:tasks.workunit.client.1.smithi165.stdout:7/716: dwrite d0/d3d/d9f/fbe [0,4194304] 0 2024-09-16T02:05:56.561 INFO:tasks.workunit.client.1.smithi165.stdout:2/754: dwrite df/d23/d28/d3b/fa1 [0,4194304] 0 2024-09-16T02:05:56.563 INFO:tasks.workunit.client.1.smithi165.stdout:2/755: dread - df/d10/d1a/fd3 zero size 2024-09-16T02:05:56.564 INFO:tasks.workunit.client.1.smithi165.stdout:4/630: rename d4/dc/c25 to d4/dc/d28/ccc 0 2024-09-16T02:05:56.565 INFO:tasks.workunit.client.1.smithi165.stdout:3/801: dread da/d17/de5/d104/d2c/f74 [0,4194304] 0 2024-09-16T02:05:56.568 INFO:tasks.workunit.client.1.smithi165.stdout:2/756: dread - df/d10/d1a/fd3 zero size 2024-09-16T02:05:56.569 INFO:tasks.workunit.client.1.smithi165.stdout:4/631: creat d4/d40/d4f/fcd x:0 0 0 2024-09-16T02:05:56.570 INFO:tasks.workunit.client.1.smithi165.stdout:2/757: dread - df/d10/d1a/fd3 zero size 2024-09-16T02:05:56.570 INFO:tasks.workunit.client.1.smithi165.stdout:7/717: dread d0/d4b/fb9 [0,4194304] 0 2024-09-16T02:05:56.572 INFO:tasks.workunit.client.1.smithi165.stdout:7/718: fsync d0/df/d7/f23 0 2024-09-16T02:05:56.573 INFO:tasks.workunit.client.1.smithi165.stdout:4/632: rename d4/dc/d18/lb8 to d4/dc/d20/lce 0 2024-09-16T02:05:56.577 INFO:tasks.workunit.client.1.smithi165.stdout:3/802: creat da/d17/de5/d104/d2c/d2d/d6c/dfb/f117 x:0 0 0 2024-09-16T02:05:56.579 INFO:tasks.workunit.client.1.smithi165.stdout:7/719: dwrite d0/d2c/f7c [4194304,4194304] 0 2024-09-16T02:05:56.582 INFO:tasks.workunit.client.1.smithi165.stdout:6/682: sync 2024-09-16T02:05:56.582 INFO:tasks.workunit.client.1.smithi165.stdout:5/708: sync 2024-09-16T02:05:56.582 INFO:tasks.workunit.client.1.smithi165.stdout:8/734: sync 2024-09-16T02:05:56.582 INFO:tasks.workunit.client.1.smithi165.stdout:3/803: dread da/f9d [0,4194304] 0 2024-09-16T02:05:56.584 INFO:tasks.workunit.client.1.smithi165.stdout:5/709: chown de/d21/d26/d3a/d54/l46 11006 1 2024-09-16T02:05:56.586 INFO:tasks.workunit.client.1.smithi165.stdout:6/683: mknod d7/d17/d75/d97/cbf 0 2024-09-16T02:05:56.587 INFO:tasks.workunit.client.1.smithi165.stdout:6/684: dread - d7/d17/d75/fb4 zero size 2024-09-16T02:05:56.593 INFO:tasks.workunit.client.1.smithi165.stdout:3/804: dwrite da/d17/de5/d104/d91/f100 [0,4194304] 0 2024-09-16T02:05:56.595 INFO:tasks.workunit.client.1.smithi165.stdout:8/735: dwrite dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fc4 [0,4194304] 0 2024-09-16T02:05:56.596 INFO:tasks.workunit.client.1.smithi165.stdout:6/685: dread d7/dc/d3b/d3a/f5a [0,4194304] 0 2024-09-16T02:05:56.597 INFO:tasks.workunit.client.1.smithi165.stdout:3/805: write da/d17/de5/d104/d2c/d2d/d6c/db5/fe2 [203608,2568] 0 2024-09-16T02:05:56.599 INFO:tasks.workunit.client.1.smithi165.stdout:4/633: getdents d4/dc/d28 0 2024-09-16T02:05:56.602 INFO:tasks.workunit.client.1.smithi165.stdout:6/686: unlink d7/dc/df/l39 0 2024-09-16T02:05:56.605 INFO:tasks.workunit.client.1.smithi165.stdout:4/634: mknod d4/dc/d28/ccf 0 2024-09-16T02:05:56.605 INFO:tasks.workunit.client.1.smithi165.stdout:6/687: chown d7/l2b 23791601 1 2024-09-16T02:05:56.608 INFO:tasks.workunit.client.1.smithi165.stdout:5/710: write de/d19/d1c/d49/fa3 [93366,80321] 0 2024-09-16T02:05:56.608 INFO:tasks.workunit.client.1.smithi165.stdout:8/736: getdents dd/d11/d14/d70 0 2024-09-16T02:05:56.609 INFO:tasks.workunit.client.1.smithi165.stdout:2/758: dwrite df/d10/d37/f3d [0,4194304] 0 2024-09-16T02:05:56.612 INFO:tasks.workunit.client.1.smithi165.stdout:2/759: read - df/d10/d1a/fd3 zero size 2024-09-16T02:05:56.612 INFO:tasks.workunit.client.1.smithi165.stdout:7/720: dread d0/df/d7/f23 [0,4194304] 0 2024-09-16T02:05:56.614 INFO:tasks.workunit.client.1.smithi165.stdout:3/806: dwrite da/d17/de5/d104/d2c/d2d/d6c/fe1 [0,4194304] 0 2024-09-16T02:05:56.615 INFO:tasks.workunit.client.1.smithi165.stdout:8/737: write dd/d9e/dd0/fed [779365,76603] 0 2024-09-16T02:05:56.617 INFO:tasks.workunit.client.1.smithi165.stdout:8/738: write dd/ff [2078416,94446] 0 2024-09-16T02:05:56.618 INFO:tasks.workunit.client.1.smithi165.stdout:8/739: fsync dd/fdd 0 2024-09-16T02:05:56.618 INFO:tasks.workunit.client.1.smithi165.stdout:6/688: dread d7/dc/d3b/d3a/d3d/d5d/d73/d82/f7e [0,4194304] 0 2024-09-16T02:05:56.619 INFO:tasks.workunit.client.1.smithi165.stdout:8/740: fsync f6 0 2024-09-16T02:05:56.620 INFO:tasks.workunit.client.1.smithi165.stdout:7/721: unlink d0/df/d33/d2a/l46 0 2024-09-16T02:05:56.621 INFO:tasks.workunit.client.1.smithi165.stdout:5/711: write de/d19/d1c/d4d/f72 [1349612,111175] 0 2024-09-16T02:05:56.622 INFO:tasks.workunit.client.1.smithi165.stdout:4/635: truncate d4/dc/d18/fa3 667081 0 2024-09-16T02:05:56.624 INFO:tasks.workunit.client.1.smithi165.stdout:5/712: chown de/d19/d1c/d84/daa/fcd 60 1 2024-09-16T02:05:56.625 INFO:tasks.workunit.client.1.smithi165.stdout:8/741: fdatasync dd/d11/d14/f19 0 2024-09-16T02:05:56.625 INFO:tasks.workunit.client.1.smithi165.stdout:5/713: chown de 251512639 1 2024-09-16T02:05:56.626 INFO:tasks.workunit.client.1.smithi165.stdout:7/722: creat d0/df/d65/fee x:0 0 0 2024-09-16T02:05:56.627 INFO:tasks.workunit.client.1.smithi165.stdout:2/760: unlink df/d23/d28/d9a/la3 0 2024-09-16T02:05:56.629 INFO:tasks.workunit.client.1.smithi165.stdout:6/689: dwrite d7/d1f/f8c [0,4194304] 0 2024-09-16T02:05:56.631 INFO:tasks.workunit.client.1.smithi165.stdout:7/723: creat d0/d3d/d9f/fef x:0 0 0 2024-09-16T02:05:56.633 INFO:tasks.workunit.client.1.smithi165.stdout:8/742: rename dd/d9e/c9f to dd/d9e/dd0/c107 0 2024-09-16T02:05:56.633 INFO:tasks.workunit.client.1.smithi165.stdout:2/761: mknod df/d23/d66/ce4 0 2024-09-16T02:05:56.635 INFO:tasks.workunit.client.1.smithi165.stdout:5/714: dwrite de/d19/d1c/f3e [0,4194304] 0 2024-09-16T02:05:56.636 INFO:tasks.workunit.client.1.smithi165.stdout:6/690: unlink d7/dc/d3b/d3a/l5e 0 2024-09-16T02:05:56.638 INFO:tasks.workunit.client.1.smithi165.stdout:7/724: creat d0/d4b/db4/dda/ff0 x:0 0 0 2024-09-16T02:05:56.641 INFO:tasks.workunit.client.1.smithi165.stdout:5/715: fsync de/d21/d26/d3a/f91 0 2024-09-16T02:05:56.642 INFO:tasks.workunit.client.1.smithi165.stdout:7/725: chown d0/df/d33/d2a/f4d 50 1 2024-09-16T02:05:56.677 INFO:tasks.workunit.client.1.smithi165.stdout:1/803: sync 2024-09-16T02:05:56.678 INFO:tasks.workunit.client.1.smithi165.stdout:4/636: truncate d4/dc/d18/f34 6901575 0 2024-09-16T02:05:56.679 INFO:tasks.workunit.client.1.smithi165.stdout:7/726: write d0/df/d33/d2a/f4d [2036044,12823] 0 2024-09-16T02:05:56.682 INFO:tasks.workunit.client.1.smithi165.stdout:6/691: dwrite d7/d17/d75/d97/f9b [0,4194304] 0 2024-09-16T02:05:56.683 INFO:tasks.workunit.client.1.smithi165.stdout:7/727: dread - d0/df/d33/d2a/dd2/f70 zero size 2024-09-16T02:05:56.684 INFO:tasks.workunit.client.1.smithi165.stdout:4/637: creat d4/dc/d28/d30/fd0 x:0 0 0 2024-09-16T02:05:56.685 INFO:tasks.workunit.client.1.smithi165.stdout:1/804: dread d1/dd/d11/d33/d3f/d59/f90 [0,4194304] 0 2024-09-16T02:05:56.691 INFO:tasks.workunit.client.1.smithi165.stdout:5/716: dread de/d21/d51/f5f [0,4194304] 0 2024-09-16T02:05:56.691 INFO:tasks.workunit.client.1.smithi165.stdout:1/805: creat d1/d19/d24/d97/f104 x:0 0 0 2024-09-16T02:05:56.692 INFO:tasks.workunit.client.1.smithi165.stdout:4/638: truncate d4/dc/d18/d37/d53/d64/faa 171569 0 2024-09-16T02:05:56.692 INFO:tasks.workunit.client.1.smithi165.stdout:8/743: dwrite dd/d11/d14/d3f/d25/fa8 [0,4194304] 0 2024-09-16T02:05:56.697 INFO:tasks.workunit.client.1.smithi165.stdout:1/806: creat d1/d19/d24/d30/f105 x:0 0 0 2024-09-16T02:05:56.697 INFO:tasks.workunit.client.1.smithi165.stdout:8/744: fdatasync dd/d11/d14/d70/d7b/d9a/fcc 0 2024-09-16T02:05:56.700 INFO:tasks.workunit.client.1.smithi165.stdout:5/717: symlink de/d21/d26/d98/leb 0 2024-09-16T02:05:56.700 INFO:tasks.workunit.client.1.smithi165.stdout:4/639: mknod d4/dc/d18/d37/d53/cd1 0 2024-09-16T02:05:56.703 INFO:tasks.workunit.client.1.smithi165.stdout:7/728: dwrite d0/d2c/f8d [0,4194304] 0 2024-09-16T02:05:56.703 INFO:tasks.workunit.client.1.smithi165.stdout:6/692: dwrite d7/dc/d3b/f59 [0,4194304] 0 2024-09-16T02:05:56.704 INFO:tasks.workunit.client.1.smithi165.stdout:8/745: write dd/d11/d38/d74/d7d/fca [1043801,48809] 0 2024-09-16T02:05:56.705 INFO:tasks.workunit.client.1.smithi165.stdout:5/718: mknod de/d19/d1c/d4d/dc1/cec 0 2024-09-16T02:05:56.707 INFO:tasks.workunit.client.1.smithi165.stdout:7/729: rmdir d0/d3d 39 2024-09-16T02:05:56.708 INFO:tasks.workunit.client.1.smithi165.stdout:7/730: readlink d0/df/l6d 0 2024-09-16T02:05:56.710 INFO:tasks.workunit.client.1.smithi165.stdout:1/807: creat d1/d19/d24/f106 x:0 0 0 2024-09-16T02:05:56.714 INFO:tasks.workunit.client.1.smithi165.stdout:5/719: symlink de/d21/d26/d94/d9d/led 0 2024-09-16T02:05:56.716 INFO:tasks.workunit.client.1.smithi165.stdout:8/746: creat dd/d11/d14/d70/d7b/df2/dfc/f108 x:0 0 0 2024-09-16T02:05:56.716 INFO:tasks.workunit.client.1.smithi165.stdout:5/720: truncate de/d21/fe8 408966 0 2024-09-16T02:05:56.717 INFO:tasks.workunit.client.1.smithi165.stdout:1/808: creat d1/d68/dca/f107 x:0 0 0 2024-09-16T02:05:56.719 INFO:tasks.workunit.client.1.smithi165.stdout:4/640: creat d4/dc/d28/fd2 x:0 0 0 2024-09-16T02:05:56.720 INFO:tasks.workunit.client.1.smithi165.stdout:7/731: link d0/df/d65/f6e d0/d2c/d85/d8c/dde/ff1 0 2024-09-16T02:05:56.720 INFO:tasks.workunit.client.1.smithi165.stdout:1/809: chown d1/d19/d4d/d84/l75 0 1 2024-09-16T02:05:56.721 INFO:tasks.workunit.client.1.smithi165.stdout:8/747: dread - dd/d11/d14/d3f/d25/d36/d81/f8d zero size 2024-09-16T02:05:56.722 INFO:tasks.workunit.client.1.smithi165.stdout:6/693: dwrite d7/dc/df/d1a/d4d/d5f/f88 [0,4194304] 0 2024-09-16T02:05:56.724 INFO:tasks.workunit.client.1.smithi165.stdout:4/641: mkdir d4/dc0/dd3 0 2024-09-16T02:05:56.725 INFO:tasks.workunit.client.1.smithi165.stdout:1/810: fsync d1/dd/d11/d33/d3f/d47/d7d/fee 0 2024-09-16T02:05:56.727 INFO:tasks.workunit.client.1.smithi165.stdout:6/694: read d7/dc/df/d1a/f47 [904142,9407] 0 2024-09-16T02:05:56.729 INFO:tasks.workunit.client.1.smithi165.stdout:4/642: dread - d4/fc3 zero size 2024-09-16T02:05:56.730 INFO:tasks.workunit.client.1.smithi165.stdout:5/721: dwrite de/d19/d67/d74/fc6 [0,4194304] 0 2024-09-16T02:05:56.732 INFO:tasks.workunit.client.1.smithi165.stdout:1/811: dread d1/dd/d11/f61 [0,4194304] 0 2024-09-16T02:05:56.733 INFO:tasks.workunit.client.1.smithi165.stdout:5/722: fdatasync de/d21/f8f 0 2024-09-16T02:05:56.734 INFO:tasks.workunit.client.1.smithi165.stdout:6/695: write d7/d17/d75/fb4 [389452,94458] 0 2024-09-16T02:05:56.739 INFO:tasks.workunit.client.1.smithi165.stdout:7/732: dwrite d0/d4b/d63/f8f [0,4194304] 0 2024-09-16T02:05:56.740 INFO:tasks.workunit.client.1.smithi165.stdout:7/733: read - d0/df/d33/dc2/fe2 zero size 2024-09-16T02:05:56.742 INFO:tasks.workunit.client.1.smithi165.stdout:9/801: sync 2024-09-16T02:05:56.742 INFO:tasks.workunit.client.1.smithi165.stdout:0/663: sync 2024-09-16T02:05:56.744 INFO:tasks.workunit.client.1.smithi165.stdout:1/812: dwrite d1/dd/d11/f61 [0,4194304] 0 2024-09-16T02:05:56.757 INFO:tasks.workunit.client.0.smithi110.stdout:5/242: sync 2024-09-16T02:05:56.762 INFO:tasks.workunit.client.1.smithi165.stdout:5/723: dread de/d21/d26/d3a/f3c [0,4194304] 0 2024-09-16T02:05:56.767 INFO:tasks.workunit.client.1.smithi165.stdout:4/643: rmdir d4/d40 39 2024-09-16T02:05:56.767 INFO:tasks.workunit.client.1.smithi165.stdout:2/762: sync 2024-09-16T02:05:56.767 INFO:tasks.workunit.client.1.smithi165.stdout:3/807: sync 2024-09-16T02:05:56.768 INFO:tasks.workunit.client.1.smithi165.stdout:8/748: rename dd/d11/d14/d3f/d25/d36/d81/dd2/d53/fba to dd/d11/d38/f109 0 2024-09-16T02:05:56.768 INFO:tasks.workunit.client.1.smithi165.stdout:6/696: rename d7/dc/df/d1a/d4d to d7/dc/df/d1a/d4d/da8/dc0 22 2024-09-16T02:05:56.769 INFO:tasks.workunit.client.1.smithi165.stdout:3/808: chown da/d57/fb4 47 1 2024-09-16T02:05:56.773 INFO:tasks.workunit.client.1.smithi165.stdout:9/802: creat d7/df/d37/d65/f103 x:0 0 0 2024-09-16T02:05:56.773 INFO:tasks.workunit.client.1.smithi165.stdout:1/813: readlink d1/d68/l5c 0 2024-09-16T02:05:56.774 INFO:tasks.workunit.client.1.smithi165.stdout:5/724: fdatasync de/d21/d26/d94/da8/fd0 0 2024-09-16T02:05:56.775 INFO:tasks.workunit.client.1.smithi165.stdout:6/697: mkdir d7/d17/d75/dc1 0 2024-09-16T02:05:56.776 INFO:tasks.workunit.client.1.smithi165.stdout:3/809: rename da/d17/de5/d104/d2c/d10c/f6d to da/d20/d26/d8c/f118 0 2024-09-16T02:05:56.777 INFO:tasks.workunit.client.1.smithi165.stdout:5/725: fdatasync de/d19/f25 0 2024-09-16T02:05:56.778 INFO:tasks.workunit.client.1.smithi165.stdout:6/698: chown d7/dc/d3b/d3a/d3d/c81 2 1 2024-09-16T02:05:56.779 INFO:tasks.workunit.client.1.smithi165.stdout:8/749: creat dd/d34/dd7/f10a x:0 0 0 2024-09-16T02:05:56.781 INFO:tasks.workunit.client.1.smithi165.stdout:0/664: dwrite d0/d2a/d70/f8e [4194304,4194304] 0 2024-09-16T02:05:56.783 INFO:tasks.workunit.client.1.smithi165.stdout:7/734: write d0/df/d65/f6e [1291218,85283] 0 2024-09-16T02:05:56.783 INFO:tasks.workunit.client.1.smithi165.stdout:3/810: mkdir da/d17/d7a/d7d/da8/d119 0 2024-09-16T02:05:56.785 INFO:tasks.workunit.client.1.smithi165.stdout:6/699: write d7/f1e [2658845,33859] 0 2024-09-16T02:05:56.788 INFO:tasks.workunit.client.1.smithi165.stdout:5/726: rename de/d21/d26/l7d to de/d21/d26/d9a/lee 0 2024-09-16T02:05:56.789 INFO:tasks.workunit.client.1.smithi165.stdout:6/700: truncate d7/d17/d75/f7d 35037 0 2024-09-16T02:05:56.792 INFO:tasks.workunit.client.1.smithi165.stdout:7/735: chown d0/df/d33/d2a/dd2/la1 187 1 2024-09-16T02:05:56.792 INFO:tasks.workunit.client.1.smithi165.stdout:4/644: link d4/c2e d4/d40/d4f/cd4 0 2024-09-16T02:05:56.793 INFO:tasks.workunit.client.1.smithi165.stdout:1/814: getdents d1/d6b/df6 0 2024-09-16T02:05:56.793 INFO:tasks.workunit.client.1.smithi165.stdout:5/727: creat de/d21/fef x:0 0 0 2024-09-16T02:05:56.794 INFO:tasks.workunit.client.1.smithi165.stdout:3/811: link da/d17/de5/f113 da/d17/de5/f11a 0 2024-09-16T02:05:56.795 INFO:tasks.workunit.client.0.smithi110.stdout:5/243: dread d5/dd/f4c [0,4194304] 0 2024-09-16T02:05:56.795 INFO:tasks.workunit.client.0.smithi110.stdout:5/244: stat d5/dd/l1b 0 2024-09-16T02:05:56.796 INFO:tasks.workunit.client.1.smithi165.stdout:2/763: dread df/d23/f6e [0,4194304] 0 2024-09-16T02:05:56.798 INFO:tasks.workunit.client.1.smithi165.stdout:1/815: dread d1/d6b/df6/fd5 [0,4194304] 0 2024-09-16T02:05:56.798 INFO:tasks.workunit.client.1.smithi165.stdout:4/645: rename d4/d40/l7b to d4/dc0/ld5 0 2024-09-16T02:05:56.800 INFO:tasks.workunit.client.0.smithi110.stdout:5/245: fdatasync d5/f16 0 2024-09-16T02:05:56.800 INFO:tasks.workunit.client.1.smithi165.stdout:4/646: truncate d4/dc0/fca 755293 0 2024-09-16T02:05:56.802 INFO:tasks.workunit.client.1.smithi165.stdout:4/647: truncate d4/dc/d20/d4e/f72 331677 0 2024-09-16T02:05:56.802 INFO:tasks.workunit.client.1.smithi165.stdout:3/812: rmdir da/d57/d8d 39 2024-09-16T02:05:56.804 INFO:tasks.workunit.client.1.smithi165.stdout:8/750: truncate dd/d34/fb4 1359046 0 2024-09-16T02:05:56.804 INFO:tasks.workunit.client.1.smithi165.stdout:5/728: symlink de/d19/d1c/d4d/dc1/lf0 0 2024-09-16T02:05:56.805 INFO:tasks.workunit.client.1.smithi165.stdout:0/665: write d0/d1e/f57 [623741,69752] 0 2024-09-16T02:05:56.806 INFO:tasks.workunit.client.1.smithi165.stdout:6/701: symlink d7/dc/df/d1a/d4d/da8/lc2 0 2024-09-16T02:05:56.807 INFO:tasks.workunit.client.1.smithi165.stdout:2/764: symlink df/d23/d28/d3b/d82/le5 0 2024-09-16T02:05:56.808 INFO:tasks.workunit.client.0.smithi110.stdout:5/246: dread d5/f1e [0,4194304] 0 2024-09-16T02:05:56.808 INFO:tasks.workunit.client.0.smithi110.stdout:5/247: chown c3 94228 1 2024-09-16T02:05:56.809 INFO:tasks.workunit.client.1.smithi165.stdout:1/816: creat d1/d6b/dd7/f108 x:0 0 0 2024-09-16T02:05:56.809 INFO:tasks.workunit.client.1.smithi165.stdout:8/751: read - dd/d11/d14/d3f/d25/d36/d4f/f98 zero size 2024-09-16T02:05:56.810 INFO:tasks.workunit.client.1.smithi165.stdout:7/736: rename d0/d4b/d58/ca7 to d0/df/d33/dc2/cf2 0 2024-09-16T02:05:56.810 INFO:tasks.workunit.client.1.smithi165.stdout:5/729: dread - de/d21/d26/d3a/d6d/d95/fcf zero size 2024-09-16T02:05:56.811 INFO:tasks.workunit.client.0.smithi110.stdout:5/248: write d5/f16 [186643,10499] 0 2024-09-16T02:05:56.811 INFO:tasks.workunit.client.1.smithi165.stdout:9/803: dread d7/d14/f16 [4194304,4194304] 0 2024-09-16T02:05:56.813 INFO:tasks.workunit.client.1.smithi165.stdout:7/737: chown d0/d4b/db4/dda/fe5 3990972 1 2024-09-16T02:05:56.813 INFO:tasks.workunit.client.1.smithi165.stdout:6/702: creat d7/dc/d3b/d86/fc3 x:0 0 0 2024-09-16T02:05:56.814 INFO:tasks.workunit.client.1.smithi165.stdout:1/817: truncate d1/d22/f4e 894206 0 2024-09-16T02:05:56.816 INFO:tasks.workunit.client.1.smithi165.stdout:9/804: mkdir d7/df/d67/d104 0 2024-09-16T02:05:56.819 INFO:tasks.workunit.client.0.smithi110.stdout:5/249: dwrite d5/dd/f2b [0,4194304] 0 2024-09-16T02:05:56.821 INFO:tasks.workunit.client.0.smithi110.stdout:5/250: readlink d5/dd/df/d28/l52 0 2024-09-16T02:05:56.821 INFO:tasks.workunit.client.1.smithi165.stdout:4/648: dread d4/dc/d20/d4e/f54 [0,4194304] 0 2024-09-16T02:05:56.821 INFO:tasks.workunit.client.1.smithi165.stdout:8/752: dwrite dd/d11/d38/d74/d7d/fca [0,4194304] 0 2024-09-16T02:05:56.822 INFO:tasks.workunit.client.0.smithi110.stdout:5/251: dread - d5/dd/df/f3f zero size 2024-09-16T02:05:56.822 INFO:tasks.workunit.client.1.smithi165.stdout:3/813: dread da/d20/d26/d8c/f118 [0,4194304] 0 2024-09-16T02:05:56.823 INFO:tasks.workunit.client.0.smithi110.stdout:5/252: write d5/d36/f53 [925500,78658] 0 2024-09-16T02:05:56.823 INFO:tasks.workunit.client.1.smithi165.stdout:5/730: unlink de/d19/c78 0 2024-09-16T02:05:56.823 INFO:tasks.workunit.client.1.smithi165.stdout:3/814: write da/d17/d7a/d7d/fe7 [3623081,7535] 0 2024-09-16T02:05:56.828 INFO:tasks.workunit.client.1.smithi165.stdout:4/649: chown d4/dc/d18/d37/d53/d64/d8b/d71/c82 200310753 1 2024-09-16T02:05:56.828 INFO:tasks.workunit.client.0.smithi110.stdout:5/253: symlink d5/d36/d45/l55 0 2024-09-16T02:05:56.829 INFO:tasks.workunit.client.1.smithi165.stdout:7/738: symlink d0/d2c/d85/d8c/lf3 0 2024-09-16T02:05:56.832 INFO:tasks.workunit.client.1.smithi165.stdout:1/818: truncate d1/f79 2823596 0 2024-09-16T02:05:56.832 INFO:tasks.workunit.client.1.smithi165.stdout:4/650: chown d4/dc/d18/d37/d53/d64/d8b 171349495 1 2024-09-16T02:05:56.833 INFO:tasks.workunit.client.1.smithi165.stdout:0/666: write d0/d2a/f5c [523008,2329] 0 2024-09-16T02:05:56.833 INFO:tasks.workunit.client.1.smithi165.stdout:2/765: write df/f19 [50000,118314] 0 2024-09-16T02:05:56.834 INFO:tasks.workunit.client.0.smithi110.stdout:5/254: rename d5/dd/df/f1c to d5/d36/d45/f56 0 2024-09-16T02:05:56.834 INFO:tasks.workunit.client.1.smithi165.stdout:4/651: dread - d4/dc/d20/d4e/fa7 zero size 2024-09-16T02:05:56.835 INFO:tasks.workunit.client.1.smithi165.stdout:3/815: dread da/d17/de5/d104/d91/f100 [0,4194304] 0 2024-09-16T02:05:56.835 INFO:tasks.workunit.client.1.smithi165.stdout:5/731: creat de/d21/d26/d94/ff1 x:0 0 0 2024-09-16T02:05:56.837 INFO:tasks.workunit.client.1.smithi165.stdout:4/652: dread - d4/dc/d28/fd2 zero size 2024-09-16T02:05:56.838 INFO:tasks.workunit.client.1.smithi165.stdout:5/732: fdatasync de/d19/d1c/d84/fb7 0 2024-09-16T02:05:56.838 INFO:tasks.workunit.client.0.smithi110.stdout:5/255: creat d5/d36/d45/d47/f57 x:0 0 0 2024-09-16T02:05:56.840 INFO:tasks.workunit.client.1.smithi165.stdout:7/739: creat d0/d4b/db4/ff4 x:0 0 0 2024-09-16T02:05:56.840 INFO:tasks.workunit.client.1.smithi165.stdout:1/819: dwrite d1/d22/f74 [0,4194304] 0 2024-09-16T02:05:56.845 INFO:tasks.workunit.client.1.smithi165.stdout:0/667: read d0/d2a/d70/f8b [136930,19506] 0 2024-09-16T02:05:56.846 INFO:tasks.workunit.client.1.smithi165.stdout:2/766: stat df/d23/d28/d9a/d86/cbd 0 2024-09-16T02:05:56.848 INFO:tasks.workunit.client.1.smithi165.stdout:9/805: dwrite f2 [0,4194304] 0 2024-09-16T02:05:56.848 INFO:tasks.workunit.client.1.smithi165.stdout:2/767: write df/d10/d37/f74 [2105338,124041] 0 2024-09-16T02:05:56.849 INFO:tasks.workunit.client.1.smithi165.stdout:9/806: write d7/d14/d7a/f101 [698690,119781] 0 2024-09-16T02:05:56.850 INFO:tasks.workunit.client.0.smithi110.stdout:5/256: dwrite d5/dd/f4c [0,4194304] 0 2024-09-16T02:05:56.851 INFO:tasks.workunit.client.1.smithi165.stdout:9/807: chown d7/d32/d38/d68/fd3 1 1 2024-09-16T02:05:56.852 INFO:tasks.workunit.client.1.smithi165.stdout:4/653: chown d4/dc/d28/d2b/d42 2 1 2024-09-16T02:05:56.857 INFO:tasks.workunit.client.1.smithi165.stdout:6/703: link d7/dc/c22 d7/d17/d75/dc1/cc4 0 2024-09-16T02:05:56.858 INFO:tasks.workunit.client.1.smithi165.stdout:6/704: fsync d7/f1e 0 2024-09-16T02:05:56.860 INFO:tasks.workunit.client.1.smithi165.stdout:1/820: creat d1/dd/d11/d33/d3f/d6c/f109 x:0 0 0 2024-09-16T02:05:56.860 INFO:tasks.workunit.client.1.smithi165.stdout:7/740: write d0/d3d/d9f/ddc/da8/ddd/fe4 [153878,99730] 0 2024-09-16T02:05:56.863 INFO:tasks.workunit.client.1.smithi165.stdout:8/753: dwrite dd/d11/f5f [4194304,4194304] 0 2024-09-16T02:05:56.866 INFO:tasks.workunit.client.1.smithi165.stdout:6/705: dread - d7/dc/d3b/d3a/d3d/d5d/d73/d82/fa3 zero size 2024-09-16T02:05:56.867 INFO:tasks.workunit.client.0.smithi110.stdout:5/257: dread d5/d36/f53 [0,4194304] 0 2024-09-16T02:05:56.875 INFO:tasks.workunit.client.1.smithi165.stdout:0/668: readlink d0/d1e/d20/d28/d9a/lb6 0 2024-09-16T02:05:56.876 INFO:tasks.workunit.client.0.smithi110.stdout:5/258: creat d5/dd/df/d11/f58 x:0 0 0 2024-09-16T02:05:56.877 INFO:tasks.workunit.client.1.smithi165.stdout:0/669: dread - d0/d1e/d20/f97 zero size 2024-09-16T02:05:56.878 INFO:tasks.workunit.client.1.smithi165.stdout:5/733: dread de/d21/f8b [0,4194304] 0 2024-09-16T02:05:56.879 INFO:tasks.workunit.client.1.smithi165.stdout:4/654: chown d4/dc0/ld5 8151 1 2024-09-16T02:05:56.879 INFO:tasks.workunit.client.1.smithi165.stdout:2/768: fdatasync df/d23/f38 0 2024-09-16T02:05:56.880 INFO:tasks.workunit.client.1.smithi165.stdout:6/706: write d7/dc/d3b/d3a/d3d/d5d/d73/d82/fa3 [193386,1479] 0 2024-09-16T02:05:56.883 INFO:tasks.workunit.client.0.smithi110.stdout:5/259: dwrite d5/dd/f4c [0,4194304] 0 2024-09-16T02:05:56.883 INFO:tasks.workunit.client.1.smithi165.stdout:7/741: dread d0/df/f5f [0,4194304] 0 2024-09-16T02:05:56.884 INFO:tasks.workunit.client.1.smithi165.stdout:8/754: dwrite dd/d11/d14/d70/d7b/df2/dfc/f108 [0,4194304] 0 2024-09-16T02:05:56.884 INFO:tasks.workunit.client.1.smithi165.stdout:9/808: rmdir d7/d1f/d54/dfb 0 2024-09-16T02:05:56.884 INFO:tasks.workunit.client.1.smithi165.stdout:3/816: dread da/d17/dcc/f24 [0,4194304] 0 2024-09-16T02:05:56.885 INFO:tasks.workunit.client.1.smithi165.stdout:4/655: rmdir d4/dbc 39 2024-09-16T02:05:56.887 INFO:tasks.workunit.client.0.smithi110.stdout:5/260: creat d5/f59 x:0 0 0 2024-09-16T02:05:56.888 INFO:tasks.workunit.client.1.smithi165.stdout:7/742: write d0/df/d7/f92 [1702209,118733] 0 2024-09-16T02:05:56.889 INFO:tasks.workunit.client.0.smithi110.stdout:5/261: write d5/d36/f53 [653266,17360] 0 2024-09-16T02:05:56.893 INFO:tasks.workunit.client.1.smithi165.stdout:0/670: mkdir d0/d1e/d39/d48/d5f/ddf 0 2024-09-16T02:05:56.894 INFO:tasks.workunit.client.1.smithi165.stdout:2/769: dread df/d23/d28/f94 [0,4194304] 0 2024-09-16T02:05:56.895 INFO:tasks.workunit.client.1.smithi165.stdout:4/656: mkdir d4/dc/d20/dc2/dd6 0 2024-09-16T02:05:56.896 INFO:tasks.workunit.client.0.smithi110.stdout:5/262: read d5/dd/df/d11/f2f [3602,31992] 0 2024-09-16T02:05:56.897 INFO:tasks.workunit.client.1.smithi165.stdout:3/817: creat da/f11b x:0 0 0 2024-09-16T02:05:56.897 INFO:tasks.workunit.client.1.smithi165.stdout:7/743: write d0/df/d42/fa3 [650123,52871] 0 2024-09-16T02:05:56.899 INFO:tasks.workunit.client.1.smithi165.stdout:6/707: rename d7/dc/df/d1a/d4d/d90/fb6 to d7/dc/d3b/d3a/d3d/d5d/d73/d82/fc5 0 2024-09-16T02:05:56.899 INFO:tasks.workunit.client.1.smithi165.stdout:5/734: symlink de/d19/d1c/d4d/dc1/lf2 0 2024-09-16T02:05:56.901 INFO:tasks.workunit.client.1.smithi165.stdout:0/671: creat d0/d1e/d20/d28/da7/db4/fe0 x:0 0 0 2024-09-16T02:05:56.903 INFO:tasks.workunit.client.1.smithi165.stdout:4/657: symlink d4/dc/d20/d4e/ld7 0 2024-09-16T02:05:56.903 INFO:tasks.workunit.client.1.smithi165.stdout:2/770: unlink df/d10/d37/c5f 0 2024-09-16T02:05:56.903 INFO:tasks.workunit.client.1.smithi165.stdout:3/818: write da/d20/d26/d6e/f73 [379643,36832] 0 2024-09-16T02:05:56.904 INFO:tasks.workunit.client.1.smithi165.stdout:9/809: dread d7/d14/f16 [4194304,4194304] 0 2024-09-16T02:05:56.905 INFO:tasks.workunit.client.1.smithi165.stdout:8/755: dwrite dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/fff [0,4194304] 0 2024-09-16T02:05:56.907 INFO:tasks.workunit.client.1.smithi165.stdout:4/658: write d4/dc/d18/f9b [327308,31481] 0 2024-09-16T02:05:56.909 INFO:tasks.workunit.client.1.smithi165.stdout:6/708: truncate d7/dc/d3b/d3a/d3d/fa1 514837 0 2024-09-16T02:05:56.910 INFO:tasks.workunit.client.1.smithi165.stdout:9/810: chown d7/d32/d38/d68/d7f/f70 12696601 1 2024-09-16T02:05:56.910 INFO:tasks.workunit.client.1.smithi165.stdout:0/672: unlink d0/d1e/d39/d48/d74/cbf 0 2024-09-16T02:05:56.912 INFO:tasks.workunit.client.1.smithi165.stdout:8/756: unlink dd/d11/d14/d3f/d25/d36/d4f/l92 0 2024-09-16T02:05:56.912 INFO:tasks.workunit.client.1.smithi165.stdout:9/811: stat d7/d32/d38/d53/d56/lf2 0 2024-09-16T02:05:56.913 INFO:tasks.workunit.client.1.smithi165.stdout:0/673: fsync d0/d1e/d20/f97 0 2024-09-16T02:05:56.913 INFO:tasks.workunit.client.1.smithi165.stdout:6/709: write d7/dc/df/d1a/d4d/d5f/f84 [675826,44495] 0 2024-09-16T02:05:56.915 INFO:tasks.workunit.client.0.smithi110.stdout:5/263: fdatasync d5/d36/f53 0 2024-09-16T02:05:56.916 INFO:tasks.workunit.client.0.smithi110.stdout:0/289: sync 2024-09-16T02:05:56.916 INFO:tasks.workunit.client.1.smithi165.stdout:0/674: readlink d0/l17 0 2024-09-16T02:05:56.917 INFO:tasks.workunit.client.1.smithi165.stdout:3/819: creat da/f11c x:0 0 0 2024-09-16T02:05:56.917 INFO:tasks.workunit.client.1.smithi165.stdout:6/710: read d7/d1f/f8c [3995626,104753] 0 2024-09-16T02:05:56.918 INFO:tasks.workunit.client.1.smithi165.stdout:7/744: dwrite d0/df/d33/d2a/f94 [0,4194304] 0 2024-09-16T02:05:56.918 INFO:tasks.workunit.client.1.smithi165.stdout:5/735: getdents de/d19/d1c/d84/daa 0 2024-09-16T02:05:56.919 INFO:tasks.workunit.client.1.smithi165.stdout:9/812: rmdir d7/d32/d38/d58/d99 39 2024-09-16T02:05:56.923 INFO:tasks.workunit.client.1.smithi165.stdout:6/711: dread - d7/dc/d3b/d86/fa5 zero size 2024-09-16T02:05:56.924 INFO:tasks.workunit.client.1.smithi165.stdout:7/745: write d0/df/d7/f23 [2453169,82683] 0 2024-09-16T02:05:56.924 INFO:tasks.workunit.client.0.smithi110.stdout:0/290: link d3/d6/c2f d3/c56 0 2024-09-16T02:05:56.925 INFO:tasks.workunit.client.0.smithi110.stdout:0/291: fsync d3/f9 0 2024-09-16T02:05:56.929 INFO:tasks.workunit.client.1.smithi165.stdout:1/821: dwrite d1/dd/d11/f1b [0,4194304] 0 2024-09-16T02:05:56.929 INFO:tasks.workunit.client.0.smithi110.stdout:0/292: rename d3/lb to d3/d6/d43/d55/l57 0 2024-09-16T02:05:56.930 INFO:tasks.workunit.client.1.smithi165.stdout:8/757: dread dd/d11/d14/d3f/d25/d36/d81/fc9 [0,4194304] 0 2024-09-16T02:05:56.930 INFO:tasks.workunit.client.1.smithi165.stdout:5/736: write de/d60/d65/faf [946046,1000] 0 2024-09-16T02:05:56.932 INFO:tasks.workunit.client.1.smithi165.stdout:1/822: read - d1/d68/dca/fec zero size 2024-09-16T02:05:56.933 INFO:tasks.workunit.client.0.smithi110.stdout:0/293: creat d3/d6/d4b/f58 x:0 0 0 2024-09-16T02:05:56.933 INFO:tasks.workunit.client.1.smithi165.stdout:1/823: chown d1/dd/d11/d33/d3f 22008542 1 2024-09-16T02:05:56.936 INFO:tasks.workunit.client.1.smithi165.stdout:9/813: mkdir d7/d32/d38/d53/d5c/d105 0 2024-09-16T02:05:56.936 INFO:tasks.workunit.client.1.smithi165.stdout:6/712: creat d7/dc/d3b/d86/fc6 x:0 0 0 2024-09-16T02:05:56.939 INFO:tasks.workunit.client.1.smithi165.stdout:7/746: dwrite d0/df/d33/f34 [0,4194304] 0 2024-09-16T02:05:56.940 INFO:tasks.workunit.client.1.smithi165.stdout:4/659: getdents d4/dc/d28/d3b 0 2024-09-16T02:05:56.942 INFO:tasks.workunit.client.1.smithi165.stdout:5/737: mkdir de/d60/dbc/df3 0 2024-09-16T02:05:56.942 INFO:tasks.workunit.client.1.smithi165.stdout:7/747: read - d0/d4b/db4/fce zero size 2024-09-16T02:05:56.944 INFO:tasks.workunit.client.1.smithi165.stdout:2/771: truncate df/d10/d1a/d2d/dd1/d79/fd6 251080 0 2024-09-16T02:05:56.946 INFO:tasks.workunit.client.1.smithi165.stdout:9/814: dwrite d7/f35 [0,4194304] 0 2024-09-16T02:05:56.949 INFO:tasks.workunit.client.0.smithi110.stdout:0/294: dread d3/d4/dc/d10/f3c [0,4194304] 0 2024-09-16T02:05:56.949 INFO:tasks.workunit.client.1.smithi165.stdout:9/815: chown d7/d1f/d27/d49 29259264 1 2024-09-16T02:05:56.949 INFO:tasks.workunit.client.1.smithi165.stdout:8/758: dread dd/d34/fb4 [0,4194304] 0 2024-09-16T02:05:56.950 INFO:tasks.workunit.client.0.smithi110.stdout:0/295: write d3/d6/d4b/f4d [4364175,13551] 0 2024-09-16T02:05:56.951 INFO:tasks.workunit.client.1.smithi165.stdout:4/660: getdents d4/dc/d18/d37/d53/d64/da0 0 2024-09-16T02:05:56.953 INFO:tasks.workunit.client.1.smithi165.stdout:6/713: creat d7/dc/df/d1a/d4d/fc7 x:0 0 0 2024-09-16T02:05:56.954 INFO:tasks.workunit.client.1.smithi165.stdout:7/748: dwrite d0/d4b/d63/f9e [0,4194304] 0 2024-09-16T02:05:56.955 INFO:tasks.workunit.client.1.smithi165.stdout:3/820: dread da/d17/f5b [0,4194304] 0 2024-09-16T02:05:56.957 INFO:tasks.workunit.client.1.smithi165.stdout:3/821: chown da/d17/de5/d104/f23 2144593 1 2024-09-16T02:05:56.960 INFO:tasks.workunit.client.1.smithi165.stdout:5/738: rename de/c34 to de/d21/d26/d94/d9d/cf4 0 2024-09-16T02:05:56.960 INFO:tasks.workunit.client.1.smithi165.stdout:4/661: readlink d4/dc/l15 0 2024-09-16T02:05:56.962 INFO:tasks.workunit.client.1.smithi165.stdout:7/749: rmdir d0/df/d33/d2a 39 2024-09-16T02:05:56.963 INFO:tasks.workunit.client.1.smithi165.stdout:7/750: chown d0/df/d7/l48 241950 1 2024-09-16T02:05:56.967 INFO:tasks.workunit.client.1.smithi165.stdout:1/824: write d1/d19/d24/d30/f40 [3520366,92344] 0 2024-09-16T02:05:56.967 INFO:tasks.workunit.client.1.smithi165.stdout:6/714: mknod d7/dc/df/cc8 0 2024-09-16T02:05:56.968 INFO:tasks.workunit.client.1.smithi165.stdout:4/662: symlink d4/dc/d18/d37/d53/d64/d91/ld8 0 2024-09-16T02:05:56.968 INFO:tasks.workunit.client.1.smithi165.stdout:5/739: creat de/d21/d26/d3a/d6d/d95/dab/ff5 x:0 0 0 2024-09-16T02:05:56.969 INFO:tasks.workunit.client.1.smithi165.stdout:6/715: write d7/d1f/f32 [653917,36654] 0 2024-09-16T02:05:56.969 INFO:tasks.workunit.client.1.smithi165.stdout:9/816: creat d7/d32/f106 x:0 0 0 2024-09-16T02:05:56.971 INFO:tasks.workunit.client.1.smithi165.stdout:6/716: chown d7/dc/l93 5045053 1 2024-09-16T02:05:56.971 INFO:tasks.workunit.client.1.smithi165.stdout:7/751: creat d0/df/d33/dc2/ff5 x:0 0 0 2024-09-16T02:05:56.973 INFO:tasks.workunit.client.1.smithi165.stdout:1/825: creat d1/d19/d4d/f10a x:0 0 0 2024-09-16T02:05:56.975 INFO:tasks.workunit.client.1.smithi165.stdout:4/663: rmdir d4/dc/d28 39 2024-09-16T02:05:56.978 INFO:tasks.workunit.client.1.smithi165.stdout:3/822: mknod da/d57/d8d/c11d 0 2024-09-16T02:05:56.978 INFO:tasks.workunit.client.0.smithi110.stdout:0/296: dread d3/d6/ff [0,4194304] 0 2024-09-16T02:05:56.979 INFO:tasks.workunit.client.1.smithi165.stdout:4/664: truncate d4/d40/faf 671717 0 2024-09-16T02:05:56.980 INFO:tasks.workunit.client.1.smithi165.stdout:6/717: rename d7/dc/d3b/d3c/c79 to d7/d17/d75/dc1/cc9 0 2024-09-16T02:05:56.981 INFO:tasks.workunit.client.1.smithi165.stdout:5/740: mkdir de/d19/df6 0 2024-09-16T02:05:56.983 INFO:tasks.workunit.client.1.smithi165.stdout:8/759: dwrite dd/d11/f69 [0,4194304] 0 2024-09-16T02:05:56.983 INFO:tasks.workunit.client.1.smithi165.stdout:6/718: fsync d7/dc/d3b/d86/fc3 0 2024-09-16T02:05:56.984 INFO:tasks.workunit.client.1.smithi165.stdout:3/823: fdatasync da/d17/d7a/d7d/fb3 0 2024-09-16T02:05:56.986 INFO:tasks.workunit.client.1.smithi165.stdout:4/665: chown d4/c6f 2121660 1 2024-09-16T02:05:56.986 INFO:tasks.workunit.client.1.smithi165.stdout:9/817: dread d7/d32/d38/d53/d5c/f81 [0,4194304] 0 2024-09-16T02:05:56.986 INFO:tasks.workunit.client.0.smithi110.stdout:0/297: dwrite d3/d4/dc/f1e [4194304,4194304] 0 2024-09-16T02:05:56.986 INFO:tasks.workunit.client.0.smithi110.stdout:0/298: chown d3/d6/c45 113 1 2024-09-16T02:05:56.987 INFO:tasks.workunit.client.1.smithi165.stdout:1/826: creat d1/d22/f10b x:0 0 0 2024-09-16T02:05:56.987 INFO:tasks.workunit.client.0.smithi110.stdout:0/299: chown d3/l3d 224500073 1 2024-09-16T02:05:56.989 INFO:tasks.workunit.client.1.smithi165.stdout:1/827: truncate d1/fd9 233572 0 2024-09-16T02:05:56.990 INFO:tasks.workunit.client.0.smithi110.stdout:0/300: unlink d3/c25 0 2024-09-16T02:05:56.993 INFO:tasks.workunit.client.0.smithi110.stdout:0/301: dread d3/d4/dc/d10/f3c [0,4194304] 0 2024-09-16T02:05:57.000 INFO:tasks.workunit.client.0.smithi110.stdout:0/302: dwrite d3/d6/d4b/f4d [0,4194304] 0 2024-09-16T02:05:57.005 INFO:tasks.workunit.client.0.smithi110.stdout:0/303: getdents d3/d4/d41 0 2024-09-16T02:05:57.012 INFO:tasks.workunit.client.0.smithi110.stdout:0/304: dwrite d3/d4/d41/f48 [0,4194304] 0 2024-09-16T02:05:57.016 INFO:tasks.workunit.client.0.smithi110.stdout:0/305: mkdir d3/d6/d43/d55/d59 0 2024-09-16T02:05:57.016 INFO:tasks.workunit.client.0.smithi110.stdout:0/306: mknod d3/d6/c5a 0 2024-09-16T02:05:57.018 INFO:tasks.workunit.client.0.smithi110.stdout:0/307: rename d3/d4/c46 to d3/d4/dc/c5b 0 2024-09-16T02:05:57.020 INFO:tasks.workunit.client.0.smithi110.stdout:0/308: creat d3/d6/d43/d55/d59/f5c x:0 0 0 2024-09-16T02:05:57.030 INFO:tasks.workunit.client.0.smithi110.stdout:0/309: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:57.030 INFO:tasks.workunit.client.0.smithi110.stdout:0/310: chown d3/d6/l36 1042 1 2024-09-16T02:05:57.033 INFO:tasks.workunit.client.0.smithi110.stdout:0/311: dread d3/d4/dc/f1c [0,4194304] 0 2024-09-16T02:05:57.034 INFO:tasks.workunit.client.0.smithi110.stdout:0/312: fdatasync d3/d6/d4b/f4d 0 2024-09-16T02:05:57.035 INFO:tasks.workunit.client.0.smithi110.stdout:0/313: symlink d3/d4/d41/l5d 0 2024-09-16T02:05:57.036 INFO:tasks.workunit.client.0.smithi110.stdout:0/314: chown c2 21047293 1 2024-09-16T02:05:57.038 INFO:tasks.workunit.client.0.smithi110.stdout:0/315: link d3/d6/d43/d55/d59/f5c d3/d4/dc/f5e 0 2024-09-16T02:05:57.039 INFO:tasks.workunit.client.0.smithi110.stdout:0/316: creat d3/d4/d41/f5f x:0 0 0 2024-09-16T02:05:57.041 INFO:tasks.workunit.client.0.smithi110.stdout:0/317: link d3/d6/f3b d3/d4/d41/f60 0 2024-09-16T02:05:57.043 INFO:tasks.workunit.client.0.smithi110.stdout:0/318: fsync d3/d4/dc/d10/f3c 0 2024-09-16T02:05:57.044 INFO:tasks.workunit.client.0.smithi110.stdout:0/319: mknod d3/c61 0 2024-09-16T02:05:57.046 INFO:tasks.workunit.client.0.smithi110.stdout:0/320: rmdir d3/d4/dc/d14 39 2024-09-16T02:05:57.048 INFO:tasks.workunit.client.0.smithi110.stdout:0/321: write d3/d6/f21 [1215452,88144] 0 2024-09-16T02:05:57.051 INFO:tasks.workunit.client.0.smithi110.stdout:0/322: mkdir d3/d4/dc/d14/d62 0 2024-09-16T02:05:57.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/323: dwrite d3/f17 [0,4194304] 0 2024-09-16T02:05:57.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/324: fdatasync d3/f9 0 2024-09-16T02:05:57.062 INFO:tasks.workunit.client.0.smithi110.stdout:0/325: read d3/d4/dc/d10/f35 [71729,43060] 0 2024-09-16T02:05:57.069 INFO:tasks.workunit.client.0.smithi110.stdout:0/326: dread d3/f28 [0,4194304] 0 2024-09-16T02:05:57.070 INFO:tasks.workunit.client.1.smithi165.stdout:7/752: truncate d0/d2c/f8d 3267748 0 2024-09-16T02:05:57.071 INFO:tasks.workunit.client.0.smithi110.stdout:0/327: truncate d3/d6/f39 89000 0 2024-09-16T02:05:57.072 INFO:tasks.workunit.client.1.smithi165.stdout:7/753: write d0/d4b/db4/dba/fbd [3564061,126672] 0 2024-09-16T02:05:57.073 INFO:tasks.workunit.client.0.smithi110.stdout:0/328: symlink d3/d6/d43/l63 0 2024-09-16T02:05:57.073 INFO:tasks.workunit.client.1.smithi165.stdout:4/666: dwrite d4/dc/d18/d37/d53/d64/d8b/f61 [0,4194304] 0 2024-09-16T02:05:57.075 INFO:tasks.workunit.client.1.smithi165.stdout:4/667: readlink d4/dc/d20/d4e/d73/l85 0 2024-09-16T02:05:57.076 INFO:tasks.workunit.client.1.smithi165.stdout:1/828: creat d1/dd/d11/d33/d3f/d59/f10c x:0 0 0 2024-09-16T02:05:57.076 INFO:tasks.workunit.client.0.smithi110.stdout:0/329: fsync d3/d4/dc/f1c 0 2024-09-16T02:05:57.076 INFO:tasks.workunit.client.1.smithi165.stdout:8/760: dwrite dd/f67 [0,4194304] 0 2024-09-16T02:05:57.077 INFO:tasks.workunit.client.1.smithi165.stdout:3/824: rename da/d17/d7a/c107 to da/d17/de5/d104/d2c/d10c/d6b/c11e 0 2024-09-16T02:05:57.079 INFO:tasks.workunit.client.1.smithi165.stdout:8/761: truncate dd/d11/d14/d3f/d72/fa5 778134 0 2024-09-16T02:05:57.082 INFO:tasks.workunit.client.1.smithi165.stdout:4/668: chown d4/dc/d28/d2b/d42/d99/fb6 754896576 1 2024-09-16T02:05:57.082 INFO:tasks.workunit.client.1.smithi165.stdout:5/741: getdents de/d19/d1c/d49/da5 0 2024-09-16T02:05:57.084 INFO:tasks.workunit.client.1.smithi165.stdout:5/742: write de/d21/d51/fb4 [428393,56637] 0 2024-09-16T02:05:57.085 INFO:tasks.workunit.client.1.smithi165.stdout:1/829: rename d1/d22/fa2 to d1/d6b/f10d 0 2024-09-16T02:05:57.087 INFO:tasks.workunit.client.1.smithi165.stdout:3/825: symlink da/d17/de5/d104/d2c/d10c/d9c/da6/l11f 0 2024-09-16T02:05:57.087 INFO:tasks.workunit.client.1.smithi165.stdout:8/762: rmdir dd/d11/daa/db9 39 2024-09-16T02:05:57.088 INFO:tasks.workunit.client.1.smithi165.stdout:3/826: readlink da/d17/de5/d104/d2c/d2d/l33 0 2024-09-16T02:05:57.089 INFO:tasks.workunit.client.1.smithi165.stdout:3/827: readlink da/d20/d26/l55 0 2024-09-16T02:05:57.090 INFO:tasks.workunit.client.1.smithi165.stdout:4/669: creat d4/dc/d18/d37/d53/d64/fd9 x:0 0 0 2024-09-16T02:05:57.091 INFO:tasks.workunit.client.1.smithi165.stdout:8/763: read dd/d11/d14/d3f/d25/d36/d85/fc3 [337365,128628] 0 2024-09-16T02:05:57.091 INFO:tasks.workunit.client.1.smithi165.stdout:1/830: mknod d1/dd/d11/d33/c10e 0 2024-09-16T02:05:57.092 INFO:tasks.workunit.client.1.smithi165.stdout:9/818: getdents d7/d32/d85/d8a 0 2024-09-16T02:05:57.095 INFO:tasks.workunit.client.1.smithi165.stdout:1/831: unlink d1/dd/d11/d33/d3f/d47/cc3 0 2024-09-16T02:05:57.098 INFO:tasks.workunit.client.1.smithi165.stdout:8/764: dread dd/d11/d14/d70/d7b/df2/ffa [0,4194304] 0 2024-09-16T02:05:57.100 INFO:tasks.workunit.client.1.smithi165.stdout:1/832: unlink d1/d19/d24/d30/d72/faa 0 2024-09-16T02:05:57.100 INFO:tasks.workunit.client.1.smithi165.stdout:4/670: dwrite d4/dc/f19 [0,4194304] 0 2024-09-16T02:05:57.101 INFO:tasks.workunit.client.1.smithi165.stdout:9/819: rmdir d7/d32/d38/d53/d5c/d105 0 2024-09-16T02:05:57.104 INFO:tasks.workunit.client.1.smithi165.stdout:0/675: sync 2024-09-16T02:05:57.105 INFO:tasks.workunit.client.1.smithi165.stdout:2/772: sync 2024-09-16T02:05:57.108 INFO:tasks.workunit.client.1.smithi165.stdout:1/833: mknod d1/dd/d11/d33/d3f/d59/c10f 0 2024-09-16T02:05:57.108 INFO:tasks.workunit.client.1.smithi165.stdout:4/671: dread d4/dc/d28/d3b/f90 [0,4194304] 0 2024-09-16T02:05:57.109 INFO:tasks.workunit.client.0.smithi110.stdout:0/330: write d3/d4/dc/d10/f3c [2010815,129396] 0 2024-09-16T02:05:57.112 INFO:tasks.workunit.client.1.smithi165.stdout:4/672: creat d4/d40/d4f/fda x:0 0 0 2024-09-16T02:05:57.115 INFO:tasks.workunit.client.0.smithi110.stdout:0/331: dwrite d3/d6/d4b/f4d [4194304,4194304] 0 2024-09-16T02:05:57.117 INFO:tasks.workunit.client.0.smithi110.stdout:0/332: rename d3/d4/dc to d3/d4/dc/d14/d64 22 2024-09-16T02:05:57.117 INFO:tasks.workunit.client.1.smithi165.stdout:4/673: creat d4/dc/d20/dc2/fdb x:0 0 0 2024-09-16T02:05:57.117 INFO:tasks.workunit.client.1.smithi165.stdout:1/834: dwrite d1/d6b/df6/fd1 [0,4194304] 0 2024-09-16T02:05:57.117 INFO:tasks.workunit.client.1.smithi165.stdout:2/773: truncate df/d23/d28/d9a/f5c 4795625 0 2024-09-16T02:05:57.118 INFO:tasks.workunit.client.0.smithi110.stdout:0/333: mknod d3/d4/d41/c65 0 2024-09-16T02:05:57.119 INFO:tasks.workunit.client.1.smithi165.stdout:4/674: write d4/dc/d18/f22 [2834888,99861] 0 2024-09-16T02:05:57.121 INFO:tasks.workunit.client.1.smithi165.stdout:2/774: dread - df/d10/d1a/d2d/dd1/d79/d98/fe0 zero size 2024-09-16T02:05:57.122 INFO:tasks.workunit.client.1.smithi165.stdout:9/820: dread d7/d32/d38/d58/fc3 [0,4194304] 0 2024-09-16T02:05:57.141 INFO:tasks.workunit.client.0.smithi110.stdout:9/227: sync 2024-09-16T02:05:57.141 INFO:tasks.workunit.client.0.smithi110.stdout:1/339: sync 2024-09-16T02:05:57.142 INFO:tasks.workunit.client.0.smithi110.stdout:0/334: creat d3/d4/dc/d10/f66 x:0 0 0 2024-09-16T02:05:57.142 INFO:tasks.workunit.client.1.smithi165.stdout:4/675: chown d4/dc/l2c 215 1 2024-09-16T02:05:57.143 INFO:tasks.workunit.client.1.smithi165.stdout:8/765: write dd/d11/d14/d3f/d25/d36/f64 [4484300,94583] 0 2024-09-16T02:05:57.144 INFO:tasks.workunit.client.0.smithi110.stdout:0/335: read d3/d4/f23 [797050,70297] 0 2024-09-16T02:05:57.146 INFO:tasks.workunit.client.1.smithi165.stdout:2/775: creat df/d23/d28/d87/fe6 x:0 0 0 2024-09-16T02:05:57.147 INFO:tasks.workunit.client.0.smithi110.stdout:9/228: write d1/d5/d20/f39 [4852942,89220] 0 2024-09-16T02:05:57.149 INFO:tasks.workunit.client.1.smithi165.stdout:0/676: write d0/f13 [2527999,803] 0 2024-09-16T02:05:57.149 INFO:tasks.workunit.client.1.smithi165.stdout:0/677: readlink d0/la 0 2024-09-16T02:05:57.152 INFO:tasks.workunit.client.1.smithi165.stdout:2/776: truncate df/d10/d1a/d2d/f78 1376198 0 2024-09-16T02:05:57.153 INFO:tasks.workunit.client.0.smithi110.stdout:0/336: fsync d3/d4/dc/d14/f19 0 2024-09-16T02:05:57.153 INFO:tasks.workunit.client.0.smithi110.stdout:0/337: stat d3/d6 0 2024-09-16T02:05:57.155 INFO:tasks.workunit.client.1.smithi165.stdout:0/678: dread d0/f30 [0,4194304] 0 2024-09-16T02:05:57.156 INFO:tasks.workunit.client.1.smithi165.stdout:1/835: truncate d1/d6b/df6/fd1 1273961 0 2024-09-16T02:05:57.156 INFO:tasks.workunit.client.1.smithi165.stdout:0/679: chown d0/d1e/d39/d48/f75 4147109 1 2024-09-16T02:05:57.156 INFO:tasks.workunit.client.1.smithi165.stdout:1/836: chown d1/d22 503 1 2024-09-16T02:05:57.157 INFO:tasks.workunit.client.0.smithi110.stdout:1/340: rmdir d0/d25/d63/d5f 0 2024-09-16T02:05:57.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/837: chown d1/d19/d24/d30/d72 65348 1 2024-09-16T02:05:57.158 INFO:tasks.workunit.client.1.smithi165.stdout:8/766: dread dd/d11/f47 [0,4194304] 0 2024-09-16T02:05:57.159 INFO:tasks.workunit.client.1.smithi165.stdout:1/838: chown d1/dd/d11/d46/fdf 100829817 1 2024-09-16T02:05:57.159 INFO:tasks.workunit.client.1.smithi165.stdout:2/777: mkdir df/d10/d37/de7 0 2024-09-16T02:05:57.160 INFO:tasks.workunit.client.0.smithi110.stdout:0/338: rename d3/d4/dc/f5e to d3/d6/d43/f67 0 2024-09-16T02:05:57.160 INFO:tasks.workunit.client.1.smithi165.stdout:8/767: write dd/d62/fc0 [3831193,31929] 0 2024-09-16T02:05:57.161 INFO:tasks.workunit.client.0.smithi110.stdout:0/339: chown d3/d4/dc/c40 832 1 2024-09-16T02:05:57.161 INFO:tasks.workunit.client.1.smithi165.stdout:1/839: dread - d1/dd/d11/d46/fdf zero size 2024-09-16T02:05:57.162 INFO:tasks.workunit.client.1.smithi165.stdout:8/768: stat dd/d11/daa/lb5 0 2024-09-16T02:05:57.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/229: getdents d1/d1b 0 2024-09-16T02:05:57.163 INFO:tasks.workunit.client.1.smithi165.stdout:1/840: chown d1/d19/d24/d30/d72 336 1 2024-09-16T02:05:57.165 INFO:tasks.workunit.client.1.smithi165.stdout:0/680: dwrite d0/d1e/d39/d48/f8f [0,4194304] 0 2024-09-16T02:05:57.168 INFO:tasks.workunit.client.1.smithi165.stdout:4/676: dread d4/dc/d28/d2b/f74 [0,4194304] 0 2024-09-16T02:05:57.170 INFO:tasks.workunit.client.1.smithi165.stdout:1/841: symlink d1/d19/d24/d30/l110 0 2024-09-16T02:05:57.170 INFO:tasks.workunit.client.0.smithi110.stdout:1/341: rmdir d0/d1/d4/d70 0 2024-09-16T02:05:57.172 INFO:tasks.workunit.client.0.smithi110.stdout:1/342: dread d0/d1/d4/f24 [0,4194304] 0 2024-09-16T02:05:57.174 INFO:tasks.workunit.client.1.smithi165.stdout:0/681: dread - d0/d1e/d39/fc8 zero size 2024-09-16T02:05:57.174 INFO:tasks.workunit.client.0.smithi110.stdout:1/343: write d0/d1/d2a/d32/f33 [5018680,129206] 0 2024-09-16T02:05:57.175 INFO:tasks.workunit.client.0.smithi110.stdout:9/230: creat d1/f4f x:0 0 0 2024-09-16T02:05:57.176 INFO:tasks.workunit.client.1.smithi165.stdout:8/769: truncate dd/d11/d14/d3f/d25/d36/d81/dd2/f32 4248862 0 2024-09-16T02:05:57.177 INFO:tasks.workunit.client.1.smithi165.stdout:8/770: fdatasync dd/d11/d14/d3f/d72/fab 0 2024-09-16T02:05:57.178 INFO:tasks.workunit.client.1.smithi165.stdout:1/842: rename d1/d6b/df6/fd1 to d1/dd/d11/d33/d92/f111 0 2024-09-16T02:05:57.179 INFO:tasks.workunit.client.0.smithi110.stdout:0/340: dwrite d3/d6/d43/f67 [0,4194304] 0 2024-09-16T02:05:57.180 INFO:tasks.workunit.client.1.smithi165.stdout:1/843: truncate d1/dd/d11/d33/d3f/d47/f8d 853461 0 2024-09-16T02:05:57.181 INFO:tasks.workunit.client.0.smithi110.stdout:1/344: stat d0/da/c59 0 2024-09-16T02:05:57.184 INFO:tasks.workunit.client.1.smithi165.stdout:8/771: creat dd/d11/d14/d3f/d25/d36/d81/f10b x:0 0 0 2024-09-16T02:05:57.185 INFO:tasks.workunit.client.1.smithi165.stdout:2/778: truncate df/d10/d37/f3d 1024681 0 2024-09-16T02:05:57.187 INFO:tasks.workunit.client.0.smithi110.stdout:1/345: symlink d0/d1/d2a/d32/d6e/l71 0 2024-09-16T02:05:57.188 INFO:tasks.workunit.client.1.smithi165.stdout:8/772: mknod dd/d34/dd7/c10c 0 2024-09-16T02:05:57.190 INFO:tasks.workunit.client.0.smithi110.stdout:0/341: dread d3/d4/f23 [4194304,4194304] 0 2024-09-16T02:05:57.192 INFO:tasks.workunit.client.1.smithi165.stdout:0/682: link d0/d2a/fca d0/d1e/d20/d28/fe1 0 2024-09-16T02:05:57.196 INFO:tasks.workunit.client.1.smithi165.stdout:2/779: mknod df/d23/d28/d3b/d6d/d8b/ce8 0 2024-09-16T02:05:57.196 INFO:tasks.workunit.client.0.smithi110.stdout:9/231: link d1/l31 d1/d5/d8/de/l50 0 2024-09-16T02:05:57.196 INFO:tasks.workunit.client.0.smithi110.stdout:0/342: dwrite d3/d4/dc/f1e [0,4194304] 0 2024-09-16T02:05:57.197 INFO:tasks.workunit.client.1.smithi165.stdout:0/683: dwrite d0/f9 [0,4194304] 0 2024-09-16T02:05:57.198 INFO:tasks.workunit.client.1.smithi165.stdout:1/844: dread d1/dd/d11/f1b [4194304,4194304] 0 2024-09-16T02:05:57.199 INFO:tasks.workunit.client.1.smithi165.stdout:0/684: dread - d0/d1e/d20/d28/da7/db4/fe0 zero size 2024-09-16T02:05:57.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:56 smithi165 ceph-mon[34621]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 67 MiB/s rd, 263 MiB/s wr, 499 op/s 2024-09-16T02:05:57.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/773: symlink dd/l10d 0 2024-09-16T02:05:57.205 INFO:tasks.workunit.client.1.smithi165.stdout:1/845: mkdir d1/d19/d4d/d84/d112 0 2024-09-16T02:05:57.205 INFO:tasks.workunit.client.0.smithi110.stdout:0/343: truncate d3/d6/f39 1000966 0 2024-09-16T02:05:57.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:56 smithi110 ceph-mon[27634]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 67 MiB/s rd, 263 MiB/s wr, 499 op/s 2024-09-16T02:05:57.206 INFO:tasks.workunit.client.0.smithi110.stdout:0/344: write d3/d6/f21 [3004511,54527] 0 2024-09-16T02:05:57.208 INFO:tasks.workunit.client.1.smithi165.stdout:8/774: fdatasync dd/d11/d14/fbc 0 2024-09-16T02:05:57.209 INFO:tasks.workunit.client.0.smithi110.stdout:1/346: write d0/d1/d2a/f34 [1863008,16421] 0 2024-09-16T02:05:57.211 INFO:tasks.workunit.client.1.smithi165.stdout:0/685: dwrite d0/d1e/d39/d48/d45/f95 [0,4194304] 0 2024-09-16T02:05:57.211 INFO:tasks.workunit.client.1.smithi165.stdout:1/846: symlink d1/d19/d4d/d84/l113 0 2024-09-16T02:05:57.212 INFO:tasks.workunit.client.1.smithi165.stdout:6/719: sync 2024-09-16T02:05:57.212 INFO:tasks.workunit.client.1.smithi165.stdout:1/847: read - d1/d19/d24/d30/f105 zero size 2024-09-16T02:05:57.214 INFO:tasks.workunit.client.1.smithi165.stdout:1/848: fdatasync d1/dd/d11/d33/f8a 0 2024-09-16T02:05:57.214 INFO:tasks.workunit.client.0.smithi110.stdout:0/345: creat d3/d4/dc/f68 x:0 0 0 2024-09-16T02:05:57.215 INFO:tasks.workunit.client.1.smithi165.stdout:8/775: symlink dd/d11/d14/d3f/l10e 0 2024-09-16T02:05:57.216 INFO:tasks.workunit.client.1.smithi165.stdout:1/849: write d1/d22/f10b [930932,52860] 0 2024-09-16T02:05:57.216 INFO:tasks.workunit.client.1.smithi165.stdout:2/780: getdents df/d23/d28/d9a 0 2024-09-16T02:05:57.219 INFO:tasks.workunit.client.0.smithi110.stdout:0/346: rename d3/d4/dc/d10/c30 to d3/d6/d4b/c69 0 2024-09-16T02:05:57.219 INFO:tasks.workunit.client.1.smithi165.stdout:8/776: fdatasync dd/d11/daa/fad 0 2024-09-16T02:05:57.220 INFO:tasks.workunit.client.1.smithi165.stdout:0/686: creat d0/d1e/d39/d48/d45/db3/fe2 x:0 0 0 2024-09-16T02:05:57.221 INFO:tasks.workunit.client.1.smithi165.stdout:6/720: dread d7/d17/d75/d97/f9b [0,4194304] 0 2024-09-16T02:05:57.223 INFO:tasks.workunit.client.1.smithi165.stdout:8/777: symlink dd/d11/d14/d3f/d72/l10f 0 2024-09-16T02:05:57.228 INFO:tasks.workunit.client.1.smithi165.stdout:1/850: dwrite d1/dd/d11/d33/f8a [0,4194304] 0 2024-09-16T02:05:57.228 INFO:tasks.workunit.client.1.smithi165.stdout:8/778: symlink dd/d11/d14/d3f/d25/d36/d85/l110 0 2024-09-16T02:05:57.229 INFO:tasks.workunit.client.1.smithi165.stdout:1/851: fsync d1/fd9 0 2024-09-16T02:05:57.229 INFO:tasks.workunit.client.1.smithi165.stdout:2/781: dread df/f90 [0,4194304] 0 2024-09-16T02:05:57.231 INFO:tasks.workunit.client.1.smithi165.stdout:6/721: dread d7/d17/f69 [0,4194304] 0 2024-09-16T02:05:57.234 INFO:tasks.workunit.client.1.smithi165.stdout:8/779: readlink dd/d11/d14/d3f/d25/d36/d81/dd2/d89/l101 0 2024-09-16T02:05:57.236 INFO:tasks.workunit.client.1.smithi165.stdout:1/852: rename d1/dd/d11/d46/fce to d1/dd/d11/d33/d67/dcc/f114 0 2024-09-16T02:05:57.237 INFO:tasks.workunit.client.1.smithi165.stdout:0/687: link d0/d1e/d39/d48/d5f/d96/da4/dbb/lde d0/d1e/d39/d99/le3 0 2024-09-16T02:05:57.240 INFO:tasks.workunit.client.1.smithi165.stdout:6/722: mkdir d7/dc/d7f/dca 0 2024-09-16T02:05:57.242 INFO:tasks.workunit.client.1.smithi165.stdout:6/723: truncate d7/d1f/f33 4776670 0 2024-09-16T02:05:57.243 INFO:tasks.workunit.client.1.smithi165.stdout:8/780: getdents dd/d11/d14/d70/d7b/df2 0 2024-09-16T02:05:57.243 INFO:tasks.workunit.client.1.smithi165.stdout:0/688: link d0/d1e/d39/d48/d5f/d96/dac/cdb d0/d1e/d20/d28/d9a/ce4 0 2024-09-16T02:05:57.244 INFO:tasks.workunit.client.1.smithi165.stdout:1/853: dwrite d1/dd/d11/d33/d3f/d47/f8d [0,4194304] 0 2024-09-16T02:05:57.246 INFO:tasks.workunit.client.1.smithi165.stdout:0/689: truncate d0/d1e/d20/d28/fe1 925300 0 2024-09-16T02:05:57.248 INFO:tasks.workunit.client.1.smithi165.stdout:8/781: rename dd/d11/d14/d70/fa7 to dd/d62/f111 0 2024-09-16T02:05:57.250 INFO:tasks.workunit.client.1.smithi165.stdout:8/782: fsync dd/d11/daa/fcb 0 2024-09-16T02:05:57.253 INFO:tasks.workunit.client.1.smithi165.stdout:6/724: rename d7/dc/d3b/d3a to d7/d17/d75/d97/dcb 0 2024-09-16T02:05:57.254 INFO:tasks.workunit.client.1.smithi165.stdout:1/854: dwrite d1/d19/d24/d30/f105 [0,4194304] 0 2024-09-16T02:05:57.255 INFO:tasks.workunit.client.1.smithi165.stdout:6/725: dread - d7/dc/d3b/d86/fa5 zero size 2024-09-16T02:05:57.258 INFO:tasks.workunit.client.1.smithi165.stdout:1/855: write d1/dd/d11/d33/d35/fb9 [693259,100115] 0 2024-09-16T02:05:57.259 INFO:tasks.workunit.client.0.smithi110.stdout:0/347: dread d3/d6/ff [0,4194304] 0 2024-09-16T02:05:57.260 INFO:tasks.workunit.client.0.smithi110.stdout:0/348: stat d3/d4/dc/c40 0 2024-09-16T02:05:57.260 INFO:tasks.workunit.client.1.smithi165.stdout:6/726: chown d7/d17/d75/d97/dcb/d3d/dbd 995931 1 2024-09-16T02:05:57.260 INFO:tasks.workunit.client.1.smithi165.stdout:2/782: dwrite df/d10/d1a/d2d/dd1/d79/fd6 [0,4194304] 0 2024-09-16T02:05:57.261 INFO:tasks.workunit.client.1.smithi165.stdout:0/690: link d0/d1e/d39/d99/le3 d0/d61/le5 0 2024-09-16T02:05:57.262 INFO:tasks.workunit.client.0.smithi110.stdout:0/349: symlink d3/d6/d4b/l6a 0 2024-09-16T02:05:57.262 INFO:tasks.workunit.client.1.smithi165.stdout:2/783: truncate df/fc5 1316255 0 2024-09-16T02:05:57.263 INFO:tasks.workunit.client.0.smithi110.stdout:0/350: chown d3/d4/dc/d10/f66 1613601 1 2024-09-16T02:05:57.265 INFO:tasks.workunit.client.1.smithi165.stdout:6/727: mkdir d7/d17/d75/d97/dcb/d3d/d5d/dcc 0 2024-09-16T02:05:57.266 INFO:tasks.workunit.client.1.smithi165.stdout:8/783: write dd/d11/d14/d70/d7b/d9a/fcc [828973,82879] 0 2024-09-16T02:05:57.268 INFO:tasks.workunit.client.0.smithi110.stdout:0/351: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:05:57.269 INFO:tasks.workunit.client.1.smithi165.stdout:0/691: rename d0/d1e/d39/c80 to d0/d2a/d70/ce6 0 2024-09-16T02:05:57.271 INFO:tasks.workunit.client.1.smithi165.stdout:6/728: mkdir d7/dc/d3b/d3c/dcd 0 2024-09-16T02:05:57.272 INFO:tasks.workunit.client.0.smithi110.stdout:0/352: mknod d3/d6/d43/d55/c6b 0 2024-09-16T02:05:57.273 INFO:tasks.workunit.client.1.smithi165.stdout:1/856: dwrite d1/d19/d24/d97/fea [0,4194304] 0 2024-09-16T02:05:57.273 INFO:tasks.workunit.client.1.smithi165.stdout:0/692: chown d0/d1e/l4c 36 1 2024-09-16T02:05:57.274 INFO:tasks.workunit.client.1.smithi165.stdout:2/784: dwrite df/d10/d1a/d2d/dd1/f7c [0,4194304] 0 2024-09-16T02:05:57.276 INFO:tasks.workunit.client.0.smithi110.stdout:0/353: link d3/d6/c2f d3/d6/c6c 0 2024-09-16T02:05:57.278 INFO:tasks.workunit.client.0.smithi110.stdout:0/354: truncate d3/d4/d41/f5f 902152 0 2024-09-16T02:05:57.278 INFO:tasks.workunit.client.0.smithi110.stdout:0/355: readlink d3/d4/d41/l5d 0 2024-09-16T02:05:57.280 INFO:tasks.workunit.client.0.smithi110.stdout:0/356: truncate d3/d6/d4b/f51 84947 0 2024-09-16T02:05:57.281 INFO:tasks.workunit.client.0.smithi110.stdout:1/347: dread d0/d1/d4/f31 [0,4194304] 0 2024-09-16T02:05:57.281 INFO:tasks.workunit.client.1.smithi165.stdout:1/857: mknod d1/d68/de7/c115 0 2024-09-16T02:05:57.282 INFO:tasks.workunit.client.0.smithi110.stdout:1/348: stat d0/d1/c50 0 2024-09-16T02:05:57.283 INFO:tasks.workunit.client.1.smithi165.stdout:8/784: getdents dd/d11/d14/d70/d7b/df2/dfc 0 2024-09-16T02:05:57.284 INFO:tasks.workunit.client.1.smithi165.stdout:0/693: symlink d0/d1e/d20/d28/d6d/le7 0 2024-09-16T02:05:57.285 INFO:tasks.workunit.client.0.smithi110.stdout:0/357: mkdir d3/d4/d6d 0 2024-09-16T02:05:57.285 INFO:tasks.workunit.client.1.smithi165.stdout:6/729: dwrite d7/dc/df/d1a/fbb [0,4194304] 0 2024-09-16T02:05:57.285 INFO:tasks.workunit.client.0.smithi110.stdout:0/358: readlink d3/d6/d43/l47 0 2024-09-16T02:05:57.287 INFO:tasks.workunit.client.0.smithi110.stdout:0/359: chown d3/d4/f4a 0 1 2024-09-16T02:05:57.289 INFO:tasks.workunit.client.0.smithi110.stdout:1/349: dwrite d0/d1/f3f [0,4194304] 0 2024-09-16T02:05:57.290 INFO:tasks.workunit.client.1.smithi165.stdout:8/785: symlink dd/d11/d14/d3f/d25/d36/d81/l112 0 2024-09-16T02:05:57.290 INFO:tasks.workunit.client.1.smithi165.stdout:1/858: mkdir d1/dd/d11/d33/d3f/d59/d116 0 2024-09-16T02:05:57.294 INFO:tasks.workunit.client.0.smithi110.stdout:0/360: mknod d3/d4/d6d/c6e 0 2024-09-16T02:05:57.295 INFO:tasks.workunit.client.1.smithi165.stdout:2/785: dread df/d23/d28/d9a/f9d [0,4194304] 0 2024-09-16T02:05:57.295 INFO:tasks.workunit.client.1.smithi165.stdout:6/730: creat d7/dc/df/d1a/d4d/fce x:0 0 0 2024-09-16T02:05:57.299 INFO:tasks.workunit.client.1.smithi165.stdout:8/786: link dd/d11/d14/def/f102 dd/d11/d14/d3f/d25/d36/d85/f113 0 2024-09-16T02:05:57.299 INFO:tasks.workunit.client.1.smithi165.stdout:1/859: dwrite d1/dd/d11/d33/d3f/d59/f10c [0,4194304] 0 2024-09-16T02:05:57.299 INFO:tasks.workunit.client.0.smithi110.stdout:0/361: dread d3/f17 [0,4194304] 0 2024-09-16T02:05:57.300 INFO:tasks.workunit.client.0.smithi110.stdout:0/362: chown d3/d4/dc/d14/f19 24 1 2024-09-16T02:05:57.300 INFO:tasks.workunit.client.1.smithi165.stdout:2/786: mknod df/d10/d37/de7/ce9 0 2024-09-16T02:05:57.302 INFO:tasks.workunit.client.0.smithi110.stdout:0/363: truncate d3/d6/f34 1639512 0 2024-09-16T02:05:57.303 INFO:tasks.workunit.client.1.smithi165.stdout:8/787: rmdir dd/d11/d14/d3f/d25/d36/d81/dd2 39 2024-09-16T02:05:57.304 INFO:tasks.workunit.client.1.smithi165.stdout:1/860: creat d1/d19/d24/d30/f117 x:0 0 0 2024-09-16T02:05:57.304 INFO:tasks.workunit.client.1.smithi165.stdout:2/787: rmdir df/d23/d28/d3b 39 2024-09-16T02:05:57.305 INFO:tasks.workunit.client.1.smithi165.stdout:8/788: chown dd/d11/d14/d70/d7b/d9a 4400990 1 2024-09-16T02:05:57.305 INFO:tasks.workunit.client.1.smithi165.stdout:7/754: sync 2024-09-16T02:05:57.305 INFO:tasks.workunit.client.0.smithi110.stdout:0/364: unlink d3/d6/f44 0 2024-09-16T02:05:57.305 INFO:tasks.workunit.client.1.smithi165.stdout:6/731: dwrite d7/dc/df/d1a/d4d/d5f/f88 [0,4194304] 0 2024-09-16T02:05:57.307 INFO:tasks.workunit.client.0.smithi110.stdout:0/365: creat d3/d6/d43/d55/f6f x:0 0 0 2024-09-16T02:05:57.310 INFO:tasks.workunit.client.1.smithi165.stdout:1/861: creat d1/dd/d11/d42/f118 x:0 0 0 2024-09-16T02:05:57.312 INFO:tasks.workunit.client.0.smithi110.stdout:0/366: mkdir d3/d4/dc/d70 0 2024-09-16T02:05:57.312 INFO:tasks.workunit.client.1.smithi165.stdout:6/732: symlink d7/d17/d75/d97/lcf 0 2024-09-16T02:05:57.313 INFO:tasks.workunit.client.1.smithi165.stdout:2/788: readlink df/d10/d1a/d2d/dd1/d79/db1/ld0 0 2024-09-16T02:05:57.314 INFO:tasks.workunit.client.0.smithi110.stdout:0/367: read d3/d6/d43/d55/d59/f5c [4130803,117063] 0 2024-09-16T02:05:57.314 INFO:tasks.workunit.client.1.smithi165.stdout:1/862: truncate d1/d19/d4d/fab 119342 0 2024-09-16T02:05:57.315 INFO:tasks.workunit.client.1.smithi165.stdout:2/789: stat df/d10/d1a/c97 0 2024-09-16T02:05:57.315 INFO:tasks.workunit.client.0.smithi110.stdout:0/368: write d3/d4/f27 [2936307,45741] 0 2024-09-16T02:05:57.318 INFO:tasks.workunit.client.1.smithi165.stdout:6/733: mkdir d7/d17/d75/d97/dcb/d3d/dd0 0 2024-09-16T02:05:57.321 INFO:tasks.workunit.client.1.smithi165.stdout:1/863: creat d1/dd/d11/d33/d3f/d47/d7d/db3/f119 x:0 0 0 2024-09-16T02:05:57.322 INFO:tasks.workunit.client.1.smithi165.stdout:6/734: creat d7/dc/d7f/fd1 x:0 0 0 2024-09-16T02:05:57.327 INFO:tasks.workunit.client.1.smithi165.stdout:2/790: creat df/d23/d28/d3b/fea x:0 0 0 2024-09-16T02:05:57.328 INFO:tasks.workunit.client.0.smithi110.stdout:1/350: dread d0/d1/f53 [0,4194304] 0 2024-09-16T02:05:57.328 INFO:tasks.workunit.client.0.smithi110.stdout:1/351: truncate d0/da/f6a 889675 0 2024-09-16T02:05:57.329 INFO:tasks.workunit.client.0.smithi110.stdout:1/352: chown d0/d1/l30 26463 1 2024-09-16T02:05:57.329 INFO:tasks.workunit.client.0.smithi110.stdout:0/369: unlink d3/d6/f34 0 2024-09-16T02:05:57.330 INFO:tasks.workunit.client.1.smithi165.stdout:2/791: fdatasync df/d23/f84 0 2024-09-16T02:05:57.331 INFO:tasks.workunit.client.1.smithi165.stdout:2/792: chown df/d23/d28/d3b/d6d 8 1 2024-09-16T02:05:57.331 INFO:tasks.workunit.client.1.smithi165.stdout:2/793: stat df/d23/d66 0 2024-09-16T02:05:57.334 INFO:tasks.workunit.client.0.smithi110.stdout:1/353: creat d0/d1/d4/d46/d51/f72 x:0 0 0 2024-09-16T02:05:57.334 INFO:tasks.workunit.client.1.smithi165.stdout:7/755: write d0/df/d7/f7e [967747,45662] 0 2024-09-16T02:05:57.335 INFO:tasks.workunit.client.0.smithi110.stdout:0/370: dread d3/d6/d43/f67 [0,4194304] 0 2024-09-16T02:05:57.335 INFO:tasks.workunit.client.1.smithi165.stdout:7/756: chown d0/d3d/lc6 743061 1 2024-09-16T02:05:57.335 INFO:tasks.workunit.client.1.smithi165.stdout:7/757: read - d0/d3d/dd5/fe7 zero size 2024-09-16T02:05:57.336 INFO:tasks.workunit.client.1.smithi165.stdout:2/794: creat df/d23/d28/d3b/feb x:0 0 0 2024-09-16T02:05:57.337 INFO:tasks.workunit.client.1.smithi165.stdout:8/789: write dd/d11/d14/d3f/d72/f87 [705451,14800] 0 2024-09-16T02:05:57.339 INFO:tasks.workunit.client.1.smithi165.stdout:8/790: chown dd/d11/d38/f39 4 1 2024-09-16T02:05:57.341 INFO:tasks.workunit.client.0.smithi110.stdout:0/371: dwrite d3/d4/d41/f48 [0,4194304] 0 2024-09-16T02:05:57.342 INFO:tasks.workunit.client.0.smithi110.stdout:0/372: chown d3/d6/d4b/f4d 0 1 2024-09-16T02:05:57.343 INFO:tasks.workunit.client.1.smithi165.stdout:8/791: write dd/d11/d14/d3f/d25/fdc [1932477,89368] 0 2024-09-16T02:05:57.344 INFO:tasks.workunit.client.1.smithi165.stdout:7/758: dwrite d0/d4b/db4/ff4 [0,4194304] 0 2024-09-16T02:05:57.346 INFO:tasks.workunit.client.0.smithi110.stdout:0/373: dread d3/f17 [0,4194304] 0 2024-09-16T02:05:57.349 INFO:tasks.workunit.client.0.smithi110.stdout:0/374: unlink d3/d4/f23 0 2024-09-16T02:05:57.350 INFO:tasks.workunit.client.0.smithi110.stdout:0/375: read d3/d6/d4b/f51 [76637,65032] 0 2024-09-16T02:05:57.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/354: truncate d0/d1/d2a/f34 3331937 0 2024-09-16T02:05:57.351 INFO:tasks.workunit.client.0.smithi110.stdout:0/376: fsync d3/d6/d43/d55/f6f 0 2024-09-16T02:05:57.352 INFO:tasks.workunit.client.0.smithi110.stdout:1/355: dread - d0/d1/d4/d46/d64/f66 zero size 2024-09-16T02:05:57.352 INFO:tasks.workunit.client.0.smithi110.stdout:0/377: write d3/d4/f1d [3044310,15675] 0 2024-09-16T02:05:57.353 INFO:tasks.workunit.client.1.smithi165.stdout:2/795: dwrite df/d23/d28/d9a/d86/fd2 [0,4194304] 0 2024-09-16T02:05:57.354 INFO:tasks.workunit.client.0.smithi110.stdout:1/356: truncate d0/da/f17 4907624 0 2024-09-16T02:05:57.354 INFO:tasks.workunit.client.0.smithi110.stdout:0/378: chown d3/d4/d41/l5d 7150976 1 2024-09-16T02:05:57.355 INFO:tasks.workunit.client.0.smithi110.stdout:0/379: chown d3/d6/d4b/l6a 42 1 2024-09-16T02:05:57.359 INFO:tasks.workunit.client.1.smithi165.stdout:1/864: dwrite d1/d22/f6f [0,4194304] 0 2024-09-16T02:05:57.362 INFO:tasks.workunit.client.1.smithi165.stdout:1/865: dread - d1/dd/f103 zero size 2024-09-16T02:05:57.364 INFO:tasks.workunit.client.1.smithi165.stdout:1/866: chown d1/dd/d11/f1b 213980 1 2024-09-16T02:05:57.364 INFO:tasks.workunit.client.1.smithi165.stdout:6/735: dwrite d7/dc/df/d1a/f4f [0,4194304] 0 2024-09-16T02:05:57.367 INFO:tasks.workunit.client.1.smithi165.stdout:8/792: dwrite dd/d11/d14/d3f/d72/f87 [0,4194304] 0 2024-09-16T02:05:57.369 INFO:tasks.workunit.client.1.smithi165.stdout:1/867: unlink d1/dd/d11/d33/fb1 0 2024-09-16T02:05:57.372 INFO:tasks.workunit.client.1.smithi165.stdout:1/868: truncate d1/dd/d11/fe8 1180628 0 2024-09-16T02:05:57.373 INFO:tasks.workunit.client.1.smithi165.stdout:6/736: rename d7/dc/d3b to d7/dc/d7f/dd2 0 2024-09-16T02:05:57.377 INFO:tasks.workunit.client.1.smithi165.stdout:8/793: rename dd/d11/d14/d70/d7b/d9a/ca1 to dd/d62/c114 0 2024-09-16T02:05:57.383 INFO:tasks.workunit.client.1.smithi165.stdout:6/737: creat d7/fd3 x:0 0 0 2024-09-16T02:05:57.384 INFO:tasks.workunit.client.1.smithi165.stdout:6/738: readlink d7/dc/l1b 0 2024-09-16T02:05:57.384 INFO:tasks.workunit.client.1.smithi165.stdout:8/794: truncate dd/d11/d14/d3f/d25/d36/d4f/f98 415625 0 2024-09-16T02:05:57.385 INFO:tasks.workunit.client.1.smithi165.stdout:1/869: getdents d1/d6b/dd7 0 2024-09-16T02:05:57.387 INFO:tasks.workunit.client.1.smithi165.stdout:6/739: symlink d7/d17/d75/ld4 0 2024-09-16T02:05:57.389 INFO:tasks.workunit.client.1.smithi165.stdout:1/870: symlink d1/dd/d11/d33/d3f/d6c/dde/l11a 0 2024-09-16T02:05:57.390 INFO:tasks.workunit.client.0.smithi110.stdout:3/216: sync 2024-09-16T02:05:57.390 INFO:tasks.workunit.client.0.smithi110.stdout:2/293: sync 2024-09-16T02:05:57.390 INFO:tasks.workunit.client.0.smithi110.stdout:8/292: sync 2024-09-16T02:05:57.391 INFO:tasks.workunit.client.0.smithi110.stdout:6/404: sync 2024-09-16T02:05:57.391 INFO:tasks.workunit.client.0.smithi110.stdout:7/225: sync 2024-09-16T02:05:57.391 INFO:tasks.workunit.client.0.smithi110.stdout:5/264: sync 2024-09-16T02:05:57.391 INFO:tasks.workunit.client.0.smithi110.stdout:4/334: sync 2024-09-16T02:05:57.391 INFO:tasks.workunit.client.0.smithi110.stdout:0/380: dwrite d3/d6/f39 [0,4194304] 0 2024-09-16T02:05:57.391 INFO:tasks.workunit.client.1.smithi165.stdout:7/759: dread d0/d4b/db4/dba/fbd [0,4194304] 0 2024-09-16T02:05:57.393 INFO:tasks.workunit.client.1.smithi165.stdout:8/795: link dd/d11/d14/d3f/f6a dd/d11/d14/d70/d7b/d9a/f115 0 2024-09-16T02:05:57.394 INFO:tasks.workunit.client.0.smithi110.stdout:5/265: chown d5/dd/l3e 1025078 1 2024-09-16T02:05:57.395 INFO:tasks.workunit.client.0.smithi110.stdout:0/381: chown d3/d6/d43/d55/d59 12393563 1 2024-09-16T02:05:57.396 INFO:tasks.workunit.client.0.smithi110.stdout:3/217: truncate d8/d29/f30 78744 0 2024-09-16T02:05:57.396 INFO:tasks.workunit.client.0.smithi110.stdout:6/405: mkdir d0/d2/d57/d7a 0 2024-09-16T02:05:57.397 INFO:tasks.workunit.client.1.smithi165.stdout:6/740: dwrite d7/dc/f48 [0,4194304] 0 2024-09-16T02:05:57.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/293: mkdir d3/d2b/d27/d45/d66 0 2024-09-16T02:05:57.399 INFO:tasks.workunit.client.0.smithi110.stdout:4/335: write d4/d8/d31/d36/d4f/f58 [1084773,76862] 0 2024-09-16T02:05:57.399 INFO:tasks.workunit.client.0.smithi110.stdout:5/266: symlink d5/d36/d3d/l5a 0 2024-09-16T02:05:57.400 INFO:tasks.workunit.client.1.smithi165.stdout:1/871: dwrite d1/f3a [0,4194304] 0 2024-09-16T02:05:57.401 INFO:tasks.workunit.client.1.smithi165.stdout:5/743: sync 2024-09-16T02:05:57.401 INFO:tasks.workunit.client.1.smithi165.stdout:3/828: sync 2024-09-16T02:05:57.401 INFO:tasks.workunit.client.1.smithi165.stdout:4/677: sync 2024-09-16T02:05:57.401 INFO:tasks.workunit.client.1.smithi165.stdout:9/821: sync 2024-09-16T02:05:57.402 INFO:tasks.workunit.client.0.smithi110.stdout:1/357: dread d0/d1/d2a/d32/f41 [0,4194304] 0 2024-09-16T02:05:57.403 INFO:tasks.workunit.client.0.smithi110.stdout:4/336: chown d4/d8/d31/d36/f62 1939 1 2024-09-16T02:05:57.403 INFO:tasks.workunit.client.0.smithi110.stdout:2/294: dwrite d0/da/f24 [0,4194304] 0 2024-09-16T02:05:57.404 INFO:tasks.workunit.client.0.smithi110.stdout:0/382: creat d3/d4/d6d/f71 x:0 0 0 2024-09-16T02:05:57.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/872: chown d1/dd/d11/fe8 597 1 2024-09-16T02:05:57.407 INFO:tasks.workunit.client.1.smithi165.stdout:3/829: truncate da/d17/de5/d104/d2c/db7/f10d 798412 0 2024-09-16T02:05:57.409 INFO:tasks.workunit.client.1.smithi165.stdout:1/873: fdatasync d1/dd/f2e 0 2024-09-16T02:05:57.411 INFO:tasks.workunit.client.0.smithi110.stdout:8/294: creat d3/d2b/d27/f67 x:0 0 0 2024-09-16T02:05:57.415 INFO:tasks.workunit.client.1.smithi165.stdout:6/741: symlink d7/d17/d75/d97/dcb/d74/db7/ld5 0 2024-09-16T02:05:57.419 INFO:tasks.workunit.client.1.smithi165.stdout:5/744: dwrite de/f5b [0,4194304] 0 2024-09-16T02:05:57.420 INFO:tasks.workunit.client.1.smithi165.stdout:3/830: dwrite da/d17/de5/d104/d2c/d10c/f93 [0,4194304] 0 2024-09-16T02:05:57.420 INFO:tasks.workunit.client.0.smithi110.stdout:3/218: mknod d8/d29/d45/c4a 0 2024-09-16T02:05:57.422 INFO:tasks.workunit.client.0.smithi110.stdout:4/337: creat d4/d8/d31/d36/d4f/f69 x:0 0 0 2024-09-16T02:05:57.423 INFO:tasks.workunit.client.1.smithi165.stdout:3/831: read - da/d17/de5/d104/d2c/db7/fc1 zero size 2024-09-16T02:05:57.424 INFO:tasks.workunit.client.0.smithi110.stdout:7/226: dwrite f1 [0,4194304] 0 2024-09-16T02:05:57.425 INFO:tasks.workunit.client.0.smithi110.stdout:7/227: chown d3/da/d10/d11/d3e/d40 1865 1 2024-09-16T02:05:57.429 INFO:tasks.workunit.client.0.smithi110.stdout:8/295: write d3/d12/d1a/f5d [852772,96630] 0 2024-09-16T02:05:57.429 INFO:tasks.workunit.client.1.smithi165.stdout:7/760: rename d0/df/d33/d2a/f4d to d0/ff6 0 2024-09-16T02:05:57.429 INFO:tasks.workunit.client.1.smithi165.stdout:6/742: dwrite d7/dc/df/d1a/d4d/fc7 [0,4194304] 0 2024-09-16T02:05:57.431 INFO:tasks.workunit.client.1.smithi165.stdout:9/822: creat d7/df/d37/f107 x:0 0 0 2024-09-16T02:05:57.431 INFO:tasks.workunit.client.1.smithi165.stdout:5/745: creat de/d19/d1c/d84/daa/ff7 x:0 0 0 2024-09-16T02:05:57.433 INFO:tasks.workunit.client.1.smithi165.stdout:3/832: mkdir da/d17/de5/d104/d2c/d10c/d6b/d120 0 2024-09-16T02:05:57.437 INFO:tasks.workunit.client.1.smithi165.stdout:4/678: rename d4/dc/d20/d45/l6c to d4/dc/d18/d37/dc9/ldc 0 2024-09-16T02:05:57.440 INFO:tasks.workunit.client.0.smithi110.stdout:7/228: creat d3/da/d10/d11/d3e/f42 x:0 0 0 2024-09-16T02:05:57.442 INFO:tasks.workunit.client.0.smithi110.stdout:8/296: mkdir d3/d2b/d27/d45/d68 0 2024-09-16T02:05:57.443 INFO:tasks.workunit.client.0.smithi110.stdout:8/297: readlink d3/d12/l17 0 2024-09-16T02:05:57.444 INFO:tasks.workunit.client.0.smithi110.stdout:4/338: creat d4/d8/d31/d5d/f6a x:0 0 0 2024-09-16T02:05:57.444 INFO:tasks.workunit.client.1.smithi165.stdout:3/833: dwrite da/d20/d26/f51 [0,4194304] 0 2024-09-16T02:05:57.445 INFO:tasks.workunit.client.1.smithi165.stdout:6/743: symlink d7/dc/d7f/dca/ld6 0 2024-09-16T02:05:57.445 INFO:tasks.workunit.client.0.smithi110.stdout:5/267: getdents d5/d36/d45 0 2024-09-16T02:05:57.448 INFO:tasks.workunit.client.0.smithi110.stdout:4/339: write d4/d12/d18/f4d [77744,25581] 0 2024-09-16T02:05:57.448 INFO:tasks.workunit.client.0.smithi110.stdout:7/229: dwrite f1 [0,4194304] 0 2024-09-16T02:05:57.450 INFO:tasks.workunit.client.0.smithi110.stdout:1/358: dread d0/d1/d2a/d32/f3a [0,4194304] 0 2024-09-16T02:05:57.451 INFO:tasks.workunit.client.1.smithi165.stdout:9/823: rename d7/d32/d38/d53/d5c/d61/fcd to d7/d1f/ddb/f108 0 2024-09-16T02:05:57.454 INFO:tasks.workunit.client.1.smithi165.stdout:4/679: creat d4/dc/d18/d37/d53/d64/d91/fdd x:0 0 0 2024-09-16T02:05:57.455 INFO:tasks.workunit.client.0.smithi110.stdout:5/268: fsync d5/f1e 0 2024-09-16T02:05:57.455 INFO:tasks.workunit.client.1.smithi165.stdout:8/796: write dd/d62/f111 [2865756,27114] 0 2024-09-16T02:05:57.456 INFO:tasks.workunit.client.1.smithi165.stdout:6/744: symlink d7/dc/d7f/ld7 0 2024-09-16T02:05:57.457 INFO:tasks.workunit.client.0.smithi110.stdout:0/383: dread d3/d4/f1d [0,4194304] 0 2024-09-16T02:05:57.457 INFO:tasks.workunit.client.0.smithi110.stdout:9/232: sync 2024-09-16T02:05:57.458 INFO:tasks.workunit.client.1.smithi165.stdout:3/834: mkdir da/d17/de5/d104/d2c/db7/d121 0 2024-09-16T02:05:57.460 INFO:tasks.workunit.client.0.smithi110.stdout:1/359: mknod d0/d1/d4/c73 0 2024-09-16T02:05:57.461 INFO:tasks.workunit.client.0.smithi110.stdout:1/360: fsync d0/da/f17 0 2024-09-16T02:05:57.464 INFO:tasks.workunit.client.0.smithi110.stdout:8/298: link d3/d2b/f4a d3/d12/d1a/d36/d60/d62/d5f/f69 0 2024-09-16T02:05:57.464 INFO:tasks.workunit.client.0.smithi110.stdout:8/299: truncate d3/d12/f2f 4809463 0 2024-09-16T02:05:57.465 INFO:tasks.workunit.client.0.smithi110.stdout:5/269: fsync d5/f13 0 2024-09-16T02:05:57.465 INFO:tasks.workunit.client.1.smithi165.stdout:9/824: symlink d7/df/d37/d65/l109 0 2024-09-16T02:05:57.466 INFO:tasks.workunit.client.0.smithi110.stdout:7/230: mknod d3/da/c43 0 2024-09-16T02:05:57.467 INFO:tasks.workunit.client.1.smithi165.stdout:6/745: dwrite d7/dc/d7f/dd2/f59 [0,4194304] 0 2024-09-16T02:05:57.469 INFO:tasks.workunit.client.0.smithi110.stdout:0/384: unlink d3/d4/l2b 0 2024-09-16T02:05:57.471 INFO:tasks.workunit.client.0.smithi110.stdout:2/295: dwrite d0/da/f2c [4194304,4194304] 0 2024-09-16T02:05:57.473 INFO:tasks.workunit.client.1.smithi165.stdout:6/746: dread d7/dc/d7f/dd2/f44 [0,4194304] 0 2024-09-16T02:05:57.473 INFO:tasks.workunit.client.1.smithi165.stdout:3/835: dwrite da/d17/de5/d104/d2c/d2d/d6c/def/f114 [0,4194304] 0 2024-09-16T02:05:57.477 INFO:tasks.workunit.client.1.smithi165.stdout:0/694: sync 2024-09-16T02:05:57.477 INFO:tasks.workunit.client.1.smithi165.stdout:2/796: sync 2024-09-16T02:05:57.477 INFO:tasks.workunit.client.1.smithi165.stdout:5/746: dread de/d21/d26/d94/da8/fd0 [0,4194304] 0 2024-09-16T02:05:57.482 INFO:tasks.workunit.client.0.smithi110.stdout:2/296: dwrite d0/db/f2e [4194304,4194304] 0 2024-09-16T02:05:57.482 INFO:tasks.workunit.client.1.smithi165.stdout:2/797: truncate df/d23/d28/d3b/d6d/d8b/f8e 1225232 0 2024-09-16T02:05:57.483 INFO:tasks.workunit.client.0.smithi110.stdout:6/406: dread d0/d2/dc/d16/f3b [0,4194304] 0 2024-09-16T02:05:57.483 INFO:tasks.workunit.client.1.smithi165.stdout:3/836: creat da/d17/de5/d104/d2c/de8/f122 x:0 0 0 2024-09-16T02:05:57.485 INFO:tasks.workunit.client.0.smithi110.stdout:2/297: write d0/da/d18/d25/d3b/f53 [12049,42529] 0 2024-09-16T02:05:57.486 INFO:tasks.workunit.client.0.smithi110.stdout:8/300: symlink d3/d12/l6a 0 2024-09-16T02:05:57.487 INFO:tasks.workunit.client.1.smithi165.stdout:4/680: link d4/dc/d28/d2b/f74 d4/dc/d20/d4e/d73/fde 0 2024-09-16T02:05:57.489 INFO:tasks.workunit.client.1.smithi165.stdout:4/681: stat d4/dc/d18/fa8 0 2024-09-16T02:05:57.489 INFO:tasks.workunit.client.1.smithi165.stdout:2/798: dwrite df/fc5 [0,4194304] 0 2024-09-16T02:05:57.492 INFO:tasks.workunit.client.0.smithi110.stdout:7/231: mkdir d3/d15/d44 0 2024-09-16T02:05:57.497 INFO:tasks.workunit.client.1.smithi165.stdout:5/747: creat de/d21/d26/d94/d9d/ff8 x:0 0 0 2024-09-16T02:05:57.497 INFO:tasks.workunit.client.1.smithi165.stdout:5/748: fdatasync de/d19/f32 0 2024-09-16T02:05:57.497 INFO:tasks.workunit.client.0.smithi110.stdout:7/232: chown d3/da/d10/f3d 16 1 2024-09-16T02:05:57.498 INFO:tasks.workunit.client.1.smithi165.stdout:8/797: rename dd/l100 to dd/d11/d14/d3f/d25/d36/d81/dd2/d89/l116 0 2024-09-16T02:05:57.498 INFO:tasks.workunit.client.0.smithi110.stdout:9/233: symlink d1/d5/d8/l51 0 2024-09-16T02:05:57.499 INFO:tasks.workunit.client.1.smithi165.stdout:8/798: stat c7 0 2024-09-16T02:05:57.500 INFO:tasks.workunit.client.1.smithi165.stdout:8/799: readlink dd/l96 0 2024-09-16T02:05:57.502 INFO:tasks.workunit.client.1.smithi165.stdout:9/825: dread d7/fd [0,4194304] 0 2024-09-16T02:05:57.504 INFO:tasks.workunit.client.0.smithi110.stdout:2/298: dread d0/da/f24 [0,4194304] 0 2024-09-16T02:05:57.506 INFO:tasks.workunit.client.0.smithi110.stdout:5/270: dwrite d5/dd/f43 [0,4194304] 0 2024-09-16T02:05:57.506 INFO:tasks.workunit.client.0.smithi110.stdout:6/407: dwrite d0/d29/d2a/d2f/f58 [0,4194304] 0 2024-09-16T02:05:57.506 INFO:tasks.workunit.client.1.smithi165.stdout:7/761: dwrite d0/d2c/f8d [0,4194304] 0 2024-09-16T02:05:57.506 INFO:tasks.workunit.client.0.smithi110.stdout:3/219: dwrite d8/dc/f21 [0,4194304] 0 2024-09-16T02:05:57.508 INFO:tasks.workunit.client.1.smithi165.stdout:7/762: write d0/d4b/db4/fce [25143,2635] 0 2024-09-16T02:05:57.509 INFO:tasks.workunit.client.0.smithi110.stdout:9/234: chown d1/d2b/d2e/f3a 27 1 2024-09-16T02:05:57.509 INFO:tasks.workunit.client.1.smithi165.stdout:5/749: dwrite de/d21/d26/d3a/dd5/fd7 [0,4194304] 0 2024-09-16T02:05:57.512 INFO:tasks.workunit.client.0.smithi110.stdout:2/299: write d0/da/d18/d25/d3b/f53 [376160,30341] 0 2024-09-16T02:05:57.515 INFO:tasks.workunit.client.1.smithi165.stdout:2/799: rename df/d10/d1a/d2d/dd1/d79/ca5 to df/d23/d28/d3b/d6d/cec 0 2024-09-16T02:05:57.517 INFO:tasks.workunit.client.1.smithi165.stdout:2/800: truncate df/d10/d1a/fd3 814895 0 2024-09-16T02:05:57.518 INFO:tasks.workunit.client.1.smithi165.stdout:2/801: fdatasync df/d10/f13 0 2024-09-16T02:05:57.521 INFO:tasks.workunit.client.0.smithi110.stdout:4/340: getdents d4/d8/d31/d36/d3c 0 2024-09-16T02:05:57.521 INFO:tasks.workunit.client.0.smithi110.stdout:9/235: dwrite d1/d5/d8/de/f46 [0,4194304] 0 2024-09-16T02:05:57.526 INFO:tasks.workunit.client.0.smithi110.stdout:1/361: rename d0/d1/d4/d46/d51/l58 to d0/d1/l74 0 2024-09-16T02:05:57.527 INFO:tasks.workunit.client.0.smithi110.stdout:1/362: write d0/da/f29 [706562,124597] 0 2024-09-16T02:05:57.528 INFO:tasks.workunit.client.1.smithi165.stdout:9/826: rmdir d7/d32/d38/d53/d5c/d61/d97 39 2024-09-16T02:05:57.529 INFO:tasks.workunit.client.0.smithi110.stdout:1/363: write d0/da/f2c [2749405,57869] 0 2024-09-16T02:05:57.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/271: mknod d5/dd/df/d28/c5b 0 2024-09-16T02:05:57.533 INFO:tasks.workunit.client.1.smithi165.stdout:5/750: mknod de/d21/d26/d3a/d6d/dad/cf9 0 2024-09-16T02:05:57.534 INFO:tasks.workunit.client.0.smithi110.stdout:8/301: mkdir d3/d2b/d27/d45/d66/d6b 0 2024-09-16T02:05:57.537 INFO:tasks.workunit.client.0.smithi110.stdout:2/300: dread d0/da/d18/dc/f17 [0,4194304] 0 2024-09-16T02:05:57.538 INFO:tasks.workunit.client.1.smithi165.stdout:3/837: write da/fd7 [533141,39530] 0 2024-09-16T02:05:57.539 INFO:tasks.workunit.client.1.smithi165.stdout:1/874: sync 2024-09-16T02:05:57.539 INFO:tasks.workunit.client.0.smithi110.stdout:2/301: read d0/da/d18/d2d/f4a [4036999,44894] 0 2024-09-16T02:05:57.539 INFO:tasks.workunit.client.1.smithi165.stdout:2/802: unlink df/d10/d1a/d2d/dd1/d79/db1/ld0 0 2024-09-16T02:05:57.540 INFO:tasks.workunit.client.1.smithi165.stdout:3/838: write da/d17/de5/d104/d2c/d2d/fbd [436004,70822] 0 2024-09-16T02:05:57.541 INFO:tasks.workunit.client.1.smithi165.stdout:0/695: write d0/d1e/d39/d48/d45/f4b [4115020,31933] 0 2024-09-16T02:05:57.541 INFO:tasks.workunit.client.0.smithi110.stdout:2/302: write d0/da/d18/d2d/d41/f44 [458398,127326] 0 2024-09-16T02:05:57.543 INFO:tasks.workunit.client.1.smithi165.stdout:4/682: creat d4/dc/fdf x:0 0 0 2024-09-16T02:05:57.545 INFO:tasks.workunit.client.0.smithi110.stdout:2/303: dread d0/db/f36 [0,4194304] 0 2024-09-16T02:05:57.546 INFO:tasks.workunit.client.1.smithi165.stdout:7/763: link d0/dc3/fd8 d0/d3d/d9f/ff7 0 2024-09-16T02:05:57.547 INFO:tasks.workunit.client.0.smithi110.stdout:7/233: rename d3/c6 to d3/da/d10/d2c/c45 0 2024-09-16T02:05:57.548 INFO:tasks.workunit.client.1.smithi165.stdout:5/751: mknod de/d21/d26/d3a/d6d/dad/cfa 0 2024-09-16T02:05:57.549 INFO:tasks.workunit.client.0.smithi110.stdout:7/234: write d3/da/f22 [970075,27857] 0 2024-09-16T02:05:57.549 INFO:tasks.workunit.client.1.smithi165.stdout:7/764: dread - d0/df/d7/f93 zero size 2024-09-16T02:05:57.550 INFO:tasks.workunit.client.1.smithi165.stdout:3/839: dwrite da/d20/d26/f51 [0,4194304] 0 2024-09-16T02:05:57.551 INFO:tasks.workunit.client.1.smithi165.stdout:2/803: mkdir df/dbb/ded 0 2024-09-16T02:05:57.554 INFO:tasks.workunit.client.1.smithi165.stdout:0/696: creat d0/d1e/d39/d48/fe8 x:0 0 0 2024-09-16T02:05:57.554 INFO:tasks.workunit.client.1.smithi165.stdout:4/683: dwrite d4/dc/d18/f9b [0,4194304] 0 2024-09-16T02:05:57.554 INFO:tasks.workunit.client.0.smithi110.stdout:8/302: mkdir d3/d12/d1a/d6c 0 2024-09-16T02:05:57.557 INFO:tasks.workunit.client.1.smithi165.stdout:0/697: truncate d0/d1e/d39/d48/d45/db3/fe2 123035 0 2024-09-16T02:05:57.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/220: write d8/f16 [415102,102073] 0 2024-09-16T02:05:57.564 INFO:tasks.workunit.client.1.smithi165.stdout:5/752: rename c8 to de/d60/cfb 0 2024-09-16T02:05:57.564 INFO:tasks.workunit.client.0.smithi110.stdout:7/235: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:57.564 INFO:tasks.workunit.client.0.smithi110.stdout:3/221: write d8/d29/f41 [361273,123041] 0 2024-09-16T02:05:57.566 INFO:tasks.workunit.client.0.smithi110.stdout:7/236: chown d3/f19 912436 1 2024-09-16T02:05:57.566 INFO:tasks.workunit.client.1.smithi165.stdout:7/765: mknod d0/d3d/d9f/ddc/da8/ddd/cf8 0 2024-09-16T02:05:57.567 INFO:tasks.workunit.client.1.smithi165.stdout:1/875: dread d1/dd/d11/d33/f56 [0,4194304] 0 2024-09-16T02:05:57.568 INFO:tasks.workunit.client.1.smithi165.stdout:1/876: chown d1/dd/d11/d33/d3f/d59/f10c 1110760 1 2024-09-16T02:05:57.569 INFO:tasks.workunit.client.0.smithi110.stdout:2/304: creat d0/da/d18/dc/f61 x:0 0 0 2024-09-16T02:05:57.570 INFO:tasks.workunit.client.0.smithi110.stdout:2/305: chown d0/l9 58 1 2024-09-16T02:05:57.570 INFO:tasks.workunit.client.1.smithi165.stdout:8/800: getdents dd/d11/d14/d3f/d25/d36/d4f 0 2024-09-16T02:05:57.572 INFO:tasks.workunit.client.1.smithi165.stdout:8/801: write dd/d11/fcd [308407,93490] 0 2024-09-16T02:05:57.573 INFO:tasks.workunit.client.1.smithi165.stdout:8/802: stat dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/lec 0 2024-09-16T02:05:57.573 INFO:tasks.workunit.client.1.smithi165.stdout:4/684: symlink d4/dc/d20/d4e/le0 0 2024-09-16T02:05:57.573 INFO:tasks.workunit.client.0.smithi110.stdout:6/408: rename d0/d2/f4d to d0/d2/dc/d16/f7b 0 2024-09-16T02:05:57.574 INFO:tasks.workunit.client.0.smithi110.stdout:1/364: mkdir d0/d1/d4/d46/d75 0 2024-09-16T02:05:57.575 INFO:tasks.workunit.client.1.smithi165.stdout:8/803: chown dd/d11/d14/d3f/d25/d36/d81/dd2/d53/c93 386 1 2024-09-16T02:05:57.579 INFO:tasks.workunit.client.1.smithi165.stdout:7/766: rmdir d0/d4b/d58 39 2024-09-16T02:05:57.580 INFO:tasks.workunit.client.0.smithi110.stdout:8/303: stat d3/l7 0 2024-09-16T02:05:57.581 INFO:tasks.workunit.client.1.smithi165.stdout:0/698: dread d0/d1e/d20/d28/d6d/d87/fa9 [0,4194304] 0 2024-09-16T02:05:57.581 INFO:tasks.workunit.client.1.smithi165.stdout:0/699: readlink d0/d1e/d20/d28/d6d/le7 0 2024-09-16T02:05:57.582 INFO:tasks.workunit.client.1.smithi165.stdout:0/700: read - d0/d1e/d39/d48/fe8 zero size 2024-09-16T02:05:57.583 INFO:tasks.workunit.client.1.smithi165.stdout:0/701: write d0/d1e/d20/d28/da7/db4/fe0 [363183,81697] 0 2024-09-16T02:05:57.583 INFO:tasks.workunit.client.1.smithi165.stdout:1/877: creat d1/dd/d11/d33/dfa/f11b x:0 0 0 2024-09-16T02:05:57.584 INFO:tasks.workunit.client.1.smithi165.stdout:1/878: fdatasync d1/dd/d11/d46/f73 0 2024-09-16T02:05:57.585 INFO:tasks.workunit.client.0.smithi110.stdout:3/222: unlink d8/dc/d1b/d1c/f1f 0 2024-09-16T02:05:57.585 INFO:tasks.workunit.client.0.smithi110.stdout:4/341: write d4/fc [2325229,120189] 0 2024-09-16T02:05:57.586 INFO:tasks.workunit.client.0.smithi110.stdout:3/223: write d8/dc/f21 [3514364,8731] 0 2024-09-16T02:05:57.587 INFO:tasks.workunit.client.0.smithi110.stdout:7/237: truncate d3/f26 426351 0 2024-09-16T02:05:57.587 INFO:tasks.workunit.client.1.smithi165.stdout:1/879: dread d1/dd/d11/d33/d35/fb9 [0,4194304] 0 2024-09-16T02:05:57.588 INFO:tasks.workunit.client.0.smithi110.stdout:7/238: write d3/da/f18 [4960495,55591] 0 2024-09-16T02:05:57.589 INFO:tasks.workunit.client.0.smithi110.stdout:9/236: creat d1/f52 x:0 0 0 2024-09-16T02:05:57.592 INFO:tasks.workunit.client.0.smithi110.stdout:5/272: truncate d5/dd/f4c 3957709 0 2024-09-16T02:05:57.597 INFO:tasks.workunit.client.0.smithi110.stdout:2/306: dread d0/db/f36 [0,4194304] 0 2024-09-16T02:05:57.598 INFO:tasks.workunit.client.0.smithi110.stdout:5/273: dwrite d5/f13 [0,4194304] 0 2024-09-16T02:05:57.598 INFO:tasks.workunit.client.0.smithi110.stdout:1/365: rename d0/d25/c54 to d0/d1/d4/d46/d64/c76 0 2024-09-16T02:05:57.599 INFO:tasks.workunit.client.0.smithi110.stdout:1/366: chown d0/d1/d2a 963485 1 2024-09-16T02:05:57.600 INFO:tasks.workunit.client.0.smithi110.stdout:5/274: chown d5/dd/df/d11/l41 0 1 2024-09-16T02:05:57.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/342: mkdir d4/d8/d17/d6b 0 2024-09-16T02:05:57.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/275: dwrite d5/dd/f2b [0,4194304] 0 2024-09-16T02:05:57.608 INFO:tasks.workunit.client.0.smithi110.stdout:7/239: mknod d3/da/d10/d2c/c46 0 2024-09-16T02:05:57.610 INFO:tasks.workunit.client.1.smithi165.stdout:6/747: sync 2024-09-16T02:05:57.614 INFO:tasks.workunit.client.1.smithi165.stdout:2/804: truncate df/d23/d28/d3b/fa1 4109311 0 2024-09-16T02:05:57.615 INFO:tasks.workunit.client.1.smithi165.stdout:2/805: chown df/d10/c21 3 1 2024-09-16T02:05:57.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/224: mkdir d8/d48/d4b 0 2024-09-16T02:05:57.617 INFO:tasks.workunit.client.1.smithi165.stdout:1/880: mknod d1/d6b/dd7/c11c 0 2024-09-16T02:05:57.619 INFO:tasks.workunit.client.0.smithi110.stdout:4/343: unlink d4/d8/d31/c53 0 2024-09-16T02:05:57.620 INFO:tasks.workunit.client.0.smithi110.stdout:4/344: write d4/d8/d17/d23/f51 [348358,68996] 0 2024-09-16T02:05:57.620 INFO:tasks.workunit.client.0.smithi110.stdout:5/276: creat d5/d36/f5c x:0 0 0 2024-09-16T02:05:57.622 INFO:tasks.workunit.client.0.smithi110.stdout:9/237: symlink d1/d5/l53 0 2024-09-16T02:05:57.629 INFO:tasks.workunit.client.0.smithi110.stdout:5/277: unlink d5/d36/f5c 0 2024-09-16T02:05:57.630 INFO:tasks.workunit.client.0.smithi110.stdout:4/345: symlink d4/d8/d17/d23/d61/l6c 0 2024-09-16T02:05:57.631 INFO:tasks.workunit.client.0.smithi110.stdout:9/238: rmdir d1/dd 39 2024-09-16T02:05:57.631 INFO:tasks.workunit.client.0.smithi110.stdout:9/239: chown d1/d5/l28 54845 1 2024-09-16T02:05:57.632 INFO:tasks.workunit.client.0.smithi110.stdout:4/346: truncate d4/d8/d17/d23/f4a 425788 0 2024-09-16T02:05:57.632 INFO:tasks.workunit.client.0.smithi110.stdout:6/409: getdents d0/d29/d2a/d2f/d49 0 2024-09-16T02:05:57.633 INFO:tasks.workunit.client.0.smithi110.stdout:9/240: chown d1/d5/d8/de/d1f/f3e 22 1 2024-09-16T02:05:57.633 INFO:tasks.workunit.client.0.smithi110.stdout:2/307: link d0/c14 d0/db/d47/d48/c62 0 2024-09-16T02:05:57.635 INFO:tasks.workunit.client.0.smithi110.stdout:1/367: rename d0/d1/d2a/d32/d40/l6c to d0/d1/d2a/l77 0 2024-09-16T02:05:57.638 INFO:tasks.workunit.client.0.smithi110.stdout:5/278: mknod d5/dd/c5d 0 2024-09-16T02:05:57.642 INFO:tasks.workunit.client.0.smithi110.stdout:3/225: creat d8/f4c x:0 0 0 2024-09-16T02:05:57.645 INFO:tasks.workunit.client.1.smithi165.stdout:5/753: getdents de/d21/d26/d94/d9d 0 2024-09-16T02:05:57.645 INFO:tasks.workunit.client.0.smithi110.stdout:5/279: chown d5/dd/df/d28/l52 314006317 1 2024-09-16T02:05:57.646 INFO:tasks.workunit.client.1.smithi165.stdout:7/767: creat d0/d4b/ff9 x:0 0 0 2024-09-16T02:05:57.647 INFO:tasks.workunit.client.1.smithi165.stdout:0/702: dwrite d0/d1e/d39/f6c [4194304,4194304] 0 2024-09-16T02:05:57.648 INFO:tasks.workunit.client.0.smithi110.stdout:6/410: dwrite d0/d29/d2a/d2f/f73 [0,4194304] 0 2024-09-16T02:05:57.650 INFO:tasks.workunit.client.0.smithi110.stdout:9/241: dwrite d1/d5/d8/de/d1f/f3e [0,4194304] 0 2024-09-16T02:05:57.650 INFO:tasks.workunit.client.1.smithi165.stdout:0/703: dread - d0/d2a/d70/fab zero size 2024-09-16T02:05:57.650 INFO:tasks.workunit.client.1.smithi165.stdout:2/806: rmdir df/d10/d1a/dca 39 2024-09-16T02:05:57.651 INFO:tasks.workunit.client.0.smithi110.stdout:7/240: rename d3/da/d10/d2c/l31 to d3/l47 0 2024-09-16T02:05:57.655 INFO:tasks.workunit.client.0.smithi110.stdout:5/280: fdatasync d5/dd/df/d11/f58 0 2024-09-16T02:05:57.656 INFO:tasks.workunit.client.0.smithi110.stdout:4/347: dwrite d4/f11 [4194304,4194304] 0 2024-09-16T02:05:57.658 INFO:tasks.workunit.client.1.smithi165.stdout:2/807: rename df/d23/f48 to df/d10/db4/fee 0 2024-09-16T02:05:57.662 INFO:tasks.workunit.client.1.smithi165.stdout:7/768: dwrite d0/df/d33/d2a/f94 [4194304,4194304] 0 2024-09-16T02:05:57.662 INFO:tasks.workunit.client.0.smithi110.stdout:7/241: chown d3/da/d10/d11/c16 1 1 2024-09-16T02:05:57.664 INFO:tasks.workunit.client.1.smithi165.stdout:0/704: mknod d0/d1e/d20/d28/da7/db4/ce9 0 2024-09-16T02:05:57.665 INFO:tasks.workunit.client.1.smithi165.stdout:7/769: write d0/d2c/f7c [3919929,57185] 0 2024-09-16T02:05:57.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/308: dwrite d0/da/d18/dc/f2b [0,4194304] 0 2024-09-16T02:05:57.665 INFO:tasks.workunit.client.0.smithi110.stdout:9/242: symlink d1/d2b/d2e/d38/l54 0 2024-09-16T02:05:57.666 INFO:tasks.workunit.client.0.smithi110.stdout:3/226: creat d8/f4d x:0 0 0 2024-09-16T02:05:57.667 INFO:tasks.workunit.client.1.smithi165.stdout:6/748: dread d7/f1e [0,4194304] 0 2024-09-16T02:05:57.668 INFO:tasks.workunit.client.0.smithi110.stdout:1/368: dread d0/d1/d4/f18 [0,4194304] 0 2024-09-16T02:05:57.668 INFO:tasks.workunit.client.1.smithi165.stdout:0/705: fsync d0/d1e/d20/d28/da7/db4/fe0 0 2024-09-16T02:05:57.669 INFO:tasks.workunit.client.0.smithi110.stdout:7/242: fdatasync d3/f14 0 2024-09-16T02:05:57.670 INFO:tasks.workunit.client.1.smithi165.stdout:2/808: symlink df/d23/d28/d3b/lef 0 2024-09-16T02:05:57.671 INFO:tasks.workunit.client.0.smithi110.stdout:6/411: mknod d0/d2/d57/d75/c7c 0 2024-09-16T02:05:57.672 INFO:tasks.workunit.client.1.smithi165.stdout:9/827: sync 2024-09-16T02:05:57.672 INFO:tasks.workunit.client.0.smithi110.stdout:5/281: rename d5/dd/df/d28/l33 to d5/d36/d45/d47/l5e 0 2024-09-16T02:05:57.673 INFO:tasks.workunit.client.1.smithi165.stdout:6/749: stat d7/d17/d75/dc1/cc9 0 2024-09-16T02:05:57.673 INFO:tasks.workunit.client.1.smithi165.stdout:1/881: dread d1/dd/d11/d33/d3f/d47/d7d/fee [0,4194304] 0 2024-09-16T02:05:57.675 INFO:tasks.workunit.client.0.smithi110.stdout:9/243: mkdir d1/d5/d20/d55 0 2024-09-16T02:05:57.675 INFO:tasks.workunit.client.0.smithi110.stdout:6/412: dread d0/d2/d5/f52 [0,4194304] 0 2024-09-16T02:05:57.675 INFO:tasks.workunit.client.1.smithi165.stdout:6/750: write d7/dc/df/d1a/f4f [4078060,114561] 0 2024-09-16T02:05:57.676 INFO:tasks.workunit.client.0.smithi110.stdout:6/413: fdatasync d0/d2/dc/f6d 0 2024-09-16T02:05:57.678 INFO:tasks.workunit.client.1.smithi165.stdout:2/809: rmdir df/d23/ddc 39 2024-09-16T02:05:57.679 INFO:tasks.workunit.client.1.smithi165.stdout:9/828: fdatasync d7/d32/d4a/f7e 0 2024-09-16T02:05:57.680 INFO:tasks.workunit.client.0.smithi110.stdout:6/414: chown d0/d29/d2a/c4c 636484076 1 2024-09-16T02:05:57.680 INFO:tasks.workunit.client.0.smithi110.stdout:5/282: fdatasync d5/dd/df/f3f 0 2024-09-16T02:05:57.681 INFO:tasks.workunit.client.0.smithi110.stdout:6/415: stat d0/d2/d5/f52 0 2024-09-16T02:05:57.681 INFO:tasks.workunit.client.0.smithi110.stdout:7/243: dread d3/f26 [0,4194304] 0 2024-09-16T02:05:57.684 INFO:tasks.workunit.client.0.smithi110.stdout:9/244: rename d1/d5/f1a to d1/d5/d8/de/f56 0 2024-09-16T02:05:57.684 INFO:tasks.workunit.client.0.smithi110.stdout:9/245: chown f0 25229 1 2024-09-16T02:05:57.685 INFO:tasks.workunit.client.1.smithi165.stdout:6/751: rmdir d7/d17/d75/d97/dcb 39 2024-09-16T02:05:57.685 INFO:tasks.workunit.client.0.smithi110.stdout:3/227: creat d8/dc/d1b/d3a/d43/f4e x:0 0 0 2024-09-16T02:05:57.686 INFO:tasks.workunit.client.1.smithi165.stdout:5/754: dread de/d21/d4e/f55 [0,4194304] 0 2024-09-16T02:05:57.686 INFO:tasks.workunit.client.0.smithi110.stdout:1/369: dwrite d0/f56 [0,4194304] 0 2024-09-16T02:05:57.688 INFO:tasks.workunit.client.1.smithi165.stdout:1/882: rename d1/dd/d11/d33/d3f/d47/d7d/db3/de0/c71 to d1/d19/d4d/d84/d112/c11d 0 2024-09-16T02:05:57.689 INFO:tasks.workunit.client.0.smithi110.stdout:9/246: write d1/d5/d8/d26/f45 [706393,90704] 0 2024-09-16T02:05:57.690 INFO:tasks.workunit.client.0.smithi110.stdout:5/283: symlink d5/dd/df/d28/l5f 0 2024-09-16T02:05:57.691 INFO:tasks.workunit.client.0.smithi110.stdout:9/247: readlink d1/d1b/l24 0 2024-09-16T02:05:57.692 INFO:tasks.workunit.client.0.smithi110.stdout:7/244: rmdir d3/da/d10/d2c 39 2024-09-16T02:05:57.693 INFO:tasks.workunit.client.0.smithi110.stdout:1/370: read d0/da/f5c [1700169,70015] 0 2024-09-16T02:05:57.693 INFO:tasks.workunit.client.0.smithi110.stdout:7/245: chown d3/da/cb 78274 1 2024-09-16T02:05:57.694 INFO:tasks.workunit.client.0.smithi110.stdout:6/416: unlink d0/d2/f12 0 2024-09-16T02:05:57.695 INFO:tasks.workunit.client.1.smithi165.stdout:0/706: getdents d0/d1e/d20/d28/d6d 0 2024-09-16T02:05:57.695 INFO:tasks.workunit.client.0.smithi110.stdout:3/228: creat d8/d48/f4f x:0 0 0 2024-09-16T02:05:57.696 INFO:tasks.workunit.client.1.smithi165.stdout:9/829: dwrite d7/d32/d38/d58/fc3 [0,4194304] 0 2024-09-16T02:05:57.696 INFO:tasks.workunit.client.1.smithi165.stdout:6/752: creat d7/dc/d7f/dd2/d3c/dcd/fd8 x:0 0 0 2024-09-16T02:05:57.696 INFO:tasks.workunit.client.0.smithi110.stdout:9/248: rmdir d1/d1b 39 2024-09-16T02:05:57.699 INFO:tasks.workunit.client.1.smithi165.stdout:0/707: mknod d0/d61/cea 0 2024-09-16T02:05:57.701 INFO:tasks.workunit.client.0.smithi110.stdout:6/417: mknod d0/d2/d57/c7d 0 2024-09-16T02:05:57.703 INFO:tasks.workunit.client.0.smithi110.stdout:3/229: unlink f3 0 2024-09-16T02:05:57.704 INFO:tasks.workunit.client.0.smithi110.stdout:3/230: chown d8/dc/l2f 13 1 2024-09-16T02:05:57.706 INFO:tasks.workunit.client.1.smithi165.stdout:1/883: creat d1/f11e x:0 0 0 2024-09-16T02:05:57.709 INFO:tasks.workunit.client.1.smithi165.stdout:0/708: dwrite d0/d1e/d39/d48/fe8 [0,4194304] 0 2024-09-16T02:05:57.709 INFO:tasks.workunit.client.1.smithi165.stdout:9/830: mkdir d7/d32/d4a/dff/d10a 0 2024-09-16T02:05:57.710 INFO:tasks.workunit.client.0.smithi110.stdout:2/309: dread d0/da/f2c [0,4194304] 0 2024-09-16T02:05:57.712 INFO:tasks.workunit.client.1.smithi165.stdout:5/755: rename de/d19/d1c/d49/da5/db1/fc9 to de/d19/ffc 0 2024-09-16T02:05:57.712 INFO:tasks.workunit.client.1.smithi165.stdout:5/756: readlink de/d19/d1c/d4d/dc1/lf2 0 2024-09-16T02:05:57.716 INFO:tasks.workunit.client.1.smithi165.stdout:7/770: truncate d0/d3d/d9f/ddc/da8/ddd/fe4 206369 0 2024-09-16T02:05:57.717 INFO:tasks.workunit.client.0.smithi110.stdout:9/249: dread d1/d5/d8/de/f56 [0,4194304] 0 2024-09-16T02:05:57.717 INFO:tasks.workunit.client.0.smithi110.stdout:3/231: unlink d8/d29/f30 0 2024-09-16T02:05:57.719 INFO:tasks.workunit.client.0.smithi110.stdout:9/250: read d1/d2b/d2e/f3a [2083348,47111] 0 2024-09-16T02:05:57.719 INFO:tasks.workunit.client.1.smithi165.stdout:1/884: creat d1/d19/f11f x:0 0 0 2024-09-16T02:05:57.720 INFO:tasks.workunit.client.0.smithi110.stdout:1/371: creat d0/d1/d2a/f78 x:0 0 0 2024-09-16T02:05:57.721 INFO:tasks.workunit.client.1.smithi165.stdout:9/831: mknod d7/d32/d38/d53/d5c/d61/d8f/c10b 0 2024-09-16T02:05:57.721 INFO:tasks.workunit.client.1.smithi165.stdout:9/832: fsync d7/d32/d38/d53/d5c/f8d 0 2024-09-16T02:05:57.723 INFO:tasks.workunit.client.0.smithi110.stdout:6/418: link d0/d29/d2a/d2f/d34/f64 d0/d29/d2a/d2f/d49/f7e 0 2024-09-16T02:05:57.724 INFO:tasks.workunit.client.0.smithi110.stdout:6/419: stat d0/d2/d18/d1d/f3d 0 2024-09-16T02:05:57.727 INFO:tasks.workunit.client.1.smithi165.stdout:6/753: link d7/dc/d7f/dd2/d3c/f70 d7/dc/df/d1a/fd9 0 2024-09-16T02:05:57.727 INFO:tasks.workunit.client.0.smithi110.stdout:5/284: write d5/dd/df/d11/f2f [5076732,83962] 0 2024-09-16T02:05:57.729 INFO:tasks.workunit.client.1.smithi165.stdout:7/771: mkdir d0/d4b/db4/dfa 0 2024-09-16T02:05:57.729 INFO:tasks.workunit.client.0.smithi110.stdout:5/285: write d5/d36/d45/d47/f57 [118195,72600] 0 2024-09-16T02:05:57.730 INFO:tasks.workunit.client.0.smithi110.stdout:7/246: write d3/f34 [426609,47105] 0 2024-09-16T02:05:57.730 INFO:tasks.workunit.client.0.smithi110.stdout:3/232: creat d8/dc/d1b/d3a/f50 x:0 0 0 2024-09-16T02:05:57.733 INFO:tasks.workunit.client.0.smithi110.stdout:3/233: truncate d8/dc/d1b/d3a/f50 317895 0 2024-09-16T02:05:57.734 INFO:tasks.workunit.client.0.smithi110.stdout:9/251: rmdir d1/d2b/d2e/d38/d3d 39 2024-09-16T02:05:57.736 INFO:tasks.workunit.client.1.smithi165.stdout:4/685: sync 2024-09-16T02:05:57.736 INFO:tasks.workunit.client.1.smithi165.stdout:3/840: sync 2024-09-16T02:05:57.736 INFO:tasks.workunit.client.1.smithi165.stdout:8/804: sync 2024-09-16T02:05:57.738 INFO:tasks.workunit.client.0.smithi110.stdout:1/372: mkdir d0/d1/d4/d46/d64/d79 0 2024-09-16T02:05:57.739 INFO:tasks.workunit.client.1.smithi165.stdout:0/709: creat d0/d1e/d39/d48/d5f/d82/d91/feb x:0 0 0 2024-09-16T02:05:57.740 INFO:tasks.workunit.client.0.smithi110.stdout:2/310: creat d0/d5f/f63 x:0 0 0 2024-09-16T02:05:57.741 INFO:tasks.workunit.client.0.smithi110.stdout:2/311: write d0/da/d18/dc/f2b [426890,75798] 0 2024-09-16T02:05:57.742 INFO:tasks.workunit.client.1.smithi165.stdout:5/757: link de/d19/f32 de/d21/d26/d94/d9d/ffd 0 2024-09-16T02:05:57.744 INFO:tasks.workunit.client.1.smithi165.stdout:7/772: write d0/d2c/d85/f97 [2877686,96340] 0 2024-09-16T02:05:57.744 INFO:tasks.workunit.client.1.smithi165.stdout:1/885: dread d1/dd/d11/d33/d3f/fc8 [0,4194304] 0 2024-09-16T02:05:57.746 INFO:tasks.workunit.client.1.smithi165.stdout:8/805: creat dd/d62/f117 x:0 0 0 2024-09-16T02:05:57.748 INFO:tasks.workunit.client.0.smithi110.stdout:7/247: unlink d3/d15/f1c 0 2024-09-16T02:05:57.749 INFO:tasks.workunit.client.1.smithi165.stdout:5/758: dwrite de/d60/d65/faf [0,4194304] 0 2024-09-16T02:05:57.750 INFO:tasks.workunit.client.1.smithi165.stdout:5/759: write de/d21/d51/f5f [55805,120477] 0 2024-09-16T02:05:57.751 INFO:tasks.workunit.client.1.smithi165.stdout:4/686: creat d4/dc/d20/d4e/d73/fe1 x:0 0 0 2024-09-16T02:05:57.752 INFO:tasks.workunit.client.0.smithi110.stdout:9/252: creat d1/d5/d8/de/d1f/f57 x:0 0 0 2024-09-16T02:05:57.753 INFO:tasks.workunit.client.0.smithi110.stdout:2/312: dread d0/da/d18/d2d/f5a [0,4194304] 0 2024-09-16T02:05:57.755 INFO:tasks.workunit.client.1.smithi165.stdout:3/841: creat da/d17/de5/d104/d2c/d10c/d9c/f123 x:0 0 0 2024-09-16T02:05:57.755 INFO:tasks.workunit.client.1.smithi165.stdout:0/710: creat d0/d1e/d39/d48/d74/dc6/fec x:0 0 0 2024-09-16T02:05:57.757 INFO:tasks.workunit.client.1.smithi165.stdout:3/842: write da/d17/de5/d104/d2c/d2d/d6c/db5/fbb [6384480,4500] 0 2024-09-16T02:05:57.759 INFO:tasks.workunit.client.1.smithi165.stdout:1/886: unlink d1/d6b/df6/f88 0 2024-09-16T02:05:57.760 INFO:tasks.workunit.client.0.smithi110.stdout:9/253: dwrite d1/d5/d8/d26/f45 [0,4194304] 0 2024-09-16T02:05:57.762 INFO:tasks.workunit.client.1.smithi165.stdout:9/833: dwrite d7/d1f/d27/f3c [0,4194304] 0 2024-09-16T02:05:57.762 INFO:tasks.workunit.client.1.smithi165.stdout:7/773: rename d0/df/l6d to d0/d4b/db4/dba/lfb 0 2024-09-16T02:05:57.763 INFO:tasks.workunit.client.1.smithi165.stdout:8/806: dread - dd/d11/d14/d70/fe9 zero size 2024-09-16T02:05:57.764 INFO:tasks.workunit.client.1.smithi165.stdout:7/774: chown d0/d4b/f5d 93099834 1 2024-09-16T02:05:57.767 INFO:tasks.workunit.client.0.smithi110.stdout:9/254: dwrite d1/d5/d8/de/f3b [0,4194304] 0 2024-09-16T02:05:57.769 INFO:tasks.workunit.client.0.smithi110.stdout:9/255: write d1/d5/d20/f4b [1052654,87200] 0 2024-09-16T02:05:57.772 INFO:tasks.workunit.client.1.smithi165.stdout:4/687: dread d4/d40/d4f/f78 [0,4194304] 0 2024-09-16T02:05:57.772 INFO:tasks.workunit.client.1.smithi165.stdout:8/807: dread dd/d11/d38/f45 [0,4194304] 0 2024-09-16T02:05:57.774 INFO:tasks.workunit.client.0.smithi110.stdout:1/373: mkdir d0/d1/d4/d46/d7a 0 2024-09-16T02:05:57.777 INFO:tasks.workunit.client.0.smithi110.stdout:6/420: creat d0/d2/d5/d1e/f7f x:0 0 0 2024-09-16T02:05:57.780 INFO:tasks.workunit.client.1.smithi165.stdout:3/843: rmdir da 39 2024-09-16T02:05:57.781 INFO:tasks.workunit.client.1.smithi165.stdout:8/808: dwrite dd/d11/daa/fad [0,4194304] 0 2024-09-16T02:05:57.782 INFO:tasks.workunit.client.1.smithi165.stdout:8/809: stat dd/d11/d38/d74 0 2024-09-16T02:05:57.783 INFO:tasks.workunit.client.1.smithi165.stdout:1/887: rename d1/d68/l5c to d1/dd/d11/d33/d3f/d47/d7d/db3/de0/l120 0 2024-09-16T02:05:57.785 INFO:tasks.workunit.client.1.smithi165.stdout:5/760: creat de/d60/dbc/df3/ffe x:0 0 0 2024-09-16T02:05:57.785 INFO:tasks.workunit.client.0.smithi110.stdout:3/234: creat d8/f51 x:0 0 0 2024-09-16T02:05:57.786 INFO:tasks.workunit.client.1.smithi165.stdout:9/834: mknod d7/d32/d38/d53/d56/d95/c10c 0 2024-09-16T02:05:57.791 INFO:tasks.workunit.client.1.smithi165.stdout:7/775: creat d0/d2c/d85/d8c/ffc x:0 0 0 2024-09-16T02:05:57.791 INFO:tasks.workunit.client.1.smithi165.stdout:2/810: sync 2024-09-16T02:05:57.792 INFO:tasks.workunit.client.1.smithi165.stdout:7/776: read d0/df/d7/f23 [2514881,18076] 0 2024-09-16T02:05:57.793 INFO:tasks.workunit.client.1.smithi165.stdout:7/777: chown d0/df/d7/fe 65634 1 2024-09-16T02:05:57.795 INFO:tasks.workunit.client.0.smithi110.stdout:7/248: dwrite d3/f26 [0,4194304] 0 2024-09-16T02:05:57.796 INFO:tasks.workunit.client.0.smithi110.stdout:7/249: dread - d3/d15/d38/f3b zero size 2024-09-16T02:05:57.797 INFO:tasks.workunit.client.0.smithi110.stdout:1/374: symlink d0/d1/d4/l7b 0 2024-09-16T02:05:57.799 INFO:tasks.workunit.client.0.smithi110.stdout:6/421: fsync d0/d29/d2a/d2f/d49/f7e 0 2024-09-16T02:05:57.800 INFO:tasks.workunit.client.0.smithi110.stdout:5/286: link d5/dd/l4b d5/dd/l60 0 2024-09-16T02:05:57.801 INFO:tasks.workunit.client.1.smithi165.stdout:1/888: chown d1/d19/d4d/cf2 11 1 2024-09-16T02:05:57.809 INFO:tasks.workunit.client.1.smithi165.stdout:5/761: chown de/d60/cfb 2 1 2024-09-16T02:05:57.809 INFO:tasks.workunit.client.1.smithi165.stdout:5/762: write de/d19/fc5 [1182713,19044] 0 2024-09-16T02:05:57.809 INFO:tasks.workunit.client.0.smithi110.stdout:9/256: creat d1/dd/f58 x:0 0 0 2024-09-16T02:05:57.810 INFO:tasks.workunit.client.1.smithi165.stdout:5/763: write de/d21/fef [752245,91175] 0 2024-09-16T02:05:57.811 INFO:tasks.workunit.client.1.smithi165.stdout:3/844: dread da/d17/de5/d104/d2c/f74 [0,4194304] 0 2024-09-16T02:05:57.811 INFO:tasks.workunit.client.0.smithi110.stdout:1/375: mkdir d0/da/d7c 0 2024-09-16T02:05:57.813 INFO:tasks.workunit.client.0.smithi110.stdout:2/313: truncate d0/db/d47/f50 2413710 0 2024-09-16T02:05:57.815 INFO:tasks.workunit.client.0.smithi110.stdout:6/422: creat d0/d2/dc/f80 x:0 0 0 2024-09-16T02:05:57.816 INFO:tasks.workunit.client.1.smithi165.stdout:4/688: dwrite d4/dc/d18/d37/d53/f51 [0,4194304] 0 2024-09-16T02:05:57.816 INFO:tasks.workunit.client.1.smithi165.stdout:4/689: readlink d4/dc/d18/d37/l9e 0 2024-09-16T02:05:57.822 INFO:tasks.workunit.client.1.smithi165.stdout:9/835: write d7/fd [2337998,118298] 0 2024-09-16T02:05:57.822 INFO:tasks.workunit.client.0.smithi110.stdout:3/235: unlink d8/dc/l47 0 2024-09-16T02:05:57.823 INFO:tasks.workunit.client.0.smithi110.stdout:9/257: truncate d1/d2b/f2d 3377461 0 2024-09-16T02:05:57.823 INFO:tasks.workunit.client.0.smithi110.stdout:9/258: fsync d1/d5/d8/f40 0 2024-09-16T02:05:57.823 INFO:tasks.workunit.client.1.smithi165.stdout:6/754: sync 2024-09-16T02:05:57.824 INFO:tasks.workunit.client.0.smithi110.stdout:9/259: readlink d1/d5/d8/la 0 2024-09-16T02:05:57.824 INFO:tasks.workunit.client.1.smithi165.stdout:1/889: rmdir d1/d19/d24/d30/d72 39 2024-09-16T02:05:57.825 INFO:tasks.workunit.client.1.smithi165.stdout:6/755: write d7/dc/f94 [631508,81880] 0 2024-09-16T02:05:57.825 INFO:tasks.workunit.client.1.smithi165.stdout:1/890: write d1/d22/f2c [157774,25933] 0 2024-09-16T02:05:57.826 INFO:tasks.workunit.client.0.smithi110.stdout:2/314: write d0/da/f24 [17483,97191] 0 2024-09-16T02:05:57.826 INFO:tasks.workunit.client.1.smithi165.stdout:8/810: mkdir dd/d11/d14/d3f/d25/d36/d81/d118 0 2024-09-16T02:05:57.827 INFO:tasks.workunit.client.1.smithi165.stdout:9/836: dwrite d7/df/f1c [0,4194304] 0 2024-09-16T02:05:57.827 INFO:tasks.workunit.client.0.smithi110.stdout:7/250: getdents d3/da/d10/d11/d3e/d40 0 2024-09-16T02:05:57.827 INFO:tasks.workunit.client.1.smithi165.stdout:6/756: write d7/dc/d7f/dd2/d86/fc3 [312217,127636] 0 2024-09-16T02:05:57.836 INFO:tasks.workunit.client.0.smithi110.stdout:9/260: dwrite d1/d5/d8/de/d1f/f57 [0,4194304] 0 2024-09-16T02:05:57.838 INFO:tasks.workunit.client.0.smithi110.stdout:2/315: mknod d0/db/d47/d48/c64 0 2024-09-16T02:05:57.838 INFO:tasks.workunit.client.1.smithi165.stdout:2/811: symlink df/dbb/ded/lf0 0 2024-09-16T02:05:57.840 INFO:tasks.workunit.client.0.smithi110.stdout:5/287: dwrite f0 [0,4194304] 0 2024-09-16T02:05:57.840 INFO:tasks.workunit.client.0.smithi110.stdout:2/316: chown d0/l40 1551116 1 2024-09-16T02:05:57.841 INFO:tasks.workunit.client.0.smithi110.stdout:7/251: dwrite f1 [4194304,4194304] 0 2024-09-16T02:05:57.842 INFO:tasks.workunit.client.1.smithi165.stdout:0/711: link d0/le d0/d1e/d39/led 0 2024-09-16T02:05:57.843 INFO:tasks.workunit.client.1.smithi165.stdout:3/845: write da/d17/f1a [837336,69289] 0 2024-09-16T02:05:57.846 INFO:tasks.workunit.client.0.smithi110.stdout:2/317: dread d0/db/f36 [0,4194304] 0 2024-09-16T02:05:57.848 INFO:tasks.workunit.client.0.smithi110.stdout:2/318: chown d0/da/d18/d2d/f4a 33 1 2024-09-16T02:05:57.848 INFO:tasks.workunit.client.0.smithi110.stdout:0/385: sync 2024-09-16T02:05:57.849 INFO:tasks.workunit.client.1.smithi165.stdout:7/778: mkdir d0/df/dfd 0 2024-09-16T02:05:57.850 INFO:tasks.workunit.client.0.smithi110.stdout:3/236: dwrite f7 [0,4194304] 0 2024-09-16T02:05:57.853 INFO:tasks.workunit.client.1.smithi165.stdout:4/690: dwrite d4/f44 [0,4194304] 0 2024-09-16T02:05:57.858 INFO:tasks.workunit.client.0.smithi110.stdout:5/288: rmdir d5/dd 39 2024-09-16T02:05:57.860 INFO:tasks.workunit.client.1.smithi165.stdout:9/837: rename d7/c3d to d7/d32/d38/d68/d7f/c10d 0 2024-09-16T02:05:57.860 INFO:tasks.workunit.client.1.smithi165.stdout:9/838: stat d7/d32/faf 0 2024-09-16T02:05:57.863 INFO:tasks.workunit.client.0.smithi110.stdout:2/319: symlink d0/da/d18/d2d/l65 0 2024-09-16T02:05:57.864 INFO:tasks.workunit.client.1.smithi165.stdout:2/812: creat df/d10/d1a/d2d/dd1/d79/db1/ff1 x:0 0 0 2024-09-16T02:05:57.866 INFO:tasks.workunit.client.1.smithi165.stdout:0/712: rmdir d0/d1e/d20/d28/d6d/d87 39 2024-09-16T02:05:57.868 INFO:tasks.workunit.client.1.smithi165.stdout:3/846: unlink da/l68 0 2024-09-16T02:05:57.868 INFO:tasks.workunit.client.0.smithi110.stdout:9/261: dwrite d1/d2b/d2e/d38/d3d/f4e [0,4194304] 0 2024-09-16T02:05:57.872 INFO:tasks.workunit.client.1.smithi165.stdout:1/891: unlink d1/dd/d11/d42/fda 0 2024-09-16T02:05:57.873 INFO:tasks.workunit.client.1.smithi165.stdout:1/892: truncate d1/d6b/dd7/f108 580924 0 2024-09-16T02:05:57.877 INFO:tasks.workunit.client.1.smithi165.stdout:8/811: symlink dd/d11/d14/d70/l119 0 2024-09-16T02:05:57.877 INFO:tasks.workunit.client.1.smithi165.stdout:8/812: read - dd/d62/f117 zero size 2024-09-16T02:05:57.878 INFO:tasks.workunit.client.1.smithi165.stdout:9/839: unlink d7/l36 0 2024-09-16T02:05:57.883 INFO:tasks.workunit.client.1.smithi165.stdout:3/847: rmdir da/d17/d7a/d7d 39 2024-09-16T02:05:57.884 INFO:tasks.workunit.client.1.smithi165.stdout:3/848: dread - da/d20/d26/d6e/f101 zero size 2024-09-16T02:05:57.886 INFO:tasks.workunit.client.1.smithi165.stdout:7/779: creat d0/d2c/dc8/dea/ffe x:0 0 0 2024-09-16T02:05:57.887 INFO:tasks.workunit.client.1.smithi165.stdout:5/764: truncate de/d21/d26/d3a/f7b 2922361 0 2024-09-16T02:05:57.888 INFO:tasks.workunit.client.0.smithi110.stdout:7/252: dread d3/da/d10/f30 [0,4194304] 0 2024-09-16T02:05:57.889 INFO:tasks.workunit.client.1.smithi165.stdout:6/757: dwrite d7/d1f/f8c [0,4194304] 0 2024-09-16T02:05:57.890 INFO:tasks.workunit.client.1.smithi165.stdout:5/765: write de/d21/d51/f5e [872389,99124] 0 2024-09-16T02:05:57.892 INFO:tasks.workunit.client.1.smithi165.stdout:4/691: creat d4/dc0/dd3/fe2 x:0 0 0 2024-09-16T02:05:57.892 INFO:tasks.workunit.client.1.smithi165.stdout:6/758: chown d7/dc/d7f/dd2/d3c 197605 1 2024-09-16T02:05:57.895 INFO:tasks.workunit.client.1.smithi165.stdout:4/692: fsync d4/d40/d4f/fb1 0 2024-09-16T02:05:57.898 INFO:tasks.workunit.client.1.smithi165.stdout:3/849: dwrite da/d17/de5/d104/d2c/d2d/d6c/f61 [0,4194304] 0 2024-09-16T02:05:57.899 INFO:tasks.workunit.client.1.smithi165.stdout:0/713: getdents d0/d1e/d39/d48/d5f/ddf 0 2024-09-16T02:05:57.901 INFO:tasks.workunit.client.1.smithi165.stdout:7/780: dwrite d0/d4b/fb9 [4194304,4194304] 0 2024-09-16T02:05:57.901 INFO:tasks.workunit.client.1.smithi165.stdout:1/893: dwrite d1/d22/f87 [0,4194304] 0 2024-09-16T02:05:57.905 INFO:tasks.workunit.client.0.smithi110.stdout:6/423: getdents d0/d2/d57 0 2024-09-16T02:05:57.906 INFO:tasks.workunit.client.1.smithi165.stdout:9/840: mknod d7/d1f/c10e 0 2024-09-16T02:05:57.906 INFO:tasks.workunit.client.1.smithi165.stdout:5/766: truncate de/d19/d1c/d49/da5/db1/fe1 515434 0 2024-09-16T02:05:57.908 INFO:tasks.workunit.client.0.smithi110.stdout:2/320: creat d0/da/d18/d2d/f66 x:0 0 0 2024-09-16T02:05:57.908 INFO:tasks.workunit.client.1.smithi165.stdout:7/781: write d0/d4b/fb9 [8328946,114314] 0 2024-09-16T02:05:57.908 INFO:tasks.workunit.client.1.smithi165.stdout:1/894: chown d1/dd/d11/d33/f8a 1851769179 1 2024-09-16T02:05:57.910 INFO:tasks.workunit.client.0.smithi110.stdout:3/237: mknod d8/dc/d1b/c52 0 2024-09-16T02:05:57.911 INFO:tasks.workunit.client.1.smithi165.stdout:7/782: chown d0/d2c/f8d 15466 1 2024-09-16T02:05:57.913 INFO:tasks.workunit.client.1.smithi165.stdout:7/783: dread - d0/df/d83/f9c zero size 2024-09-16T02:05:57.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/262: symlink d1/d5/d8/de/d1f/l59 0 2024-09-16T02:05:57.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/263: dread - d1/f52 zero size 2024-09-16T02:05:57.918 INFO:tasks.workunit.client.1.smithi165.stdout:7/784: write d0/d3d/d9f/fbe [4234505,5561] 0 2024-09-16T02:05:57.918 INFO:tasks.workunit.client.1.smithi165.stdout:5/767: rmdir de/d21/d26/d3a/dd5 39 2024-09-16T02:05:57.918 INFO:tasks.workunit.client.1.smithi165.stdout:6/759: write d7/d17/d75/d97/dcb/d3d/d5d/d73/d82/f89 [2353076,67277] 0 2024-09-16T02:05:57.923 INFO:tasks.workunit.client.0.smithi110.stdout:6/424: creat d0/d2/d57/d75/f81 x:0 0 0 2024-09-16T02:05:57.924 INFO:tasks.workunit.client.1.smithi165.stdout:3/850: dwrite da/f9d [4194304,4194304] 0 2024-09-16T02:05:57.924 INFO:tasks.workunit.client.1.smithi165.stdout:1/895: truncate d1/dd/d11/d33/d67/fa8 599374 0 2024-09-16T02:05:57.927 INFO:tasks.workunit.client.0.smithi110.stdout:3/238: chown d8/f1e 1991069594 1 2024-09-16T02:05:57.928 INFO:tasks.workunit.client.1.smithi165.stdout:2/813: truncate df/f34 1355055 0 2024-09-16T02:05:57.929 INFO:tasks.workunit.client.0.smithi110.stdout:9/264: rmdir d1/d5/d8/de 39 2024-09-16T02:05:57.929 INFO:tasks.workunit.client.1.smithi165.stdout:7/785: dwrite d0/d2c/d85/f88 [0,4194304] 0 2024-09-16T02:05:57.931 INFO:tasks.workunit.client.1.smithi165.stdout:0/714: unlink d0/d1e/d20/ccf 0 2024-09-16T02:05:57.932 INFO:tasks.workunit.client.0.smithi110.stdout:7/253: mknod d3/da/d10/d11/d3e/d40/c48 0 2024-09-16T02:05:57.932 INFO:tasks.workunit.client.0.smithi110.stdout:7/254: readlink d3/d15/l1e 0 2024-09-16T02:05:57.934 INFO:tasks.workunit.client.0.smithi110.stdout:5/289: creat d5/f61 x:0 0 0 2024-09-16T02:05:57.935 INFO:tasks.workunit.client.0.smithi110.stdout:5/290: dread - d5/f61 zero size 2024-09-16T02:05:57.936 INFO:tasks.workunit.client.0.smithi110.stdout:3/239: dread d8/dc/f27 [0,4194304] 0 2024-09-16T02:05:57.936 INFO:tasks.workunit.client.0.smithi110.stdout:6/425: symlink d0/d29/d2a/d2f/d49/l82 0 2024-09-16T02:05:57.940 INFO:tasks.workunit.client.0.smithi110.stdout:2/321: creat d0/db/d33/d46/f67 x:0 0 0 2024-09-16T02:05:57.943 INFO:tasks.workunit.client.0.smithi110.stdout:5/291: dwrite d5/d36/d3d/f4f [0,4194304] 0 2024-09-16T02:05:57.944 INFO:tasks.workunit.client.1.smithi165.stdout:3/851: rename da/d57/fb4 to da/d17/de5/d104/d2c/d10c/f124 0 2024-09-16T02:05:57.946 INFO:tasks.workunit.client.0.smithi110.stdout:2/322: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:57.946 INFO:tasks.workunit.client.1.smithi165.stdout:3/852: chown da/d57/d8d/c11d 3100 1 2024-09-16T02:05:57.947 INFO:tasks.workunit.client.1.smithi165.stdout:8/813: dwrite dd/d11/d14/d70/d7b/df2/ffa [0,4194304] 0 2024-09-16T02:05:57.947 INFO:tasks.workunit.client.0.smithi110.stdout:3/240: unlink d8/d29/f32 0 2024-09-16T02:05:57.948 INFO:tasks.workunit.client.0.smithi110.stdout:2/323: read d0/da/d18/dc/f1c [3713945,82756] 0 2024-09-16T02:05:57.953 INFO:tasks.workunit.client.1.smithi165.stdout:2/814: creat df/d10/d1a/d2d/dd1/d79/d98/ff2 x:0 0 0 2024-09-16T02:05:57.954 INFO:tasks.workunit.client.1.smithi165.stdout:2/815: chown df/d10/d1a/d2d/dd1 213242 1 2024-09-16T02:05:57.955 INFO:tasks.workunit.client.1.smithi165.stdout:2/816: write df/d23/d66/f8d [3484210,90208] 0 2024-09-16T02:05:57.956 INFO:tasks.workunit.client.1.smithi165.stdout:0/715: symlink d0/d1e/d39/d48/d5f/d96/da4/lee 0 2024-09-16T02:05:57.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/265: write d1/d5/d8/de/f56 [1489882,99151] 0 2024-09-16T02:05:57.957 INFO:tasks.workunit.client.0.smithi110.stdout:9/266: fdatasync f0 0 2024-09-16T02:05:57.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/817: dread - df/d23/d28/d3b/d6d/d8b/fb2 zero size 2024-09-16T02:05:57.958 INFO:tasks.workunit.client.1.smithi165.stdout:5/768: symlink de/d21/d26/d3a/d54/d8c/dc7/lff 0 2024-09-16T02:05:57.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/818: readlink l8 0 2024-09-16T02:05:57.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/819: write df/f92 [986135,64469] 0 2024-09-16T02:05:57.961 INFO:tasks.workunit.client.1.smithi165.stdout:9/841: link d7/d1f/d27/d49/lbc d7/df/d37/d43/l10f 0 2024-09-16T02:05:57.961 INFO:tasks.workunit.client.1.smithi165.stdout:2/820: write df/d23/d28/f46 [4062020,46208] 0 2024-09-16T02:05:57.962 INFO:tasks.workunit.client.0.smithi110.stdout:7/255: getdents d3/d15/d44 0 2024-09-16T02:05:57.968 INFO:tasks.workunit.client.0.smithi110.stdout:7/256: dwrite d3/da/fc [0,4194304] 0 2024-09-16T02:05:57.968 INFO:tasks.workunit.client.0.smithi110.stdout:3/241: symlink d8/dc/d1b/d3a/d43/l53 0 2024-09-16T02:05:57.969 INFO:tasks.workunit.client.1.smithi165.stdout:3/853: stat da/d17/de5/d104/d2c/d2d/cdb 0 2024-09-16T02:05:57.970 INFO:tasks.workunit.client.0.smithi110.stdout:7/257: stat d3/da/d10/l25 0 2024-09-16T02:05:57.970 INFO:tasks.workunit.client.0.smithi110.stdout:2/324: chown d0/db/l4e 19666 1 2024-09-16T02:05:57.971 INFO:tasks.workunit.client.1.smithi165.stdout:3/854: chown da/d17/de5/d104/d2c/d10c/d9c/da6/l11f 288 1 2024-09-16T02:05:57.972 INFO:tasks.workunit.client.1.smithi165.stdout:8/814: creat dd/d11/d14/d70/d7b/d9a/f11a x:0 0 0 2024-09-16T02:05:57.973 INFO:tasks.workunit.client.1.smithi165.stdout:4/693: getdents d4/dc/d20/dc2 0 2024-09-16T02:05:57.974 INFO:tasks.workunit.client.1.smithi165.stdout:6/760: dwrite d7/dc/d7f/dd2/d3c/f70 [0,4194304] 0 2024-09-16T02:05:57.975 INFO:tasks.workunit.client.1.smithi165.stdout:7/786: creat d0/d4b/db4/dfa/fff x:0 0 0 2024-09-16T02:05:57.975 INFO:tasks.workunit.client.1.smithi165.stdout:6/761: stat d7/d17/d75/fb4 0 2024-09-16T02:05:57.976 INFO:tasks.workunit.client.1.smithi165.stdout:8/815: truncate dd/d11/d38/da6/db0/fbf 654186 0 2024-09-16T02:05:57.977 INFO:tasks.workunit.client.1.smithi165.stdout:7/787: truncate d0/df/d33/d2a/f94 9044217 0 2024-09-16T02:05:57.979 INFO:tasks.workunit.client.1.smithi165.stdout:7/788: chown d0/df/d42/fa5 1531773751 1 2024-09-16T02:05:57.980 INFO:tasks.workunit.client.1.smithi165.stdout:7/789: chown d0/d2c/d85/d8c 6921 1 2024-09-16T02:05:57.980 INFO:tasks.workunit.client.1.smithi165.stdout:7/790: chown d0/d4b/d63/c66 122919117 1 2024-09-16T02:05:57.980 INFO:tasks.workunit.client.0.smithi110.stdout:6/426: dwrite d0/d2/d5/d1e/f40 [0,4194304] 0 2024-09-16T02:05:57.985 INFO:tasks.workunit.client.0.smithi110.stdout:3/242: unlink d8/f1d 0 2024-09-16T02:05:57.994 INFO:tasks.workunit.client.0.smithi110.stdout:2/325: symlink d0/d5f/l68 0 2024-09-16T02:05:57.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/292: dread d5/dd/f4c [0,4194304] 0 2024-09-16T02:05:57.999 INFO:tasks.workunit.client.1.smithi165.stdout:9/842: unlink d7/df/l51 0 2024-09-16T02:05:58.001 INFO:tasks.workunit.client.1.smithi165.stdout:2/821: stat df/d10/d1a/d68/c5e 0 2024-09-16T02:05:58.001 INFO:tasks.workunit.client.0.smithi110.stdout:3/243: symlink d8/d48/l54 0 2024-09-16T02:05:58.002 INFO:tasks.workunit.client.1.smithi165.stdout:1/896: link d1/d22/f85 d1/dd/d11/d33/d3f/d6c/f121 0 2024-09-16T02:05:58.003 INFO:tasks.workunit.client.0.smithi110.stdout:7/258: symlink d3/da/d10/d2c/l49 0 2024-09-16T02:05:58.005 INFO:tasks.workunit.client.0.smithi110.stdout:2/326: read d0/da/f28 [2937352,57429] 0 2024-09-16T02:05:58.006 INFO:tasks.workunit.client.1.smithi165.stdout:4/694: creat d4/dc/d18/d37/dc9/fe3 x:0 0 0 2024-09-16T02:05:58.006 INFO:tasks.workunit.client.1.smithi165.stdout:4/695: readlink d4/dc/d20/l7f 0 2024-09-16T02:05:58.006 INFO:tasks.workunit.client.0.smithi110.stdout:5/293: dwrite d5/dd/f23 [4194304,4194304] 0 2024-09-16T02:05:58.007 INFO:tasks.workunit.client.0.smithi110.stdout:5/294: fdatasync f4 0 2024-09-16T02:05:58.009 INFO:tasks.workunit.client.1.smithi165.stdout:7/791: symlink d0/d2c/l100 0 2024-09-16T02:05:58.013 INFO:tasks.workunit.client.0.smithi110.stdout:3/244: rmdir d8/dc/d1b 39 2024-09-16T02:05:58.014 INFO:tasks.workunit.client.1.smithi165.stdout:0/716: stat d0/d1e/d20/d28/d6d/d87/cd3 0 2024-09-16T02:05:58.015 INFO:tasks.workunit.client.0.smithi110.stdout:6/427: dwrite d0/d2/dc/f5d [0,4194304] 0 2024-09-16T02:05:58.017 INFO:tasks.workunit.client.0.smithi110.stdout:9/267: rename d1/l31 to d1/d5/d8/l5a 0 2024-09-16T02:05:58.018 INFO:tasks.workunit.client.0.smithi110.stdout:9/268: chown d1/d5/d8/de/d1f/l2f 3508 1 2024-09-16T02:05:58.020 INFO:tasks.workunit.client.0.smithi110.stdout:9/269: write d1/d5/d8/de/d1f/f48 [626631,100846] 0 2024-09-16T02:05:58.021 INFO:tasks.workunit.client.0.smithi110.stdout:7/259: creat d3/da/d10/d11/d3e/d40/f4a x:0 0 0 2024-09-16T02:05:58.022 INFO:tasks.workunit.client.0.smithi110.stdout:9/270: write d1/f4f [580978,99848] 0 2024-09-16T02:05:58.022 INFO:tasks.workunit.client.0.smithi110.stdout:7/260: chown d3/da/d10/f29 5 1 2024-09-16T02:05:58.022 INFO:tasks.workunit.client.1.smithi165.stdout:5/769: mknod de/d21/d26/d3a/c100 0 2024-09-16T02:05:58.023 INFO:tasks.workunit.client.1.smithi165.stdout:5/770: stat de/d21/d26/d3a/d6d/dad/fd8 0 2024-09-16T02:05:58.025 INFO:tasks.workunit.client.0.smithi110.stdout:3/245: readlink d8/dc/d1b/d36/l44 0 2024-09-16T02:05:58.026 INFO:tasks.workunit.client.1.smithi165.stdout:1/897: symlink d1/d19/d4d/l122 0 2024-09-16T02:05:58.027 INFO:tasks.workunit.client.1.smithi165.stdout:1/898: fdatasync d1/d6b/dd7/f108 0 2024-09-16T02:05:58.027 INFO:tasks.workunit.client.0.smithi110.stdout:6/428: creat d0/f83 x:0 0 0 2024-09-16T02:05:58.028 INFO:tasks.workunit.client.1.smithi165.stdout:1/899: fdatasync d1/d6b/df6/fed 0 2024-09-16T02:05:58.031 INFO:tasks.workunit.client.0.smithi110.stdout:2/327: rename d0/da/l23 to d0/da/d18/dc/l69 0 2024-09-16T02:05:58.031 INFO:tasks.workunit.client.1.smithi165.stdout:8/816: mkdir dd/d11/d11b 0 2024-09-16T02:05:58.032 INFO:tasks.workunit.client.0.smithi110.stdout:7/261: rmdir d3/d15/d38 39 2024-09-16T02:05:58.036 INFO:tasks.workunit.client.0.smithi110.stdout:7/262: write d3/f9 [8715064,73775] 0 2024-09-16T02:05:58.037 INFO:tasks.workunit.client.1.smithi165.stdout:4/696: symlink d4/dc/d18/d37/d53/d64/d91/le4 0 2024-09-16T02:05:58.038 INFO:tasks.workunit.client.0.smithi110.stdout:9/271: mkdir d1/d5/d8/d26/d5b 0 2024-09-16T02:05:58.038 INFO:tasks.workunit.client.0.smithi110.stdout:9/272: readlink d1/d5/d8/de/l37 0 2024-09-16T02:05:58.038 INFO:tasks.workunit.client.0.smithi110.stdout:3/246: symlink d8/d48/l55 0 2024-09-16T02:05:58.041 INFO:tasks.workunit.client.1.smithi165.stdout:0/717: rename d0/d1e/d39/d48/f38 to d0/d1e/d39/d48/fef 0 2024-09-16T02:05:58.043 INFO:tasks.workunit.client.1.smithi165.stdout:0/718: fsync d0/d1e/d39/d48/d74/dc6/fec 0 2024-09-16T02:05:58.043 INFO:tasks.workunit.client.1.smithi165.stdout:3/855: dwrite da/d17/d7a/d7d/fb3 [0,4194304] 0 2024-09-16T02:05:58.045 INFO:tasks.workunit.client.1.smithi165.stdout:6/762: truncate d7/dc/df/d1a/f47 39106 0 2024-09-16T02:05:58.046 INFO:tasks.workunit.client.1.smithi165.stdout:9/843: mknod d7/d32/c110 0 2024-09-16T02:05:58.047 INFO:tasks.workunit.client.1.smithi165.stdout:9/844: chown d7/d32/d38/f77 58885854 1 2024-09-16T02:05:58.051 INFO:tasks.workunit.client.1.smithi165.stdout:2/822: symlink df/d10/lf3 0 2024-09-16T02:05:58.051 INFO:tasks.workunit.client.1.smithi165.stdout:2/823: chown df/d23/d28/d3b/d6d/d8b/cda 922787 1 2024-09-16T02:05:58.053 INFO:tasks.workunit.client.0.smithi110.stdout:7/263: write d3/f14 [3583891,67593] 0 2024-09-16T02:05:58.054 INFO:tasks.workunit.client.0.smithi110.stdout:7/264: write d3/f26 [3001558,95284] 0 2024-09-16T02:05:58.056 INFO:tasks.workunit.client.0.smithi110.stdout:2/328: truncate d0/da/d18/f29 372452 0 2024-09-16T02:05:58.057 INFO:tasks.workunit.client.1.smithi165.stdout:4/697: creat d4/dc/d20/d4e/fe5 x:0 0 0 2024-09-16T02:05:58.059 INFO:tasks.workunit.client.1.smithi165.stdout:3/856: fdatasync da/fb 0 2024-09-16T02:05:58.062 INFO:tasks.workunit.client.1.smithi165.stdout:0/719: dread d0/d1e/d39/d48/d5f/f73 [0,4194304] 0 2024-09-16T02:05:58.062 INFO:tasks.workunit.client.1.smithi165.stdout:2/824: creat df/d23/d28/d9a/d86/ff4 x:0 0 0 2024-09-16T02:05:58.062 INFO:tasks.workunit.client.1.smithi165.stdout:2/825: readlink df/d23/d66/l9e 0 2024-09-16T02:05:58.063 INFO:tasks.workunit.client.0.smithi110.stdout:2/329: dwrite d0/da/f24 [0,4194304] 0 2024-09-16T02:05:58.064 INFO:tasks.workunit.client.0.smithi110.stdout:5/295: rename d5/dd/l4b to d5/l62 0 2024-09-16T02:05:58.065 INFO:tasks.workunit.client.1.smithi165.stdout:1/900: symlink d1/dd/d11/d33/d92/da3/l123 0 2024-09-16T02:05:58.065 INFO:tasks.workunit.client.0.smithi110.stdout:6/429: fdatasync d0/d29/d2a/d2f/d49/f7e 0 2024-09-16T02:05:58.071 INFO:tasks.workunit.client.0.smithi110.stdout:9/273: creat d1/d5/d8/f5c x:0 0 0 2024-09-16T02:05:58.072 INFO:tasks.workunit.client.0.smithi110.stdout:3/247: creat d8/f56 x:0 0 0 2024-09-16T02:05:58.073 INFO:tasks.workunit.client.1.smithi165.stdout:8/817: link dd/d11/d14/d70/d7b/ffe dd/d11/d38/d74/f11c 0 2024-09-16T02:05:58.076 INFO:tasks.workunit.client.1.smithi165.stdout:8/818: write dd/d11/fcd [180637,79176] 0 2024-09-16T02:05:58.077 INFO:tasks.workunit.client.1.smithi165.stdout:0/720: dwrite d0/d1e/d39/d48/d74/dc6/fd4 [4194304,4194304] 0 2024-09-16T02:05:58.077 INFO:tasks.workunit.client.0.smithi110.stdout:4/348: sync 2024-09-16T02:05:58.077 INFO:tasks.workunit.client.0.smithi110.stdout:8/304: sync 2024-09-16T02:05:58.077 INFO:tasks.workunit.client.0.smithi110.stdout:8/305: stat d3 0 2024-09-16T02:05:58.078 INFO:tasks.workunit.client.0.smithi110.stdout:5/296: chown d5/dd/l60 233 1 2024-09-16T02:05:58.078 INFO:tasks.workunit.client.0.smithi110.stdout:8/306: readlink d3/d2b/d27/l41 0 2024-09-16T02:05:58.079 INFO:tasks.workunit.client.1.smithi165.stdout:1/901: dread d1/f9 [0,4194304] 0 2024-09-16T02:05:58.080 INFO:tasks.workunit.client.0.smithi110.stdout:4/349: write d4/d8/d17/d23/d35/f4b [471335,112725] 0 2024-09-16T02:05:58.081 INFO:tasks.workunit.client.0.smithi110.stdout:4/350: stat d4 0 2024-09-16T02:05:58.082 INFO:tasks.workunit.client.0.smithi110.stdout:8/307: read - d3/d31/f50 zero size 2024-09-16T02:05:58.085 INFO:tasks.workunit.client.0.smithi110.stdout:4/351: dread - d4/d8/d31/d36/d3c/f5c zero size 2024-09-16T02:05:58.089 INFO:tasks.workunit.client.0.smithi110.stdout:5/297: dwrite d5/dd/f2b [0,4194304] 0 2024-09-16T02:05:58.089 INFO:tasks.workunit.client.0.smithi110.stdout:3/248: dread f2 [0,4194304] 0 2024-09-16T02:05:58.091 INFO:tasks.workunit.client.0.smithi110.stdout:7/265: getdents d3/da/d10 0 2024-09-16T02:05:58.092 INFO:tasks.workunit.client.0.smithi110.stdout:9/274: mknod d1/d5/d8/d29/c5d 0 2024-09-16T02:05:58.093 INFO:tasks.workunit.client.1.smithi165.stdout:3/857: dread da/d17/f9f [0,4194304] 0 2024-09-16T02:05:58.094 INFO:tasks.workunit.client.1.smithi165.stdout:3/858: write da/d17/de5/d104/d2c/d2d/d6c/fe1 [3090745,23831] 0 2024-09-16T02:05:58.096 INFO:tasks.workunit.client.0.smithi110.stdout:6/430: rename d0/d2/dc to d0/d2/d5/d84 0 2024-09-16T02:05:58.098 INFO:tasks.workunit.client.0.smithi110.stdout:2/330: truncate d0/da/f2c 4207775 0 2024-09-16T02:05:58.100 INFO:tasks.workunit.client.0.smithi110.stdout:4/352: rmdir d4/d8/d31/d36/d3c/d3d 39 2024-09-16T02:05:58.103 INFO:tasks.workunit.client.0.smithi110.stdout:3/249: mkdir d8/dc/d1b/d36/d57 0 2024-09-16T02:05:58.104 INFO:tasks.workunit.client.0.smithi110.stdout:3/250: chown d8/dc/d1b/d3a/c3f 2537862 1 2024-09-16T02:05:58.105 INFO:tasks.workunit.client.0.smithi110.stdout:5/298: mknod d5/d36/d45/d47/c63 0 2024-09-16T02:05:58.105 INFO:tasks.workunit.client.0.smithi110.stdout:2/331: dwrite d0/d5f/f63 [0,4194304] 0 2024-09-16T02:05:58.107 INFO:tasks.workunit.client.0.smithi110.stdout:7/266: creat d3/da/d10/d11/d3e/d40/f4b x:0 0 0 2024-09-16T02:05:58.111 INFO:tasks.workunit.client.0.smithi110.stdout:6/431: symlink d0/d2/d5/d84/l85 0 2024-09-16T02:05:58.114 INFO:tasks.workunit.client.0.smithi110.stdout:8/308: mknod d3/d12/d5e/c6d 0 2024-09-16T02:05:58.114 INFO:tasks.workunit.client.0.smithi110.stdout:2/332: dwrite d0/db/d47/f60 [0,4194304] 0 2024-09-16T02:05:58.118 INFO:tasks.workunit.client.0.smithi110.stdout:4/353: rename d4/d8/d31/d36 to d4/d8/d17/d23/d4c/d6d 0 2024-09-16T02:05:58.119 INFO:tasks.workunit.client.0.smithi110.stdout:4/354: chown d4/d12/d3b/l5e 1895850 1 2024-09-16T02:05:58.122 INFO:tasks.workunit.client.0.smithi110.stdout:5/299: creat d5/d36/f64 x:0 0 0 2024-09-16T02:05:58.124 INFO:tasks.workunit.client.0.smithi110.stdout:7/267: readlink d3/da/l37 0 2024-09-16T02:05:58.128 INFO:tasks.workunit.client.1.smithi165.stdout:7/792: getdents d0/d4b/db4/dda 0 2024-09-16T02:05:58.131 INFO:tasks.workunit.client.0.smithi110.stdout:3/251: dread d8/dc/d1b/f2c [0,4194304] 0 2024-09-16T02:05:58.133 INFO:tasks.workunit.client.0.smithi110.stdout:6/432: unlink d0/d2/c6c 0 2024-09-16T02:05:58.133 INFO:tasks.workunit.client.1.smithi165.stdout:4/698: mkdir d4/dc/d28/de6 0 2024-09-16T02:05:58.135 INFO:tasks.workunit.client.0.smithi110.stdout:4/355: dread d4/d8/d31/f39 [0,4194304] 0 2024-09-16T02:05:58.135 INFO:tasks.workunit.client.1.smithi165.stdout:7/793: dwrite d0/d3d/dd5/fe7 [0,4194304] 0 2024-09-16T02:05:58.136 INFO:tasks.workunit.client.1.smithi165.stdout:7/794: chown d0/l98 1307209015 1 2024-09-16T02:05:58.138 INFO:tasks.workunit.client.1.smithi165.stdout:9/845: rmdir d7/df/d67/d104 0 2024-09-16T02:05:58.139 INFO:tasks.workunit.client.1.smithi165.stdout:9/846: truncate f2 4974172 0 2024-09-16T02:05:58.140 INFO:tasks.workunit.client.1.smithi165.stdout:5/771: sync 2024-09-16T02:05:58.140 INFO:tasks.workunit.client.0.smithi110.stdout:6/433: dwrite d0/d2/f42 [4194304,4194304] 0 2024-09-16T02:05:58.140 INFO:tasks.workunit.client.1.smithi165.stdout:1/902: readlink d1/d22/ldb 0 2024-09-16T02:05:58.142 INFO:tasks.workunit.client.0.smithi110.stdout:5/300: rename d5/d36/d45/d47/f49 to d5/d36/d45/d47/f65 0 2024-09-16T02:05:58.143 INFO:tasks.workunit.client.0.smithi110.stdout:9/275: truncate d1/d5/d8/de/f56 760585 0 2024-09-16T02:05:58.144 INFO:tasks.workunit.client.1.smithi165.stdout:7/795: dread d0/df/d42/fa5 [0,4194304] 0 2024-09-16T02:05:58.145 INFO:tasks.workunit.client.0.smithi110.stdout:3/252: mkdir d8/dc/d1b/d3a/d43/d58 0 2024-09-16T02:05:58.146 INFO:tasks.workunit.client.0.smithi110.stdout:8/309: dread d3/f44 [0,4194304] 0 2024-09-16T02:05:58.147 INFO:tasks.workunit.client.0.smithi110.stdout:3/253: write d8/d48/f4f [506647,96728] 0 2024-09-16T02:05:58.148 INFO:tasks.workunit.client.1.smithi165.stdout:1/903: dwrite d1/dd/d11/d33/d3f/d47/d7d/db3/fbc [0,4194304] 0 2024-09-16T02:05:58.148 INFO:tasks.workunit.client.0.smithi110.stdout:8/310: read - d3/d12/f5c zero size 2024-09-16T02:05:58.148 INFO:tasks.workunit.client.0.smithi110.stdout:3/254: readlink d8/d48/l54 0 2024-09-16T02:05:58.150 INFO:tasks.workunit.client.0.smithi110.stdout:2/333: dread d0/da/d18/f19 [0,4194304] 0 2024-09-16T02:05:58.151 INFO:tasks.workunit.client.1.smithi165.stdout:3/859: fdatasync da/d17/d7a/f96 0 2024-09-16T02:05:58.155 INFO:tasks.workunit.client.0.smithi110.stdout:7/268: creat d3/da/d2e/f4c x:0 0 0 2024-09-16T02:05:58.156 INFO:tasks.workunit.client.0.smithi110.stdout:7/269: truncate d3/f8 1324173 0 2024-09-16T02:05:58.157 INFO:tasks.workunit.client.1.smithi165.stdout:3/860: dread da/d20/d26/f31 [0,4194304] 0 2024-09-16T02:05:58.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/276: symlink d1/d5/d8/de/l5e 0 2024-09-16T02:05:58.165 INFO:tasks.workunit.client.0.smithi110.stdout:3/255: rmdir d8/d48 39 2024-09-16T02:05:58.166 INFO:tasks.workunit.client.0.smithi110.stdout:7/270: dwrite d3/da/d2e/f4c [0,4194304] 0 2024-09-16T02:05:58.167 INFO:tasks.workunit.client.0.smithi110.stdout:9/277: truncate d1/d2b/d2e/d38/d3d/f4e 4673408 0 2024-09-16T02:05:58.169 INFO:tasks.workunit.client.0.smithi110.stdout:3/256: dread d8/dc/d1b/d3a/f50 [0,4194304] 0 2024-09-16T02:05:58.170 INFO:tasks.workunit.client.1.smithi165.stdout:1/904: write d1/d19/d24/d30/d72/f91 [262172,114652] 0 2024-09-16T02:05:58.171 INFO:tasks.workunit.client.1.smithi165.stdout:1/905: stat d1/dd/d11/d33/d35/fb9 0 2024-09-16T02:05:58.171 INFO:tasks.workunit.client.0.smithi110.stdout:4/356: symlink d4/d8/d17/d6b/l6e 0 2024-09-16T02:05:58.173 INFO:tasks.workunit.client.0.smithi110.stdout:2/334: unlink d0/da/d18/d2d/l3a 0 2024-09-16T02:05:58.174 INFO:tasks.workunit.client.0.smithi110.stdout:5/301: mknod d5/c66 0 2024-09-16T02:05:58.175 INFO:tasks.workunit.client.1.smithi165.stdout:4/699: mknod d4/ce7 0 2024-09-16T02:05:58.175 INFO:tasks.workunit.client.0.smithi110.stdout:5/302: read - d5/f61 zero size 2024-09-16T02:05:58.177 INFO:tasks.workunit.client.1.smithi165.stdout:4/700: write d4/dc/d20/d4e/f72 [1098954,32479] 0 2024-09-16T02:05:58.177 INFO:tasks.workunit.client.1.smithi165.stdout:9/847: creat d7/d32/d38/d53/d5c/d61/dd5/f111 x:0 0 0 2024-09-16T02:05:58.177 INFO:tasks.workunit.client.1.smithi165.stdout:4/701: fsync d4/fc3 0 2024-09-16T02:05:58.179 INFO:tasks.workunit.client.1.smithi165.stdout:9/848: read - d7/df/d37/d65/fdf zero size 2024-09-16T02:05:58.180 INFO:tasks.workunit.client.0.smithi110.stdout:2/335: dwrite d0/d5f/f63 [0,4194304] 0 2024-09-16T02:05:58.181 INFO:tasks.workunit.client.0.smithi110.stdout:8/311: symlink d3/d12/d1a/d6c/l6e 0 2024-09-16T02:05:58.181 INFO:tasks.workunit.client.1.smithi165.stdout:2/826: link df/d10/db4/cc2 df/dbb/ded/cf5 0 2024-09-16T02:05:58.182 INFO:tasks.workunit.client.0.smithi110.stdout:2/336: chown d0/da/d18/d2d/d39/c3e 1 1 2024-09-16T02:05:58.182 INFO:tasks.workunit.client.0.smithi110.stdout:8/312: chown d3/d12/d5e/c6d 3277 1 2024-09-16T02:05:58.182 INFO:tasks.workunit.client.1.smithi165.stdout:0/721: truncate d0/d1e/d39/d48/f8f 3562303 0 2024-09-16T02:05:58.183 INFO:tasks.workunit.client.1.smithi165.stdout:5/772: dwrite f6 [0,4194304] 0 2024-09-16T02:05:58.188 INFO:tasks.workunit.client.1.smithi165.stdout:1/906: unlink d1/d19/d4d/d84/l75 0 2024-09-16T02:05:58.190 INFO:tasks.workunit.client.0.smithi110.stdout:4/357: mkdir d4/d8/d31/d6f 0 2024-09-16T02:05:58.190 INFO:tasks.workunit.client.1.smithi165.stdout:0/722: dwrite d0/f9 [4194304,4194304] 0 2024-09-16T02:05:58.193 INFO:tasks.workunit.client.1.smithi165.stdout:6/763: sync 2024-09-16T02:05:58.194 INFO:tasks.workunit.client.1.smithi165.stdout:1/907: dread d1/f9 [0,4194304] 0 2024-09-16T02:05:58.197 INFO:tasks.workunit.client.0.smithi110.stdout:5/303: rename d5/d36/d3d/f42 to d5/d36/f67 0 2024-09-16T02:05:58.199 INFO:tasks.workunit.client.1.smithi165.stdout:4/702: symlink d4/dc/d18/d37/d53/le8 0 2024-09-16T02:05:58.201 INFO:tasks.workunit.client.1.smithi165.stdout:3/861: mknod da/d57/d8d/c125 0 2024-09-16T02:05:58.201 INFO:tasks.workunit.client.1.smithi165.stdout:1/908: dwrite d1/dd/f103 [0,4194304] 0 2024-09-16T02:05:58.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/849: dread d7/df/d67/d92/fc6 [0,4194304] 0 2024-09-16T02:05:58.204 INFO:tasks.workunit.client.1.smithi165.stdout:1/909: dread - d1/dd/d11/d33/d3f/d47/d7d/db3/de0/fb2 zero size 2024-09-16T02:05:58.204 INFO:tasks.workunit.client.1.smithi165.stdout:3/862: truncate da/d17/dcc/ff3 476753 0 2024-09-16T02:05:58.207 INFO:tasks.workunit.client.0.smithi110.stdout:3/257: write d8/dc/f25 [819261,85479] 0 2024-09-16T02:05:58.210 INFO:tasks.workunit.client.0.smithi110.stdout:4/358: truncate d4/d8/d17/d23/d4c/d6d/d3c/d3d/f47 973356 0 2024-09-16T02:05:58.212 INFO:tasks.workunit.client.0.smithi110.stdout:4/359: dread - d4/d8/d17/d23/d4c/d6d/f62 zero size 2024-09-16T02:05:58.212 INFO:tasks.workunit.client.0.smithi110.stdout:2/337: rename d0/da/d18/dc/f17 to d0/da/d18/d2d/d39/f6a 0 2024-09-16T02:05:58.213 INFO:tasks.workunit.client.1.smithi165.stdout:1/910: dwrite d1/d19/d24/d30/d72/f91 [0,4194304] 0 2024-09-16T02:05:58.214 INFO:tasks.workunit.client.0.smithi110.stdout:5/304: fdatasync d5/dd/df/f1d 0 2024-09-16T02:05:58.215 INFO:tasks.workunit.client.0.smithi110.stdout:7/271: truncate d3/da/fe 1629658 0 2024-09-16T02:05:58.215 INFO:tasks.workunit.client.1.smithi165.stdout:1/911: write d1/dd/d11/d33/f56 [2734240,10668] 0 2024-09-16T02:05:58.215 INFO:tasks.workunit.client.0.smithi110.stdout:7/272: readlink d3/l1a 0 2024-09-16T02:05:58.217 INFO:tasks.workunit.client.0.smithi110.stdout:7/273: write d3/da/d10/f29 [5612425,106432] 0 2024-09-16T02:05:58.219 INFO:tasks.workunit.client.0.smithi110.stdout:3/258: truncate d8/dc/d1b/d1c/f26 702727 0 2024-09-16T02:05:58.220 INFO:tasks.workunit.client.0.smithi110.stdout:3/259: stat d8/dc/d1b/d3a/d43/f4e 0 2024-09-16T02:05:58.221 INFO:tasks.workunit.client.1.smithi165.stdout:4/703: dread f1 [0,4194304] 0 2024-09-16T02:05:58.223 INFO:tasks.workunit.client.1.smithi165.stdout:9/850: mkdir d7/d14/d7a/d112 0 2024-09-16T02:05:58.223 INFO:tasks.workunit.client.1.smithi165.stdout:8/819: sync 2024-09-16T02:05:58.223 INFO:tasks.workunit.client.1.smithi165.stdout:7/796: sync 2024-09-16T02:05:58.224 INFO:tasks.workunit.client.0.smithi110.stdout:4/360: creat d4/d8/d17/d23/f70 x:0 0 0 2024-09-16T02:05:58.226 INFO:tasks.workunit.client.0.smithi110.stdout:4/361: write d4/f2c [2636597,113182] 0 2024-09-16T02:05:58.226 INFO:tasks.workunit.client.1.smithi165.stdout:3/863: dread da/d17/de5/d104/d2c/d10c/fac [0,4194304] 0 2024-09-16T02:05:58.229 INFO:tasks.workunit.client.1.smithi165.stdout:5/773: mkdir de/d21/d26/d3a/d6d/de2/d101 0 2024-09-16T02:05:58.231 INFO:tasks.workunit.client.0.smithi110.stdout:9/278: dwrite d1/d2b/f2d [0,4194304] 0 2024-09-16T02:05:58.231 INFO:tasks.workunit.client.0.smithi110.stdout:5/305: write d5/dd/df/f1d [569856,15162] 0 2024-09-16T02:05:58.234 INFO:tasks.workunit.client.0.smithi110.stdout:7/274: chown d3/d15/d38/f3b 1011 1 2024-09-16T02:05:58.234 INFO:tasks.workunit.client.1.smithi165.stdout:9/851: dread d7/d32/d85/fd7 [0,4194304] 0 2024-09-16T02:05:58.235 INFO:tasks.workunit.client.0.smithi110.stdout:7/275: write d3/da/d10/f39 [3466232,102401] 0 2024-09-16T02:05:58.236 INFO:tasks.workunit.client.0.smithi110.stdout:2/338: symlink d0/da/l6b 0 2024-09-16T02:05:58.237 INFO:tasks.workunit.client.0.smithi110.stdout:7/276: write d3/d15/d38/f3b [544764,54855] 0 2024-09-16T02:05:58.238 INFO:tasks.workunit.client.0.smithi110.stdout:7/277: rename d3 to d3/da/d10/d2c/d4d 22 2024-09-16T02:05:58.242 INFO:tasks.workunit.client.1.smithi165.stdout:8/820: creat dd/d11/d14/d3f/d25/d36/d4f/f11d x:0 0 0 2024-09-16T02:05:58.243 INFO:tasks.workunit.client.0.smithi110.stdout:5/306: rmdir d5/dd/df/d11 39 2024-09-16T02:05:58.248 INFO:tasks.workunit.client.1.smithi165.stdout:4/704: dread d4/dc/d28/d3b/f90 [0,4194304] 0 2024-09-16T02:05:58.250 INFO:tasks.workunit.client.0.smithi110.stdout:2/339: fdatasync d0/da/d18/dc/f1c 0 2024-09-16T02:05:58.252 INFO:tasks.workunit.client.1.smithi165.stdout:9/852: mkdir d7/d32/d38/d68/d7f/d113 0 2024-09-16T02:05:58.253 INFO:tasks.workunit.client.0.smithi110.stdout:7/278: mkdir d3/da/d2e/d4e 0 2024-09-16T02:05:58.253 INFO:tasks.workunit.client.1.smithi165.stdout:3/864: dread da/d20/d26/f30 [0,4194304] 0 2024-09-16T02:05:58.254 INFO:tasks.workunit.client.1.smithi165.stdout:1/912: write d1/dd/d11/d42/faf [200491,128732] 0 2024-09-16T02:05:58.254 INFO:tasks.workunit.client.1.smithi165.stdout:6/764: creat d7/dc/df/fda x:0 0 0 2024-09-16T02:05:58.258 INFO:tasks.workunit.client.0.smithi110.stdout:5/307: unlink d5/dd/f23 0 2024-09-16T02:05:58.259 INFO:tasks.workunit.client.1.smithi165.stdout:7/797: dwrite d0/f41 [0,4194304] 0 2024-09-16T02:05:58.260 INFO:tasks.workunit.client.1.smithi165.stdout:2/827: link df/d23/d28/d3b/f56 df/d10/d1a/dca/ff6 0 2024-09-16T02:05:58.261 INFO:tasks.workunit.client.0.smithi110.stdout:3/260: link d8/dc/d1b/f31 d8/d29/d45/f59 0 2024-09-16T02:05:58.261 INFO:tasks.workunit.client.0.smithi110.stdout:4/362: dread d4/d8/d17/d23/d35/f42 [0,4194304] 0 2024-09-16T02:05:58.262 INFO:tasks.workunit.client.1.smithi165.stdout:8/821: creat dd/d11/d14/d70/d7b/df2/dfc/f11e x:0 0 0 2024-09-16T02:05:58.265 INFO:tasks.workunit.client.0.smithi110.stdout:2/340: write d0/da/d18/d2d/f4a [3717948,82411] 0 2024-09-16T02:05:58.265 INFO:tasks.workunit.client.1.smithi165.stdout:0/723: getdents d0/d1e/d39/d48/d5f/d82/d91 0 2024-09-16T02:05:58.266 INFO:tasks.workunit.client.0.smithi110.stdout:2/341: write d0/da/f26 [959344,53333] 0 2024-09-16T02:05:58.269 INFO:tasks.workunit.client.0.smithi110.stdout:2/342: truncate d0/db/d33/d46/f67 563344 0 2024-09-16T02:05:58.269 INFO:tasks.workunit.client.1.smithi165.stdout:5/774: dwrite de/d19/d1c/f56 [0,4194304] 0 2024-09-16T02:05:58.271 INFO:tasks.workunit.client.1.smithi165.stdout:3/865: creat da/d20/d26/d6e/f126 x:0 0 0 2024-09-16T02:05:58.272 INFO:tasks.workunit.client.1.smithi165.stdout:1/913: creat d1/dd/d11/d46/f124 x:0 0 0 2024-09-16T02:05:58.272 INFO:tasks.workunit.client.1.smithi165.stdout:3/866: stat da/fd7 0 2024-09-16T02:05:58.272 INFO:tasks.workunit.client.1.smithi165.stdout:8/822: dwrite dd/d7f/fde [0,4194304] 0 2024-09-16T02:05:58.274 INFO:tasks.workunit.client.0.smithi110.stdout:5/308: write d5/d36/d45/d47/f65 [1272449,26697] 0 2024-09-16T02:05:58.274 INFO:tasks.workunit.client.1.smithi165.stdout:3/867: write da/d17/de5/d104/d2c/db7/fc1 [520493,62054] 0 2024-09-16T02:05:58.274 INFO:tasks.workunit.client.0.smithi110.stdout:4/363: chown d4/d12/l68 167 1 2024-09-16T02:05:58.275 INFO:tasks.workunit.client.1.smithi165.stdout:6/765: truncate d7/dc/df/d1a/f2d 3822624 0 2024-09-16T02:05:58.276 INFO:tasks.workunit.client.1.smithi165.stdout:2/828: creat df/d10/d1a/d2d/dd1/ff7 x:0 0 0 2024-09-16T02:05:58.277 INFO:tasks.workunit.client.0.smithi110.stdout:3/261: creat d8/dc/d1b/d36/d3b/f5a x:0 0 0 2024-09-16T02:05:58.284 INFO:tasks.workunit.client.0.smithi110.stdout:4/364: dwrite d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [0,4194304] 0 2024-09-16T02:05:58.284 INFO:tasks.workunit.client.1.smithi165.stdout:6/766: dread d7/dc/df/d1a/d4d/d5f/f84 [0,4194304] 0 2024-09-16T02:05:58.285 INFO:tasks.workunit.client.1.smithi165.stdout:6/767: chown d7/d17/d75/d97/dcb 49464 1 2024-09-16T02:05:58.286 INFO:tasks.workunit.client.1.smithi165.stdout:6/768: dread - d7/dc/d7f/dd2/f6f zero size 2024-09-16T02:05:58.287 INFO:tasks.workunit.client.0.smithi110.stdout:9/279: link d1/d2b/d2e/c42 d1/d2b/d2e/d38/d3d/c5f 0 2024-09-16T02:05:58.293 INFO:tasks.workunit.client.1.smithi165.stdout:9/853: write d7/f22 [4452977,36354] 0 2024-09-16T02:05:58.293 INFO:tasks.workunit.client.1.smithi165.stdout:1/914: rmdir d1/dd/d11/d33/d3f/d47/d7d/db3/de0 39 2024-09-16T02:05:58.294 INFO:tasks.workunit.client.1.smithi165.stdout:9/854: readlink d7/d32/d38/d68/l8e 0 2024-09-16T02:05:58.313 INFO:tasks.workunit.client.0.smithi110.stdout:1/376: sync 2024-09-16T02:05:58.313 INFO:tasks.workunit.client.0.smithi110.stdout:0/386: sync 2024-09-16T02:05:58.314 INFO:tasks.workunit.client.1.smithi165.stdout:4/705: sync 2024-09-16T02:05:58.315 INFO:tasks.workunit.client.1.smithi165.stdout:4/706: truncate d4/dc/d28/d2b/d42/d99/fb6 1237667 0 2024-09-16T02:05:58.321 INFO:tasks.workunit.client.0.smithi110.stdout:0/387: dwrite d3/d4/dc/d10/f3c [0,4194304] 0 2024-09-16T02:05:58.326 INFO:tasks.workunit.client.0.smithi110.stdout:1/377: dread d0/d1/d2a/f34 [0,4194304] 0 2024-09-16T02:05:58.340 INFO:tasks.workunit.client.0.smithi110.stdout:0/388: dread d3/f17 [0,4194304] 0 2024-09-16T02:05:58.377 INFO:tasks.workunit.client.1.smithi165.stdout:2/829: mknod df/d10/d1a/dca/cf8 0 2024-09-16T02:05:58.379 INFO:tasks.workunit.client.0.smithi110.stdout:2/343: write d0/da/f28 [295223,55370] 0 2024-09-16T02:05:58.380 INFO:tasks.workunit.client.0.smithi110.stdout:2/344: chown d0/db/c20 1858 1 2024-09-16T02:05:58.382 INFO:tasks.workunit.client.0.smithi110.stdout:5/309: write d5/f19 [728182,41778] 0 2024-09-16T02:05:58.383 INFO:tasks.workunit.client.1.smithi165.stdout:0/724: dwrite d0/f5a [0,4194304] 0 2024-09-16T02:05:58.383 INFO:tasks.workunit.client.0.smithi110.stdout:3/262: mkdir d8/d48/d5b 0 2024-09-16T02:05:58.386 INFO:tasks.workunit.client.1.smithi165.stdout:5/775: symlink de/d19/df6/l102 0 2024-09-16T02:05:58.387 INFO:tasks.workunit.client.0.smithi110.stdout:3/263: dread - d8/dc/d1b/d36/d3b/f5a zero size 2024-09-16T02:05:58.389 INFO:tasks.workunit.client.0.smithi110.stdout:2/345: dread d0/da/d18/d2d/f5a [0,4194304] 0 2024-09-16T02:05:58.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/310: dwrite f4 [0,4194304] 0 2024-09-16T02:05:58.397 INFO:tasks.workunit.client.1.smithi165.stdout:8/823: truncate dd/fdd 919241 0 2024-09-16T02:05:58.398 INFO:tasks.workunit.client.0.smithi110.stdout:0/389: unlink d3/d6/d4b/f58 0 2024-09-16T02:05:58.401 INFO:tasks.workunit.client.1.smithi165.stdout:1/915: fsync d1/dd/d11/d33/d3f/d6c/f121 0 2024-09-16T02:05:58.403 INFO:tasks.workunit.client.0.smithi110.stdout:7/279: getdents d3/da/d10/d11 0 2024-09-16T02:05:58.412 INFO:tasks.workunit.client.1.smithi165.stdout:7/798: rename d0/d2c/d85/d8c/lf3 to d0/df/d42/l101 0 2024-09-16T02:05:58.412 INFO:tasks.workunit.client.1.smithi165.stdout:7/799: stat d0/d4b/fb9 0 2024-09-16T02:05:58.416 INFO:tasks.workunit.client.0.smithi110.stdout:5/311: rmdir d5/dd/df/d28 39 2024-09-16T02:05:58.419 INFO:tasks.workunit.client.1.smithi165.stdout:2/830: creat df/dbb/ff9 x:0 0 0 2024-09-16T02:05:58.419 INFO:tasks.workunit.client.1.smithi165.stdout:2/831: dread - df/d10/d1a/d2d/dd1/ff7 zero size 2024-09-16T02:05:58.427 INFO:tasks.workunit.client.0.smithi110.stdout:9/280: link d1/d1b/d23/f4c d1/d5/d8/d29/f60 0 2024-09-16T02:05:58.428 INFO:tasks.workunit.client.1.smithi165.stdout:5/776: unlink de/d21/d26/d3a/d6d/d95/fae 0 2024-09-16T02:05:58.431 INFO:tasks.workunit.client.1.smithi165.stdout:8/824: creat dd/d11/d14/def/f11f x:0 0 0 2024-09-16T02:05:58.438 INFO:tasks.workunit.client.1.smithi165.stdout:3/868: symlink da/d17/d7a/d7d/l127 0 2024-09-16T02:05:58.438 INFO:tasks.workunit.client.0.smithi110.stdout:9/281: dread d1/d2b/d2e/f3a [0,4194304] 0 2024-09-16T02:05:58.441 INFO:tasks.workunit.client.1.smithi165.stdout:7/800: mknod d0/d4b/db4/dda/c102 0 2024-09-16T02:05:58.444 INFO:tasks.workunit.client.0.smithi110.stdout:9/282: symlink d1/d2b/d2e/d38/d3d/l61 0 2024-09-16T02:05:58.446 INFO:tasks.workunit.client.1.smithi165.stdout:0/725: mknod d0/d1e/d39/d48/d5f/ddf/cf0 0 2024-09-16T02:05:58.447 INFO:tasks.workunit.client.1.smithi165.stdout:8/825: dread dd/d11/f47 [0,4194304] 0 2024-09-16T02:05:58.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/777: rename de/d21/d26/d3a/d6d/d95/fa1 to de/d21/d26/d94/f103 0 2024-09-16T02:05:58.450 INFO:tasks.workunit.client.1.smithi165.stdout:9/855: creat d7/d1f/f114 x:0 0 0 2024-09-16T02:05:58.450 INFO:tasks.workunit.client.0.smithi110.stdout:9/283: mknod d1/d2b/d2e/d38/c62 0 2024-09-16T02:05:58.451 INFO:tasks.workunit.client.1.smithi165.stdout:9/856: readlink d7/d1f/d27/d49/le0 0 2024-09-16T02:05:58.451 INFO:tasks.workunit.client.0.smithi110.stdout:9/284: readlink d1/d5/d8/l51 0 2024-09-16T02:05:58.453 INFO:tasks.workunit.client.1.smithi165.stdout:6/769: getdents d7/dc/d7f/dd2/d3c/dcd 0 2024-09-16T02:05:58.454 INFO:tasks.workunit.client.1.smithi165.stdout:6/770: chown d7/c2c 456847161 1 2024-09-16T02:05:58.455 INFO:tasks.workunit.client.1.smithi165.stdout:0/726: creat d0/d1e/d39/d99/ff1 x:0 0 0 2024-09-16T02:05:58.455 INFO:tasks.workunit.client.0.smithi110.stdout:9/285: dread d1/d5/d8/de/f3b [0,4194304] 0 2024-09-16T02:05:58.537 INFO:tasks.workunit.client.1.smithi165.stdout:9/857: mkdir d7/df/d37/d43/d88/d115 0 2024-09-16T02:05:58.541 INFO:tasks.workunit.client.0.smithi110.stdout:9/286: dwrite d1/d5/d8/d29/f60 [0,4194304] 0 2024-09-16T02:05:58.542 INFO:tasks.workunit.client.0.smithi110.stdout:9/287: write f0 [4468782,105934] 0 2024-09-16T02:05:58.547 INFO:tasks.workunit.client.1.smithi165.stdout:6/771: creat d7/d17/d75/d97/fdb x:0 0 0 2024-09-16T02:05:58.550 INFO:tasks.workunit.client.0.smithi110.stdout:9/288: dwrite d1/d5/f18 [4194304,4194304] 0 2024-09-16T02:05:58.553 INFO:tasks.workunit.client.1.smithi165.stdout:6/772: mkdir d7/d17/d75/dc1/ddc 0 2024-09-16T02:05:58.553 INFO:tasks.workunit.client.0.smithi110.stdout:9/289: truncate d1/d5/d8/f40 787930 0 2024-09-16T02:05:58.560 INFO:tasks.workunit.client.0.smithi110.stdout:9/290: getdents d1/d5/d8/d26 0 2024-09-16T02:05:58.562 INFO:tasks.workunit.client.0.smithi110.stdout:9/291: mknod d1/d5/d8/d29/c63 0 2024-09-16T02:05:58.565 INFO:tasks.workunit.client.0.smithi110.stdout:9/292: symlink d1/d5/d8/d26/l64 0 2024-09-16T02:05:58.567 INFO:tasks.workunit.client.0.smithi110.stdout:9/293: write d1/d5/d8/de/d1f/f48 [862495,50699] 0 2024-09-16T02:05:58.568 INFO:tasks.workunit.client.0.smithi110.stdout:9/294: fdatasync d1/d5/d8/d29/f60 0 2024-09-16T02:05:58.570 INFO:tasks.workunit.client.0.smithi110.stdout:5/312: mknod d5/d36/c68 0 2024-09-16T02:05:58.572 INFO:tasks.workunit.client.0.smithi110.stdout:5/313: rmdir d5/dd/df 39 2024-09-16T02:05:58.578 INFO:tasks.workunit.client.0.smithi110.stdout:5/314: dwrite d5/f1e [0,4194304] 0 2024-09-16T02:05:58.586 INFO:tasks.workunit.client.0.smithi110.stdout:1/378: write d0/d25/f42 [222181,115053] 0 2024-09-16T02:05:58.593 INFO:tasks.workunit.client.0.smithi110.stdout:1/379: getdents d0/da 0 2024-09-16T02:05:58.594 INFO:tasks.workunit.client.0.smithi110.stdout:3/264: write d8/dc/f27 [1535668,21384] 0 2024-09-16T02:05:58.594 INFO:tasks.workunit.client.0.smithi110.stdout:3/265: readlink d8/dc/l12 0 2024-09-16T02:05:58.596 INFO:tasks.workunit.client.0.smithi110.stdout:1/380: read d0/d1/d4/f31 [1140106,22632] 0 2024-09-16T02:05:58.598 INFO:tasks.workunit.client.0.smithi110.stdout:1/381: mknod d0/d25/c7d 0 2024-09-16T02:05:58.599 INFO:tasks.workunit.client.0.smithi110.stdout:3/266: creat d8/f5c x:0 0 0 2024-09-16T02:05:58.601 INFO:tasks.workunit.client.0.smithi110.stdout:3/267: mknod d8/dc/d1b/d3a/c5d 0 2024-09-16T02:05:58.602 INFO:tasks.workunit.client.0.smithi110.stdout:1/382: creat d0/d1/d2a/f7e x:0 0 0 2024-09-16T02:05:58.603 INFO:tasks.workunit.client.0.smithi110.stdout:3/268: symlink d8/dc/d1b/d36/l5e 0 2024-09-16T02:05:58.608 INFO:tasks.workunit.client.0.smithi110.stdout:3/269: link d8/f15 d8/d29/d45/f5f 0 2024-09-16T02:05:58.609 INFO:tasks.workunit.client.0.smithi110.stdout:1/383: dwrite d0/da/f29 [0,4194304] 0 2024-09-16T02:05:58.611 INFO:tasks.workunit.client.0.smithi110.stdout:2/346: write d0/db/d47/f50 [3419890,23416] 0 2024-09-16T02:05:58.612 INFO:tasks.workunit.client.0.smithi110.stdout:2/347: fdatasync d0/da/f28 0 2024-09-16T02:05:58.614 INFO:tasks.workunit.client.0.smithi110.stdout:0/390: truncate d3/d4/f27 1877582 0 2024-09-16T02:05:58.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/270: creat d8/dc/d1b/f60 x:0 0 0 2024-09-16T02:05:58.616 INFO:tasks.workunit.client.0.smithi110.stdout:0/391: chown d3/d6/d4b/f4d 0 1 2024-09-16T02:05:58.616 INFO:tasks.workunit.client.0.smithi110.stdout:3/271: readlink d8/l23 0 2024-09-16T02:05:58.619 INFO:tasks.workunit.client.0.smithi110.stdout:1/384: dwrite d0/d1/d2a/d32/f67 [4194304,4194304] 0 2024-09-16T02:05:58.620 INFO:tasks.workunit.client.0.smithi110.stdout:0/392: unlink d3/l24 0 2024-09-16T02:05:58.621 INFO:tasks.workunit.client.0.smithi110.stdout:0/393: fsync d3/f1a 0 2024-09-16T02:05:58.621 INFO:tasks.workunit.client.0.smithi110.stdout:3/272: rmdir d8/dc 39 2024-09-16T02:05:58.622 INFO:tasks.workunit.client.1.smithi165.stdout:4/707: dwrite d4/dc/d28/d2b/f74 [0,4194304] 0 2024-09-16T02:05:58.623 INFO:tasks.workunit.client.0.smithi110.stdout:1/385: creat d0/d1/d4/d46/d51/f7f x:0 0 0 2024-09-16T02:05:58.625 INFO:tasks.workunit.client.1.smithi165.stdout:2/832: dwrite df/d23/d28/d9a/d86/fae [0,4194304] 0 2024-09-16T02:05:58.627 INFO:tasks.workunit.client.1.smithi165.stdout:5/778: chown de/d21/d26/d94/f103 0 1 2024-09-16T02:05:58.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/273: read d8/fb [6002345,16634] 0 2024-09-16T02:05:58.629 INFO:tasks.workunit.client.1.smithi165.stdout:2/833: stat df/d23/d66/f7d 0 2024-09-16T02:05:58.636 INFO:tasks.workunit.client.0.smithi110.stdout:3/274: truncate d8/dc/d1b/f24 123429 0 2024-09-16T02:05:58.636 INFO:tasks.workunit.client.1.smithi165.stdout:5/779: truncate de/d21/d26/f8a 691008 0 2024-09-16T02:05:58.638 INFO:tasks.workunit.client.1.smithi165.stdout:4/708: dwrite d4/dc/fac [0,4194304] 0 2024-09-16T02:05:58.639 INFO:tasks.workunit.client.1.smithi165.stdout:3/869: truncate da/d20/d26/fa7 1131006 0 2024-09-16T02:05:58.640 INFO:tasks.workunit.client.1.smithi165.stdout:5/780: truncate de/f1d 3868323 0 2024-09-16T02:05:58.641 INFO:tasks.workunit.client.1.smithi165.stdout:3/870: readlink da/d17/de5/d104/d2c/d2d/l50 0 2024-09-16T02:05:58.642 INFO:tasks.workunit.client.1.smithi165.stdout:3/871: readlink da/d17/de5/d104/l39 0 2024-09-16T02:05:58.645 INFO:tasks.workunit.client.1.smithi165.stdout:4/709: dread d4/dc/d20/d4e/d73/fde [0,4194304] 0 2024-09-16T02:05:58.645 INFO:tasks.workunit.client.1.smithi165.stdout:5/781: readlink de/l15 0 2024-09-16T02:05:58.645 INFO:tasks.workunit.client.1.smithi165.stdout:9/858: write d7/d32/d4a/f4d [689326,27763] 0 2024-09-16T02:05:58.646 INFO:tasks.workunit.client.1.smithi165.stdout:5/782: chown de/d19/d1c/d84/daa 2042253 1 2024-09-16T02:05:58.647 INFO:tasks.workunit.client.1.smithi165.stdout:3/872: creat da/d17/d7a/dab/f128 x:0 0 0 2024-09-16T02:05:58.647 INFO:tasks.workunit.client.1.smithi165.stdout:9/859: write d7/d1f/ddb/fea [983097,62362] 0 2024-09-16T02:05:58.647 INFO:tasks.workunit.client.1.smithi165.stdout:0/727: write d0/d1e/f24 [2110689,79317] 0 2024-09-16T02:05:58.650 INFO:tasks.workunit.client.1.smithi165.stdout:4/710: mkdir d4/dc/d18/d37/d53/d64/d8b/d71/de9 0 2024-09-16T02:05:58.650 INFO:tasks.workunit.client.1.smithi165.stdout:0/728: write d0/d1e/d20/d28/da7/db4/fd0 [543937,9775] 0 2024-09-16T02:05:58.651 INFO:tasks.workunit.client.1.smithi165.stdout:7/801: rename d0/dc3 to d0/d2c/dc8/d103 0 2024-09-16T02:05:58.652 INFO:tasks.workunit.client.1.smithi165.stdout:5/783: mknod de/d19/d67/c104 0 2024-09-16T02:05:58.655 INFO:tasks.workunit.client.1.smithi165.stdout:5/784: write de/d21/d26/d3a/f5a [8377471,99462] 0 2024-09-16T02:05:58.656 INFO:tasks.workunit.client.1.smithi165.stdout:2/834: dread df/d23/f50 [0,4194304] 0 2024-09-16T02:05:58.656 INFO:tasks.workunit.client.1.smithi165.stdout:7/802: write d0/d3d/f5b [2362600,92631] 0 2024-09-16T02:05:58.657 INFO:tasks.workunit.client.1.smithi165.stdout:8/826: rename dd/d62/f117 to dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/f120 0 2024-09-16T02:05:58.658 INFO:tasks.workunit.client.0.smithi110.stdout:1/386: dread d0/d1/f53 [0,4194304] 0 2024-09-16T02:05:58.658 INFO:tasks.workunit.client.1.smithi165.stdout:8/827: stat dd/f8a 0 2024-09-16T02:05:58.661 INFO:tasks.workunit.client.1.smithi165.stdout:4/711: mkdir d4/dc/dea 0 2024-09-16T02:05:58.661 INFO:tasks.workunit.client.1.smithi165.stdout:2/835: write df/d10/d1a/d2d/dd1/d79/fd6 [2436801,123820] 0 2024-09-16T02:05:58.664 INFO:tasks.workunit.client.1.smithi165.stdout:1/916: link d1/dd/d11/d33/d3f/f55 d1/f125 0 2024-09-16T02:05:58.666 INFO:tasks.workunit.client.1.smithi165.stdout:5/785: creat de/d21/f105 x:0 0 0 2024-09-16T02:05:58.671 INFO:tasks.workunit.client.1.smithi165.stdout:4/712: creat d4/dc/d20/d67/feb x:0 0 0 2024-09-16T02:05:58.675 INFO:tasks.workunit.client.0.smithi110.stdout:4/365: rename d4/d8/d17/d23/d4c/d6d/d3c/c46 to d4/d8/d17/d23/c71 0 2024-09-16T02:05:58.675 INFO:tasks.workunit.client.1.smithi165.stdout:7/803: link d0/d4b/db4/dda/c102 d0/d4b/db4/dfa/c104 0 2024-09-16T02:05:58.676 INFO:tasks.workunit.client.0.smithi110.stdout:4/366: chown d4/d8/d17/d23/f37 314805 1 2024-09-16T02:05:58.678 INFO:tasks.workunit.client.0.smithi110.stdout:7/280: rename d3/da to d3/d15/d38/d4f 0 2024-09-16T02:05:58.679 INFO:tasks.workunit.client.1.smithi165.stdout:1/917: link d1/dd/d11/l78 d1/d22/l126 0 2024-09-16T02:05:58.680 INFO:tasks.workunit.client.0.smithi110.stdout:4/367: mknod d4/d8/d17/d23/d4c/c72 0 2024-09-16T02:05:58.681 INFO:tasks.workunit.client.0.smithi110.stdout:4/368: write d4/f11 [8146407,15417] 0 2024-09-16T02:05:58.681 INFO:tasks.workunit.client.1.smithi165.stdout:7/804: dwrite d0/df/d83/f9c [0,4194304] 0 2024-09-16T02:05:58.684 INFO:tasks.workunit.client.0.smithi110.stdout:9/295: rename d1/d5/l53 to d1/d5/d8/de/d1f/l65 0 2024-09-16T02:05:58.688 INFO:tasks.workunit.client.1.smithi165.stdout:7/805: unlink d0/df/d7/f23 0 2024-09-16T02:05:58.689 INFO:tasks.workunit.client.1.smithi165.stdout:7/806: fsync d0/df/d42/fa3 0 2024-09-16T02:05:58.692 INFO:tasks.workunit.client.0.smithi110.stdout:4/369: fdatasync d4/d12/d18/f27 0 2024-09-16T02:05:58.694 INFO:tasks.workunit.client.0.smithi110.stdout:9/296: dwrite d1/d5/d8/de/d1f/f4a [0,4194304] 0 2024-09-16T02:05:58.694 INFO:tasks.workunit.client.0.smithi110.stdout:7/281: dread d3/f9 [0,4194304] 0 2024-09-16T02:05:58.698 INFO:tasks.workunit.client.0.smithi110.stdout:9/297: truncate d1/d2b/f2d 4204834 0 2024-09-16T02:05:58.702 INFO:tasks.workunit.client.0.smithi110.stdout:5/315: rename d5/dd/df/d28/l2d to d5/l69 0 2024-09-16T02:05:58.703 INFO:tasks.workunit.client.0.smithi110.stdout:4/370: dwrite d4/f2c [0,4194304] 0 2024-09-16T02:05:58.703 INFO:tasks.workunit.client.0.smithi110.stdout:6/434: sync 2024-09-16T02:05:58.709 INFO:tasks.workunit.client.1.smithi165.stdout:7/807: getdents d0/d3d 0 2024-09-16T02:05:58.712 INFO:tasks.workunit.client.0.smithi110.stdout:7/282: dwrite d3/d15/d38/d4f/f18 [4194304,4194304] 0 2024-09-16T02:05:58.713 INFO:tasks.workunit.client.1.smithi165.stdout:6/773: rename d7/d17/d75/d97/dcb/d3d/d5d/d73/d82 to d7/d17/d75/d97/dcb/d3d/ddd 0 2024-09-16T02:05:58.715 INFO:tasks.workunit.client.0.smithi110.stdout:9/298: dread d1/d5/d8/de/d1f/f57 [0,4194304] 0 2024-09-16T02:05:58.716 INFO:tasks.workunit.client.0.smithi110.stdout:5/316: dread f0 [0,4194304] 0 2024-09-16T02:05:58.719 INFO:tasks.workunit.client.1.smithi165.stdout:9/860: rename d7/d32/d38/d53/d5c/d61/dd5/f111 to d7/df/d67/d92/d93/db6/f116 0 2024-09-16T02:05:58.719 INFO:tasks.workunit.client.1.smithi165.stdout:0/729: rename d0/d1e/d20 to d0/d1e/d20/d28/d6d/d87/df2 22 2024-09-16T02:05:58.720 INFO:tasks.workunit.client.1.smithi165.stdout:9/861: readlink d7/d32/d38/d68/lf6 0 2024-09-16T02:05:58.721 INFO:tasks.workunit.client.1.smithi165.stdout:7/808: dread d0/df/d42/fa3 [0,4194304] 0 2024-09-16T02:05:58.723 INFO:tasks.workunit.client.0.smithi110.stdout:4/371: dwrite d4/d8/d17/d23/d4c/d6d/f3a [0,4194304] 0 2024-09-16T02:05:58.723 INFO:tasks.workunit.client.1.smithi165.stdout:7/809: write d0/d2c/d85/fac [156063,81677] 0 2024-09-16T02:05:58.726 INFO:tasks.workunit.client.1.smithi165.stdout:6/774: creat d7/d17/d75/d97/dcb/d74/db7/fde x:0 0 0 2024-09-16T02:05:58.728 INFO:tasks.workunit.client.0.smithi110.stdout:3/275: dwrite d8/dc/d1b/d1c/f26 [0,4194304] 0 2024-09-16T02:05:58.731 INFO:tasks.workunit.client.1.smithi165.stdout:7/810: dwrite d0/df/d7/f92 [0,4194304] 0 2024-09-16T02:05:58.736 INFO:tasks.workunit.client.1.smithi165.stdout:3/873: dwrite da/d17/de5/d104/d2c/d2d/d6c/fba [0,4194304] 0 2024-09-16T02:05:58.739 INFO:tasks.workunit.client.1.smithi165.stdout:6/775: creat d7/dc/df/d1a/d4d/d5f/da7/fdf x:0 0 0 2024-09-16T02:05:58.741 INFO:tasks.workunit.client.0.smithi110.stdout:1/387: dwrite d0/da/f5c [0,4194304] 0 2024-09-16T02:05:58.744 INFO:tasks.workunit.client.1.smithi165.stdout:9/862: creat d7/d1f/d54/df9/f117 x:0 0 0 2024-09-16T02:05:58.744 INFO:tasks.workunit.client.1.smithi165.stdout:8/828: write dd/d11/d14/d3f/d25/d36/d81/dd2/f63 [2674888,27885] 0 2024-09-16T02:05:58.745 INFO:tasks.workunit.client.0.smithi110.stdout:2/348: rename d0/da/f45 to d0/db/d33/f6c 0 2024-09-16T02:05:58.746 INFO:tasks.workunit.client.1.smithi165.stdout:8/829: dread - dd/d11/d38/d74/fd5 zero size 2024-09-16T02:05:58.746 INFO:tasks.workunit.client.1.smithi165.stdout:5/786: write de/d60/fb2 [569674,24809] 0 2024-09-16T02:05:58.749 INFO:tasks.workunit.client.0.smithi110.stdout:1/388: dwrite d0/d1/d2a/f5d [0,4194304] 0 2024-09-16T02:05:58.756 INFO:tasks.workunit.client.1.smithi165.stdout:2/836: rename df/d10/d1a/d2d/dd1/d79 to df/d23/d28/dfa 0 2024-09-16T02:05:58.760 INFO:tasks.workunit.client.1.smithi165.stdout:7/811: symlink d0/df/dfd/l105 0 2024-09-16T02:05:58.761 INFO:tasks.workunit.client.1.smithi165.stdout:1/918: write d1/dd/d11/f1d [769495,43304] 0 2024-09-16T02:05:58.761 INFO:tasks.workunit.client.0.smithi110.stdout:1/389: symlink d0/d1/d2a/d32/d40/l80 0 2024-09-16T02:05:58.762 INFO:tasks.workunit.client.1.smithi165.stdout:7/812: stat d0/df/d33/d2a/fb0 0 2024-09-16T02:05:58.762 INFO:tasks.workunit.client.1.smithi165.stdout:1/919: write d1/dd/f103 [3054808,125000] 0 2024-09-16T02:05:58.763 INFO:tasks.workunit.client.1.smithi165.stdout:8/830: rmdir dd/d11/d14/d3f/db3/dbe 39 2024-09-16T02:05:58.765 INFO:tasks.workunit.client.0.smithi110.stdout:9/299: dread d1/d5/d8/de/f46 [0,4194304] 0 2024-09-16T02:05:58.766 INFO:tasks.workunit.client.0.smithi110.stdout:9/300: write d1/f3 [8041585,2122] 0 2024-09-16T02:05:58.768 INFO:tasks.workunit.client.0.smithi110.stdout:0/394: rename d3/f9 to d3/d4/dc/d70/f72 0 2024-09-16T02:05:58.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/395: dread - d3/d6/d43/d55/f6f zero size 2024-09-16T02:05:58.770 INFO:tasks.workunit.client.0.smithi110.stdout:4/372: dread d4/d12/d18/f27 [0,4194304] 0 2024-09-16T02:05:58.771 INFO:tasks.workunit.client.0.smithi110.stdout:4/373: dread - d4/d8/d17/d23/d4c/d6d/f62 zero size 2024-09-16T02:05:58.774 INFO:tasks.workunit.client.0.smithi110.stdout:9/301: rmdir d1/d5/d8/de 39 2024-09-16T02:05:58.775 INFO:tasks.workunit.client.1.smithi165.stdout:7/813: creat d0/d4b/db4/dba/f106 x:0 0 0 2024-09-16T02:05:58.776 INFO:tasks.workunit.client.0.smithi110.stdout:3/276: rename d8/dc/d1b/d36/l5e to d8/dc/d1b/d3a/d43/l61 0 2024-09-16T02:05:58.781 INFO:tasks.workunit.client.0.smithi110.stdout:9/302: readlink d1/d5/d8/l5a 0 2024-09-16T02:05:58.782 INFO:tasks.workunit.client.0.smithi110.stdout:3/277: dread - d8/f22 zero size 2024-09-16T02:05:58.783 INFO:tasks.workunit.client.0.smithi110.stdout:4/374: rename d4/d54 to d4/d8/d31/d73 0 2024-09-16T02:05:58.785 INFO:tasks.workunit.client.0.smithi110.stdout:9/303: unlink d1/d5/d20/f4b 0 2024-09-16T02:05:58.786 INFO:tasks.workunit.client.1.smithi165.stdout:8/831: fsync dd/fdd 0 2024-09-16T02:05:58.788 INFO:tasks.workunit.client.0.smithi110.stdout:4/375: creat d4/d8/d17/d23/f74 x:0 0 0 2024-09-16T02:05:58.788 INFO:tasks.workunit.client.1.smithi165.stdout:5/787: link de/d21/d51/l71 de/d19/d67/db9/dd6/l106 0 2024-09-16T02:05:58.790 INFO:tasks.workunit.client.1.smithi165.stdout:4/713: rename d4/dc/d20/d4e/c88 to d4/d40/cec 0 2024-09-16T02:05:58.793 INFO:tasks.workunit.client.1.smithi165.stdout:1/920: dwrite d1/dd/d11/d33/d3f/d47/d7d/db3/de0/fb7 [0,4194304] 0 2024-09-16T02:05:58.793 INFO:tasks.workunit.client.1.smithi165.stdout:8/832: mknod dd/d34/c121 0 2024-09-16T02:05:58.794 INFO:tasks.workunit.client.1.smithi165.stdout:8/833: dread - dd/d11/d14/def/f11f zero size 2024-09-16T02:05:58.795 INFO:tasks.workunit.client.1.smithi165.stdout:1/921: dread - d1/dd/d11/d33/d3f/d47/d7d/db3/de0/fe1 zero size 2024-09-16T02:05:58.796 INFO:tasks.workunit.client.0.smithi110.stdout:4/376: link d4/d8/d17/d23/f74 d4/d8/d17/d23/d4c/d6d/d4f/f75 0 2024-09-16T02:05:58.796 INFO:tasks.workunit.client.1.smithi165.stdout:5/788: dwrite de/d19/d1c/d84/d92/fa7 [0,4194304] 0 2024-09-16T02:05:58.796 INFO:tasks.workunit.client.1.smithi165.stdout:8/834: write dd/d11/f5f [4340122,61529] 0 2024-09-16T02:05:58.797 INFO:tasks.workunit.client.1.smithi165.stdout:0/730: rename d0/d1e/d20/d28/l43 to d0/d1e/d39/d48/d45/db3/lf3 0 2024-09-16T02:05:58.797 INFO:tasks.workunit.client.1.smithi165.stdout:8/835: chown dd/d11/d14/def 286637 1 2024-09-16T02:05:58.798 INFO:tasks.workunit.client.1.smithi165.stdout:1/922: fdatasync d1/dd/d11/d33/d3f/d6c/fbd 0 2024-09-16T02:05:58.798 INFO:tasks.workunit.client.1.smithi165.stdout:4/714: symlink d4/dc/d20/dc4/led 0 2024-09-16T02:05:58.799 INFO:tasks.workunit.client.1.smithi165.stdout:3/874: rename da/dfe/c10b to da/d17/c129 0 2024-09-16T02:05:58.800 INFO:tasks.workunit.client.1.smithi165.stdout:3/875: stat da/d20/d26/l38 0 2024-09-16T02:05:58.803 INFO:tasks.workunit.client.1.smithi165.stdout:8/836: dread dd/d11/daa/fad [0,4194304] 0 2024-09-16T02:05:58.804 INFO:tasks.workunit.client.1.smithi165.stdout:5/789: mkdir de/d19/d1c/d4d/dc1/d107 0 2024-09-16T02:05:58.805 INFO:tasks.workunit.client.1.smithi165.stdout:3/876: creat da/d17/de5/d104/d2c/d10c/d6b/f12a x:0 0 0 2024-09-16T02:05:58.805 INFO:tasks.workunit.client.1.smithi165.stdout:4/715: dwrite d4/dc0/fca [0,4194304] 0 2024-09-16T02:05:58.807 INFO:tasks.workunit.client.1.smithi165.stdout:4/716: stat d4/dc/d20/d45/f97 0 2024-09-16T02:05:58.808 INFO:tasks.workunit.client.1.smithi165.stdout:5/790: mkdir de/d21/d26/d94/d9d/d108 0 2024-09-16T02:05:58.808 INFO:tasks.workunit.client.1.smithi165.stdout:3/877: dread - da/d17/de5/d104/d2c/d2d/d6c/ffd zero size 2024-09-16T02:05:58.808 INFO:tasks.workunit.client.1.smithi165.stdout:1/923: getdents d1/dd/d11/d33/d3f/d7e 0 2024-09-16T02:05:58.808 INFO:tasks.workunit.client.1.smithi165.stdout:4/717: stat d4/l1d 0 2024-09-16T02:05:58.810 INFO:tasks.workunit.client.1.smithi165.stdout:5/791: rmdir de/d21/d26/d3a/d54 39 2024-09-16T02:05:58.810 INFO:tasks.workunit.client.1.smithi165.stdout:4/718: readlink d4/d40/d4f/lba 0 2024-09-16T02:05:58.812 INFO:tasks.workunit.client.1.smithi165.stdout:5/792: chown de/d19/d67/l7c 83 1 2024-09-16T02:05:58.812 INFO:tasks.workunit.client.1.smithi165.stdout:4/719: truncate d4/dc0/dd3/fe2 1034522 0 2024-09-16T02:05:58.813 INFO:tasks.workunit.client.1.smithi165.stdout:5/793: unlink de/d21/f8b 0 2024-09-16T02:05:58.814 INFO:tasks.workunit.client.1.smithi165.stdout:4/720: mkdir d4/dc/d28/d2b/d42/d99/dee 0 2024-09-16T02:05:58.814 INFO:tasks.workunit.client.1.smithi165.stdout:5/794: read - de/d21/d26/d3a/d6d/d95/fcf zero size 2024-09-16T02:05:58.815 INFO:tasks.workunit.client.1.smithi165.stdout:1/924: getdents d1/dd/d11/d33/d3f/d47/d7d/db3/de0 0 2024-09-16T02:05:58.816 INFO:tasks.workunit.client.1.smithi165.stdout:4/721: chown d4/c4b 4373501 1 2024-09-16T02:05:58.816 INFO:tasks.workunit.client.1.smithi165.stdout:5/795: read de/d19/d1c/d4d/f72 [881290,37314] 0 2024-09-16T02:05:58.817 INFO:tasks.workunit.client.1.smithi165.stdout:1/925: write d1/d19/ff1 [713904,5222] 0 2024-09-16T02:05:58.818 INFO:tasks.workunit.client.1.smithi165.stdout:4/722: fsync d4/dc/d18/d37/d53/d64/f75 0 2024-09-16T02:05:58.821 INFO:tasks.workunit.client.1.smithi165.stdout:5/796: dread de/d19/d1c/f56 [0,4194304] 0 2024-09-16T02:05:58.823 INFO:tasks.workunit.client.1.smithi165.stdout:1/926: dwrite d1/d22/f6f [0,4194304] 0 2024-09-16T02:05:58.823 INFO:tasks.workunit.client.1.smithi165.stdout:5/797: truncate de/d21/f105 9383 0 2024-09-16T02:05:58.824 INFO:tasks.workunit.client.1.smithi165.stdout:5/798: fsync de/d21/f9f 0 2024-09-16T02:05:58.824 INFO:tasks.workunit.client.1.smithi165.stdout:1/927: truncate d1/d6b/df6/fed 771126 0 2024-09-16T02:05:58.825 INFO:tasks.workunit.client.1.smithi165.stdout:5/799: stat de/d19/d1c/cde 0 2024-09-16T02:05:58.827 INFO:tasks.workunit.client.1.smithi165.stdout:5/800: dread de/d21/d51/f58 [0,4194304] 0 2024-09-16T02:05:58.828 INFO:tasks.workunit.client.1.smithi165.stdout:5/801: creat de/d19/d1c/d4d/f109 x:0 0 0 2024-09-16T02:05:58.841 INFO:tasks.workunit.client.1.smithi165.stdout:5/802: dread de/d21/d26/d3a/d6d/dad/fd8 [0,4194304] 0 2024-09-16T02:05:58.842 INFO:tasks.workunit.client.1.smithi165.stdout:5/803: write de/d21/d26/d94/ff1 [78096,99394] 0 2024-09-16T02:05:58.845 INFO:tasks.workunit.client.1.smithi165.stdout:5/804: getdents de/d21/d26/d3a/d6d/d95/dab 0 2024-09-16T02:05:58.848 INFO:tasks.workunit.client.1.smithi165.stdout:5/805: truncate de/d21/d26/d3a/d54/f89 105591 0 2024-09-16T02:05:58.848 INFO:tasks.workunit.client.1.smithi165.stdout:5/806: dread - de/d21/d26/d94/d9d/fe3 zero size 2024-09-16T02:05:58.853 INFO:tasks.workunit.client.1.smithi165.stdout:5/807: symlink de/d21/d26/d3a/d54/l10a 0 2024-09-16T02:05:58.853 INFO:tasks.workunit.client.1.smithi165.stdout:5/808: fsync de/d19/d1c/d4d/f72 0 2024-09-16T02:05:58.853 INFO:tasks.workunit.client.1.smithi165.stdout:5/809: readlink de/d19/d67/l7c 0 2024-09-16T02:05:58.855 INFO:tasks.workunit.client.1.smithi165.stdout:5/810: rename de/c77 to de/d21/d26/c10b 0 2024-09-16T02:05:58.856 INFO:tasks.workunit.client.1.smithi165.stdout:5/811: mknod de/d60/c10c 0 2024-09-16T02:05:58.863 INFO:tasks.workunit.client.1.smithi165.stdout:5/812: link de/f14 de/d19/d1c/d84/daa/f10d 0 2024-09-16T02:05:58.868 INFO:tasks.workunit.client.1.smithi165.stdout:5/813: link de/d21/c47 de/d21/d26/d3a/dd5/c10e 0 2024-09-16T02:05:58.870 INFO:tasks.workunit.client.1.smithi165.stdout:5/814: creat de/d21/d26/de6/f10f x:0 0 0 2024-09-16T02:05:58.872 INFO:tasks.workunit.client.0.smithi110.stdout:8/313: sync 2024-09-16T02:05:58.876 INFO:tasks.workunit.client.1.smithi165.stdout:5/815: dwrite de/d21/d26/d94/da8/fd0 [0,4194304] 0 2024-09-16T02:05:58.877 INFO:tasks.workunit.client.0.smithi110.stdout:8/314: symlink d3/d2b/l6f 0 2024-09-16T02:05:58.878 INFO:tasks.workunit.client.1.smithi165.stdout:5/816: write de/d21/d26/de6/f10f [299654,25033] 0 2024-09-16T02:05:58.882 INFO:tasks.workunit.client.1.smithi165.stdout:5/817: mkdir de/d21/d26/d3a/d54/d8c/dc7/d110 0 2024-09-16T02:05:58.884 INFO:tasks.workunit.client.1.smithi165.stdout:5/818: write de/d21/d26/d98/fa0 [698622,43176] 0 2024-09-16T02:05:58.885 INFO:tasks.workunit.client.1.smithi165.stdout:1/928: dread d1/dd/d11/d33/d3f/d59/f90 [0,4194304] 0 2024-09-16T02:05:58.885 INFO:tasks.workunit.client.0.smithi110.stdout:8/315: link d3/d12/d1a/d36/d60/f64 d3/d2b/f70 0 2024-09-16T02:05:58.886 INFO:tasks.workunit.client.1.smithi165.stdout:1/929: chown d1/dd/d11/d33/d3f/d59/f90 127 1 2024-09-16T02:05:58.886 INFO:tasks.workunit.client.0.smithi110.stdout:8/316: write d3/d2b/d27/f67 [848631,76696] 0 2024-09-16T02:05:58.890 INFO:tasks.workunit.client.1.smithi165.stdout:5/819: creat de/d21/d51/f111 x:0 0 0 2024-09-16T02:05:58.895 INFO:tasks.workunit.client.0.smithi110.stdout:8/317: dwrite d3/fd [4194304,4194304] 0 2024-09-16T02:05:58.898 INFO:tasks.workunit.client.1.smithi165.stdout:5/820: rename de/d21/d26/d3a/d54/l46 to de/d19/d1c/d49/da5/l112 0 2024-09-16T02:05:58.900 INFO:tasks.workunit.client.0.smithi110.stdout:8/318: dread d3/f44 [0,4194304] 0 2024-09-16T02:05:58.903 INFO:tasks.workunit.client.0.smithi110.stdout:5/317: write d5/dd/f21 [162443,92931] 0 2024-09-16T02:05:58.905 INFO:tasks.workunit.client.1.smithi165.stdout:5/821: dwrite de/d21/f105 [0,4194304] 0 2024-09-16T02:05:58.906 INFO:tasks.workunit.client.0.smithi110.stdout:6/435: truncate d0/d2/d5/d84/f54 4741530 0 2024-09-16T02:05:58.911 INFO:tasks.workunit.client.0.smithi110.stdout:8/319: dwrite d3/d2b/d27/f67 [0,4194304] 0 2024-09-16T02:05:58.913 INFO:tasks.workunit.client.1.smithi165.stdout:5/822: rename fc to de/d21/d26/f113 0 2024-09-16T02:05:58.917 INFO:tasks.workunit.client.0.smithi110.stdout:5/318: mknod d5/dd/df/d28/c6a 0 2024-09-16T02:05:58.918 INFO:tasks.workunit.client.0.smithi110.stdout:5/319: write d5/f61 [75842,33644] 0 2024-09-16T02:05:58.918 INFO:tasks.workunit.client.0.smithi110.stdout:0/396: mknod d3/d4/dc/c73 0 2024-09-16T02:05:58.918 INFO:tasks.workunit.client.1.smithi165.stdout:6/776: write d7/d17/d75/f77 [879373,36547] 0 2024-09-16T02:05:58.919 INFO:tasks.workunit.client.0.smithi110.stdout:5/320: chown d5/d36/d3d/l5a 450208 1 2024-09-16T02:05:58.920 INFO:tasks.workunit.client.1.smithi165.stdout:5/823: symlink de/d19/d1c/d84/d92/l114 0 2024-09-16T02:05:58.920 INFO:tasks.workunit.client.0.smithi110.stdout:0/397: dread d3/f1a [4194304,4194304] 0 2024-09-16T02:05:58.922 INFO:tasks.workunit.client.1.smithi165.stdout:5/824: truncate de/d21/d26/d94/d9d/ffd 4631818 0 2024-09-16T02:05:58.923 INFO:tasks.workunit.client.1.smithi165.stdout:5/825: chown de/d19/d67/d74/f9e 1 1 2024-09-16T02:05:58.924 INFO:tasks.workunit.client.1.smithi165.stdout:6/777: fdatasync d7/d17/f69 0 2024-09-16T02:05:58.927 INFO:tasks.workunit.client.0.smithi110.stdout:6/436: creat d0/d2/d57/d7a/f86 x:0 0 0 2024-09-16T02:05:58.928 INFO:tasks.workunit.client.1.smithi165.stdout:5/826: symlink de/d60/d65/l115 0 2024-09-16T02:05:58.928 INFO:tasks.workunit.client.0.smithi110.stdout:2/349: truncate d0/da/d18/d2d/f4a 919331 0 2024-09-16T02:05:58.930 INFO:tasks.workunit.client.0.smithi110.stdout:8/320: dwrite d3/d12/f26 [0,4194304] 0 2024-09-16T02:05:58.934 INFO:tasks.workunit.client.0.smithi110.stdout:5/321: rename d5/dd/f21 to d5/dd/df/d28/f6b 0 2024-09-16T02:05:58.934 INFO:tasks.workunit.client.0.smithi110.stdout:5/322: write d5/f51 [402735,59908] 0 2024-09-16T02:05:58.935 INFO:tasks.workunit.client.1.smithi165.stdout:9/863: write d7/d14/f6c [4070857,130830] 0 2024-09-16T02:05:58.937 INFO:tasks.workunit.client.1.smithi165.stdout:5/827: dwrite de/d21/d51/f111 [0,4194304] 0 2024-09-16T02:05:58.941 INFO:tasks.workunit.client.0.smithi110.stdout:1/390: truncate d0/da/f6a 829191 0 2024-09-16T02:05:58.944 INFO:tasks.workunit.client.1.smithi165.stdout:6/778: dwrite d7/d17/d75/d97/f9b [0,4194304] 0 2024-09-16T02:05:58.949 INFO:tasks.workunit.client.1.smithi165.stdout:2/837: truncate df/d23/d28/f46 1326756 0 2024-09-16T02:05:58.951 INFO:tasks.workunit.client.0.smithi110.stdout:9/304: write d1/d2b/d2e/f3a [4123043,6666] 0 2024-09-16T02:05:58.953 INFO:tasks.workunit.client.1.smithi165.stdout:6/779: dread d7/d17/d75/d97/f9b [0,4194304] 0 2024-09-16T02:05:58.953 INFO:tasks.workunit.client.0.smithi110.stdout:6/437: dread d0/d2/d5/d1e/d48/f74 [0,4194304] 0 2024-09-16T02:05:58.954 INFO:tasks.workunit.client.1.smithi165.stdout:6/780: fsync d7/dc/d7f/dd2/fb3 0 2024-09-16T02:05:58.955 INFO:tasks.workunit.client.1.smithi165.stdout:6/781: chown d7/dc/c3e 29252 1 2024-09-16T02:05:58.956 INFO:tasks.workunit.client.0.smithi110.stdout:1/391: creat d0/da/f81 x:0 0 0 2024-09-16T02:05:58.956 INFO:tasks.workunit.client.1.smithi165.stdout:6/782: chown d7/d17/d75/d97/dcb/d3d/d5d/d73/f7c 5856 1 2024-09-16T02:05:58.959 INFO:tasks.workunit.client.0.smithi110.stdout:8/321: link d3/d12/d1a/d36/d60/f64 d3/d12/d1d/f71 0 2024-09-16T02:05:58.961 INFO:tasks.workunit.client.0.smithi110.stdout:3/278: dwrite d8/dc/d1b/f24 [0,4194304] 0 2024-09-16T02:05:58.962 INFO:tasks.workunit.client.0.smithi110.stdout:5/323: symlink d5/l6c 0 2024-09-16T02:05:58.965 INFO:tasks.workunit.client.1.smithi165.stdout:7/814: symlink d0/df/d33/dc2/l107 0 2024-09-16T02:05:58.966 INFO:tasks.workunit.client.0.smithi110.stdout:2/350: creat d0/db/d33/f6d x:0 0 0 2024-09-16T02:05:58.967 INFO:tasks.workunit.client.0.smithi110.stdout:9/305: dread d1/d5/d8/de/d1f/f4a [0,4194304] 0 2024-09-16T02:05:58.968 INFO:tasks.workunit.client.0.smithi110.stdout:9/306: dread - d1/dd/f58 zero size 2024-09-16T02:05:58.969 INFO:tasks.workunit.client.0.smithi110.stdout:9/307: dread - d1/d2b/d2e/f4d zero size 2024-09-16T02:05:58.970 INFO:tasks.workunit.client.1.smithi165.stdout:6/783: rename d7/dc/d7f/dd2/d86 to d7/d17/d75/d97/dcb/d74/db7/de0 0 2024-09-16T02:05:58.971 INFO:tasks.workunit.client.1.smithi165.stdout:7/815: dwrite d0/d4b/d63/f8f [0,4194304] 0 2024-09-16T02:05:58.974 INFO:tasks.workunit.client.1.smithi165.stdout:2/838: symlink df/d10/d1a/lfb 0 2024-09-16T02:05:58.975 INFO:tasks.workunit.client.0.smithi110.stdout:1/392: fsync d0/d1/d2a/d32/f4f 0 2024-09-16T02:05:58.978 INFO:tasks.workunit.client.0.smithi110.stdout:8/322: rename d3/d2b/f53 to d3/d12/d1a/d36/f72 0 2024-09-16T02:05:58.978 INFO:tasks.workunit.client.0.smithi110.stdout:8/323: readlink d3/d12/d1a/l28 0 2024-09-16T02:05:58.981 INFO:tasks.workunit.client.1.smithi165.stdout:7/816: write d0/df/fc1 [465649,24538] 0 2024-09-16T02:05:58.982 INFO:tasks.workunit.client.1.smithi165.stdout:8/837: sync 2024-09-16T02:05:58.982 INFO:tasks.workunit.client.1.smithi165.stdout:0/731: dwrite d0/d47/f65 [4194304,4194304] 0 2024-09-16T02:05:58.983 INFO:tasks.workunit.client.1.smithi165.stdout:7/817: write d0/df/d33/dc2/ff5 [137495,12163] 0 2024-09-16T02:05:58.983 INFO:tasks.workunit.client.1.smithi165.stdout:2/839: mknod df/d23/d28/d87/cfc 0 2024-09-16T02:05:58.984 INFO:tasks.workunit.client.1.smithi165.stdout:3/878: sync 2024-09-16T02:05:58.984 INFO:tasks.workunit.client.1.smithi165.stdout:1/930: sync 2024-09-16T02:05:58.984 INFO:tasks.workunit.client.1.smithi165.stdout:4/723: sync 2024-09-16T02:05:58.984 INFO:tasks.workunit.client.1.smithi165.stdout:6/784: dread d7/d17/f69 [0,4194304] 0 2024-09-16T02:05:58.987 INFO:tasks.workunit.client.1.smithi165.stdout:6/785: chown d7/dc/df/cc8 0 1 2024-09-16T02:05:58.987 INFO:tasks.workunit.client.1.smithi165.stdout:3/879: dread - da/d17/de5/d104/d2c/d2d/fdc zero size 2024-09-16T02:05:58.988 INFO:tasks.workunit.client.0.smithi110.stdout:6/438: symlink d0/l87 0 2024-09-16T02:05:58.989 INFO:tasks.workunit.client.1.smithi165.stdout:6/786: chown d7/d17/d75/d97/dcb/d3d 371119 1 2024-09-16T02:05:58.991 INFO:tasks.workunit.client.1.smithi165.stdout:0/732: truncate d0/d2a/f77 941461 0 2024-09-16T02:05:58.998 INFO:tasks.workunit.client.1.smithi165.stdout:6/787: dwrite d7/dc/f99 [0,4194304] 0 2024-09-16T02:05:58.999 INFO:tasks.workunit.client.0.smithi110.stdout:1/393: symlink d0/d1/d4/d46/d64/l82 0 2024-09-16T02:05:59.001 INFO:tasks.workunit.client.0.smithi110.stdout:1/394: write d0/d1/d4/d46/d51/f7f [752173,129647] 0 2024-09-16T02:05:59.001 INFO:tasks.workunit.client.0.smithi110.stdout:5/324: mkdir d5/dd/df/d11/d6d 0 2024-09-16T02:05:59.004 INFO:tasks.workunit.client.0.smithi110.stdout:3/279: symlink d8/dc/d1b/d36/d57/l62 0 2024-09-16T02:05:59.006 INFO:tasks.workunit.client.1.smithi165.stdout:7/818: dread d0/df/d33/f34 [0,4194304] 0 2024-09-16T02:05:59.006 INFO:tasks.workunit.client.1.smithi165.stdout:7/819: fdatasync d0/f12 0 2024-09-16T02:05:59.008 INFO:tasks.workunit.client.1.smithi165.stdout:4/724: truncate d4/dc/d18/d37/d53/d64/d8b/d71/f7d 954320 0 2024-09-16T02:05:59.008 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:05:58 smithi110 ceph-mon[27634]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 238 MiB/s wr, 443 op/s 2024-09-16T02:05:59.010 INFO:tasks.workunit.client.0.smithi110.stdout:2/351: mknod d0/c6e 0 2024-09-16T02:05:59.014 INFO:tasks.workunit.client.1.smithi165.stdout:4/725: dwrite d4/f44 [4194304,4194304] 0 2024-09-16T02:05:59.017 INFO:tasks.workunit.client.0.smithi110.stdout:1/395: read - d0/d25/f4a zero size 2024-09-16T02:05:59.019 INFO:tasks.workunit.client.1.smithi165.stdout:6/788: mkdir d7/d17/d75/de1 0 2024-09-16T02:05:59.019 INFO:tasks.workunit.client.0.smithi110.stdout:1/396: truncate d0/d25/d63/f6b 206682 0 2024-09-16T02:05:59.019 INFO:tasks.workunit.client.1.smithi165.stdout:6/789: fdatasync d7/dc/d7f/dd2/f6f 0 2024-09-16T02:05:59.023 INFO:tasks.workunit.client.0.smithi110.stdout:5/325: dread d5/dd/f43 [0,4194304] 0 2024-09-16T02:05:59.025 INFO:tasks.workunit.client.0.smithi110.stdout:5/326: read d5/dd/df/d11/f2f [555964,98618] 0 2024-09-16T02:05:59.029 INFO:tasks.workunit.client.0.smithi110.stdout:6/439: creat d0/d2/d5/f88 x:0 0 0 2024-09-16T02:05:59.033 INFO:tasks.workunit.client.1.smithi165.stdout:7/820: stat d0/df/d42 0 2024-09-16T02:05:59.033 INFO:tasks.workunit.client.0.smithi110.stdout:3/280: creat d8/d48/d5b/f63 x:0 0 0 2024-09-16T02:05:59.034 INFO:tasks.workunit.client.0.smithi110.stdout:3/281: stat d8/f16 0 2024-09-16T02:05:59.038 INFO:tasks.workunit.client.0.smithi110.stdout:5/327: rename d5/d36/c68 to d5/d36/c6e 0 2024-09-16T02:05:59.039 INFO:tasks.workunit.client.1.smithi165.stdout:2/840: creat df/d10/d1a/d68/ffd x:0 0 0 2024-09-16T02:05:59.040 INFO:tasks.workunit.client.1.smithi165.stdout:4/726: rmdir d4/d40/d4f 39 2024-09-16T02:05:59.042 INFO:tasks.workunit.client.1.smithi165.stdout:4/727: fdatasync d4/dc/d18/f22 0 2024-09-16T02:05:59.043 INFO:tasks.workunit.client.1.smithi165.stdout:6/790: creat d7/d17/d75/d97/dcb/fe2 x:0 0 0 2024-09-16T02:05:59.043 INFO:tasks.workunit.client.0.smithi110.stdout:1/397: mknod d0/d1/d4/d46/c83 0 2024-09-16T02:05:59.044 INFO:tasks.workunit.client.1.smithi165.stdout:8/838: link dd/d11/d14/d3f/d25/fe1 dd/d11/d14/d70/d7b/d9a/f122 0 2024-09-16T02:05:59.045 INFO:tasks.workunit.client.1.smithi165.stdout:8/839: fsync dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fce 0 2024-09-16T02:05:59.046 INFO:tasks.workunit.client.0.smithi110.stdout:3/282: mkdir d8/dc/d1b/d36/d57/d64 0 2024-09-16T02:05:59.046 INFO:tasks.workunit.client.1.smithi165.stdout:8/840: chown dd/d11/d14/d3f/d25/ca3 147968652 1 2024-09-16T02:05:59.047 INFO:tasks.workunit.client.1.smithi165.stdout:5/828: dread de/d21/d26/d3a/d54/f79 [0,4194304] 0 2024-09-16T02:05:59.047 INFO:tasks.workunit.client.1.smithi165.stdout:7/821: unlink d0/d3d/d9f/ddc/da8/ddd/f82 0 2024-09-16T02:05:59.047 INFO:tasks.workunit.client.1.smithi165.stdout:5/829: fdatasync de/d21/fe4 0 2024-09-16T02:05:59.050 INFO:tasks.workunit.client.0.smithi110.stdout:5/328: mkdir d5/dd/df/d28/d6f 0 2024-09-16T02:05:59.051 INFO:tasks.workunit.client.0.smithi110.stdout:5/329: chown d5/f61 1 1 2024-09-16T02:05:59.052 INFO:tasks.workunit.client.0.smithi110.stdout:5/330: fsync d5/dd/df/f3f 0 2024-09-16T02:05:59.056 INFO:tasks.workunit.client.0.smithi110.stdout:0/398: dwrite d3/d6/d4b/f51 [0,4194304] 0 2024-09-16T02:05:59.057 INFO:tasks.workunit.client.0.smithi110.stdout:6/440: mknod d0/d29/d2a/d2f/c89 0 2024-09-16T02:05:59.057 INFO:tasks.workunit.client.0.smithi110.stdout:6/441: dread - d0/d2/f69 zero size 2024-09-16T02:05:59.057 INFO:tasks.workunit.client.1.smithi165.stdout:8/841: dwrite dd/d11/d14/d70/d7b/df2/ffa [4194304,4194304] 0 2024-09-16T02:05:59.057 INFO:tasks.workunit.client.1.smithi165.stdout:7/822: dwrite d0/df/d33/d2a/fb0 [0,4194304] 0 2024-09-16T02:05:59.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/399: read d3/d6/f21 [1246991,87368] 0 2024-09-16T02:05:59.058 INFO:tasks.workunit.client.0.smithi110.stdout:1/398: rename d0/c4b to d0/d1/d4/d46/d64/c84 0 2024-09-16T02:05:59.059 INFO:tasks.workunit.client.0.smithi110.stdout:1/399: chown d0/d1/c50 221821021 1 2024-09-16T02:05:59.061 INFO:tasks.workunit.client.1.smithi165.stdout:6/791: mkdir d7/d17/d75/d97/dcb/d74/de3 0 2024-09-16T02:05:59.065 INFO:tasks.workunit.client.1.smithi165.stdout:6/792: write d7/dc/df/d1a/d4d/fce [252285,37794] 0 2024-09-16T02:05:59.066 INFO:tasks.workunit.client.1.smithi165.stdout:6/793: chown f2 111 1 2024-09-16T02:05:59.066 INFO:tasks.workunit.client.1.smithi165.stdout:9/864: dwrite d7/d1f/d54/fc4 [0,4194304] 0 2024-09-16T02:05:59.070 INFO:tasks.workunit.client.0.smithi110.stdout:1/400: dwrite d0/d1/f68 [0,4194304] 0 2024-09-16T02:05:59.082 INFO:tasks.workunit.client.1.smithi165.stdout:2/841: truncate df/d23/d28/d3b/f5b 4636834 0 2024-09-16T02:05:59.083 INFO:tasks.workunit.client.0.smithi110.stdout:5/331: rename d5/dd/df/d11/l22 to d5/dd/df/d11/d6d/l70 0 2024-09-16T02:05:59.084 INFO:tasks.workunit.client.0.smithi110.stdout:5/332: dread - d5/d36/f64 zero size 2024-09-16T02:05:59.085 INFO:tasks.workunit.client.1.smithi165.stdout:4/728: unlink d4/dc/d18/d37/l4d 0 2024-09-16T02:05:59.086 INFO:tasks.workunit.client.0.smithi110.stdout:3/283: symlink d8/dc/d1b/d3a/d43/d58/l65 0 2024-09-16T02:05:59.090 INFO:tasks.workunit.client.0.smithi110.stdout:1/401: write d0/d1/f53 [2020538,55389] 0 2024-09-16T02:05:59.092 INFO:tasks.workunit.client.0.smithi110.stdout:2/352: link d0/da/d18/dc/c1d d0/db/d33/c6f 0 2024-09-16T02:05:59.092 INFO:tasks.workunit.client.0.smithi110.stdout:1/402: write d0/d25/d63/f19 [4428482,32216] 0 2024-09-16T02:05:59.094 INFO:tasks.workunit.client.1.smithi165.stdout:7/823: dwrite d0/d4b/db4/dda/fe5 [0,4194304] 0 2024-09-16T02:05:59.094 INFO:tasks.workunit.client.0.smithi110.stdout:3/284: dwrite d8/f16 [0,4194304] 0 2024-09-16T02:05:59.099 INFO:tasks.workunit.client.1.smithi165.stdout:5/830: fsync de/f14 0 2024-09-16T02:05:59.105 INFO:tasks.workunit.client.0.smithi110.stdout:9/308: truncate d1/d1b/f1d 705654 0 2024-09-16T02:05:59.107 INFO:tasks.workunit.client.1.smithi165.stdout:3/880: dwrite da/d20/d26/f84 [0,4194304] 0 2024-09-16T02:05:59.109 INFO:tasks.workunit.client.1.smithi165.stdout:1/931: truncate d1/d19/d24/d97/fc1 3532229 0 2024-09-16T02:05:59.110 INFO:tasks.workunit.client.0.smithi110.stdout:1/403: creat d0/da/f85 x:0 0 0 2024-09-16T02:05:59.115 INFO:tasks.workunit.client.1.smithi165.stdout:1/932: dwrite d1/d19/d4d/fab [0,4194304] 0 2024-09-16T02:05:59.116 INFO:tasks.workunit.client.0.smithi110.stdout:0/400: fdatasync d3/d4/dc/d10/f35 0 2024-09-16T02:05:59.117 INFO:tasks.workunit.client.1.smithi165.stdout:0/733: write d0/d1e/d39/f6a [2072512,15177] 0 2024-09-16T02:05:59.122 INFO:tasks.workunit.client.0.smithi110.stdout:1/404: fsync d0/d1/d2a/d32/f38 0 2024-09-16T02:05:59.123 INFO:tasks.workunit.client.0.smithi110.stdout:1/405: write d0/d1/d4/f18 [993452,124557] 0 2024-09-16T02:05:59.125 INFO:tasks.workunit.client.1.smithi165.stdout:0/734: dwrite d0/d1e/d39/d48/d74/dc6/fd4 [0,4194304] 0 2024-09-16T02:05:59.127 INFO:tasks.workunit.client.0.smithi110.stdout:3/285: link d8/dc/f2b d8/d48/d4b/f66 0 2024-09-16T02:05:59.139 INFO:tasks.workunit.client.0.smithi110.stdout:2/353: rename d0/da/d18/d2d to d0/db/d33/d70 0 2024-09-16T02:05:59.142 INFO:tasks.workunit.client.0.smithi110.stdout:3/286: creat d8/dc/d1b/d3a/d43/f67 x:0 0 0 2024-09-16T02:05:59.144 INFO:tasks.workunit.client.1.smithi165.stdout:2/842: stat df/dbb/ded/cf5 0 2024-09-16T02:05:59.145 INFO:tasks.workunit.client.1.smithi165.stdout:2/843: write df/d10/d1a/d68/fdf [277927,53805] 0 2024-09-16T02:05:59.146 INFO:tasks.workunit.client.0.smithi110.stdout:0/401: rename d3/d6/d43/d55/l57 to d3/d6/d43/d55/l74 0 2024-09-16T02:05:59.146 INFO:tasks.workunit.client.1.smithi165.stdout:2/844: chown df/d10/d1a/d2d/dd1/ff7 88 1 2024-09-16T02:05:59.147 INFO:tasks.workunit.client.1.smithi165.stdout:4/729: write d4/dc/d28/d2b/f41 [654614,53830] 0 2024-09-16T02:05:59.148 INFO:tasks.workunit.client.0.smithi110.stdout:6/442: truncate d0/d2/f42 1024255 0 2024-09-16T02:05:59.150 INFO:tasks.workunit.client.1.smithi165.stdout:9/865: write d7/d32/d38/d53/d56/d95/f6a [3864102,26224] 0 2024-09-16T02:05:59.150 INFO:tasks.workunit.client.0.smithi110.stdout:0/402: dread d3/d4/d41/f60 [0,4194304] 0 2024-09-16T02:05:59.152 INFO:tasks.workunit.client.1.smithi165.stdout:6/794: dwrite d7/f57 [0,4194304] 0 2024-09-16T02:05:59.153 INFO:tasks.workunit.client.0.smithi110.stdout:1/406: creat d0/d1/d4/d46/d75/f86 x:0 0 0 2024-09-16T02:05:59.153 INFO:tasks.workunit.client.0.smithi110.stdout:5/333: write d5/f2c [139879,109689] 0 2024-09-16T02:05:59.154 INFO:tasks.workunit.client.1.smithi165.stdout:7/824: creat d0/d3d/d9f/ddc/f108 x:0 0 0 2024-09-16T02:05:59.160 INFO:tasks.workunit.client.1.smithi165.stdout:5/831: mknod de/d21/d26/d3a/d6d/dad/c116 0 2024-09-16T02:05:59.162 INFO:tasks.workunit.client.0.smithi110.stdout:2/354: unlink d0/da/d18/dc/c1d 0 2024-09-16T02:05:59.167 INFO:tasks.workunit.client.0.smithi110.stdout:3/287: link d8/f39 d8/d29/d45/f68 0 2024-09-16T02:05:59.173 INFO:tasks.workunit.client.0.smithi110.stdout:2/355: rename d0/db/l32 to d0/db/d33/d70/l71 0 2024-09-16T02:05:59.174 INFO:tasks.workunit.client.0.smithi110.stdout:2/356: fdatasync d0/f49 0 2024-09-16T02:05:59.174 INFO:tasks.workunit.client.1.smithi165.stdout:0/735: creat d0/d2a/ff4 x:0 0 0 2024-09-16T02:05:59.175 INFO:tasks.workunit.client.0.smithi110.stdout:3/288: dwrite d8/dc/d1b/d3a/d43/f4e [0,4194304] 0 2024-09-16T02:05:59.175 INFO:tasks.workunit.client.1.smithi165.stdout:7/825: dread d0/f3 [0,4194304] 0 2024-09-16T02:05:59.176 INFO:tasks.workunit.client.0.smithi110.stdout:6/443: link d0/d2/d5/d1e/l30 d0/d2/d57/l8a 0 2024-09-16T02:05:59.185 INFO:tasks.workunit.client.1.smithi165.stdout:8/842: link dd/d11/d38/da6/c104 dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/c123 0 2024-09-16T02:05:59.185 INFO:tasks.workunit.client.0.smithi110.stdout:9/309: dwrite d1/d5/d8/de/f56 [0,4194304] 0 2024-09-16T02:05:59.187 INFO:tasks.workunit.client.0.smithi110.stdout:3/289: rename d8/dc/d1b/d36/d57/l62 to d8/d29/l69 0 2024-09-16T02:05:59.192 INFO:tasks.workunit.client.1.smithi165.stdout:9/866: mkdir d7/df/d67/d92/d93/db6/d118 0 2024-09-16T02:05:59.193 INFO:tasks.workunit.client.0.smithi110.stdout:0/403: getdents d3/d4/dc 0 2024-09-16T02:05:59.193 INFO:tasks.workunit.client.1.smithi165.stdout:9/867: write d7/d32/d38/d53/d5c/d61/fb9 [68905,39235] 0 2024-09-16T02:05:59.194 INFO:tasks.workunit.client.0.smithi110.stdout:1/407: getdents d0/d1/d4/d46/d51 0 2024-09-16T02:05:59.194 INFO:tasks.workunit.client.1.smithi165.stdout:9/868: chown d7/d32/d38/d68 27 1 2024-09-16T02:05:59.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:05:58 smithi165 ceph-mon[34621]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 238 MiB/s wr, 443 op/s 2024-09-16T02:05:59.200 INFO:tasks.workunit.client.0.smithi110.stdout:2/357: symlink d0/da/l72 0 2024-09-16T02:05:59.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/869: dwrite d7/df/d37/f107 [0,4194304] 0 2024-09-16T02:05:59.202 INFO:tasks.workunit.client.0.smithi110.stdout:9/310: readlink d1/d5/d8/de/d1f/l65 0 2024-09-16T02:05:59.204 INFO:tasks.workunit.client.0.smithi110.stdout:3/290: rmdir d8/d48/d4b 39 2024-09-16T02:05:59.206 INFO:tasks.workunit.client.0.smithi110.stdout:3/291: chown d8/dc/d1b/f60 492708 1 2024-09-16T02:05:59.206 INFO:tasks.workunit.client.0.smithi110.stdout:5/334: getdents d5/dd/df/d11/d6d 0 2024-09-16T02:05:59.207 INFO:tasks.workunit.client.1.smithi165.stdout:5/832: dwrite de/f14 [8388608,4194304] 0 2024-09-16T02:05:59.208 INFO:tasks.workunit.client.0.smithi110.stdout:2/358: dwrite d0/da/d18/dc/f2b [0,4194304] 0 2024-09-16T02:05:59.208 INFO:tasks.workunit.client.1.smithi165.stdout:1/933: truncate d1/f125 1351490 0 2024-09-16T02:05:59.209 INFO:tasks.workunit.client.0.smithi110.stdout:3/292: write d8/dc/d1b/d36/d3b/f49 [116945,93109] 0 2024-09-16T02:05:59.211 INFO:tasks.workunit.client.0.smithi110.stdout:6/444: dread d0/d2/d18/f59 [0,4194304] 0 2024-09-16T02:05:59.211 INFO:tasks.workunit.client.0.smithi110.stdout:0/404: mkdir d3/d4/dc/d75 0 2024-09-16T02:05:59.217 INFO:tasks.workunit.client.1.smithi165.stdout:2/845: unlink df/d10/d37/c42 0 2024-09-16T02:05:59.217 INFO:tasks.workunit.client.1.smithi165.stdout:2/846: readlink df/la7 0 2024-09-16T02:05:59.218 INFO:tasks.workunit.client.1.smithi165.stdout:2/847: chown df/d23/d28/f81 451582730 1 2024-09-16T02:05:59.219 INFO:tasks.workunit.client.1.smithi165.stdout:8/843: rmdir dd/d34/dd7 39 2024-09-16T02:05:59.220 INFO:tasks.workunit.client.0.smithi110.stdout:9/311: symlink d1/d1b/l66 0 2024-09-16T02:05:59.221 INFO:tasks.workunit.client.1.smithi165.stdout:6/795: creat d7/d1f/dbc/fe4 x:0 0 0 2024-09-16T02:05:59.226 INFO:tasks.workunit.client.0.smithi110.stdout:2/359: mknod d0/da/d18/dc/c73 0 2024-09-16T02:05:59.228 INFO:tasks.workunit.client.0.smithi110.stdout:3/293: mkdir d8/d48/d5b/d6a 0 2024-09-16T02:05:59.229 INFO:tasks.workunit.client.0.smithi110.stdout:6/445: mkdir d0/d29/d2a/d2d/d8b 0 2024-09-16T02:05:59.232 INFO:tasks.workunit.client.0.smithi110.stdout:1/408: symlink d0/d1/d2a/l87 0 2024-09-16T02:05:59.234 INFO:tasks.workunit.client.0.smithi110.stdout:9/312: symlink d1/d5/d8/d26/l67 0 2024-09-16T02:05:59.235 INFO:tasks.workunit.client.1.smithi165.stdout:3/881: truncate da/d17/de5/d104/d2c/d10c/d6b/f90 2155325 0 2024-09-16T02:05:59.235 INFO:tasks.workunit.client.1.smithi165.stdout:3/882: readlink da/d17/d7a/lf9 0 2024-09-16T02:05:59.236 INFO:tasks.workunit.client.0.smithi110.stdout:5/335: mkdir d5/d71 0 2024-09-16T02:05:59.237 INFO:tasks.workunit.client.1.smithi165.stdout:2/848: creat df/d23/d28/d87/ffe x:0 0 0 2024-09-16T02:05:59.239 INFO:tasks.workunit.client.1.smithi165.stdout:8/844: symlink dd/d11/d14/d70/d7b/df2/l124 0 2024-09-16T02:05:59.241 INFO:tasks.workunit.client.1.smithi165.stdout:8/845: truncate dd/d11/d14/d3f/d25/d36/d81/f10b 782772 0 2024-09-16T02:05:59.242 INFO:tasks.workunit.client.0.smithi110.stdout:6/446: mknod d0/d2/d18/c8c 0 2024-09-16T02:05:59.245 INFO:tasks.workunit.client.0.smithi110.stdout:1/409: creat d0/d1/d2a/d32/d6e/f88 x:0 0 0 2024-09-16T02:05:59.248 INFO:tasks.workunit.client.0.smithi110.stdout:5/336: mknod d5/dd/df/d11/c72 0 2024-09-16T02:05:59.250 INFO:tasks.workunit.client.0.smithi110.stdout:1/410: dread d0/d1/d4/d46/d51/f7f [0,4194304] 0 2024-09-16T02:05:59.250 INFO:tasks.workunit.client.0.smithi110.stdout:0/405: write d3/d4/dc/f3e [1275352,69910] 0 2024-09-16T02:05:59.252 INFO:tasks.workunit.client.0.smithi110.stdout:2/360: mknod d0/db/d33/c74 0 2024-09-16T02:05:59.253 INFO:tasks.workunit.client.1.smithi165.stdout:7/826: link d0/d2c/l100 d0/d2c/d85/l109 0 2024-09-16T02:05:59.254 INFO:tasks.workunit.client.1.smithi165.stdout:0/736: dwrite d0/d1e/d20/f7f [0,4194304] 0 2024-09-16T02:05:59.256 INFO:tasks.workunit.client.1.smithi165.stdout:4/730: symlink d4/dc/d28/d2b/d42/d99/lef 0 2024-09-16T02:05:59.269 INFO:tasks.workunit.client.0.smithi110.stdout:7/283: sync 2024-09-16T02:05:59.270 INFO:tasks.workunit.client.0.smithi110.stdout:7/284: fdatasync d3/d15/d38/d4f/d10/d11/f3f 0 2024-09-16T02:05:59.271 INFO:tasks.workunit.client.0.smithi110.stdout:7/285: write d3/d15/d38/d4f/d10/d11/f3f [667589,15151] 0 2024-09-16T02:05:59.273 INFO:tasks.workunit.client.1.smithi165.stdout:9/870: truncate d7/d32/d38/d53/d56/dca/dd2/fbf 7662 0 2024-09-16T02:05:59.275 INFO:tasks.workunit.client.0.smithi110.stdout:7/286: dread d3/d15/d38/d4f/f22 [0,4194304] 0 2024-09-16T02:05:59.275 INFO:tasks.workunit.client.1.smithi165.stdout:5/833: creat de/f117 x:0 0 0 2024-09-16T02:05:59.276 INFO:tasks.workunit.client.1.smithi165.stdout:5/834: truncate de/d19/d1c/d4d/f109 72508 0 2024-09-16T02:05:59.277 INFO:tasks.workunit.client.1.smithi165.stdout:6/796: write d7/dc/df/d1a/d4d/f4e [849766,3393] 0 2024-09-16T02:05:59.277 INFO:tasks.workunit.client.1.smithi165.stdout:5/835: chown de/d21/d51/f5f 33 1 2024-09-16T02:05:59.277 INFO:tasks.workunit.client.0.smithi110.stdout:0/406: truncate d3/d4/dc/d10/f66 523732 0 2024-09-16T02:05:59.277 INFO:tasks.workunit.client.0.smithi110.stdout:5/337: write d5/f6 [2262925,14311] 0 2024-09-16T02:05:59.278 INFO:tasks.workunit.client.0.smithi110.stdout:0/407: chown d3/d4/d41/l52 2043 1 2024-09-16T02:05:59.279 INFO:tasks.workunit.client.0.smithi110.stdout:3/294: creat d8/f6b x:0 0 0 2024-09-16T02:05:59.280 INFO:tasks.workunit.client.0.smithi110.stdout:3/295: dread - d8/dc/f2b zero size 2024-09-16T02:05:59.281 INFO:tasks.workunit.client.0.smithi110.stdout:3/296: chown d8/f56 425 1 2024-09-16T02:05:59.283 INFO:tasks.workunit.client.0.smithi110.stdout:5/338: dread d5/dd/df/d11/f50 [0,4194304] 0 2024-09-16T02:05:59.284 INFO:tasks.workunit.client.0.smithi110.stdout:9/313: link d1/d2b/f2d d1/d5/d8/f68 0 2024-09-16T02:05:59.285 INFO:tasks.workunit.client.1.smithi165.stdout:7/827: fsync d0/df/d42/fa5 0 2024-09-16T02:05:59.286 INFO:tasks.workunit.client.1.smithi165.stdout:7/828: dread - d0/d2c/d85/d8c/ffc zero size 2024-09-16T02:05:59.288 INFO:tasks.workunit.client.1.smithi165.stdout:2/849: truncate df/d23/d66/f8d 4152371 0 2024-09-16T02:05:59.288 INFO:tasks.workunit.client.1.smithi165.stdout:4/731: mkdir d4/dc/d28/d3b/df0 0 2024-09-16T02:05:59.290 INFO:tasks.workunit.client.1.smithi165.stdout:4/732: write d4/dc/d18/d37/d53/d64/d91/fdd [164435,67736] 0 2024-09-16T02:05:59.293 INFO:tasks.workunit.client.0.smithi110.stdout:0/408: write d3/f28 [2841248,68392] 0 2024-09-16T02:05:59.295 INFO:tasks.workunit.client.0.smithi110.stdout:0/409: read d3/d4/dc/d10/f66 [81044,121606] 0 2024-09-16T02:05:59.297 INFO:tasks.workunit.client.1.smithi165.stdout:1/934: getdents d1/dd 0 2024-09-16T02:05:59.298 INFO:tasks.workunit.client.0.smithi110.stdout:7/287: dwrite d3/f27 [0,4194304] 0 2024-09-16T02:05:59.300 INFO:tasks.workunit.client.1.smithi165.stdout:6/797: symlink d7/dc/df/d1a/d4d/d5f/le5 0 2024-09-16T02:05:59.302 INFO:tasks.workunit.client.0.smithi110.stdout:5/339: creat d5/dd/df/d11/d6d/f73 x:0 0 0 2024-09-16T02:05:59.302 INFO:tasks.workunit.client.1.smithi165.stdout:6/798: chown d7/d17/d75/d97/dcb/d3d/dbd/c8f 244504381 1 2024-09-16T02:05:59.303 INFO:tasks.workunit.client.0.smithi110.stdout:5/340: write d5/d36/f64 [743263,72714] 0 2024-09-16T02:05:59.305 INFO:tasks.workunit.client.1.smithi165.stdout:1/935: dwrite d1/dd/d11/d33/d3f/d47/d7d/fee [4194304,4194304] 0 2024-09-16T02:05:59.305 INFO:tasks.workunit.client.1.smithi165.stdout:2/850: stat df/c9c 0 2024-09-16T02:05:59.307 INFO:tasks.workunit.client.1.smithi165.stdout:6/799: write d7/dc/d7f/dd2/f6f [260811,17018] 0 2024-09-16T02:05:59.309 INFO:tasks.workunit.client.1.smithi165.stdout:6/800: chown d7/d1f/l36 22042 1 2024-09-16T02:05:59.309 INFO:tasks.workunit.client.1.smithi165.stdout:2/851: truncate df/dbb/ff9 227719 0 2024-09-16T02:05:59.311 INFO:tasks.workunit.client.1.smithi165.stdout:6/801: chown d7/d17/d75/dc1/cc9 6 1 2024-09-16T02:05:59.311 INFO:tasks.workunit.client.0.smithi110.stdout:6/447: rename d0/d2/d5/d84/ff to d0/d2/f8d 0 2024-09-16T02:05:59.311 INFO:tasks.workunit.client.0.smithi110.stdout:9/314: rename d1/d5/d8/d29 to d1/d5/d8/d29/d69 22 2024-09-16T02:05:59.312 INFO:tasks.workunit.client.0.smithi110.stdout:9/315: stat d1/d5/d8/f17 0 2024-09-16T02:05:59.313 INFO:tasks.workunit.client.0.smithi110.stdout:6/448: chown d0/d2/d5/d1e/c2c 3296 1 2024-09-16T02:05:59.313 INFO:tasks.workunit.client.0.smithi110.stdout:9/316: readlink d1/d5/d8/l51 0 2024-09-16T02:05:59.314 INFO:tasks.workunit.client.0.smithi110.stdout:7/288: mkdir d3/d15/d38/d4f/d10/d11/d3e/d40/d50 0 2024-09-16T02:05:59.316 INFO:tasks.workunit.client.0.smithi110.stdout:0/410: dread d3/f1a [0,4194304] 0 2024-09-16T02:05:59.317 INFO:tasks.workunit.client.1.smithi165.stdout:5/836: dread de/d19/f1f [0,4194304] 0 2024-09-16T02:05:59.319 INFO:tasks.workunit.client.1.smithi165.stdout:1/936: dwrite d1/dd/d11/d33/d3f/d47/d7d/db3/de0/fe1 [0,4194304] 0 2024-09-16T02:05:59.320 INFO:tasks.workunit.client.1.smithi165.stdout:2/852: dwrite df/d10/d37/f74 [0,4194304] 0 2024-09-16T02:05:59.320 INFO:tasks.workunit.client.0.smithi110.stdout:1/411: getdents d0/d1/d4/d46/d75 0 2024-09-16T02:05:59.320 INFO:tasks.workunit.client.1.smithi165.stdout:5/837: truncate de/d21/f9f 365779 0 2024-09-16T02:05:59.322 INFO:tasks.workunit.client.1.smithi165.stdout:7/829: creat d0/d4b/d58/f10a x:0 0 0 2024-09-16T02:05:59.324 INFO:tasks.workunit.client.1.smithi165.stdout:5/838: chown de/d21/d26/d3a/d6d/dad/lbe 12890263 1 2024-09-16T02:05:59.324 INFO:tasks.workunit.client.0.smithi110.stdout:6/449: fsync d0/d29/d2a/d2f/d49/f7e 0 2024-09-16T02:05:59.325 INFO:tasks.workunit.client.0.smithi110.stdout:5/341: dwrite d5/d36/d45/d47/f65 [0,4194304] 0 2024-09-16T02:05:59.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/846: getdents dd/d11/d14/d3f/d25/d36/d81/dd2/d89 0 2024-09-16T02:05:59.327 INFO:tasks.workunit.client.1.smithi165.stdout:5/839: write de/d19/d1c/d49/fa3 [2410638,90476] 0 2024-09-16T02:05:59.327 INFO:tasks.workunit.client.1.smithi165.stdout:4/733: creat d4/dc/d20/dc2/dd6/ff1 x:0 0 0 2024-09-16T02:05:59.336 INFO:tasks.workunit.client.0.smithi110.stdout:9/317: dwrite d1/d5/d8/f17 [4194304,4194304] 0 2024-09-16T02:05:59.338 INFO:tasks.workunit.client.0.smithi110.stdout:3/297: link d8/d29/d45/f5f d8/dc/d1b/d3a/d43/d58/f6c 0 2024-09-16T02:05:59.339 INFO:tasks.workunit.client.0.smithi110.stdout:1/412: creat d0/d25/d63/f89 x:0 0 0 2024-09-16T02:05:59.339 INFO:tasks.workunit.client.1.smithi165.stdout:6/802: truncate d7/d17/d75/d97/dcb/f49 380155 0 2024-09-16T02:05:59.340 INFO:tasks.workunit.client.1.smithi165.stdout:2/853: mknod df/d23/d66/cff 0 2024-09-16T02:05:59.343 INFO:tasks.workunit.client.1.smithi165.stdout:0/737: rename d0/d1e/d20/d28/d6d/daf/dc0/fd2 to d0/d1e/d20/d28/d6d/ff5 0 2024-09-16T02:05:59.345 INFO:tasks.workunit.client.0.smithi110.stdout:6/450: read d0/d2/d5/d1e/f44 [193557,50681] 0 2024-09-16T02:05:59.347 INFO:tasks.workunit.client.0.smithi110.stdout:0/411: fdatasync d3/f1b 0 2024-09-16T02:05:59.351 INFO:tasks.workunit.client.1.smithi165.stdout:5/840: unlink de/d19/d1c/f56 0 2024-09-16T02:05:59.351 INFO:tasks.workunit.client.1.smithi165.stdout:7/830: dread d0/d4b/db4/dba/fca [0,4194304] 0 2024-09-16T02:05:59.353 INFO:tasks.workunit.client.1.smithi165.stdout:5/841: dread - de/d21/d26/d94/d9d/ff8 zero size 2024-09-16T02:05:59.353 INFO:tasks.workunit.client.1.smithi165.stdout:4/734: mkdir d4/dc/d18/d37/dc9/df2 0 2024-09-16T02:05:59.354 INFO:tasks.workunit.client.1.smithi165.stdout:9/871: link d7/d55/l52 d7/df/d37/l119 0 2024-09-16T02:05:59.357 INFO:tasks.workunit.client.1.smithi165.stdout:3/883: sync 2024-09-16T02:05:59.357 INFO:tasks.workunit.client.1.smithi165.stdout:6/803: fsync d7/dc/df/d1a/d4d/d5f/f84 0 2024-09-16T02:05:59.357 INFO:tasks.workunit.client.1.smithi165.stdout:3/884: chown da/d17/d7a/dab 1519860 1 2024-09-16T02:05:59.359 INFO:tasks.workunit.client.1.smithi165.stdout:6/804: fdatasync d7/d17/d75/d97/dcb/d74/db7/de0/fc3 0 2024-09-16T02:05:59.359 INFO:tasks.workunit.client.1.smithi165.stdout:2/854: mkdir df/dbb/ded/d100 0 2024-09-16T02:05:59.360 INFO:tasks.workunit.client.1.smithi165.stdout:6/805: readlink d7/dc/d7f/dd2/l52 0 2024-09-16T02:05:59.362 INFO:tasks.workunit.client.1.smithi165.stdout:1/937: link d1/dd/d11/d33/f3b d1/dd/d11/d33/d3f/d6c/dde/f127 0 2024-09-16T02:05:59.363 INFO:tasks.workunit.client.1.smithi165.stdout:1/938: write d1/d19/d4d/f10a [155336,102357] 0 2024-09-16T02:05:59.364 INFO:tasks.workunit.client.1.smithi165.stdout:0/738: symlink d0/d1e/d20/d28/da7/db4/lf6 0 2024-09-16T02:05:59.365 INFO:tasks.workunit.client.0.smithi110.stdout:1/413: dread d0/d1/f23 [0,4194304] 0 2024-09-16T02:05:59.367 INFO:tasks.workunit.client.1.smithi165.stdout:7/831: mknod d0/df/d33/dc2/c10b 0 2024-09-16T02:05:59.369 INFO:tasks.workunit.client.1.smithi165.stdout:4/735: write d4/dc/d20/d45/f97 [3284181,126659] 0 2024-09-16T02:05:59.369 INFO:tasks.workunit.client.0.smithi110.stdout:6/451: mknod d0/d29/d2a/d2d/d8b/c8e 0 2024-09-16T02:05:59.369 INFO:tasks.workunit.client.1.smithi165.stdout:8/847: write dd/d11/d38/f39 [1378153,115760] 0 2024-09-16T02:05:59.371 INFO:tasks.workunit.client.1.smithi165.stdout:4/736: truncate d4/dc/fdf 157404 0 2024-09-16T02:05:59.374 INFO:tasks.workunit.client.0.smithi110.stdout:0/412: mkdir d3/d4/dc/d14/d76 0 2024-09-16T02:05:59.375 INFO:tasks.workunit.client.0.smithi110.stdout:7/289: link d3/d15/d38/d4f/d10/d11/d3e/d40/c48 d3/d15/d38/d4f/c51 0 2024-09-16T02:05:59.376 INFO:tasks.workunit.client.1.smithi165.stdout:5/842: dwrite de/d19/d1c/d49/fd4 [0,4194304] 0 2024-09-16T02:05:59.376 INFO:tasks.workunit.client.0.smithi110.stdout:5/342: write d5/d36/f67 [547096,117031] 0 2024-09-16T02:05:59.377 INFO:tasks.workunit.client.1.smithi165.stdout:3/885: mknod da/d17/de5/d104/d2c/d10c/c12b 0 2024-09-16T02:05:59.377 INFO:tasks.workunit.client.0.smithi110.stdout:7/290: truncate d3/f14 5215875 0 2024-09-16T02:05:59.379 INFO:tasks.workunit.client.0.smithi110.stdout:3/298: creat d8/f6d x:0 0 0 2024-09-16T02:05:59.379 INFO:tasks.workunit.client.1.smithi165.stdout:4/737: dwrite d4/fc3 [0,4194304] 0 2024-09-16T02:05:59.382 INFO:tasks.workunit.client.1.smithi165.stdout:6/806: fdatasync f3 0 2024-09-16T02:05:59.383 INFO:tasks.workunit.client.0.smithi110.stdout:5/343: rmdir d5/d36 39 2024-09-16T02:05:59.385 INFO:tasks.workunit.client.1.smithi165.stdout:6/807: stat d7/d17/d75/d97/dcb/d74/db7/de0 0 2024-09-16T02:05:59.386 INFO:tasks.workunit.client.1.smithi165.stdout:5/843: dwrite de/d21/d51/f5e [0,4194304] 0 2024-09-16T02:05:59.387 INFO:tasks.workunit.client.0.smithi110.stdout:7/291: dread d3/d15/d38/d4f/f22 [0,4194304] 0 2024-09-16T02:05:59.389 INFO:tasks.workunit.client.1.smithi165.stdout:7/832: rename d0/d2c/f7c to d0/d2c/dc8/dea/f10c 0 2024-09-16T02:05:59.391 INFO:tasks.workunit.client.0.smithi110.stdout:3/299: unlink d8/d48/d4b/f66 0 2024-09-16T02:05:59.395 INFO:tasks.workunit.client.1.smithi165.stdout:5/844: dwrite fa [0,4194304] 0 2024-09-16T02:05:59.395 INFO:tasks.workunit.client.0.smithi110.stdout:0/413: dread d3/d6/ff [0,4194304] 0 2024-09-16T02:05:59.398 INFO:tasks.workunit.client.0.smithi110.stdout:9/318: getdents d1/d1b 0 2024-09-16T02:05:59.401 INFO:tasks.workunit.client.0.smithi110.stdout:1/414: dread d0/d1/d4/f31 [0,4194304] 0 2024-09-16T02:05:59.401 INFO:tasks.workunit.client.0.smithi110.stdout:9/319: dread d1/d5/d8/f40 [0,4194304] 0 2024-09-16T02:05:59.401 INFO:tasks.workunit.client.1.smithi165.stdout:9/872: link d7/df/d37/f3b d7/d32/d38/d53/d5c/d61/d8f/f11a 0 2024-09-16T02:05:59.407 INFO:tasks.workunit.client.0.smithi110.stdout:0/414: symlink d3/d6/l77 0 2024-09-16T02:05:59.408 INFO:tasks.workunit.client.1.smithi165.stdout:9/873: dwrite d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:05:59.410 INFO:tasks.workunit.client.0.smithi110.stdout:0/415: truncate d3/d6/d43/d55/f6f 77415 0 2024-09-16T02:05:59.411 INFO:tasks.workunit.client.1.smithi165.stdout:3/886: symlink da/d17/de5/d104/d2c/d10c/l12c 0 2024-09-16T02:05:59.412 INFO:tasks.workunit.client.1.smithi165.stdout:4/738: chown d4/d40/d4f/c6e 0 1 2024-09-16T02:05:59.412 INFO:tasks.workunit.client.0.smithi110.stdout:1/415: fdatasync d0/d1/f57 0 2024-09-16T02:05:59.413 INFO:tasks.workunit.client.0.smithi110.stdout:7/292: getdents d3/d15/d3a 0 2024-09-16T02:05:59.415 INFO:tasks.workunit.client.0.smithi110.stdout:3/300: creat d8/dc/d1b/d36/d57/d64/f6e x:0 0 0 2024-09-16T02:05:59.416 INFO:tasks.workunit.client.1.smithi165.stdout:0/739: link d0/d1e/d39/fc8 d0/d1e/d39/d48/ff7 0 2024-09-16T02:05:59.418 INFO:tasks.workunit.client.1.smithi165.stdout:6/808: creat d7/d1f/dbc/fe6 x:0 0 0 2024-09-16T02:05:59.419 INFO:tasks.workunit.client.0.smithi110.stdout:0/416: symlink d3/d4/dc/d14/l78 0 2024-09-16T02:05:59.421 INFO:tasks.workunit.client.0.smithi110.stdout:6/452: dwrite d0/d2/d5/d84/d16/f61 [0,4194304] 0 2024-09-16T02:05:59.421 INFO:tasks.workunit.client.1.smithi165.stdout:6/809: truncate d7/d17/d75/d97/dcb/fe2 607973 0 2024-09-16T02:05:59.422 INFO:tasks.workunit.client.0.smithi110.stdout:1/416: creat d0/d1/d2a/d32/d6e/f8a x:0 0 0 2024-09-16T02:05:59.423 INFO:tasks.workunit.client.1.smithi165.stdout:7/833: rmdir d0/d4b/db4/dda 39 2024-09-16T02:05:59.423 INFO:tasks.workunit.client.1.smithi165.stdout:0/740: dwrite d0/d1e/d39/d48/d45/db3/fe2 [0,4194304] 0 2024-09-16T02:05:59.423 INFO:tasks.workunit.client.1.smithi165.stdout:6/810: write d7/d1f/dbc/fe6 [524795,73528] 0 2024-09-16T02:05:59.424 INFO:tasks.workunit.client.0.smithi110.stdout:7/293: mknod d3/d15/d38/d4f/d10/c52 0 2024-09-16T02:05:59.424 INFO:tasks.workunit.client.0.smithi110.stdout:7/294: readlink d3/d15/l1e 0 2024-09-16T02:05:59.425 INFO:tasks.workunit.client.1.smithi165.stdout:8/848: symlink dd/d34/l125 0 2024-09-16T02:05:59.429 INFO:tasks.workunit.client.1.smithi165.stdout:5/845: chown de/d21/d26/d9a/lee 0 1 2024-09-16T02:05:59.430 INFO:tasks.workunit.client.0.smithi110.stdout:0/417: creat d3/d4/d6d/f79 x:0 0 0 2024-09-16T02:05:59.431 INFO:tasks.workunit.client.1.smithi165.stdout:2/855: creat df/d23/f101 x:0 0 0 2024-09-16T02:05:59.431 INFO:tasks.workunit.client.0.smithi110.stdout:7/295: dwrite d3/f8 [0,4194304] 0 2024-09-16T02:05:59.441 INFO:tasks.workunit.client.0.smithi110.stdout:0/418: symlink d3/d6/d43/d55/d59/l7a 0 2024-09-16T02:05:59.442 INFO:tasks.workunit.client.0.smithi110.stdout:0/419: fdatasync d3/f28 0 2024-09-16T02:05:59.445 INFO:tasks.workunit.client.0.smithi110.stdout:0/420: chown d3/d6/d43/f67 32 1 2024-09-16T02:05:59.445 INFO:tasks.workunit.client.0.smithi110.stdout:1/417: dwrite d0/d1/f57 [0,4194304] 0 2024-09-16T02:05:59.450 INFO:tasks.workunit.client.1.smithi165.stdout:8/849: mkdir dd/d11/d14/d3f/d25/d36/d85/d126 0 2024-09-16T02:05:59.452 INFO:tasks.workunit.client.1.smithi165.stdout:8/850: readlink dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/lec 0 2024-09-16T02:05:59.454 INFO:tasks.workunit.client.0.smithi110.stdout:0/421: read - d3/d4/dc/f68 zero size 2024-09-16T02:05:59.455 INFO:tasks.workunit.client.1.smithi165.stdout:4/739: creat d4/dc/dea/ff3 x:0 0 0 2024-09-16T02:05:59.456 INFO:tasks.workunit.client.0.smithi110.stdout:8/324: sync 2024-09-16T02:05:59.456 INFO:tasks.workunit.client.0.smithi110.stdout:4/377: sync 2024-09-16T02:05:59.456 INFO:tasks.workunit.client.1.smithi165.stdout:1/939: getdents d1/dd/d11 0 2024-09-16T02:05:59.458 INFO:tasks.workunit.client.1.smithi165.stdout:6/811: link d7/dc/df/d1a/d4d/d5f/f88 d7/d17/d75/d97/dcb/d3d/d5d/d73/fe7 0 2024-09-16T02:05:59.458 INFO:tasks.workunit.client.0.smithi110.stdout:8/325: write d3/d2b/f52 [5116621,26124] 0 2024-09-16T02:05:59.458 INFO:tasks.workunit.client.0.smithi110.stdout:3/301: dwrite d8/dc/d1b/f35 [0,4194304] 0 2024-09-16T02:05:59.460 INFO:tasks.workunit.client.1.smithi165.stdout:8/851: mknod dd/d11/d38/d74/c127 0 2024-09-16T02:05:59.461 INFO:tasks.workunit.client.0.smithi110.stdout:0/422: creat d3/d4/d41/f7b x:0 0 0 2024-09-16T02:05:59.477 INFO:tasks.workunit.client.1.smithi165.stdout:4/740: chown d4/dc/d28/f43 133 1 2024-09-16T02:05:59.477 INFO:tasks.workunit.client.0.smithi110.stdout:3/302: fsync f4 0 2024-09-16T02:05:59.479 INFO:tasks.workunit.client.0.smithi110.stdout:7/296: write d3/d15/d38/d4f/fd [913892,111583] 0 2024-09-16T02:05:59.479 INFO:tasks.workunit.client.1.smithi165.stdout:1/940: readlink d1/dd/d11/d33/d67/lc0 0 2024-09-16T02:05:59.480 INFO:tasks.workunit.client.0.smithi110.stdout:8/326: creat d3/d12/d1a/d36/d60/d62/f73 x:0 0 0 2024-09-16T02:05:59.480 INFO:tasks.workunit.client.1.smithi165.stdout:7/834: write d0/d2c/dc8/d103/fd8 [718612,19778] 0 2024-09-16T02:05:59.480 INFO:tasks.workunit.client.0.smithi110.stdout:7/297: write d3/f26 [5019071,13568] 0 2024-09-16T02:05:59.481 INFO:tasks.workunit.client.1.smithi165.stdout:6/812: mknod d7/dc/df/d1a/d4d/d90/ce8 0 2024-09-16T02:05:59.481 INFO:tasks.workunit.client.0.smithi110.stdout:6/453: write d0/d2/f42 [1323900,111395] 0 2024-09-16T02:05:59.482 INFO:tasks.workunit.client.0.smithi110.stdout:0/423: symlink d3/d6/d4b/l7c 0 2024-09-16T02:05:59.482 INFO:tasks.workunit.client.1.smithi165.stdout:6/813: write d7/dc/df/d1a/d4d/d5f/da7/fdf [80165,23447] 0 2024-09-16T02:05:59.484 INFO:tasks.workunit.client.0.smithi110.stdout:4/378: mknod d4/d8/d17/d23/d4c/d6d/d3c/c76 0 2024-09-16T02:05:59.485 INFO:tasks.workunit.client.1.smithi165.stdout:8/852: truncate dd/d11/d14/f1e 2623585 0 2024-09-16T02:05:59.485 INFO:tasks.workunit.client.0.smithi110.stdout:7/298: truncate d3/d15/d38/d4f/d10/d11/d3e/d40/f4a 915571 0 2024-09-16T02:05:59.486 INFO:tasks.workunit.client.1.smithi165.stdout:8/853: write dd/d11/d38/da6/ff6 [1865806,59608] 0 2024-09-16T02:05:59.487 INFO:tasks.workunit.client.0.smithi110.stdout:4/379: write d4/d8/d17/d23/d4c/d6d/d4f/f58 [1840973,63251] 0 2024-09-16T02:05:59.487 INFO:tasks.workunit.client.0.smithi110.stdout:3/303: rename d8/f16 to d8/dc/d1b/d3a/d43/f6f 0 2024-09-16T02:05:59.487 INFO:tasks.workunit.client.0.smithi110.stdout:0/424: dread d3/d6/f3b [0,4194304] 0 2024-09-16T02:05:59.488 INFO:tasks.workunit.client.0.smithi110.stdout:4/380: chown d4/d8/d31/d5d 2559834 1 2024-09-16T02:05:59.488 INFO:tasks.workunit.client.0.smithi110.stdout:7/299: write d3/d15/d38/d4f/d10/f3d [421180,111472] 0 2024-09-16T02:05:59.489 INFO:tasks.workunit.client.1.smithi165.stdout:2/856: creat df/d23/d28/d3b/f102 x:0 0 0 2024-09-16T02:05:59.490 INFO:tasks.workunit.client.0.smithi110.stdout:4/381: chown d4/d12/d18/f1f 224408241 1 2024-09-16T02:05:59.490 INFO:tasks.workunit.client.1.smithi165.stdout:3/887: getdents da/d17/d7a/d7d 0 2024-09-16T02:05:59.491 INFO:tasks.workunit.client.0.smithi110.stdout:4/382: write d4/d8/d17/d23/d4c/f5b [904796,84165] 0 2024-09-16T02:05:59.492 INFO:tasks.workunit.client.0.smithi110.stdout:8/327: mknod d3/d2b/c74 0 2024-09-16T02:05:59.493 INFO:tasks.workunit.client.1.smithi165.stdout:4/741: unlink d4/c6f 0 2024-09-16T02:05:59.494 INFO:tasks.workunit.client.0.smithi110.stdout:6/454: creat d0/d2/d5/d55/f8f x:0 0 0 2024-09-16T02:05:59.494 INFO:tasks.workunit.client.1.smithi165.stdout:5/846: dwrite de/d21/d26/d3a/d54/f89 [0,4194304] 0 2024-09-16T02:05:59.495 INFO:tasks.workunit.client.0.smithi110.stdout:4/383: dread d4/f2c [0,4194304] 0 2024-09-16T02:05:59.495 INFO:tasks.workunit.client.0.smithi110.stdout:4/384: chown d4/d12/d18/c1a 1 1 2024-09-16T02:05:59.496 INFO:tasks.workunit.client.1.smithi165.stdout:1/941: mkdir d1/dd/d11/d33/d92/da3/d128 0 2024-09-16T02:05:59.497 INFO:tasks.workunit.client.1.smithi165.stdout:9/874: sync 2024-09-16T02:05:59.498 INFO:tasks.workunit.client.1.smithi165.stdout:0/741: sync 2024-09-16T02:05:59.498 INFO:tasks.workunit.client.1.smithi165.stdout:7/835: rmdir d0/d2c/d85 39 2024-09-16T02:05:59.499 INFO:tasks.workunit.client.1.smithi165.stdout:9/875: chown d7/d32/d38/d68/d7f/f70 67059210 1 2024-09-16T02:05:59.500 INFO:tasks.workunit.client.1.smithi165.stdout:6/814: unlink d7/d17/d75/d97/dcb/d3d/d5d/d73/f7c 0 2024-09-16T02:05:59.500 INFO:tasks.workunit.client.1.smithi165.stdout:9/876: readlink d7/d32/d38/d53/d56/d95/l1e 0 2024-09-16T02:05:59.501 INFO:tasks.workunit.client.1.smithi165.stdout:6/815: write d7/dc/d7f/dd2/f6f [1241860,75377] 0 2024-09-16T02:05:59.502 INFO:tasks.workunit.client.1.smithi165.stdout:6/816: dread d7/d17/d75/f7d [0,4194304] 0 2024-09-16T02:05:59.503 INFO:tasks.workunit.client.0.smithi110.stdout:3/304: dread d8/dc/d1b/d1c/f2e [0,4194304] 0 2024-09-16T02:05:59.505 INFO:tasks.workunit.client.0.smithi110.stdout:3/305: write d8/d29/f41 [505337,96767] 0 2024-09-16T02:05:59.506 INFO:tasks.workunit.client.0.smithi110.stdout:3/306: write d8/d29/f41 [259300,13450] 0 2024-09-16T02:05:59.508 INFO:tasks.workunit.client.1.smithi165.stdout:3/888: mkdir da/d57/d8d/d97/df7/d12d 0 2024-09-16T02:05:59.510 INFO:tasks.workunit.client.0.smithi110.stdout:6/455: creat d0/d2/d57/d75/f90 x:0 0 0 2024-09-16T02:05:59.513 INFO:tasks.workunit.client.0.smithi110.stdout:4/385: creat d4/d12/d3b/f77 x:0 0 0 2024-09-16T02:05:59.515 INFO:tasks.workunit.client.1.smithi165.stdout:4/742: dread d4/dc/d28/d2b/d42/f87 [0,4194304] 0 2024-09-16T02:05:59.517 INFO:tasks.workunit.client.1.smithi165.stdout:1/942: rename d1/d19/d24/d30/f105 to d1/d6b/df6/f129 0 2024-09-16T02:05:59.518 INFO:tasks.workunit.client.0.smithi110.stdout:6/456: dwrite d0/d2/d57/d75/f81 [0,4194304] 0 2024-09-16T02:05:59.519 INFO:tasks.workunit.client.1.smithi165.stdout:1/943: fsync d1/d22/f74 0 2024-09-16T02:05:59.521 INFO:tasks.workunit.client.1.smithi165.stdout:7/836: mkdir d0/d4b/db4/dba/d10d 0 2024-09-16T02:05:59.522 INFO:tasks.workunit.client.1.smithi165.stdout:9/877: dread d7/fa [0,4194304] 0 2024-09-16T02:05:59.522 INFO:tasks.workunit.client.0.smithi110.stdout:7/300: mknod d3/d15/d44/c53 0 2024-09-16T02:05:59.525 INFO:tasks.workunit.client.1.smithi165.stdout:4/743: dwrite d4/fad [0,4194304] 0 2024-09-16T02:05:59.527 INFO:tasks.workunit.client.0.smithi110.stdout:3/307: rename d8/dc/f25 to d8/dc/d1b/d3a/f70 0 2024-09-16T02:05:59.528 INFO:tasks.workunit.client.0.smithi110.stdout:0/425: truncate d3/d4/f1d 1269332 0 2024-09-16T02:05:59.531 INFO:tasks.workunit.client.1.smithi165.stdout:0/742: write d0/ff [4867324,13879] 0 2024-09-16T02:05:59.531 INFO:tasks.workunit.client.0.smithi110.stdout:4/386: chown d4/c7 121637331 1 2024-09-16T02:05:59.532 INFO:tasks.workunit.client.1.smithi165.stdout:0/743: chown d0/d1e/d39/d48/d5f/d96 62481139 1 2024-09-16T02:05:59.532 INFO:tasks.workunit.client.1.smithi165.stdout:3/889: fdatasync da/d57/d8d/f98 0 2024-09-16T02:05:59.535 INFO:tasks.workunit.client.1.smithi165.stdout:3/890: write da/d17/de5/d104/d2c/db7/fc1 [427609,83235] 0 2024-09-16T02:05:59.536 INFO:tasks.workunit.client.1.smithi165.stdout:4/744: dread d4/dc/d18/d37/d53/d64/d8b/d71/f7d [0,4194304] 0 2024-09-16T02:05:59.537 INFO:tasks.workunit.client.1.smithi165.stdout:3/891: dread - da/d17/de5/d104/d2c/de8/f122 zero size 2024-09-16T02:05:59.542 INFO:tasks.workunit.client.0.smithi110.stdout:6/457: truncate d0/d29/d2a/f2b 2293507 0 2024-09-16T02:05:59.543 INFO:tasks.workunit.client.1.smithi165.stdout:7/837: creat d0/d3d/d9f/ddc/da8/ddd/f10e x:0 0 0 2024-09-16T02:05:59.544 INFO:tasks.workunit.client.1.smithi165.stdout:1/944: dread d1/dd/f14 [0,4194304] 0 2024-09-16T02:05:59.544 INFO:tasks.workunit.client.1.smithi165.stdout:7/838: write d0/d4b/d63/f8f [3830798,40044] 0 2024-09-16T02:05:59.545 INFO:tasks.workunit.client.0.smithi110.stdout:4/387: truncate d4/f2c 1668661 0 2024-09-16T02:05:59.547 INFO:tasks.workunit.client.0.smithi110.stdout:6/458: mknod d0/d29/c91 0 2024-09-16T02:05:59.548 INFO:tasks.workunit.client.1.smithi165.stdout:5/847: truncate de/d19/d1c/d4d/f7e 125199 0 2024-09-16T02:05:59.550 INFO:tasks.workunit.client.1.smithi165.stdout:8/854: creat dd/d11/d14/d3f/d25/d36/f128 x:0 0 0 2024-09-16T02:05:59.551 INFO:tasks.workunit.client.1.smithi165.stdout:8/855: dread - dd/d11/daa/fcb zero size 2024-09-16T02:05:59.551 INFO:tasks.workunit.client.0.smithi110.stdout:4/388: dwrite d4/d8/d17/d23/d4c/d6d/f3a [0,4194304] 0 2024-09-16T02:05:59.552 INFO:tasks.workunit.client.0.smithi110.stdout:3/308: write d8/f22 [868975,26716] 0 2024-09-16T02:05:59.555 INFO:tasks.workunit.client.0.smithi110.stdout:6/459: dread d0/d2/f1c [4194304,4194304] 0 2024-09-16T02:05:59.556 INFO:tasks.workunit.client.1.smithi165.stdout:2/857: sync 2024-09-16T02:05:59.556 INFO:tasks.workunit.client.0.smithi110.stdout:7/301: dread d3/f19 [0,4194304] 0 2024-09-16T02:05:59.556 INFO:tasks.workunit.client.0.smithi110.stdout:6/460: dread - d0/d2/d57/d7a/f86 zero size 2024-09-16T02:05:59.556 INFO:tasks.workunit.client.0.smithi110.stdout:7/302: chown d3/f32 2 1 2024-09-16T02:05:59.558 INFO:tasks.workunit.client.0.smithi110.stdout:3/309: creat d8/dc/d1b/d36/f71 x:0 0 0 2024-09-16T02:05:59.559 INFO:tasks.workunit.client.0.smithi110.stdout:3/310: stat d8/f17 0 2024-09-16T02:05:59.560 INFO:tasks.workunit.client.1.smithi165.stdout:4/745: mkdir d4/dc/d18/d37/d53/d64/d8b/df4 0 2024-09-16T02:05:59.561 INFO:tasks.workunit.client.1.smithi165.stdout:1/945: mkdir d1/d19/d4d/d84/d12a 0 2024-09-16T02:05:59.562 INFO:tasks.workunit.client.0.smithi110.stdout:6/461: symlink d0/d29/d2a/d2f/d49/l92 0 2024-09-16T02:05:59.563 INFO:tasks.workunit.client.1.smithi165.stdout:9/878: creat d7/d32/d38/d68/d7f/d113/f11b x:0 0 0 2024-09-16T02:05:59.564 INFO:tasks.workunit.client.0.smithi110.stdout:3/311: symlink d8/dc/d1b/d3a/l72 0 2024-09-16T02:05:59.566 INFO:tasks.workunit.client.0.smithi110.stdout:6/462: unlink d0/d2/f68 0 2024-09-16T02:05:59.568 INFO:tasks.workunit.client.1.smithi165.stdout:0/744: link d0/f5a d0/d1e/d39/d48/d74/ff8 0 2024-09-16T02:05:59.569 INFO:tasks.workunit.client.1.smithi165.stdout:4/746: dread d4/dc0/fca [0,4194304] 0 2024-09-16T02:05:59.569 INFO:tasks.workunit.client.0.smithi110.stdout:3/312: creat d8/d29/f73 x:0 0 0 2024-09-16T02:05:59.569 INFO:tasks.workunit.client.0.smithi110.stdout:3/313: dread - d8/f5c zero size 2024-09-16T02:05:59.570 INFO:tasks.workunit.client.1.smithi165.stdout:2/858: dwrite df/d10/d1a/d68/fdf [0,4194304] 0 2024-09-16T02:05:59.570 INFO:tasks.workunit.client.0.smithi110.stdout:3/314: chown d8/dc/d1b/d36/f37 6 1 2024-09-16T02:05:59.571 INFO:tasks.workunit.client.1.smithi165.stdout:4/747: chown d4/dc/d28/d30/fd0 30515288 1 2024-09-16T02:05:59.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/315: dwrite d8/dc/f21 [0,4194304] 0 2024-09-16T02:05:59.578 INFO:tasks.workunit.client.0.smithi110.stdout:6/463: truncate d0/d29/d2a/d2f/d34/f64 745061 0 2024-09-16T02:05:59.581 INFO:tasks.workunit.client.0.smithi110.stdout:4/389: write d4/d12/d18/f1f [1398886,293] 0 2024-09-16T02:05:59.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/856: mknod dd/d11/d14/d3f/d25/d36/d85/d126/c129 0 2024-09-16T02:05:59.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/857: fsync f6 0 2024-09-16T02:05:59.585 INFO:tasks.workunit.client.0.smithi110.stdout:3/316: dread d8/d29/f41 [0,4194304] 0 2024-09-16T02:05:59.585 INFO:tasks.workunit.client.1.smithi165.stdout:8/858: chown dd/d11/d14/d3f/c77 0 1 2024-09-16T02:05:59.586 INFO:tasks.workunit.client.0.smithi110.stdout:7/303: dread d3/f26 [0,4194304] 0 2024-09-16T02:05:59.589 INFO:tasks.workunit.client.1.smithi165.stdout:0/745: fdatasync d0/f23 0 2024-09-16T02:05:59.590 INFO:tasks.workunit.client.0.smithi110.stdout:4/390: mknod d4/d8/d17/d23/d4c/d6d/c78 0 2024-09-16T02:05:59.593 INFO:tasks.workunit.client.0.smithi110.stdout:6/464: dread d0/d2/d18/f46 [0,4194304] 0 2024-09-16T02:05:59.595 INFO:tasks.workunit.client.0.smithi110.stdout:3/317: dwrite d8/dc/d1b/d36/f71 [0,4194304] 0 2024-09-16T02:05:59.596 INFO:tasks.workunit.client.1.smithi165.stdout:0/746: dwrite d0/d1e/d39/d48/d5f/d82/f9b [0,4194304] 0 2024-09-16T02:05:59.600 INFO:tasks.workunit.client.0.smithi110.stdout:4/391: rename d4/d8/d17/d6b/l6e to d4/d12/d3b/l79 0 2024-09-16T02:05:59.602 INFO:tasks.workunit.client.1.smithi165.stdout:1/946: symlink d1/dd/d11/d33/d92/da3/d128/l12b 0 2024-09-16T02:05:59.602 INFO:tasks.workunit.client.0.smithi110.stdout:7/304: symlink d3/l54 0 2024-09-16T02:05:59.604 INFO:tasks.workunit.client.1.smithi165.stdout:8/859: symlink dd/d9e/l12a 0 2024-09-16T02:05:59.605 INFO:tasks.workunit.client.0.smithi110.stdout:6/465: unlink d0/d29/d2a/d2f/d49/f71 0 2024-09-16T02:05:59.606 INFO:tasks.workunit.client.1.smithi165.stdout:7/839: write d0/df/f44 [2956744,17982] 0 2024-09-16T02:05:59.606 INFO:tasks.workunit.client.0.smithi110.stdout:7/305: dread d3/f26 [0,4194304] 0 2024-09-16T02:05:59.607 INFO:tasks.workunit.client.0.smithi110.stdout:7/306: chown d3/f8 595810 1 2024-09-16T02:05:59.610 INFO:tasks.workunit.client.1.smithi165.stdout:2/859: readlink df/d23/ddc/lde 0 2024-09-16T02:05:59.612 INFO:tasks.workunit.client.1.smithi165.stdout:0/747: fsync d0/d2a/d70/f84 0 2024-09-16T02:05:59.612 INFO:tasks.workunit.client.1.smithi165.stdout:6/817: sync 2024-09-16T02:05:59.615 INFO:tasks.workunit.client.1.smithi165.stdout:5/848: getdents de/d21/d26/d3a/d6d/de2 0 2024-09-16T02:05:59.616 INFO:tasks.workunit.client.1.smithi165.stdout:6/818: read d7/d1f/f32 [2154688,69145] 0 2024-09-16T02:05:59.617 INFO:tasks.workunit.client.1.smithi165.stdout:9/879: dwrite d7/d32/d38/f73 [0,4194304] 0 2024-09-16T02:05:59.618 INFO:tasks.workunit.client.1.smithi165.stdout:6/819: fdatasync d7/d1f/f32 0 2024-09-16T02:05:59.619 INFO:tasks.workunit.client.0.smithi110.stdout:7/307: rename d3/d15/l1e to d3/d15/d38/d4f/d10/d11/l55 0 2024-09-16T02:05:59.621 INFO:tasks.workunit.client.1.smithi165.stdout:9/880: write d7/d32/d38/d53/d5c/f8d [868402,8237] 0 2024-09-16T02:05:59.621 INFO:tasks.workunit.client.1.smithi165.stdout:6/820: write d7/d1f/f8c [35475,35580] 0 2024-09-16T02:05:59.621 INFO:tasks.workunit.client.0.smithi110.stdout:4/392: symlink d4/d8/d17/d23/d4c/d6d/d3c/l7a 0 2024-09-16T02:05:59.622 INFO:tasks.workunit.client.1.smithi165.stdout:4/748: dwrite d4/dc/d18/d37/d53/d64/d8b/f86 [0,4194304] 0 2024-09-16T02:05:59.622 INFO:tasks.workunit.client.0.smithi110.stdout:6/466: dread d0/d29/f3f [0,4194304] 0 2024-09-16T02:05:59.623 INFO:tasks.workunit.client.0.smithi110.stdout:6/467: chown d0/d2/d5/f88 103074322 1 2024-09-16T02:05:59.624 INFO:tasks.workunit.client.1.smithi165.stdout:8/860: mknod dd/d62/c12b 0 2024-09-16T02:05:59.624 INFO:tasks.workunit.client.1.smithi165.stdout:4/749: dread - d4/dc/d20/d4e/fe5 zero size 2024-09-16T02:05:59.624 INFO:tasks.workunit.client.1.smithi165.stdout:9/881: chown d7/df/d37/f107 0 1 2024-09-16T02:05:59.625 INFO:tasks.workunit.client.1.smithi165.stdout:7/840: unlink d0/d2c/dc8/ce0 0 2024-09-16T02:05:59.628 INFO:tasks.workunit.client.1.smithi165.stdout:3/892: sync 2024-09-16T02:05:59.629 INFO:tasks.workunit.client.0.smithi110.stdout:4/393: creat d4/d8/d31/d73/f7b x:0 0 0 2024-09-16T02:05:59.631 INFO:tasks.workunit.client.0.smithi110.stdout:6/468: mknod d0/d2/d18/d1d/c93 0 2024-09-16T02:05:59.634 INFO:tasks.workunit.client.0.smithi110.stdout:4/394: creat d4/d12/d3b/f7c x:0 0 0 2024-09-16T02:05:59.634 INFO:tasks.workunit.client.1.smithi165.stdout:5/849: unlink de/d19/d67/d74/fc6 0 2024-09-16T02:05:59.635 INFO:tasks.workunit.client.0.smithi110.stdout:4/395: chown d4/d8/d31/d73 20 1 2024-09-16T02:05:59.636 INFO:tasks.workunit.client.0.smithi110.stdout:3/318: dwrite d8/dc/d1b/f31 [0,4194304] 0 2024-09-16T02:05:59.636 INFO:tasks.workunit.client.0.smithi110.stdout:6/469: mkdir d0/d2/d5/d94 0 2024-09-16T02:05:59.637 INFO:tasks.workunit.client.0.smithi110.stdout:4/396: read - d4/d12/d3b/f77 zero size 2024-09-16T02:05:59.638 INFO:tasks.workunit.client.1.smithi165.stdout:1/947: truncate d1/f125 680639 0 2024-09-16T02:05:59.638 INFO:tasks.workunit.client.0.smithi110.stdout:3/319: read d8/dc/d1b/d1c/f26 [2635548,24085] 0 2024-09-16T02:05:59.639 INFO:tasks.workunit.client.0.smithi110.stdout:6/470: creat d0/d2/d57/f95 x:0 0 0 2024-09-16T02:05:59.643 INFO:tasks.workunit.client.1.smithi165.stdout:8/861: rename dd/d11/f5f to dd/d9e/f12c 0 2024-09-16T02:05:59.646 INFO:tasks.workunit.client.1.smithi165.stdout:8/862: write dd/d11/d14/d70/d7b/d9a/fcc [1394733,17502] 0 2024-09-16T02:05:59.646 INFO:tasks.workunit.client.0.smithi110.stdout:3/320: creat d8/d29/f74 x:0 0 0 2024-09-16T02:05:59.647 INFO:tasks.workunit.client.1.smithi165.stdout:8/863: chown dd/d11/d38/d74/d7d/fca 1295583 1 2024-09-16T02:05:59.647 INFO:tasks.workunit.client.1.smithi165.stdout:4/750: mknod d4/dc/d18/d37/d53/d64/d8b/d71/cf5 0 2024-09-16T02:05:59.649 INFO:tasks.workunit.client.1.smithi165.stdout:8/864: read dd/d11/d14/d3f/d25/d36/f64 [163022,89746] 0 2024-09-16T02:05:59.649 INFO:tasks.workunit.client.0.smithi110.stdout:7/308: write d3/d15/d38/d4f/fe [2235218,43411] 0 2024-09-16T02:05:59.650 INFO:tasks.workunit.client.0.smithi110.stdout:4/397: dread d4/d12/d18/f1f [0,4194304] 0 2024-09-16T02:05:59.652 INFO:tasks.workunit.client.0.smithi110.stdout:6/471: rename d0/d2/d5/l5c to d0/d2/d5/d55/l96 0 2024-09-16T02:05:59.653 INFO:tasks.workunit.client.1.smithi165.stdout:7/841: rename d0/df/dfd to d0/df/dfd/d10f 22 2024-09-16T02:05:59.654 INFO:tasks.workunit.client.0.smithi110.stdout:6/472: dread d0/d29/d2a/d2f/f5f [0,4194304] 0 2024-09-16T02:05:59.656 INFO:tasks.workunit.client.1.smithi165.stdout:1/948: dread d1/d6b/df6/f129 [0,4194304] 0 2024-09-16T02:05:59.657 INFO:tasks.workunit.client.0.smithi110.stdout:7/309: mknod d3/d15/d38/d4f/d10/d11/c56 0 2024-09-16T02:05:59.658 INFO:tasks.workunit.client.0.smithi110.stdout:7/310: write d3/f14 [793860,63528] 0 2024-09-16T02:05:59.662 INFO:tasks.workunit.client.0.smithi110.stdout:3/321: dread d8/d29/d45/f5f [0,4194304] 0 2024-09-16T02:05:59.663 INFO:tasks.workunit.client.1.smithi165.stdout:0/748: fsync d0/d1e/f26 0 2024-09-16T02:05:59.664 INFO:tasks.workunit.client.0.smithi110.stdout:4/398: dread d4/d12/d18/f34 [0,4194304] 0 2024-09-16T02:05:59.665 INFO:tasks.workunit.client.0.smithi110.stdout:6/473: mknod d0/d2/d18/d1d/c97 0 2024-09-16T02:05:59.666 INFO:tasks.workunit.client.0.smithi110.stdout:6/474: chown d0/d29/f3f 9 1 2024-09-16T02:05:59.673 INFO:tasks.workunit.client.0.smithi110.stdout:4/399: read d4/d8/d17/f26 [1973865,24596] 0 2024-09-16T02:05:59.673 INFO:tasks.workunit.client.0.smithi110.stdout:4/400: chown d4/f10 29643004 1 2024-09-16T02:05:59.674 INFO:tasks.workunit.client.1.smithi165.stdout:1/949: dread d1/dd/d11/d33/d3f/d7e/fa7 [0,4194304] 0 2024-09-16T02:05:59.674 INFO:tasks.workunit.client.1.smithi165.stdout:3/893: write da/d17/de5/d104/fd2 [1148249,71400] 0 2024-09-16T02:05:59.675 INFO:tasks.workunit.client.0.smithi110.stdout:6/475: mkdir d0/d29/d2a/d2d/d98 0 2024-09-16T02:05:59.678 INFO:tasks.workunit.client.1.smithi165.stdout:8/865: mknod dd/d11/d38/da6/c12d 0 2024-09-16T02:05:59.679 INFO:tasks.workunit.client.1.smithi165.stdout:2/860: link df/d10/d64/ldb df/d23/d28/d3b/d6d/d8b/l103 0 2024-09-16T02:05:59.679 INFO:tasks.workunit.client.1.smithi165.stdout:8/866: write dd/d11/d14/f40 [1654780,10267] 0 2024-09-16T02:05:59.680 INFO:tasks.workunit.client.1.smithi165.stdout:2/861: dread - df/d10/d1a/d2d/fbe zero size 2024-09-16T02:05:59.680 INFO:tasks.workunit.client.1.smithi165.stdout:7/842: chown d0/d4b/db4/dba/lfb 0 1 2024-09-16T02:05:59.682 INFO:tasks.workunit.client.1.smithi165.stdout:0/749: mknod d0/d1e/d39/d48/d5f/d96/dac/cf9 0 2024-09-16T02:05:59.682 INFO:tasks.workunit.client.1.smithi165.stdout:5/850: fsync de/d21/d26/f8a 0 2024-09-16T02:05:59.683 INFO:tasks.workunit.client.1.smithi165.stdout:6/821: rmdir d7/d17/d75/de1 0 2024-09-16T02:05:59.685 INFO:tasks.workunit.client.1.smithi165.stdout:5/851: chown de/d21/d26/d94/da8/fd0 109 1 2024-09-16T02:05:59.685 INFO:tasks.workunit.client.1.smithi165.stdout:3/894: mknod da/d17/c12e 0 2024-09-16T02:05:59.688 INFO:tasks.workunit.client.1.smithi165.stdout:2/862: dwrite df/f19 [0,4194304] 0 2024-09-16T02:05:59.688 INFO:tasks.workunit.client.1.smithi165.stdout:1/950: creat d1/dd/d11/d33/d3f/d7e/f12c x:0 0 0 2024-09-16T02:05:59.689 INFO:tasks.workunit.client.1.smithi165.stdout:4/751: creat d4/dc/d18/d37/d53/d64/d8b/df4/ff6 x:0 0 0 2024-09-16T02:05:59.706 INFO:tasks.workunit.client.0.smithi110.stdout:3/322: mkdir d8/d48/d5b/d6a/d75 0 2024-09-16T02:05:59.706 INFO:tasks.workunit.client.0.smithi110.stdout:6/476: dread - d0/d2/d5/d55/f8f zero size 2024-09-16T02:05:59.709 INFO:tasks.workunit.client.0.smithi110.stdout:4/401: dwrite d4/d8/f67 [0,4194304] 0 2024-09-16T02:05:59.712 INFO:tasks.workunit.client.1.smithi165.stdout:7/843: fsync d0/d4b/db4/dba/fbd 0 2024-09-16T02:05:59.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/323: fdatasync d8/d29/f41 0 2024-09-16T02:05:59.714 INFO:tasks.workunit.client.0.smithi110.stdout:3/324: dread - d8/dc/d1b/d3a/d43/f67 zero size 2024-09-16T02:05:59.714 INFO:tasks.workunit.client.0.smithi110.stdout:6/477: dwrite d0/d2/f42 [0,4194304] 0 2024-09-16T02:05:59.716 INFO:tasks.workunit.client.0.smithi110.stdout:3/325: fsync d8/dc/d1b/d3a/d43/f4e 0 2024-09-16T02:05:59.717 INFO:tasks.workunit.client.1.smithi165.stdout:8/867: rename dd/d11/d14/d3f/d25/d36/d81/dd2/c4e to dd/d11/d38/da6/c12e 0 2024-09-16T02:05:59.717 INFO:tasks.workunit.client.0.smithi110.stdout:4/402: mknod d4/d8/d17/d23/d4c/c7d 0 2024-09-16T02:05:59.717 INFO:tasks.workunit.client.0.smithi110.stdout:3/326: truncate d8/f5c 217295 0 2024-09-16T02:05:59.718 INFO:tasks.workunit.client.1.smithi165.stdout:8/868: write dd/d7f/fde [4808178,102144] 0 2024-09-16T02:05:59.719 INFO:tasks.workunit.client.0.smithi110.stdout:4/403: write d4/d12/d18/f57 [110012,43639] 0 2024-09-16T02:05:59.719 INFO:tasks.workunit.client.0.smithi110.stdout:3/327: write d8/dc/d1b/d36/f71 [995271,33647] 0 2024-09-16T02:05:59.720 INFO:tasks.workunit.client.1.smithi165.stdout:6/822: fsync f3 0 2024-09-16T02:05:59.720 INFO:tasks.workunit.client.0.smithi110.stdout:6/478: dread d0/d2/f42 [0,4194304] 0 2024-09-16T02:05:59.721 INFO:tasks.workunit.client.1.smithi165.stdout:6/823: readlink d7/dc/l93 0 2024-09-16T02:05:59.725 INFO:tasks.workunit.client.1.smithi165.stdout:9/882: link d7/d32/d38/d53/d5c/d61/l86 d7/d1f/l11c 0 2024-09-16T02:05:59.725 INFO:tasks.workunit.client.1.smithi165.stdout:2/863: symlink df/d23/d28/dfa/d98/l104 0 2024-09-16T02:05:59.727 INFO:tasks.workunit.client.1.smithi165.stdout:1/951: creat d1/dd/d11/d33/d3f/d47/d7d/db3/de0/f12d x:0 0 0 2024-09-16T02:05:59.728 INFO:tasks.workunit.client.1.smithi165.stdout:1/952: fsync d1/d22/f82 0 2024-09-16T02:05:59.728 INFO:tasks.workunit.client.1.smithi165.stdout:7/844: symlink d0/d4b/d63/l110 0 2024-09-16T02:05:59.728 INFO:tasks.workunit.client.0.smithi110.stdout:4/404: rmdir d4/d8/d31 39 2024-09-16T02:05:59.731 INFO:tasks.workunit.client.0.smithi110.stdout:6/479: creat d0/d29/d2a/d2f/f99 x:0 0 0 2024-09-16T02:05:59.735 INFO:tasks.workunit.client.1.smithi165.stdout:2/864: dread df/d10/d64/f91 [0,4194304] 0 2024-09-16T02:05:59.735 INFO:tasks.workunit.client.1.smithi165.stdout:2/865: readlink df/d23/d28/d3b/d6d/l7e 0 2024-09-16T02:05:59.736 INFO:tasks.workunit.client.1.smithi165.stdout:3/895: rename da/d20/d26/ff8 to da/d17/de5/d104/d2c/d10c/d6b/f12f 0 2024-09-16T02:05:59.742 INFO:tasks.workunit.client.0.smithi110.stdout:6/480: getdents d0/d2/d18/d1d 0 2024-09-16T02:05:59.744 INFO:tasks.workunit.client.0.smithi110.stdout:6/481: creat d0/d2/d57/d7a/f9a x:0 0 0 2024-09-16T02:05:59.745 INFO:tasks.workunit.client.1.smithi165.stdout:5/852: getdents de/d19/d1c/d4d/dc1/d107 0 2024-09-16T02:05:59.746 INFO:tasks.workunit.client.1.smithi165.stdout:8/869: write dd/f41 [258167,83920] 0 2024-09-16T02:05:59.746 INFO:tasks.workunit.client.0.smithi110.stdout:6/482: symlink d0/l9b 0 2024-09-16T02:05:59.747 INFO:tasks.workunit.client.1.smithi165.stdout:2/866: creat df/d10/d1a/d2d/dd1/f105 x:0 0 0 2024-09-16T02:05:59.747 INFO:tasks.workunit.client.1.smithi165.stdout:1/953: write d1/dd/d11/d33/d3f/d59/f90 [549213,43993] 0 2024-09-16T02:05:59.747 INFO:tasks.workunit.client.1.smithi165.stdout:6/824: creat d7/d17/d75/d97/dcb/d3d/dd0/fe9 x:0 0 0 2024-09-16T02:05:59.748 INFO:tasks.workunit.client.1.smithi165.stdout:2/867: stat df/d23/d28/d87 0 2024-09-16T02:05:59.749 INFO:tasks.workunit.client.1.smithi165.stdout:6/825: stat d7/dc/d7f 0 2024-09-16T02:05:59.750 INFO:tasks.workunit.client.1.smithi165.stdout:5/853: read de/d21/d26/d3a/f7b [1210256,57182] 0 2024-09-16T02:05:59.750 INFO:tasks.workunit.client.1.smithi165.stdout:4/752: rename d4/c4b to d4/dc/d28/d2b/cf7 0 2024-09-16T02:05:59.752 INFO:tasks.workunit.client.1.smithi165.stdout:1/954: creat d1/d6b/f12e x:0 0 0 2024-09-16T02:05:59.753 INFO:tasks.workunit.client.1.smithi165.stdout:0/750: write d0/d1e/d39/f49 [1122088,43808] 0 2024-09-16T02:05:59.753 INFO:tasks.workunit.client.1.smithi165.stdout:7/845: rename d0/df/d33/c64 to d0/d4b/db4/dba/dc4/c111 0 2024-09-16T02:05:59.753 INFO:tasks.workunit.client.1.smithi165.stdout:4/753: readlink d4/dc/d28/d3b/l81 0 2024-09-16T02:05:59.755 INFO:tasks.workunit.client.0.smithi110.stdout:3/328: write d8/dc/d1b/d3a/d43/d58/f6c [2544086,38231] 0 2024-09-16T02:05:59.756 INFO:tasks.workunit.client.0.smithi110.stdout:3/329: chown d8/d48/d4b 607537062 1 2024-09-16T02:05:59.757 INFO:tasks.workunit.client.1.smithi165.stdout:1/955: fsync d1/dd/d11/d33/d92/fc6 0 2024-09-16T02:05:59.758 INFO:tasks.workunit.client.1.smithi165.stdout:6/826: creat d7/d17/d75/d97/dcb/d74/de3/fea x:0 0 0 2024-09-16T02:05:59.760 INFO:tasks.workunit.client.1.smithi165.stdout:7/846: unlink d0/d2c/le3 0 2024-09-16T02:05:59.761 INFO:tasks.workunit.client.1.smithi165.stdout:2/868: dread df/d10/d1a/d2d/dd1/f9b [0,4194304] 0 2024-09-16T02:05:59.762 INFO:tasks.workunit.client.0.smithi110.stdout:4/405: dwrite d4/d8/d17/d23/f74 [0,4194304] 0 2024-09-16T02:05:59.762 INFO:tasks.workunit.client.0.smithi110.stdout:3/330: unlink d8/dc/d1b/d36/d57/d64/f6e 0 2024-09-16T02:05:59.762 INFO:tasks.workunit.client.1.smithi165.stdout:6/827: write f2 [313303,34923] 0 2024-09-16T02:05:59.763 INFO:tasks.workunit.client.0.smithi110.stdout:3/331: read - d8/dc/d1b/f60 zero size 2024-09-16T02:05:59.764 INFO:tasks.workunit.client.1.smithi165.stdout:4/754: creat d4/dc/d18/d37/d53/d64/d8b/ff8 x:0 0 0 2024-09-16T02:05:59.765 INFO:tasks.workunit.client.1.smithi165.stdout:8/870: dwrite dd/d34/dd7/f10a [0,4194304] 0 2024-09-16T02:05:59.767 INFO:tasks.workunit.client.1.smithi165.stdout:0/751: truncate d0/d1e/d39/d48/d5f/d82/fa5 205245 0 2024-09-16T02:05:59.767 INFO:tasks.workunit.client.1.smithi165.stdout:5/854: dwrite de/d19/d1c/d84/fe9 [0,4194304] 0 2024-09-16T02:05:59.768 INFO:tasks.workunit.client.0.smithi110.stdout:4/406: creat d4/d8/d17/d23/d4c/d6d/f7e x:0 0 0 2024-09-16T02:05:59.772 INFO:tasks.workunit.client.1.smithi165.stdout:3/896: truncate da/d17/de5/d104/d2c/d2d/d6c/fba 1001437 0 2024-09-16T02:05:59.772 INFO:tasks.workunit.client.0.smithi110.stdout:4/407: dread d4/d8/d17/d23/f74 [0,4194304] 0 2024-09-16T02:05:59.773 INFO:tasks.workunit.client.0.smithi110.stdout:4/408: stat d4/d8/d17/d23/f4a 0 2024-09-16T02:05:59.773 INFO:tasks.workunit.client.1.smithi165.stdout:5/855: write de/d19/d67/d74/f9e [591591,123071] 0 2024-09-16T02:05:59.774 INFO:tasks.workunit.client.0.smithi110.stdout:4/409: readlink d4/d12/d18/l22 0 2024-09-16T02:05:59.775 INFO:tasks.workunit.client.0.smithi110.stdout:4/410: write d4/d12/d3b/f7c [75112,116895] 0 2024-09-16T02:05:59.778 INFO:tasks.workunit.client.1.smithi165.stdout:7/847: mknod d0/d4b/d63/c112 0 2024-09-16T02:05:59.778 INFO:tasks.workunit.client.0.smithi110.stdout:4/411: mkdir d4/d8/d17/d23/d4c/d6d/d7f 0 2024-09-16T02:05:59.779 INFO:tasks.workunit.client.1.smithi165.stdout:3/897: chown da/d17/c12e 168355651 1 2024-09-16T02:05:59.780 INFO:tasks.workunit.client.1.smithi165.stdout:6/828: symlink d7/d17/d75/dc1/leb 0 2024-09-16T02:05:59.781 INFO:tasks.workunit.client.1.smithi165.stdout:2/869: read df/d23/d66/faa [222334,8165] 0 2024-09-16T02:05:59.782 INFO:tasks.workunit.client.1.smithi165.stdout:0/752: symlink d0/d1e/d39/d99/lfa 0 2024-09-16T02:05:59.783 INFO:tasks.workunit.client.0.smithi110.stdout:4/412: dread d4/d8/d17/d23/d4c/d6d/d4f/f75 [0,4194304] 0 2024-09-16T02:05:59.784 INFO:tasks.workunit.client.1.smithi165.stdout:1/956: dread d1/f49 [0,4194304] 0 2024-09-16T02:05:59.785 INFO:tasks.workunit.client.0.smithi110.stdout:4/413: write d4/d8/d17/d23/d4c/d6d/d3c/d3d/f47 [611881,102424] 0 2024-09-16T02:05:59.787 INFO:tasks.workunit.client.0.smithi110.stdout:4/414: write d4/d8/d17/d23/f51 [681710,64712] 0 2024-09-16T02:05:59.787 INFO:tasks.workunit.client.1.smithi165.stdout:0/753: unlink d0/f5a 0 2024-09-16T02:05:59.788 INFO:tasks.workunit.client.1.smithi165.stdout:5/856: dwrite de/d21/d51/fda [0,4194304] 0 2024-09-16T02:05:59.788 INFO:tasks.workunit.client.1.smithi165.stdout:7/848: mknod d0/c113 0 2024-09-16T02:05:59.790 INFO:tasks.workunit.client.1.smithi165.stdout:1/957: dread d1/d6b/dd7/f108 [0,4194304] 0 2024-09-16T02:05:59.792 INFO:tasks.workunit.client.1.smithi165.stdout:2/870: read df/d23/d28/d3b/f96 [217588,123777] 0 2024-09-16T02:05:59.792 INFO:tasks.workunit.client.1.smithi165.stdout:6/829: creat d7/d17/d75/d97/dcb/d3d/dd0/fec x:0 0 0 2024-09-16T02:05:59.793 INFO:tasks.workunit.client.0.smithi110.stdout:4/415: rename d4/d12 to d4/d8/d31/d80 0 2024-09-16T02:05:59.794 INFO:tasks.workunit.client.0.smithi110.stdout:3/332: write d8/f17 [227195,114335] 0 2024-09-16T02:05:59.794 INFO:tasks.workunit.client.1.smithi165.stdout:8/871: truncate dd/d11/d14/f54 480154 0 2024-09-16T02:05:59.795 INFO:tasks.workunit.client.1.smithi165.stdout:1/958: read - d1/dd/d11/d46/fdf zero size 2024-09-16T02:05:59.797 INFO:tasks.workunit.client.1.smithi165.stdout:3/898: dwrite da/d17/f4b [4194304,4194304] 0 2024-09-16T02:05:59.799 INFO:tasks.workunit.client.1.smithi165.stdout:2/871: rmdir df/dbb/ded 39 2024-09-16T02:05:59.801 INFO:tasks.workunit.client.0.smithi110.stdout:3/333: rename d8/f4c to d8/d48/d5b/f76 0 2024-09-16T02:05:59.802 INFO:tasks.workunit.client.0.smithi110.stdout:4/416: dwrite d4/d8/d17/d23/f4a [0,4194304] 0 2024-09-16T02:05:59.803 INFO:tasks.workunit.client.1.smithi165.stdout:8/872: readlink dd/d11/d14/d70/l83 0 2024-09-16T02:05:59.804 INFO:tasks.workunit.client.0.smithi110.stdout:4/417: fdatasync d4/d8/d31/d80/d18/f4d 0 2024-09-16T02:05:59.805 INFO:tasks.workunit.client.1.smithi165.stdout:9/883: sync 2024-09-16T02:05:59.807 INFO:tasks.workunit.client.0.smithi110.stdout:3/334: dread d8/f17 [0,4194304] 0 2024-09-16T02:05:59.813 INFO:tasks.workunit.client.1.smithi165.stdout:3/899: creat da/d17/d7a/dab/f130 x:0 0 0 2024-09-16T02:05:59.814 INFO:tasks.workunit.client.1.smithi165.stdout:4/755: truncate d4/dc/d20/d4e/d73/fde 3303043 0 2024-09-16T02:05:59.814 INFO:tasks.workunit.client.1.smithi165.stdout:5/857: dread f6 [0,4194304] 0 2024-09-16T02:05:59.816 INFO:tasks.workunit.client.1.smithi165.stdout:3/900: truncate da/d17/de5/d104/d2c/d2d/d6c/db5/fe2 520925 0 2024-09-16T02:05:59.817 INFO:tasks.workunit.client.1.smithi165.stdout:4/756: write d4/dc/d18/d37/d53/f5a [1210932,95167] 0 2024-09-16T02:05:59.817 INFO:tasks.workunit.client.0.smithi110.stdout:3/335: symlink d8/d48/d5b/d6a/d75/l77 0 2024-09-16T02:05:59.819 INFO:tasks.workunit.client.0.smithi110.stdout:4/418: creat d4/d8/d17/d23/d4c/d6d/d3c/f81 x:0 0 0 2024-09-16T02:05:59.820 INFO:tasks.workunit.client.0.smithi110.stdout:4/419: chown d4/d8/d31/d80/l68 1590674101 1 2024-09-16T02:05:59.821 INFO:tasks.workunit.client.1.smithi165.stdout:5/858: dread de/d21/d26/d3a/d54/f89 [0,4194304] 0 2024-09-16T02:05:59.822 INFO:tasks.workunit.client.0.smithi110.stdout:3/336: symlink d8/dc/d1b/d36/d3b/l78 0 2024-09-16T02:05:59.823 INFO:tasks.workunit.client.0.smithi110.stdout:3/337: fsync d8/d29/f41 0 2024-09-16T02:05:59.823 INFO:tasks.workunit.client.0.smithi110.stdout:3/338: fsync d8/f51 0 2024-09-16T02:05:59.824 INFO:tasks.workunit.client.0.smithi110.stdout:4/420: read d4/d8/d31/f39 [1620948,118289] 0 2024-09-16T02:05:59.824 INFO:tasks.workunit.client.1.smithi165.stdout:2/872: symlink df/d23/d28/d3b/l106 0 2024-09-16T02:05:59.824 INFO:tasks.workunit.client.1.smithi165.stdout:2/873: chown df/d23/d28/d3b/f96 0 1 2024-09-16T02:05:59.826 INFO:tasks.workunit.client.0.smithi110.stdout:4/421: read d4/d8/d17/d23/d4c/d6d/d3c/d3d/f47 [271115,25304] 0 2024-09-16T02:05:59.827 INFO:tasks.workunit.client.0.smithi110.stdout:3/339: unlink d8/dc/l18 0 2024-09-16T02:05:59.831 INFO:tasks.workunit.client.0.smithi110.stdout:4/422: rmdir d4/d8/d17/d23/d35 39 2024-09-16T02:05:59.834 INFO:tasks.workunit.client.1.smithi165.stdout:6/830: dread d7/dc/f48 [0,4194304] 0 2024-09-16T02:05:59.837 INFO:tasks.workunit.client.1.smithi165.stdout:0/754: truncate d0/d2a/fca 247514 0 2024-09-16T02:05:59.837 INFO:tasks.workunit.client.1.smithi165.stdout:1/959: dread d1/dd/d11/d33/d3f/fc8 [0,4194304] 0 2024-09-16T02:05:59.839 INFO:tasks.workunit.client.1.smithi165.stdout:4/757: readlink d4/dc/d28/l92 0 2024-09-16T02:05:59.839 INFO:tasks.workunit.client.1.smithi165.stdout:1/960: write d1/d19/d24/d97/fc2 [720259,105838] 0 2024-09-16T02:05:59.841 INFO:tasks.workunit.client.1.smithi165.stdout:9/884: mkdir d7/d32/d38/d53/d56/dca/dd2/d11d 0 2024-09-16T02:05:59.841 INFO:tasks.workunit.client.0.smithi110.stdout:3/340: creat d8/f79 x:0 0 0 2024-09-16T02:05:59.843 INFO:tasks.workunit.client.1.smithi165.stdout:9/885: dread - d7/d32/d38/d53/d5c/d61/d8f/fb4 zero size 2024-09-16T02:05:59.845 INFO:tasks.workunit.client.1.smithi165.stdout:8/873: rmdir dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/de8 0 2024-09-16T02:05:59.845 INFO:tasks.workunit.client.0.smithi110.stdout:3/341: dread d8/dc/d1b/d3a/f70 [0,4194304] 0 2024-09-16T02:05:59.848 INFO:tasks.workunit.client.1.smithi165.stdout:1/961: dwrite d1/d19/f11f [0,4194304] 0 2024-09-16T02:05:59.848 INFO:tasks.workunit.client.1.smithi165.stdout:8/874: fsync dd/d11/d14/d3f/d25/d36/d4f/fdf 0 2024-09-16T02:05:59.850 INFO:tasks.workunit.client.0.smithi110.stdout:3/342: creat d8/dc/d1b/d1c/f7a x:0 0 0 2024-09-16T02:05:59.851 INFO:tasks.workunit.client.1.smithi165.stdout:0/755: creat d0/d1e/d39/d48/d45/db3/ffb x:0 0 0 2024-09-16T02:05:59.851 INFO:tasks.workunit.client.1.smithi165.stdout:3/901: write da/d57/d8d/f98 [968145,65073] 0 2024-09-16T02:05:59.852 INFO:tasks.workunit.client.1.smithi165.stdout:4/758: symlink d4/dc/d20/d67/lf9 0 2024-09-16T02:05:59.853 INFO:tasks.workunit.client.0.smithi110.stdout:3/343: chown d8/dc/f2b 1 1 2024-09-16T02:05:59.854 INFO:tasks.workunit.client.1.smithi165.stdout:6/831: dread d7/dc/d7f/dd2/f59 [0,4194304] 0 2024-09-16T02:05:59.855 INFO:tasks.workunit.client.1.smithi165.stdout:7/849: getdents d0/d4b/db4/dda 0 2024-09-16T02:05:59.861 INFO:tasks.workunit.client.0.smithi110.stdout:3/344: dwrite d8/dc/d1b/d1c/f38 [0,4194304] 0 2024-09-16T02:05:59.861 INFO:tasks.workunit.client.1.smithi165.stdout:2/874: dwrite df/d23/d28/f53 [0,4194304] 0 2024-09-16T02:05:59.862 INFO:tasks.workunit.client.1.smithi165.stdout:8/875: dwrite dd/d11/d14/d70/d7b/d9a/f11a [0,4194304] 0 2024-09-16T02:05:59.865 INFO:tasks.workunit.client.1.smithi165.stdout:5/859: creat de/d19/d1c/f118 x:0 0 0 2024-09-16T02:05:59.865 INFO:tasks.workunit.client.1.smithi165.stdout:6/832: rmdir d7/d17/d75/dc1 39 2024-09-16T02:05:59.872 INFO:tasks.workunit.client.1.smithi165.stdout:9/886: rename d7/d32/d38/d68/lc7 to d7/d32/d4a/dff/l11e 0 2024-09-16T02:05:59.873 INFO:tasks.workunit.client.1.smithi165.stdout:4/759: fsync d4/dc/d18/fa3 0 2024-09-16T02:05:59.875 INFO:tasks.workunit.client.1.smithi165.stdout:3/902: mkdir da/d17/d7a/d131 0 2024-09-16T02:05:59.876 INFO:tasks.workunit.client.1.smithi165.stdout:2/875: creat df/d10/d37/de7/f107 x:0 0 0 2024-09-16T02:05:59.876 INFO:tasks.workunit.client.1.smithi165.stdout:6/833: dread d7/d17/f69 [0,4194304] 0 2024-09-16T02:05:59.876 INFO:tasks.workunit.client.0.smithi110.stdout:3/345: dread d8/fb [0,4194304] 0 2024-09-16T02:05:59.877 INFO:tasks.workunit.client.1.smithi165.stdout:8/876: creat dd/d11/d14/d70/d7b/f12f x:0 0 0 2024-09-16T02:05:59.880 INFO:tasks.workunit.client.1.smithi165.stdout:0/756: symlink d0/d1e/d20/d28/d6d/lfc 0 2024-09-16T02:05:59.880 INFO:tasks.workunit.client.1.smithi165.stdout:5/860: creat de/d21/d26/d3a/d6d/f119 x:0 0 0 2024-09-16T02:05:59.881 INFO:tasks.workunit.client.0.smithi110.stdout:3/346: dread d8/dc/d1b/d3a/d43/d58/f6c [0,4194304] 0 2024-09-16T02:05:59.883 INFO:tasks.workunit.client.1.smithi165.stdout:9/887: unlink d7/d32/d38/d68/d7f/lb3 0 2024-09-16T02:05:59.884 INFO:tasks.workunit.client.1.smithi165.stdout:9/888: write d7/d1f/d27/d49/f5e [3179786,68725] 0 2024-09-16T02:05:59.885 INFO:tasks.workunit.client.1.smithi165.stdout:9/889: dread - d7/d32/d38/d68/d7f/d113/f11b zero size 2024-09-16T02:05:59.885 INFO:tasks.workunit.client.0.smithi110.stdout:3/347: symlink d8/dc/d1b/d36/d3b/l7b 0 2024-09-16T02:05:59.886 INFO:tasks.workunit.client.1.smithi165.stdout:5/861: dread de/d21/fef [0,4194304] 0 2024-09-16T02:05:59.888 INFO:tasks.workunit.client.1.smithi165.stdout:4/760: rmdir d4 39 2024-09-16T02:05:59.890 INFO:tasks.workunit.client.0.smithi110.stdout:3/348: unlink d8/dc/c1a 0 2024-09-16T02:05:59.891 INFO:tasks.workunit.client.1.smithi165.stdout:2/876: mkdir df/d10/d64/d108 0 2024-09-16T02:05:59.892 INFO:tasks.workunit.client.0.smithi110.stdout:3/349: dread f2 [4194304,4194304] 0 2024-09-16T02:05:59.892 INFO:tasks.workunit.client.1.smithi165.stdout:8/877: fdatasync dd/f8a 0 2024-09-16T02:05:59.892 INFO:tasks.workunit.client.1.smithi165.stdout:2/877: read - df/d23/f101 zero size 2024-09-16T02:05:59.893 INFO:tasks.workunit.client.1.smithi165.stdout:3/903: unlink da/d17/d7a/dab/ce4 0 2024-09-16T02:05:59.894 INFO:tasks.workunit.client.1.smithi165.stdout:6/834: creat d7/dc/d7f/fed x:0 0 0 2024-09-16T02:05:59.896 INFO:tasks.workunit.client.0.smithi110.stdout:3/350: mkdir d8/d48/d7c 0 2024-09-16T02:05:59.897 INFO:tasks.workunit.client.1.smithi165.stdout:5/862: mkdir de/d21/d26/d11a 0 2024-09-16T02:05:59.900 INFO:tasks.workunit.client.1.smithi165.stdout:3/904: dread - da/d17/de5/d104/d2c/d10c/f124 zero size 2024-09-16T02:05:59.902 INFO:tasks.workunit.client.1.smithi165.stdout:3/905: truncate da/d17/de5/d104/d2c/d10c/ff4 128668 0 2024-09-16T02:05:59.906 INFO:tasks.workunit.client.1.smithi165.stdout:1/962: rename d1/d19/d24/d30/d72/lb4 to d1/d19/d24/d30/l12f 0 2024-09-16T02:05:59.907 INFO:tasks.workunit.client.1.smithi165.stdout:3/906: creat da/d20/d26/d8c/dd9/f132 x:0 0 0 2024-09-16T02:05:59.909 INFO:tasks.workunit.client.1.smithi165.stdout:9/890: creat d7/f11f x:0 0 0 2024-09-16T02:05:59.909 INFO:tasks.workunit.client.1.smithi165.stdout:8/878: creat dd/d11/f130 x:0 0 0 2024-09-16T02:05:59.910 INFO:tasks.workunit.client.1.smithi165.stdout:5/863: dwrite de/d21/d26/f113 [0,4194304] 0 2024-09-16T02:05:59.912 INFO:tasks.workunit.client.1.smithi165.stdout:3/907: mkdir da/dfe/d133 0 2024-09-16T02:05:59.912 INFO:tasks.workunit.client.1.smithi165.stdout:5/864: chown de/d21/d51/l8d 1 1 2024-09-16T02:05:59.913 INFO:tasks.workunit.client.1.smithi165.stdout:6/835: link d7/d17/d75/d97/lcf d7/d17/d75/lee 0 2024-09-16T02:05:59.915 INFO:tasks.workunit.client.1.smithi165.stdout:7/850: rename d0/d4b/db4/dba/dc4/cdf to d0/df/d83/c114 0 2024-09-16T02:05:59.915 INFO:tasks.workunit.client.1.smithi165.stdout:3/908: chown da/d17/de5/d104/d2c/d2d/fbf 1 1 2024-09-16T02:05:59.915 INFO:tasks.workunit.client.1.smithi165.stdout:1/963: dwrite d1/d22/f2c [0,4194304] 0 2024-09-16T02:05:59.915 INFO:tasks.workunit.client.0.smithi110.stdout:3/351: getdents d8/dc/d1b/d36/d3b 0 2024-09-16T02:05:59.916 INFO:tasks.workunit.client.1.smithi165.stdout:7/851: chown d0/df/d33 123986 1 2024-09-16T02:05:59.916 INFO:tasks.workunit.client.0.smithi110.stdout:3/352: write d8/dc/d1b/d3a/d43/f4e [4949908,2315] 0 2024-09-16T02:05:59.918 INFO:tasks.workunit.client.1.smithi165.stdout:4/761: rename d4/dc/d28/d2b/d42/d99/fb6 to d4/dc/d28/d3b/ffa 0 2024-09-16T02:05:59.920 INFO:tasks.workunit.client.0.smithi110.stdout:3/353: mknod d8/d48/d5b/d6a/c7d 0 2024-09-16T02:05:59.925 INFO:tasks.workunit.client.1.smithi165.stdout:6/836: dwrite d7/d17/d75/d97/dcb/fe2 [0,4194304] 0 2024-09-16T02:05:59.926 INFO:tasks.workunit.client.1.smithi165.stdout:3/909: rename da/d20/fae to da/d17/de5/d104/d2c/d2d/d6c/def/f134 0 2024-09-16T02:05:59.926 INFO:tasks.workunit.client.1.smithi165.stdout:5/865: dwrite de/d21/d26/d3a/f3c [4194304,4194304] 0 2024-09-16T02:05:59.927 INFO:tasks.workunit.client.1.smithi165.stdout:7/852: mkdir d0/d2c/d85/d8c/d115 0 2024-09-16T02:05:59.930 INFO:tasks.workunit.client.1.smithi165.stdout:4/762: dwrite d4/fc3 [0,4194304] 0 2024-09-16T02:05:59.930 INFO:tasks.workunit.client.1.smithi165.stdout:7/853: chown d0/d3d/d9f/fbe 50052 1 2024-09-16T02:05:59.931 INFO:tasks.workunit.client.1.smithi165.stdout:6/837: write d7/d17/d75/d97/dcb/d74/db7/fde [213690,91545] 0 2024-09-16T02:05:59.931 INFO:tasks.workunit.client.1.smithi165.stdout:5/866: write de/d21/d26/d3a/dd5/fd7 [456217,15749] 0 2024-09-16T02:05:59.933 INFO:tasks.workunit.client.1.smithi165.stdout:7/854: read - d0/df/d42/fdb zero size 2024-09-16T02:05:59.934 INFO:tasks.workunit.client.1.smithi165.stdout:4/763: write d4/dc/d28/d2b/d42/f69 [4588266,101486] 0 2024-09-16T02:05:59.934 INFO:tasks.workunit.client.1.smithi165.stdout:5/867: write de/d21/d51/f111 [2016517,66115] 0 2024-09-16T02:05:59.934 INFO:tasks.workunit.client.1.smithi165.stdout:7/855: stat d0/d4b/db4/dba 0 2024-09-16T02:05:59.938 INFO:tasks.workunit.client.1.smithi165.stdout:3/910: link da/d20/d26/l38 da/d17/d7a/d7d/da8/d119/l135 0 2024-09-16T02:05:59.941 INFO:tasks.workunit.client.1.smithi165.stdout:5/868: mkdir de/d19/df6/d11b 0 2024-09-16T02:05:59.941 INFO:tasks.workunit.client.1.smithi165.stdout:7/856: mknod d0/d4b/db4/dda/c116 0 2024-09-16T02:05:59.944 INFO:tasks.workunit.client.1.smithi165.stdout:3/911: mkdir da/d17/de5/d104/d2c/de8/d136 0 2024-09-16T02:05:59.948 INFO:tasks.workunit.client.1.smithi165.stdout:5/869: unlink de/c1e 0 2024-09-16T02:05:59.950 INFO:tasks.workunit.client.1.smithi165.stdout:5/870: truncate fa 4282323 0 2024-09-16T02:05:59.951 INFO:tasks.workunit.client.1.smithi165.stdout:6/838: rmdir d7/d17/d75/dc1/ddc 0 2024-09-16T02:05:59.951 INFO:tasks.workunit.client.1.smithi165.stdout:6/839: readlink d7/dc/l1b 0 2024-09-16T02:05:59.953 INFO:tasks.workunit.client.1.smithi165.stdout:8/879: read dd/d11/d38/da6/ff6 [533276,42442] 0 2024-09-16T02:05:59.954 INFO:tasks.workunit.client.1.smithi165.stdout:6/840: write d7/dc/df/d1a/f4f [4103772,12552] 0 2024-09-16T02:05:59.955 INFO:tasks.workunit.client.1.smithi165.stdout:6/841: readlink d7/d1f/l36 0 2024-09-16T02:05:59.959 INFO:tasks.workunit.client.1.smithi165.stdout:8/880: creat dd/d11/d38/da6/f131 x:0 0 0 2024-09-16T02:05:59.960 INFO:tasks.workunit.client.1.smithi165.stdout:5/871: creat de/d21/d26/d11a/f11c x:0 0 0 2024-09-16T02:05:59.961 INFO:tasks.workunit.client.1.smithi165.stdout:0/757: dread d0/d1e/d39/d48/fe8 [0,4194304] 0 2024-09-16T02:05:59.962 INFO:tasks.workunit.client.1.smithi165.stdout:0/758: fsync d0/d1e/d39/d48/d45/f95 0 2024-09-16T02:05:59.963 INFO:tasks.workunit.client.1.smithi165.stdout:0/759: stat d0/d1e/d39/d48 0 2024-09-16T02:05:59.965 INFO:tasks.workunit.client.0.smithi110.stdout:3/354: write d8/fb [4523150,100156] 0 2024-09-16T02:05:59.967 INFO:tasks.workunit.client.1.smithi165.stdout:6/842: creat d7/d17/d75/fef x:0 0 0 2024-09-16T02:05:59.967 INFO:tasks.workunit.client.1.smithi165.stdout:3/912: link da/d17/dcc/l12 da/d57/l137 0 2024-09-16T02:05:59.969 INFO:tasks.workunit.client.0.smithi110.stdout:3/355: dread d8/fb [0,4194304] 0 2024-09-16T02:05:59.970 INFO:tasks.workunit.client.1.smithi165.stdout:1/964: dwrite d1/dd/d11/d46/f70 [0,4194304] 0 2024-09-16T02:05:59.971 INFO:tasks.workunit.client.1.smithi165.stdout:7/857: dread d0/d2c/f8d [0,4194304] 0 2024-09-16T02:05:59.972 INFO:tasks.workunit.client.1.smithi165.stdout:8/881: link dd/d11/fcd dd/d11/d14/d70/f132 0 2024-09-16T02:05:59.976 INFO:tasks.workunit.client.0.smithi110.stdout:3/356: rename d8/dc/d1b/d3a/d43/f6f to d8/dc/f7e 0 2024-09-16T02:05:59.978 INFO:tasks.workunit.client.1.smithi165.stdout:6/843: mkdir d7/dc/df/d1a/d4d/df0 0 2024-09-16T02:05:59.982 INFO:tasks.workunit.client.0.smithi110.stdout:3/357: mkdir d8/dc/d7f 0 2024-09-16T02:05:59.984 INFO:tasks.workunit.client.0.smithi110.stdout:3/358: mkdir d8/dc/d1b/d3a/d43/d80 0 2024-09-16T02:05:59.984 INFO:tasks.workunit.client.1.smithi165.stdout:6/844: write d7/f1e [1453317,82922] 0 2024-09-16T02:05:59.985 INFO:tasks.workunit.client.1.smithi165.stdout:7/858: dread d0/d4b/db4/dba/fbd [4194304,4194304] 0 2024-09-16T02:05:59.988 INFO:tasks.workunit.client.0.smithi110.stdout:3/359: rename d8/dc/d1b/d1c/f2e to d8/dc/d1b/d36/d3b/f81 0 2024-09-16T02:05:59.989 INFO:tasks.workunit.client.1.smithi165.stdout:8/882: dwrite dd/d11/d14/d3f/d72/fa5 [0,4194304] 0 2024-09-16T02:05:59.989 INFO:tasks.workunit.client.0.smithi110.stdout:3/360: unlink d8/d48/l55 0 2024-09-16T02:05:59.991 INFO:tasks.workunit.client.0.smithi110.stdout:2/361: sync 2024-09-16T02:05:59.992 INFO:tasks.workunit.client.0.smithi110.stdout:3/361: rename d8/dc/f27 to d8/dc/d7f/f82 0 2024-09-16T02:05:59.993 INFO:tasks.workunit.client.0.smithi110.stdout:2/362: fsync d0/db/d33/d70/f42 0 2024-09-16T02:05:59.994 INFO:tasks.workunit.client.0.smithi110.stdout:2/363: mknod d0/db/c75 0 2024-09-16T02:05:59.995 INFO:tasks.workunit.client.1.smithi165.stdout:3/913: dwrite da/d17/de5/d104/d2c/d10c/fac [0,4194304] 0 2024-09-16T02:05:59.996 INFO:tasks.workunit.client.1.smithi165.stdout:7/859: dread - d0/df/d33/d2a/dd2/f70 zero size 2024-09-16T02:05:59.996 INFO:tasks.workunit.client.0.smithi110.stdout:3/362: mkdir d8/dc/d1b/d36/d83 0 2024-09-16T02:05:59.997 INFO:tasks.workunit.client.0.smithi110.stdout:3/363: chown d8/d29/d45/f59 3533 1 2024-09-16T02:05:59.998 INFO:tasks.workunit.client.1.smithi165.stdout:4/764: dwrite f1 [0,4194304] 0 2024-09-16T02:05:59.998 INFO:tasks.workunit.client.1.smithi165.stdout:8/883: symlink dd/d11/d14/d70/d7b/df2/dfc/l133 0 2024-09-16T02:05:59.999 INFO:tasks.workunit.client.1.smithi165.stdout:5/872: dread de/d21/fe4 [0,4194304] 0 2024-09-16T02:06:00.001 INFO:tasks.workunit.client.1.smithi165.stdout:0/760: dread d0/d1e/d39/f6c [4194304,4194304] 0 2024-09-16T02:06:00.003 INFO:tasks.workunit.client.0.smithi110.stdout:2/364: dwrite d0/db/d33/d70/d41/f44 [0,4194304] 0 2024-09-16T02:06:00.004 INFO:tasks.workunit.client.1.smithi165.stdout:4/765: fdatasync d4/dc/d18/f22 0 2024-09-16T02:06:00.005 INFO:tasks.workunit.client.1.smithi165.stdout:3/914: symlink da/d17/de5/d104/d2c/de8/l138 0 2024-09-16T02:06:00.005 INFO:tasks.workunit.client.0.smithi110.stdout:3/364: dread d8/dc/d1b/f24 [0,4194304] 0 2024-09-16T02:06:00.008 INFO:tasks.workunit.client.1.smithi165.stdout:1/965: dwrite d1/f125 [0,4194304] 0 2024-09-16T02:06:00.008 INFO:tasks.workunit.client.1.smithi165.stdout:5/873: creat de/d21/d4e/f11d x:0 0 0 2024-09-16T02:06:00.009 INFO:tasks.workunit.client.1.smithi165.stdout:6/845: dwrite d7/dc/d7f/fed [0,4194304] 0 2024-09-16T02:06:00.011 INFO:tasks.workunit.client.1.smithi165.stdout:5/874: fdatasync de/d19/d1c/d49/fa3 0 2024-09-16T02:06:00.013 INFO:tasks.workunit.client.1.smithi165.stdout:6/846: chown d7/dc/d7f/dd2/d3c/f70 1023 1 2024-09-16T02:06:00.014 INFO:tasks.workunit.client.1.smithi165.stdout:1/966: write d1/dd/d11/d33/dfa/f11b [816731,125717] 0 2024-09-16T02:06:00.020 INFO:tasks.workunit.client.1.smithi165.stdout:7/860: rename d0/df/d33/dc2/c10b to d0/d3d/d9f/ddc/c117 0 2024-09-16T02:06:00.022 INFO:tasks.workunit.client.1.smithi165.stdout:4/766: mkdir d4/dc/dea/dfb 0 2024-09-16T02:06:00.024 INFO:tasks.workunit.client.1.smithi165.stdout:6/847: write d7/d17/d75/d97/dcb/d3d/dd0/fec [756649,26146] 0 2024-09-16T02:06:00.024 INFO:tasks.workunit.client.0.smithi110.stdout:3/365: rename d8/f6d to d8/dc/f84 0 2024-09-16T02:06:00.025 INFO:tasks.workunit.client.0.smithi110.stdout:3/366: chown d8/d29/f42 8892 1 2024-09-16T02:06:00.026 INFO:tasks.workunit.client.1.smithi165.stdout:5/875: dwrite de/d19/d1c/f3e [0,4194304] 0 2024-09-16T02:06:00.027 INFO:tasks.workunit.client.1.smithi165.stdout:0/761: truncate d0/d2a/fca 416479 0 2024-09-16T02:06:00.029 INFO:tasks.workunit.client.0.smithi110.stdout:3/367: dread d8/fb [0,4194304] 0 2024-09-16T02:06:00.030 INFO:tasks.workunit.client.1.smithi165.stdout:1/967: unlink d1/d68/de7/c115 0 2024-09-16T02:06:00.032 INFO:tasks.workunit.client.1.smithi165.stdout:7/861: dwrite d0/df/d83/f9c [0,4194304] 0 2024-09-16T02:06:00.032 INFO:tasks.workunit.client.0.smithi110.stdout:3/368: creat d8/dc/d1b/d3a/f85 x:0 0 0 2024-09-16T02:06:00.033 INFO:tasks.workunit.client.0.smithi110.stdout:3/369: dread - d8/f51 zero size 2024-09-16T02:06:00.035 INFO:tasks.workunit.client.1.smithi165.stdout:6/848: mkdir d7/d17/d75/d97/dcb/d74/db7/df1 0 2024-09-16T02:06:00.036 INFO:tasks.workunit.client.1.smithi165.stdout:3/915: rename da/d20/f3b to da/d20/d26/d8c/f139 0 2024-09-16T02:06:00.038 INFO:tasks.workunit.client.1.smithi165.stdout:1/968: unlink d1/dd/d11/d33/d92/da3/d128/l12b 0 2024-09-16T02:06:00.038 INFO:tasks.workunit.client.1.smithi165.stdout:0/762: dread d0/d1e/f57 [0,4194304] 0 2024-09-16T02:06:00.039 INFO:tasks.workunit.client.0.smithi110.stdout:3/370: symlink d8/l86 0 2024-09-16T02:06:00.039 INFO:tasks.workunit.client.1.smithi165.stdout:9/891: sync 2024-09-16T02:06:00.039 INFO:tasks.workunit.client.1.smithi165.stdout:2/878: sync 2024-09-16T02:06:00.041 INFO:tasks.workunit.client.1.smithi165.stdout:7/862: rename d0/df/d83/f9c to d0/d2c/d85/f118 0 2024-09-16T02:06:00.041 INFO:tasks.workunit.client.1.smithi165.stdout:7/863: chown d0/d2c/d85/l109 200781 1 2024-09-16T02:06:00.043 INFO:tasks.workunit.client.1.smithi165.stdout:1/969: symlink d1/d19/d4d/l130 0 2024-09-16T02:06:00.045 INFO:tasks.workunit.client.0.smithi110.stdout:3/371: mkdir d8/d48/d7c/d87 0 2024-09-16T02:06:00.046 INFO:tasks.workunit.client.0.smithi110.stdout:3/372: chown d8/dc/d1b/d3a/d43 30782 1 2024-09-16T02:06:00.046 INFO:tasks.workunit.client.1.smithi165.stdout:2/879: mkdir df/d10/d1a/d2d/dd1/d109 0 2024-09-16T02:06:00.046 INFO:tasks.workunit.client.0.smithi110.stdout:3/373: readlink d8/dc/d1b/d3a/d43/d58/l65 0 2024-09-16T02:06:00.048 INFO:tasks.workunit.client.0.smithi110.stdout:3/374: mkdir d8/d48/d5b/d6a/d75/d88 0 2024-09-16T02:06:00.049 INFO:tasks.workunit.client.0.smithi110.stdout:3/375: write d8/f79 [831655,16957] 0 2024-09-16T02:06:00.050 INFO:tasks.workunit.client.1.smithi165.stdout:1/970: truncate d1/f79 3798780 0 2024-09-16T02:06:00.051 INFO:tasks.workunit.client.0.smithi110.stdout:3/376: dread - d8/f2a zero size 2024-09-16T02:06:00.052 INFO:tasks.workunit.client.1.smithi165.stdout:7/864: getdents d0/d4b 0 2024-09-16T02:06:00.052 INFO:tasks.workunit.client.0.smithi110.stdout:3/377: readlink d8/dc/d1b/d36/d3b/l78 0 2024-09-16T02:06:00.053 INFO:tasks.workunit.client.1.smithi165.stdout:3/916: dwrite da/d17/d7a/dab/f116 [0,4194304] 0 2024-09-16T02:06:00.053 INFO:tasks.workunit.client.1.smithi165.stdout:7/865: fsync d0/d4b/db4/dda/fe5 0 2024-09-16T02:06:00.055 INFO:tasks.workunit.client.1.smithi165.stdout:7/866: fsync d0/f12 0 2024-09-16T02:06:00.057 INFO:tasks.workunit.client.0.smithi110.stdout:3/378: getdents d8/d48 0 2024-09-16T02:06:00.058 INFO:tasks.workunit.client.1.smithi165.stdout:1/971: creat d1/dd/d11/d33/d67/dcc/f131 x:0 0 0 2024-09-16T02:06:00.058 INFO:tasks.workunit.client.0.smithi110.stdout:3/379: dread - d8/dc/d1b/d3a/d43/f67 zero size 2024-09-16T02:06:00.059 INFO:tasks.workunit.client.1.smithi165.stdout:1/972: chown d1/dd/d11/d33/d92/fc6 2214 1 2024-09-16T02:06:00.059 INFO:tasks.workunit.client.0.smithi110.stdout:2/365: write d0/db/d33/f6c [487465,15485] 0 2024-09-16T02:06:00.059 INFO:tasks.workunit.client.1.smithi165.stdout:3/917: truncate da/d17/dcc/f24 2977821 0 2024-09-16T02:06:00.061 INFO:tasks.workunit.client.1.smithi165.stdout:3/918: stat da/d17/de5/d104/d2c/d2d/d6c/fe1 0 2024-09-16T02:06:00.061 INFO:tasks.workunit.client.0.smithi110.stdout:3/380: mknod d8/d48/c89 0 2024-09-16T02:06:00.062 INFO:tasks.workunit.client.1.smithi165.stdout:1/973: unlink d1/dd/d11/d46/c7f 0 2024-09-16T02:06:00.063 INFO:tasks.workunit.client.0.smithi110.stdout:3/381: fdatasync d8/dc/d1b/d3a/d43/f4e 0 2024-09-16T02:06:00.063 INFO:tasks.workunit.client.1.smithi165.stdout:2/880: dread df/d10/d1a/d2d/f78 [0,4194304] 0 2024-09-16T02:06:00.063 INFO:tasks.workunit.client.0.smithi110.stdout:3/382: chown d8/dc/d1b/f60 2183 1 2024-09-16T02:06:00.064 INFO:tasks.workunit.client.1.smithi165.stdout:8/884: write dd/d11/d14/d70/d7b/ffe [754695,95731] 0 2024-09-16T02:06:00.065 INFO:tasks.workunit.client.1.smithi165.stdout:1/974: write d1/dd/d11/fe8 [1083185,30934] 0 2024-09-16T02:06:00.065 INFO:tasks.workunit.client.1.smithi165.stdout:0/763: dread d0/d1e/d39/d48/d74/f7b [0,4194304] 0 2024-09-16T02:06:00.065 INFO:tasks.workunit.client.1.smithi165.stdout:7/867: unlink d0/df/d33/d2a/caa 0 2024-09-16T02:06:00.066 INFO:tasks.workunit.client.1.smithi165.stdout:8/885: readlink dd/d11/d14/d70/d7b/l8c 0 2024-09-16T02:06:00.070 INFO:tasks.workunit.client.0.smithi110.stdout:3/383: rename d8/f39 to d8/dc/d1b/d36/d3b/f8a 0 2024-09-16T02:06:00.072 INFO:tasks.workunit.client.1.smithi165.stdout:4/767: write d4/dc/d20/d4e/f54 [3841303,125233] 0 2024-09-16T02:06:00.073 INFO:tasks.workunit.client.0.smithi110.stdout:2/366: link d0/da/d18/dc/f1c d0/db/d33/d70/f76 0 2024-09-16T02:06:00.074 INFO:tasks.workunit.client.0.smithi110.stdout:3/384: read d8/dc/d1b/d3a/f50 [14137,107825] 0 2024-09-16T02:06:00.074 INFO:tasks.workunit.client.1.smithi165.stdout:2/881: write df/d23/f6e [6849548,28538] 0 2024-09-16T02:06:00.078 INFO:tasks.workunit.client.0.smithi110.stdout:2/367: dread d0/db/d33/d70/f5d [0,4194304] 0 2024-09-16T02:06:00.082 INFO:tasks.workunit.client.0.smithi110.stdout:2/368: rmdir d0/db/d47 39 2024-09-16T02:06:00.085 INFO:tasks.workunit.client.1.smithi165.stdout:4/768: symlink d4/dc/d20/dc4/lfc 0 2024-09-16T02:06:00.085 INFO:tasks.workunit.client.1.smithi165.stdout:0/764: mknod d0/d1e/cfd 0 2024-09-16T02:06:00.086 INFO:tasks.workunit.client.0.smithi110.stdout:2/369: write d0/db/d33/d70/f5a [3428843,34466] 0 2024-09-16T02:06:00.086 INFO:tasks.workunit.client.1.smithi165.stdout:1/975: dwrite d1/dd/d11/d33/d67/dcc/f114 [0,4194304] 0 2024-09-16T02:06:00.086 INFO:tasks.workunit.client.1.smithi165.stdout:7/868: creat d0/d2c/dc8/d103/de9/f119 x:0 0 0 2024-09-16T02:06:00.087 INFO:tasks.workunit.client.0.smithi110.stdout:2/370: write d0/db/d33/d70/d41/f54 [289841,25142] 0 2024-09-16T02:06:00.093 INFO:tasks.workunit.client.1.smithi165.stdout:9/892: dwrite d7/df/d67/d92/d93/f96 [0,4194304] 0 2024-09-16T02:06:00.095 INFO:tasks.workunit.client.1.smithi165.stdout:5/876: sync 2024-09-16T02:06:00.096 INFO:tasks.workunit.client.1.smithi165.stdout:7/869: dwrite d0/df/d33/dc2/ff5 [0,4194304] 0 2024-09-16T02:06:00.097 INFO:tasks.workunit.client.1.smithi165.stdout:1/976: dwrite d1/dd/d11/d33/d3f/d6c/fbd [0,4194304] 0 2024-09-16T02:06:00.102 INFO:tasks.workunit.client.0.smithi110.stdout:2/371: truncate d0/da/f2c 538007 0 2024-09-16T02:06:00.105 INFO:tasks.workunit.client.0.smithi110.stdout:3/385: readlink d8/d48/l54 0 2024-09-16T02:06:00.106 INFO:tasks.workunit.client.1.smithi165.stdout:3/919: write da/d17/de5/d104/d2c/d10c/f124 [26092,26445] 0 2024-09-16T02:06:00.112 INFO:tasks.workunit.client.0.smithi110.stdout:2/372: unlink d0/da/d18/l11 0 2024-09-16T02:06:00.114 INFO:tasks.workunit.client.0.smithi110.stdout:2/373: chown d0/da/d18/dc/f57 173687991 1 2024-09-16T02:06:00.115 INFO:tasks.workunit.client.0.smithi110.stdout:2/374: write d0/db/d33/d70/f42 [1004891,54303] 0 2024-09-16T02:06:00.118 INFO:tasks.workunit.client.0.smithi110.stdout:3/386: unlink d8/f17 0 2024-09-16T02:06:00.119 INFO:tasks.workunit.client.0.smithi110.stdout:3/387: dread - d8/dc/f2b zero size 2024-09-16T02:06:00.120 INFO:tasks.workunit.client.1.smithi165.stdout:8/886: dwrite dd/d11/d14/d3f/d25/d36/d4f/f98 [0,4194304] 0 2024-09-16T02:06:00.123 INFO:tasks.workunit.client.0.smithi110.stdout:3/388: dread - d8/d48/d5b/f63 zero size 2024-09-16T02:06:00.125 INFO:tasks.workunit.client.0.smithi110.stdout:2/375: dwrite d0/db/d33/d70/f66 [0,4194304] 0 2024-09-16T02:06:00.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/389: mkdir d8/d48/d5b/d6a/d75/d8b 0 2024-09-16T02:06:00.134 INFO:tasks.workunit.client.0.smithi110.stdout:2/376: rmdir d0/db/d33 39 2024-09-16T02:06:00.137 INFO:tasks.workunit.client.0.smithi110.stdout:3/390: rename d8/dc/l2f to d8/d29/l8c 0 2024-09-16T02:06:00.139 INFO:tasks.workunit.client.0.smithi110.stdout:3/391: write d8/dc/d1b/f31 [3406746,4497] 0 2024-09-16T02:06:00.144 INFO:tasks.workunit.client.0.smithi110.stdout:2/377: readlink d0/db/d33/d70/l71 0 2024-09-16T02:06:00.147 INFO:tasks.workunit.client.0.smithi110.stdout:2/378: rmdir d0/db/d33 39 2024-09-16T02:06:00.148 INFO:tasks.workunit.client.0.smithi110.stdout:3/392: creat d8/d48/d5b/d6a/d75/d8b/f8d x:0 0 0 2024-09-16T02:06:00.149 INFO:tasks.workunit.client.0.smithi110.stdout:3/393: truncate d8/d29/f41 1502027 0 2024-09-16T02:06:00.151 INFO:tasks.workunit.client.0.smithi110.stdout:3/394: write d8/dc/d1b/d36/f40 [116742,10186] 0 2024-09-16T02:06:00.152 INFO:tasks.workunit.client.0.smithi110.stdout:2/379: symlink d0/db/d33/d70/d39/l77 0 2024-09-16T02:06:00.157 INFO:tasks.workunit.client.0.smithi110.stdout:2/380: mknod d0/db/d33/d70/d58/c78 0 2024-09-16T02:06:00.162 INFO:tasks.workunit.client.1.smithi165.stdout:2/882: symlink df/d23/d28/dfa/l10a 0 2024-09-16T02:06:00.163 INFO:tasks.workunit.client.1.smithi165.stdout:0/765: readlink d0/l5 0 2024-09-16T02:06:00.166 INFO:tasks.workunit.client.1.smithi165.stdout:5/877: creat de/d21/d26/d3a/d6d/de2/f11e x:0 0 0 2024-09-16T02:06:00.168 INFO:tasks.workunit.client.1.smithi165.stdout:1/977: rename d1/d19/d4d/fab to d1/dd/d11/d33/dfa/f132 0 2024-09-16T02:06:00.169 INFO:tasks.workunit.client.1.smithi165.stdout:1/978: read - d1/d68/dca/fec zero size 2024-09-16T02:06:00.170 INFO:tasks.workunit.client.1.smithi165.stdout:3/920: mkdir da/d17/de5/d104/d2c/de8/d13a 0 2024-09-16T02:06:00.171 INFO:tasks.workunit.client.1.smithi165.stdout:3/921: chown da/d17/de5/d104/d2c/f4e 218 1 2024-09-16T02:06:00.172 INFO:tasks.workunit.client.1.smithi165.stdout:8/887: chown dd/d11/d38/da6/c12e 203356434 1 2024-09-16T02:06:00.174 INFO:tasks.workunit.client.1.smithi165.stdout:4/769: creat d4/dc/d18/d37/dc9/df2/ffd x:0 0 0 2024-09-16T02:06:00.175 INFO:tasks.workunit.client.1.smithi165.stdout:6/849: sync 2024-09-16T02:06:00.175 INFO:tasks.workunit.client.1.smithi165.stdout:0/766: readlink d0/d1e/l9f 0 2024-09-16T02:06:00.176 INFO:tasks.workunit.client.1.smithi165.stdout:4/770: dread d4/dc/fdf [0,4194304] 0 2024-09-16T02:06:00.177 INFO:tasks.workunit.client.1.smithi165.stdout:7/870: link d0/df/d83/fe8 d0/df/dfd/f11a 0 2024-09-16T02:06:00.178 INFO:tasks.workunit.client.0.smithi110.stdout:2/381: dwrite d0/db/f36 [0,4194304] 0 2024-09-16T02:06:00.179 INFO:tasks.workunit.client.0.smithi110.stdout:2/382: chown d0/f49 16149079 1 2024-09-16T02:06:00.180 INFO:tasks.workunit.client.1.smithi165.stdout:1/979: rename d1/dd/d11/d46/f70 to d1/dd/d11/d33/d92/da3/f133 0 2024-09-16T02:06:00.180 INFO:tasks.workunit.client.1.smithi165.stdout:8/888: dwrite dd/d11/d38/da6/db0/fbf [0,4194304] 0 2024-09-16T02:06:00.183 INFO:tasks.workunit.client.1.smithi165.stdout:4/771: dread d4/dc/d28/d2b/d42/f87 [0,4194304] 0 2024-09-16T02:06:00.185 INFO:tasks.workunit.client.0.smithi110.stdout:2/383: mknod d0/db/c79 0 2024-09-16T02:06:00.187 INFO:tasks.workunit.client.0.smithi110.stdout:2/384: creat d0/db/d33/d46/f7a x:0 0 0 2024-09-16T02:06:00.191 INFO:tasks.workunit.client.0.smithi110.stdout:2/385: mkdir d0/db/d33/d70/d39/d7b 0 2024-09-16T02:06:00.195 INFO:tasks.workunit.client.1.smithi165.stdout:0/767: read d0/d1e/d39/d48/d45/db3/fe2 [3034917,50191] 0 2024-09-16T02:06:00.196 INFO:tasks.workunit.client.1.smithi165.stdout:6/850: dwrite d7/dc/d7f/dd2/f59 [0,4194304] 0 2024-09-16T02:06:00.196 INFO:tasks.workunit.client.1.smithi165.stdout:1/980: symlink d1/dd/d11/d33/d3f/d47/d7d/db3/de0/l134 0 2024-09-16T02:06:00.197 INFO:tasks.workunit.client.1.smithi165.stdout:0/768: stat d0/d1e/d39/d99/fbd 0 2024-09-16T02:06:00.198 INFO:tasks.workunit.client.1.smithi165.stdout:2/883: symlink df/d10/d1a/d68/db9/l10b 0 2024-09-16T02:06:00.199 INFO:tasks.workunit.client.1.smithi165.stdout:3/922: dread da/d17/de5/d104/d2c/d2d/d6c/fe1 [0,4194304] 0 2024-09-16T02:06:00.200 INFO:tasks.workunit.client.1.smithi165.stdout:7/871: unlink d0/df/d65/ca9 0 2024-09-16T02:06:00.201 INFO:tasks.workunit.client.1.smithi165.stdout:5/878: rmdir de/d21/d26/d94/ddf 0 2024-09-16T02:06:00.203 INFO:tasks.workunit.client.1.smithi165.stdout:1/981: rename d1/dd/d11/d33/d3f/l101 to d1/d68/de7/l135 0 2024-09-16T02:06:00.205 INFO:tasks.workunit.client.1.smithi165.stdout:5/879: mkdir de/d21/d26/d11a/d11f 0 2024-09-16T02:06:00.206 INFO:tasks.workunit.client.1.smithi165.stdout:9/893: sync 2024-09-16T02:06:00.206 INFO:tasks.workunit.client.1.smithi165.stdout:5/880: chown de/d19/d1c/d84/fe9 15205333 1 2024-09-16T02:06:00.208 INFO:tasks.workunit.client.1.smithi165.stdout:1/982: dread d1/d6b/df6/f34 [4194304,4194304] 0 2024-09-16T02:06:00.209 INFO:tasks.workunit.client.1.smithi165.stdout:1/983: chown d1/dd/d11/d33/d3f/d6c/l8f 2369496 1 2024-09-16T02:06:00.210 INFO:tasks.workunit.client.1.smithi165.stdout:2/884: symlink df/d10/d1a/d68/l10c 0 2024-09-16T02:06:00.212 INFO:tasks.workunit.client.0.smithi110.stdout:2/386: write d0/db/f27 [2814921,69573] 0 2024-09-16T02:06:00.213 INFO:tasks.workunit.client.1.smithi165.stdout:9/894: unlink d7/df/d37/d65/fed 0 2024-09-16T02:06:00.214 INFO:tasks.workunit.client.1.smithi165.stdout:6/851: rmdir d7/d17/d75/d97/dcb/d74/db7/df1 0 2024-09-16T02:06:00.216 INFO:tasks.workunit.client.1.smithi165.stdout:1/984: creat d1/dd/d11/d33/d3f/d6c/f136 x:0 0 0 2024-09-16T02:06:00.217 INFO:tasks.workunit.client.1.smithi165.stdout:8/889: dwrite dd/d11/d38/f45 [0,4194304] 0 2024-09-16T02:06:00.218 INFO:tasks.workunit.client.0.smithi110.stdout:2/387: dwrite d0/da/d18/d25/d3b/f43 [0,4194304] 0 2024-09-16T02:06:00.220 INFO:tasks.workunit.client.1.smithi165.stdout:2/885: truncate df/d23/d66/faa 194703 0 2024-09-16T02:06:00.221 INFO:tasks.workunit.client.1.smithi165.stdout:9/895: creat d7/d32/d38/d53/d5c/f120 x:0 0 0 2024-09-16T02:06:00.222 INFO:tasks.workunit.client.1.smithi165.stdout:7/872: getdents d0/d3d/d9f/ddc/dcb 0 2024-09-16T02:06:00.222 INFO:tasks.workunit.client.1.smithi165.stdout:2/886: chown df/fc5 203842 1 2024-09-16T02:06:00.223 INFO:tasks.workunit.client.1.smithi165.stdout:3/923: dread da/d20/d26/f84 [0,4194304] 0 2024-09-16T02:06:00.223 INFO:tasks.workunit.client.1.smithi165.stdout:7/873: chown d0/d4b/db4/dba/fd6 1 1 2024-09-16T02:06:00.223 INFO:tasks.workunit.client.1.smithi165.stdout:6/852: mknod d7/d17/d75/d97/dcb/d74/db7/de0/cf2 0 2024-09-16T02:06:00.224 INFO:tasks.workunit.client.1.smithi165.stdout:1/985: mknod d1/dd/d11/d33/d67/c137 0 2024-09-16T02:06:00.225 INFO:tasks.workunit.client.1.smithi165.stdout:3/924: chown da/d17/d7a/dab/ca1 439792095 1 2024-09-16T02:06:00.225 INFO:tasks.workunit.client.0.smithi110.stdout:2/388: dwrite d0/db/f36 [0,4194304] 0 2024-09-16T02:06:00.226 INFO:tasks.workunit.client.1.smithi165.stdout:6/853: chown d7/d17/d75/d97/lb1 0 1 2024-09-16T02:06:00.226 INFO:tasks.workunit.client.1.smithi165.stdout:7/874: write d0/df/d33/d2a/fb0 [1841768,60057] 0 2024-09-16T02:06:00.227 INFO:tasks.workunit.client.0.smithi110.stdout:2/389: readlink d0/db/l4e 0 2024-09-16T02:06:00.227 INFO:tasks.workunit.client.1.smithi165.stdout:8/890: mknod dd/d11/d38/da6/c134 0 2024-09-16T02:06:00.230 INFO:tasks.workunit.client.1.smithi165.stdout:3/925: write da/d17/de5/d104/d2c/d2d/d6c/dfb/f117 [379098,70428] 0 2024-09-16T02:06:00.231 INFO:tasks.workunit.client.1.smithi165.stdout:9/896: creat d7/d1f/ddb/f121 x:0 0 0 2024-09-16T02:06:00.232 INFO:tasks.workunit.client.1.smithi165.stdout:2/887: unlink df/d23/d28/d3b/f102 0 2024-09-16T02:06:00.233 INFO:tasks.workunit.client.1.smithi165.stdout:4/772: dread d4/dc/d20/d4e/d73/f8e [0,4194304] 0 2024-09-16T02:06:00.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/390: dwrite d0/db/f27 [0,4194304] 0 2024-09-16T02:06:00.235 INFO:tasks.workunit.client.1.smithi165.stdout:1/986: rmdir d1/dd/d11/d33/d3f/d59 39 2024-09-16T02:06:00.235 INFO:tasks.workunit.client.1.smithi165.stdout:0/769: write d0/d1e/d39/d48/d74/ff8 [1223931,50466] 0 2024-09-16T02:06:00.236 INFO:tasks.workunit.client.1.smithi165.stdout:8/891: rmdir dd/d11/daa 39 2024-09-16T02:06:00.238 INFO:tasks.workunit.client.1.smithi165.stdout:6/854: mknod d7/dc/d7f/dd2/d3c/cf3 0 2024-09-16T02:06:00.242 INFO:tasks.workunit.client.1.smithi165.stdout:7/875: unlink d0/d3d/d9f/ddc/da8/ddd/cf8 0 2024-09-16T02:06:00.245 INFO:tasks.workunit.client.1.smithi165.stdout:3/926: fsync da/d17/d7a/f96 0 2024-09-16T02:06:00.245 INFO:tasks.workunit.client.1.smithi165.stdout:2/888: dread df/f90 [0,4194304] 0 2024-09-16T02:06:00.246 INFO:tasks.workunit.client.0.smithi110.stdout:2/391: creat d0/da/f7c x:0 0 0 2024-09-16T02:06:00.246 INFO:tasks.workunit.client.1.smithi165.stdout:5/881: dread de/d21/d26/d9a/fc0 [0,4194304] 0 2024-09-16T02:06:00.247 INFO:tasks.workunit.client.1.smithi165.stdout:4/773: symlink d4/dc/d18/lfe 0 2024-09-16T02:06:00.250 INFO:tasks.workunit.client.1.smithi165.stdout:0/770: chown d0/d1e/d20/d28/f33 14 1 2024-09-16T02:06:00.250 INFO:tasks.workunit.client.1.smithi165.stdout:2/889: truncate df/d23/d28/d3b/fea 431330 0 2024-09-16T02:06:00.251 INFO:tasks.workunit.client.1.smithi165.stdout:5/882: truncate de/d19/d1c/d49/fa3 4757228 0 2024-09-16T02:06:00.251 INFO:tasks.workunit.client.1.smithi165.stdout:2/890: fdatasync df/fba 0 2024-09-16T02:06:00.252 INFO:tasks.workunit.client.1.smithi165.stdout:5/883: chown de/d60/dbc/df3 1045659222 1 2024-09-16T02:06:00.252 INFO:tasks.workunit.client.0.smithi110.stdout:2/392: mknod d0/da/d18/c7d 0 2024-09-16T02:06:00.255 INFO:tasks.workunit.client.1.smithi165.stdout:7/876: rename d0/d4b/db4/dda/c116 to d0/d2c/dc8/d103/c11b 0 2024-09-16T02:06:00.256 INFO:tasks.workunit.client.0.smithi110.stdout:2/393: dread d0/db/d33/d70/d41/f54 [0,4194304] 0 2024-09-16T02:06:00.257 INFO:tasks.workunit.client.1.smithi165.stdout:0/771: dread d0/d1e/d39/d48/d74/f7b [0,4194304] 0 2024-09-16T02:06:00.258 INFO:tasks.workunit.client.1.smithi165.stdout:2/891: dwrite df/d23/f6e [4194304,4194304] 0 2024-09-16T02:06:00.260 INFO:tasks.workunit.client.0.smithi110.stdout:2/394: creat d0/db/d33/d70/d41/f7e x:0 0 0 2024-09-16T02:06:00.261 INFO:tasks.workunit.client.1.smithi165.stdout:0/772: chown d0/d1e/d39/d48/d5f/d96/dac/lae 6 1 2024-09-16T02:06:00.263 INFO:tasks.workunit.client.1.smithi165.stdout:3/927: dwrite da/d17/de5/d104/d2c/d2d/d6c/fe1 [0,4194304] 0 2024-09-16T02:06:00.266 INFO:tasks.workunit.client.1.smithi165.stdout:7/877: rmdir d0/d4b/d63 39 2024-09-16T02:06:00.267 INFO:tasks.workunit.client.1.smithi165.stdout:0/773: dwrite d0/d1e/d20/f7f [0,4194304] 0 2024-09-16T02:06:00.268 INFO:tasks.workunit.client.1.smithi165.stdout:4/774: creat d4/dc/d28/de6/fff x:0 0 0 2024-09-16T02:06:00.268 INFO:tasks.workunit.client.0.smithi110.stdout:2/395: dwrite d0/db/f36 [0,4194304] 0 2024-09-16T02:06:00.269 INFO:tasks.workunit.client.1.smithi165.stdout:8/892: creat dd/d11/f135 x:0 0 0 2024-09-16T02:06:00.272 INFO:tasks.workunit.client.1.smithi165.stdout:2/892: mknod df/d10/d37/de7/c10d 0 2024-09-16T02:06:00.272 INFO:tasks.workunit.client.0.smithi110.stdout:2/396: creat d0/da/d18/dc/f7f x:0 0 0 2024-09-16T02:06:00.274 INFO:tasks.workunit.client.1.smithi165.stdout:2/893: chown df/d10/d1a/d2d/dd1 2 1 2024-09-16T02:06:00.279 INFO:tasks.workunit.client.0.smithi110.stdout:2/397: rename d0/da/d18/dc/c1e to d0/db/d47/d48/c80 0 2024-09-16T02:06:00.281 INFO:tasks.workunit.client.0.smithi110.stdout:2/398: chown d0/da/c38 155520 1 2024-09-16T02:06:00.283 INFO:tasks.workunit.client.0.smithi110.stdout:2/399: symlink d0/da/l81 0 2024-09-16T02:06:00.286 INFO:tasks.workunit.client.0.smithi110.stdout:2/400: rename d0/db/d33/d70/d39/f6a to d0/db/d33/d70/d58/f82 0 2024-09-16T02:06:00.291 INFO:tasks.workunit.client.0.smithi110.stdout:2/401: link d0/da/d18/dc/f1c d0/db/f83 0 2024-09-16T02:06:00.294 INFO:tasks.workunit.client.0.smithi110.stdout:2/402: creat d0/da/f84 x:0 0 0 2024-09-16T02:06:00.296 INFO:tasks.workunit.client.0.smithi110.stdout:2/403: unlink d0/d5f/f63 0 2024-09-16T02:06:00.297 INFO:tasks.workunit.client.1.smithi165.stdout:9/897: getdents d7/d32/d38/d68/d7f/d113 0 2024-09-16T02:06:00.297 INFO:tasks.workunit.client.1.smithi165.stdout:5/884: creat de/d19/d1c/d4d/dc1/d107/f120 x:0 0 0 2024-09-16T02:06:00.299 INFO:tasks.workunit.client.1.smithi165.stdout:0/774: symlink d0/d1e/d20/d28/d6d/daf/lfe 0 2024-09-16T02:06:00.299 INFO:tasks.workunit.client.0.smithi110.stdout:2/404: dread d0/da/d18/dc/f1f [0,4194304] 0 2024-09-16T02:06:00.300 INFO:tasks.workunit.client.1.smithi165.stdout:2/894: readlink df/d23/d28/dfa/l10a 0 2024-09-16T02:06:00.302 INFO:tasks.workunit.client.0.smithi110.stdout:2/405: creat d0/db/d33/d70/d41/f85 x:0 0 0 2024-09-16T02:06:00.302 INFO:tasks.workunit.client.1.smithi165.stdout:6/855: getdents d7/d17/d75/d97/dcb/d74 0 2024-09-16T02:06:00.304 INFO:tasks.workunit.client.1.smithi165.stdout:4/775: dwrite d4/d40/d4f/fcd [0,4194304] 0 2024-09-16T02:06:00.304 INFO:tasks.workunit.client.1.smithi165.stdout:5/885: rename fa to de/d21/d26/d9a/f121 0 2024-09-16T02:06:00.307 INFO:tasks.workunit.client.1.smithi165.stdout:9/898: dread d7/d32/d38/d53/d5c/f8d [0,4194304] 0 2024-09-16T02:06:00.309 INFO:tasks.workunit.client.1.smithi165.stdout:8/893: creat dd/d11/d14/f136 x:0 0 0 2024-09-16T02:06:00.311 INFO:tasks.workunit.client.1.smithi165.stdout:7/878: rename d0/df/d7/c39 to d0/d2c/dc8/d103/de9/c11c 0 2024-09-16T02:06:00.312 INFO:tasks.workunit.client.1.smithi165.stdout:9/899: dread d7/d32/d85/d8a/fb2 [0,4194304] 0 2024-09-16T02:06:00.312 INFO:tasks.workunit.client.1.smithi165.stdout:5/886: mkdir de/d21/d26/d3a/d6d/d122 0 2024-09-16T02:06:00.313 INFO:tasks.workunit.client.1.smithi165.stdout:5/887: chown de/d19/d1c/f3e 147957 1 2024-09-16T02:06:00.315 INFO:tasks.workunit.client.0.smithi110.stdout:2/406: truncate d0/da/d18/d25/d3b/f53 384989 0 2024-09-16T02:06:00.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/900: write d7/df/d67/d92/d93/f98 [1406300,15088] 0 2024-09-16T02:06:00.316 INFO:tasks.workunit.client.1.smithi165.stdout:2/895: truncate df/d23/d28/f32 2252320 0 2024-09-16T02:06:00.317 INFO:tasks.workunit.client.0.smithi110.stdout:2/407: creat d0/db/d33/d70/d39/f86 x:0 0 0 2024-09-16T02:06:00.319 INFO:tasks.workunit.client.1.smithi165.stdout:5/888: write de/d21/d26/d3a/f5a [2351596,59030] 0 2024-09-16T02:06:00.319 INFO:tasks.workunit.client.0.smithi110.stdout:2/408: mkdir d0/db/d33/d70/d39/d87 0 2024-09-16T02:06:00.320 INFO:tasks.workunit.client.1.smithi165.stdout:2/896: fsync df/dbb/ff9 0 2024-09-16T02:06:00.320 INFO:tasks.workunit.client.0.smithi110.stdout:2/409: rename d0/db/d33 to d0/db/d33/d70/d41/d88 22 2024-09-16T02:06:00.323 INFO:tasks.workunit.client.1.smithi165.stdout:8/894: dwrite dd/d11/d14/d3f/d25/d36/d81/dd2/d89/fce [0,4194304] 0 2024-09-16T02:06:00.323 INFO:tasks.workunit.client.1.smithi165.stdout:0/775: getdents d0/d1e/d20/d28/d6d/daf/dc0 0 2024-09-16T02:06:00.324 INFO:tasks.workunit.client.0.smithi110.stdout:2/410: creat d0/da/d18/d25/f89 x:0 0 0 2024-09-16T02:06:00.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/901: dread d7/d14/d7a/f101 [0,4194304] 0 2024-09-16T02:06:00.327 INFO:tasks.workunit.client.1.smithi165.stdout:0/776: readlink d0/d1e/d39/d48/d5f/l66 0 2024-09-16T02:06:00.328 INFO:tasks.workunit.client.1.smithi165.stdout:8/895: chown dd/d11/d14/d70/d7b/d9a/f115 123115451 1 2024-09-16T02:06:00.329 INFO:tasks.workunit.client.1.smithi165.stdout:7/879: symlink d0/d4b/db4/dba/l11d 0 2024-09-16T02:06:00.332 INFO:tasks.workunit.client.1.smithi165.stdout:2/897: creat df/d23/d28/dfa/db1/f10e x:0 0 0 2024-09-16T02:06:00.332 INFO:tasks.workunit.client.1.smithi165.stdout:1/987: sync 2024-09-16T02:06:00.333 INFO:tasks.workunit.client.1.smithi165.stdout:5/889: dread de/d19/fc5 [0,4194304] 0 2024-09-16T02:06:00.333 INFO:tasks.workunit.client.1.smithi165.stdout:6/856: dread d7/dc/df/d1a/fbb [0,4194304] 0 2024-09-16T02:06:00.333 INFO:tasks.workunit.client.1.smithi165.stdout:4/776: dwrite d4/dc/d18/d37/d53/d64/d8b/f8a [0,4194304] 0 2024-09-16T02:06:00.338 INFO:tasks.workunit.client.1.smithi165.stdout:7/880: creat d0/d3d/d9f/ddc/da8/f11e x:0 0 0 2024-09-16T02:06:00.338 INFO:tasks.workunit.client.1.smithi165.stdout:1/988: chown d1/dd/d11/d46/f124 467 1 2024-09-16T02:06:00.342 INFO:tasks.workunit.client.1.smithi165.stdout:8/896: write dd/d11/d14/d70/d7b/d9a/fd6 [1448750,32871] 0 2024-09-16T02:06:00.343 INFO:tasks.workunit.client.1.smithi165.stdout:0/777: dread d0/d1e/d39/d48/d45/f37 [0,4194304] 0 2024-09-16T02:06:00.343 INFO:tasks.workunit.client.1.smithi165.stdout:6/857: mknod d7/d1f/cf4 0 2024-09-16T02:06:00.348 INFO:tasks.workunit.client.1.smithi165.stdout:7/881: rename d0/l98 to d0/d2c/l11f 0 2024-09-16T02:06:00.351 INFO:tasks.workunit.client.1.smithi165.stdout:6/858: creat d7/d17/d75/d97/dcb/d3d/dd0/ff5 x:0 0 0 2024-09-16T02:06:00.353 INFO:tasks.workunit.client.1.smithi165.stdout:4/777: dwrite d4/dc/dea/ff3 [0,4194304] 0 2024-09-16T02:06:00.353 INFO:tasks.workunit.client.1.smithi165.stdout:0/778: creat d0/d1e/d39/d48/d5f/d96/fff x:0 0 0 2024-09-16T02:06:00.354 INFO:tasks.workunit.client.1.smithi165.stdout:7/882: mknod d0/d4b/db4/dfa/c120 0 2024-09-16T02:06:00.356 INFO:tasks.workunit.client.1.smithi165.stdout:1/989: dread d1/d19/f11f [0,4194304] 0 2024-09-16T02:06:00.357 INFO:tasks.workunit.client.1.smithi165.stdout:6/859: chown d7/dc/d7f/dd2/l60 1660 1 2024-09-16T02:06:00.362 INFO:tasks.workunit.client.1.smithi165.stdout:5/890: dwrite de/fa4 [0,4194304] 0 2024-09-16T02:06:00.362 INFO:tasks.workunit.client.1.smithi165.stdout:6/860: chown d7/d1f/c9d 862270380 1 2024-09-16T02:06:00.368 INFO:tasks.workunit.client.1.smithi165.stdout:7/883: mknod d0/d4b/db4/c121 0 2024-09-16T02:06:00.369 INFO:tasks.workunit.client.1.smithi165.stdout:8/897: dwrite dd/d11/d14/d70/d7b/d9a/fcc [0,4194304] 0 2024-09-16T02:06:00.369 INFO:tasks.workunit.client.1.smithi165.stdout:0/779: creat d0/d1e/d20/f100 x:0 0 0 2024-09-16T02:06:00.374 INFO:tasks.workunit.client.1.smithi165.stdout:2/898: dread df/d10/d1a/f27 [0,4194304] 0 2024-09-16T02:06:00.378 INFO:tasks.workunit.client.1.smithi165.stdout:5/891: getdents de/d19/d1c/d49 0 2024-09-16T02:06:00.380 INFO:tasks.workunit.client.1.smithi165.stdout:0/780: symlink d0/d1e/d39/d48/d6e/l101 0 2024-09-16T02:06:00.382 INFO:tasks.workunit.client.1.smithi165.stdout:4/778: dwrite d4/dc/d20/d67/feb [0,4194304] 0 2024-09-16T02:06:00.384 INFO:tasks.workunit.client.1.smithi165.stdout:1/990: dwrite d1/d19/d24/d30/d72/f91 [0,4194304] 0 2024-09-16T02:06:00.384 INFO:tasks.workunit.client.1.smithi165.stdout:2/899: write df/d10/d1a/d2d/fbe [463005,84572] 0 2024-09-16T02:06:00.387 INFO:tasks.workunit.client.1.smithi165.stdout:2/900: stat df/d10/d1a/d2d/f78 0 2024-09-16T02:06:00.390 INFO:tasks.workunit.client.1.smithi165.stdout:7/884: rename d0/d2c/d85/ceb to d0/d3d/c122 0 2024-09-16T02:06:00.390 INFO:tasks.workunit.client.1.smithi165.stdout:2/901: fdatasync df/fc5 0 2024-09-16T02:06:00.393 INFO:tasks.workunit.client.1.smithi165.stdout:5/892: readlink de/d19/d67/db9/dd6/l106 0 2024-09-16T02:06:00.393 INFO:tasks.workunit.client.1.smithi165.stdout:1/991: creat d1/d19/d4d/d84/f138 x:0 0 0 2024-09-16T02:06:00.396 INFO:tasks.workunit.client.1.smithi165.stdout:2/902: write df/d10/d1a/fd3 [1078682,22897] 0 2024-09-16T02:06:00.398 INFO:tasks.workunit.client.1.smithi165.stdout:1/992: mknod d1/d68/dca/c139 0 2024-09-16T02:06:00.399 INFO:tasks.workunit.client.1.smithi165.stdout:5/893: creat de/d21/d26/f123 x:0 0 0 2024-09-16T02:06:00.401 INFO:tasks.workunit.client.1.smithi165.stdout:0/781: dwrite d0/d1e/d39/d48/d45/f37 [0,4194304] 0 2024-09-16T02:06:00.405 INFO:tasks.workunit.client.1.smithi165.stdout:5/894: creat de/d21/d26/d3a/d6d/f124 x:0 0 0 2024-09-16T02:06:00.407 INFO:tasks.workunit.client.1.smithi165.stdout:5/895: chown de/d19/d1c/d84/daa 23197251 1 2024-09-16T02:06:00.409 INFO:tasks.workunit.client.1.smithi165.stdout:3/928: sync 2024-09-16T02:06:00.410 INFO:tasks.workunit.client.1.smithi165.stdout:6/861: dread d7/d17/d75/d97/dcb/d3d/ddd/f89 [0,4194304] 0 2024-09-16T02:06:00.416 INFO:tasks.workunit.client.1.smithi165.stdout:6/862: creat d7/dc/df/d1a/d4d/ff6 x:0 0 0 2024-09-16T02:06:00.416 INFO:tasks.workunit.client.1.smithi165.stdout:4/779: write d4/dc/d28/d2b/f74 [3160764,115235] 0 2024-09-16T02:06:00.419 INFO:tasks.workunit.client.1.smithi165.stdout:4/780: dread d4/d40/faf [0,4194304] 0 2024-09-16T02:06:00.420 INFO:tasks.workunit.client.1.smithi165.stdout:3/929: dread da/d17/dcc/f77 [0,4194304] 0 2024-09-16T02:06:00.421 INFO:tasks.workunit.client.1.smithi165.stdout:8/898: dread dd/d11/d14/d3f/d72/f87 [0,4194304] 0 2024-09-16T02:06:00.422 INFO:tasks.workunit.client.1.smithi165.stdout:6/863: rename f2 to d7/d17/d75/ff7 0 2024-09-16T02:06:00.422 INFO:tasks.workunit.client.1.smithi165.stdout:3/930: readlink da/d17/de5/d104/d2c/d10c/d9c/da6/l11f 0 2024-09-16T02:06:00.424 INFO:tasks.workunit.client.1.smithi165.stdout:8/899: chown dd/d11/d14/d3f/l10e 55 1 2024-09-16T02:06:00.425 INFO:tasks.workunit.client.1.smithi165.stdout:6/864: write d7/d17/d75/d97/fdb [220521,79678] 0 2024-09-16T02:06:00.426 INFO:tasks.workunit.client.1.smithi165.stdout:0/782: write d0/d2a/d70/f84 [3161129,10463] 0 2024-09-16T02:06:00.426 INFO:tasks.workunit.client.1.smithi165.stdout:3/931: truncate da/d57/f7c 28790 0 2024-09-16T02:06:00.430 INFO:tasks.workunit.client.1.smithi165.stdout:6/865: fdatasync d7/dc/d7f/fed 0 2024-09-16T02:06:00.431 INFO:tasks.workunit.client.1.smithi165.stdout:9/902: sync 2024-09-16T02:06:00.432 INFO:tasks.workunit.client.1.smithi165.stdout:8/900: mkdir dd/d11/d14/d3f/d25/d36/d81/d137 0 2024-09-16T02:06:00.435 INFO:tasks.workunit.client.1.smithi165.stdout:0/783: symlink d0/d1e/d39/l102 0 2024-09-16T02:06:00.440 INFO:tasks.workunit.client.1.smithi165.stdout:3/932: write da/d20/d26/f2a [738771,30975] 0 2024-09-16T02:06:00.450 INFO:tasks.workunit.client.1.smithi165.stdout:7/885: dwrite d0/d3d/d9f/ddc/da8/ddd/fe4 [0,4194304] 0 2024-09-16T02:06:00.452 INFO:tasks.workunit.client.1.smithi165.stdout:4/781: dwrite d4/dc/d28/d3b/ffa [0,4194304] 0 2024-09-16T02:06:00.452 INFO:tasks.workunit.client.1.smithi165.stdout:2/903: dwrite df/d10/d37/f3d [0,4194304] 0 2024-09-16T02:06:00.452 INFO:tasks.workunit.client.1.smithi165.stdout:6/866: mknod d7/d17/d75/d97/dcb/d3d/cf8 0 2024-09-16T02:06:00.452 INFO:tasks.workunit.client.1.smithi165.stdout:5/896: dwrite de/f1d [0,4194304] 0 2024-09-16T02:06:00.455 INFO:tasks.workunit.client.1.smithi165.stdout:1/993: dwrite d1/d68/f64 [0,4194304] 0 2024-09-16T02:06:00.459 INFO:tasks.workunit.client.1.smithi165.stdout:8/901: truncate dd/d11/d14/d3f/f6a 5056835 0 2024-09-16T02:06:00.460 INFO:tasks.workunit.client.1.smithi165.stdout:0/784: write d0/d1e/d39/d48/d74/dc6/fd4 [3843386,57372] 0 2024-09-16T02:06:00.465 INFO:tasks.workunit.client.1.smithi165.stdout:2/904: write df/d10/db4/fee [5534852,39219] 0 2024-09-16T02:06:00.467 INFO:tasks.workunit.client.1.smithi165.stdout:8/902: write dd/d11/d14/d3f/d25/d36/d4f/f11d [454004,83459] 0 2024-09-16T02:06:00.468 INFO:tasks.workunit.client.1.smithi165.stdout:1/994: symlink d1/dd/d11/d33/d3f/d47/d7d/db3/l13a 0 2024-09-16T02:06:00.468 INFO:tasks.workunit.client.1.smithi165.stdout:5/897: mknod de/d21/d26/d3a/d54/c125 0 2024-09-16T02:06:00.470 INFO:tasks.workunit.client.1.smithi165.stdout:9/903: dwrite d7/d32/d38/f77 [0,4194304] 0 2024-09-16T02:06:00.470 INFO:tasks.workunit.client.1.smithi165.stdout:8/903: stat dd/d11/d38/da6/cee 0 2024-09-16T02:06:00.474 INFO:tasks.workunit.client.1.smithi165.stdout:1/995: write d1/dd/d11/d33/d3f/fc8 [194361,95156] 0 2024-09-16T02:06:00.475 INFO:tasks.workunit.client.1.smithi165.stdout:9/904: stat d7/df/d67/d92/d93/fa0 0 2024-09-16T02:06:00.478 INFO:tasks.workunit.client.1.smithi165.stdout:9/905: chown d7/df/d37/d65/f103 63490 1 2024-09-16T02:06:00.478 INFO:tasks.workunit.client.1.smithi165.stdout:4/782: dwrite d4/dc/dea/ff3 [4194304,4194304] 0 2024-09-16T02:06:00.481 INFO:tasks.workunit.client.1.smithi165.stdout:1/996: write d1/d22/f10b [1342586,16221] 0 2024-09-16T02:06:00.481 INFO:tasks.workunit.client.1.smithi165.stdout:4/783: readlink d4/dc/d20/d4e/lb3 0 2024-09-16T02:06:00.482 INFO:tasks.workunit.client.1.smithi165.stdout:3/933: dread da/d17/dcc/f24 [0,4194304] 0 2024-09-16T02:06:00.483 INFO:tasks.workunit.client.1.smithi165.stdout:8/904: rename dd/d11/d14/d3f/d25/d36/d81/dd2/d89/l116 to dd/d11/de4/l138 0 2024-09-16T02:06:00.485 INFO:tasks.workunit.client.1.smithi165.stdout:4/784: symlink d4/dc/dea/l100 0 2024-09-16T02:06:00.487 INFO:tasks.workunit.client.1.smithi165.stdout:8/905: write dd/d11/d14/d3f/d25/d36/d81/dd2/f71 [5133806,61912] 0 2024-09-16T02:06:00.487 INFO:tasks.workunit.client.1.smithi165.stdout:9/906: rename d7/d1f/d27/d49/ld8 to d7/d14/d7a/d112/l122 0 2024-09-16T02:06:00.488 INFO:tasks.workunit.client.1.smithi165.stdout:4/785: creat d4/dc/d20/d45/f101 x:0 0 0 2024-09-16T02:06:00.490 INFO:tasks.workunit.client.1.smithi165.stdout:3/934: rename da/d17/d7a/lf9 to da/d17/de5/l13b 0 2024-09-16T02:06:00.491 INFO:tasks.workunit.client.1.smithi165.stdout:4/786: chown d4/dc/d18/d37/d53/d64/d8b/df4/ff6 22253869 1 2024-09-16T02:06:00.491 INFO:tasks.workunit.client.1.smithi165.stdout:8/906: creat dd/d11/d14/d3f/d25/d36/d81/dd2/d53/f139 x:0 0 0 2024-09-16T02:06:00.491 INFO:tasks.workunit.client.1.smithi165.stdout:4/787: readlink d4/dc/d28/l92 0 2024-09-16T02:06:00.492 INFO:tasks.workunit.client.1.smithi165.stdout:9/907: rename d7/d32/d38/d58/c63 to d7/df/d67/d92/d93/db6/d118/c123 0 2024-09-16T02:06:00.496 INFO:tasks.workunit.client.1.smithi165.stdout:9/908: read d7/df/f10 [2629598,48037] 0 2024-09-16T02:06:00.497 INFO:tasks.workunit.client.1.smithi165.stdout:8/907: getdents dd 0 2024-09-16T02:06:00.498 INFO:tasks.workunit.client.1.smithi165.stdout:4/788: dread d4/dc/d28/d3b/ffa [0,4194304] 0 2024-09-16T02:06:00.498 INFO:tasks.workunit.client.1.smithi165.stdout:0/785: dread d0/f2e [0,4194304] 0 2024-09-16T02:06:00.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/789: mkdir d4/dc/d20/d102 0 2024-09-16T02:06:00.502 INFO:tasks.workunit.client.1.smithi165.stdout:8/908: rename dd/d11/d14/d70/d7b/d9a/lf3 to dd/d11/d14/d70/l13a 0 2024-09-16T02:06:00.503 INFO:tasks.workunit.client.1.smithi165.stdout:4/790: creat d4/dc/d18/d37/d53/d64/d91/f103 x:0 0 0 2024-09-16T02:06:00.504 INFO:tasks.workunit.client.1.smithi165.stdout:6/867: write d7/d17/d75/d97/dcb/f5a [788069,51012] 0 2024-09-16T02:06:00.507 INFO:tasks.workunit.client.1.smithi165.stdout:4/791: mknod d4/dc/d18/d37/d53/d64/d8b/df4/c104 0 2024-09-16T02:06:00.510 INFO:tasks.workunit.client.1.smithi165.stdout:5/898: write de/d21/d26/d9a/fc0 [2644006,58065] 0 2024-09-16T02:06:00.511 INFO:tasks.workunit.client.1.smithi165.stdout:1/997: truncate d1/d22/f6f 942403 0 2024-09-16T02:06:00.512 INFO:tasks.workunit.client.1.smithi165.stdout:4/792: rmdir d4/dc/d20/d102 0 2024-09-16T02:06:00.514 INFO:tasks.workunit.client.1.smithi165.stdout:4/793: write d4/dc/d18/d37/d53/d64/fcb [173286,129627] 0 2024-09-16T02:06:00.514 INFO:tasks.workunit.client.1.smithi165.stdout:1/998: symlink d1/dd/d11/d33/d3f/d6c/dde/l13b 0 2024-09-16T02:06:00.516 INFO:tasks.workunit.client.1.smithi165.stdout:3/935: write da/d17/dcc/f24 [3217337,71800] 0 2024-09-16T02:06:00.517 INFO:tasks.workunit.client.1.smithi165.stdout:9/909: truncate d7/df/d67/d92/fc6 1663323 0 2024-09-16T02:06:00.518 INFO:tasks.workunit.client.1.smithi165.stdout:3/936: truncate da/fd4 1764342 0 2024-09-16T02:06:00.519 INFO:tasks.workunit.client.1.smithi165.stdout:6/868: write d7/fe [1415118,44676] 0 2024-09-16T02:06:00.519 INFO:tasks.workunit.client.1.smithi165.stdout:8/909: truncate dd/d11/d38/da6/db0/fbf 543015 0 2024-09-16T02:06:00.522 INFO:tasks.workunit.client.1.smithi165.stdout:1/999: truncate d1/dd/d11/d33/d3f/d47/d7d/db3/de0/fb8 5041125 0 2024-09-16T02:06:00.523 INFO:tasks.workunit.client.1.smithi165.stdout:9/910: creat d7/d32/d38/d53/d56/d95/f124 x:0 0 0 2024-09-16T02:06:00.523 INFO:tasks.workunit.client.1.smithi165.stdout:5/899: truncate de/d60/fb2 244845 0 2024-09-16T02:06:00.524 INFO:tasks.workunit.client.1.smithi165.stdout:3/937: creat da/d17/d7a/d7d/da8/f13c x:0 0 0 2024-09-16T02:06:00.525 INFO:tasks.workunit.client.1.smithi165.stdout:6/869: mkdir d7/d1f/df9 0 2024-09-16T02:06:00.528 INFO:tasks.workunit.client.1.smithi165.stdout:8/910: mknod dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/c13b 0 2024-09-16T02:06:00.529 INFO:tasks.workunit.client.1.smithi165.stdout:0/786: dwrite d0/d1e/d39/d99/fbd [0,4194304] 0 2024-09-16T02:06:00.529 INFO:tasks.workunit.client.1.smithi165.stdout:5/900: mkdir de/d21/d26/d3a/d126 0 2024-09-16T02:06:00.532 INFO:tasks.workunit.client.1.smithi165.stdout:0/787: write d0/d1e/d20/f7f [1516799,41891] 0 2024-09-16T02:06:00.532 INFO:tasks.workunit.client.1.smithi165.stdout:4/794: dread d4/d40/d4f/f78 [0,4194304] 0 2024-09-16T02:06:00.533 INFO:tasks.workunit.client.1.smithi165.stdout:8/911: write dd/d11/d14/d70/d7b/d9a/fd6 [1614909,32973] 0 2024-09-16T02:06:00.537 INFO:tasks.workunit.client.1.smithi165.stdout:3/938: creat da/d17/d7a/d7d/da8/d119/f13d x:0 0 0 2024-09-16T02:06:00.538 INFO:tasks.workunit.client.1.smithi165.stdout:3/939: stat da/d17/de5/f113 0 2024-09-16T02:06:00.539 INFO:tasks.workunit.client.1.smithi165.stdout:3/940: chown da/d17/d7a/d7d/l127 354050 1 2024-09-16T02:06:00.540 INFO:tasks.workunit.client.1.smithi165.stdout:9/911: getdents d7/d32/d4a/da8/dd9 0 2024-09-16T02:06:00.541 INFO:tasks.workunit.client.1.smithi165.stdout:9/912: write d7/d32/d4a/da8/dd9/fe8 [1450226,74915] 0 2024-09-16T02:06:00.544 INFO:tasks.workunit.client.1.smithi165.stdout:5/901: dread de/d19/ffc [0,4194304] 0 2024-09-16T02:06:00.544 INFO:tasks.workunit.client.1.smithi165.stdout:6/870: rename d7/d17/ca0 to d7/d17/d75/cfa 0 2024-09-16T02:06:00.545 INFO:tasks.workunit.client.1.smithi165.stdout:8/912: mkdir dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/d13c 0 2024-09-16T02:06:00.548 INFO:tasks.workunit.client.1.smithi165.stdout:7/886: sync 2024-09-16T02:06:00.548 INFO:tasks.workunit.client.1.smithi165.stdout:2/905: sync 2024-09-16T02:06:00.548 INFO:tasks.workunit.client.1.smithi165.stdout:3/941: read da/d17/de5/d104/fca [1757305,96273] 0 2024-09-16T02:06:00.548 INFO:tasks.workunit.client.1.smithi165.stdout:9/913: rename d7/d1f/d27/d49/cfd to d7/df/d67/d92/c125 0 2024-09-16T02:06:00.549 INFO:tasks.workunit.client.1.smithi165.stdout:5/902: mkdir de/d60/dbc/df3/d127 0 2024-09-16T02:06:00.550 INFO:tasks.workunit.client.1.smithi165.stdout:8/913: mknod dd/d62/c13d 0 2024-09-16T02:06:00.550 INFO:tasks.workunit.client.1.smithi165.stdout:0/788: dread d0/ff [4194304,4194304] 0 2024-09-16T02:06:00.551 INFO:tasks.workunit.client.1.smithi165.stdout:9/914: stat d7/d1f/d27/l75 0 2024-09-16T02:06:00.552 INFO:tasks.workunit.client.1.smithi165.stdout:2/906: write df/d23/d66/fce [889166,113563] 0 2024-09-16T02:06:00.553 INFO:tasks.workunit.client.1.smithi165.stdout:7/887: symlink d0/df/d42/l123 0 2024-09-16T02:06:00.554 INFO:tasks.workunit.client.1.smithi165.stdout:5/903: write f6 [4680429,31584] 0 2024-09-16T02:06:00.554 INFO:tasks.workunit.client.1.smithi165.stdout:3/942: rmdir da/d17/d7a/d7d/da8/d119 39 2024-09-16T02:06:00.558 INFO:tasks.workunit.client.1.smithi165.stdout:4/795: dwrite d4/dc/d20/d67/f76 [0,4194304] 0 2024-09-16T02:06:00.558 INFO:tasks.workunit.client.1.smithi165.stdout:3/943: write da/f11b [937531,16654] 0 2024-09-16T02:06:00.564 INFO:tasks.workunit.client.1.smithi165.stdout:6/871: dwrite d7/d17/d75/d97/dcb/d3d/ddd/f89 [0,4194304] 0 2024-09-16T02:06:00.567 INFO:tasks.workunit.client.1.smithi165.stdout:6/872: dread - d7/dc/df/d1a/d4d/ff6 zero size 2024-09-16T02:06:00.568 INFO:tasks.workunit.client.1.smithi165.stdout:3/944: dwrite da/d17/de5/d104/d2c/d2d/fdc [0,4194304] 0 2024-09-16T02:06:00.577 INFO:tasks.workunit.client.1.smithi165.stdout:7/888: rmdir d0/d2c/dc8/dea 39 2024-09-16T02:06:00.578 INFO:tasks.workunit.client.1.smithi165.stdout:8/914: write dd/f6c [1041676,37241] 0 2024-09-16T02:06:00.579 INFO:tasks.workunit.client.1.smithi165.stdout:8/915: fsync dd/d11/d14/d3f/d25/d36/d85/fc3 0 2024-09-16T02:06:00.579 INFO:tasks.workunit.client.1.smithi165.stdout:5/904: unlink de/d21/d26/d3a/d6d/f119 0 2024-09-16T02:06:00.582 INFO:tasks.workunit.client.1.smithi165.stdout:4/796: truncate d4/dc/d18/d37/d53/d64/d8b/d71/f7d 258193 0 2024-09-16T02:06:00.585 INFO:tasks.workunit.client.1.smithi165.stdout:8/916: unlink dd/d11/d38/d74/d7d/fca 0 2024-09-16T02:06:00.587 INFO:tasks.workunit.client.1.smithi165.stdout:8/917: dread - dd/d11/d14/d70/d7b/df2/dfc/f11e zero size 2024-09-16T02:06:00.598 INFO:tasks.workunit.client.1.smithi165.stdout:9/915: creat d7/d32/d38/d53/d5c/d61/f126 x:0 0 0 2024-09-16T02:06:00.599 INFO:tasks.workunit.client.1.smithi165.stdout:5/905: creat de/d21/d26/d3a/d54/d8c/dc7/d110/f128 x:0 0 0 2024-09-16T02:06:00.599 INFO:tasks.workunit.client.1.smithi165.stdout:8/918: chown dd/d11/d38/f45 254195197 1 2024-09-16T02:06:00.599 INFO:tasks.workunit.client.1.smithi165.stdout:6/873: link d7/d17/d75/fef d7/ffb 0 2024-09-16T02:06:00.599 INFO:tasks.workunit.client.1.smithi165.stdout:0/789: truncate d0/d1e/f93 1755919 0 2024-09-16T02:06:00.602 INFO:tasks.workunit.client.1.smithi165.stdout:3/945: creat da/f13e x:0 0 0 2024-09-16T02:06:00.603 INFO:tasks.workunit.client.1.smithi165.stdout:6/874: chown d7/dc/df/d1a/f2d 7 1 2024-09-16T02:06:00.605 INFO:tasks.workunit.client.1.smithi165.stdout:2/907: dread df/d23/d28/d3b/fa1 [0,4194304] 0 2024-09-16T02:06:00.607 INFO:tasks.workunit.client.1.smithi165.stdout:4/797: dwrite d4/d40/faf [0,4194304] 0 2024-09-16T02:06:00.608 INFO:tasks.workunit.client.1.smithi165.stdout:3/946: rename da/d20/l35 to da/d17/de5/d104/d2c/l13f 0 2024-09-16T02:06:00.610 INFO:tasks.workunit.client.1.smithi165.stdout:6/875: symlink d7/d17/d75/d97/dcb/d74/db7/lfc 0 2024-09-16T02:06:00.613 INFO:tasks.workunit.client.1.smithi165.stdout:0/790: truncate d0/d1e/d39/d48/d5f/f73 840130 0 2024-09-16T02:06:00.613 INFO:tasks.workunit.client.1.smithi165.stdout:4/798: stat d4/dc/d18/d37/d53/f5a 0 2024-09-16T02:06:00.618 INFO:tasks.workunit.client.1.smithi165.stdout:0/791: fsync d0/d1e/d39/d48/d6e/fce 0 2024-09-16T02:06:00.619 INFO:tasks.workunit.client.1.smithi165.stdout:3/947: write da/d20/d26/fa7 [1070683,35993] 0 2024-09-16T02:06:00.621 INFO:tasks.workunit.client.1.smithi165.stdout:2/908: dwrite df/d23/d28/d3b/d6d/d8b/fb2 [0,4194304] 0 2024-09-16T02:06:00.624 INFO:tasks.workunit.client.1.smithi165.stdout:5/906: dread de/d21/d26/f113 [0,4194304] 0 2024-09-16T02:06:00.624 INFO:tasks.workunit.client.1.smithi165.stdout:2/909: chown df/d23/f38 118007626 1 2024-09-16T02:06:00.624 INFO:tasks.workunit.client.1.smithi165.stdout:5/907: stat de/d21/d51 0 2024-09-16T02:06:00.626 INFO:tasks.workunit.client.1.smithi165.stdout:4/799: rename d4/dc/d28/d3b/ffa to d4/dc/d28/f105 0 2024-09-16T02:06:00.626 INFO:tasks.workunit.client.1.smithi165.stdout:3/948: write da/d20/d26/d8c/f118 [3839088,25689] 0 2024-09-16T02:06:00.632 INFO:tasks.workunit.client.1.smithi165.stdout:3/949: write da/d17/de5/d104/d2c/d10c/d6b/f12f [221253,49045] 0 2024-09-16T02:06:00.634 INFO:tasks.workunit.client.1.smithi165.stdout:5/908: dwrite de/d19/d1c/f3e [4194304,4194304] 0 2024-09-16T02:06:00.637 INFO:tasks.workunit.client.1.smithi165.stdout:5/909: read de/d21/f9f [304639,42785] 0 2024-09-16T02:06:00.640 INFO:tasks.workunit.client.1.smithi165.stdout:3/950: write da/d20/d26/f30 [950508,65729] 0 2024-09-16T02:06:00.644 INFO:tasks.workunit.client.1.smithi165.stdout:6/876: dread d7/dc/df/d1a/fd9 [0,4194304] 0 2024-09-16T02:06:00.646 INFO:tasks.workunit.client.1.smithi165.stdout:3/951: readlink da/d17/de5/d104/d2c/d2d/l50 0 2024-09-16T02:06:00.654 INFO:tasks.workunit.client.1.smithi165.stdout:3/952: chown da/dfe 61 1 2024-09-16T02:06:00.654 INFO:tasks.workunit.client.1.smithi165.stdout:2/910: dwrite df/d10/d1a/d2d/dd1/f9b [0,4194304] 0 2024-09-16T02:06:00.656 INFO:tasks.workunit.client.1.smithi165.stdout:4/800: dwrite d4/dc/d18/d37/d53/d64/d8b/d71/f7d [0,4194304] 0 2024-09-16T02:06:00.657 INFO:tasks.workunit.client.1.smithi165.stdout:6/877: symlink d7/dc/d7f/dd2/d3c/dcd/lfd 0 2024-09-16T02:06:00.658 INFO:tasks.workunit.client.1.smithi165.stdout:4/801: fdatasync d4/dc0/dd3/fe2 0 2024-09-16T02:06:00.659 INFO:tasks.workunit.client.1.smithi165.stdout:0/792: dwrite d0/d1e/f93 [0,4194304] 0 2024-09-16T02:06:00.664 INFO:tasks.workunit.client.1.smithi165.stdout:3/953: mkdir da/d17/d7a/d131/d140 0 2024-09-16T02:06:00.664 INFO:tasks.workunit.client.1.smithi165.stdout:5/910: dwrite de/d21/d26/d98/fa0 [0,4194304] 0 2024-09-16T02:06:00.666 INFO:tasks.workunit.client.1.smithi165.stdout:3/954: write da/d17/d7a/dab/f128 [627033,81700] 0 2024-09-16T02:06:00.668 INFO:tasks.workunit.client.1.smithi165.stdout:5/911: dread - de/d19/d1c/d4d/dc1/d107/f120 zero size 2024-09-16T02:06:00.670 INFO:tasks.workunit.client.0.smithi110.stdout:5/344: sync 2024-09-16T02:06:00.671 INFO:tasks.workunit.client.1.smithi165.stdout:4/802: dread d4/dc/d18/d37/d53/d64/d8b/f8a [0,4194304] 0 2024-09-16T02:06:00.673 INFO:tasks.workunit.client.0.smithi110.stdout:5/345: getdents d5/d71 0 2024-09-16T02:06:00.675 INFO:tasks.workunit.client.1.smithi165.stdout:3/955: dread da/d17/de5/d104/f23 [0,4194304] 0 2024-09-16T02:06:00.676 INFO:tasks.workunit.client.0.smithi110.stdout:5/346: getdents d5/d36/d45 0 2024-09-16T02:06:00.677 INFO:tasks.workunit.client.1.smithi165.stdout:5/912: dread de/d21/d26/d98/fa0 [0,4194304] 0 2024-09-16T02:06:00.678 INFO:tasks.workunit.client.0.smithi110.stdout:5/347: truncate d5/dd/df/d28/f6b 413457 0 2024-09-16T02:06:00.678 INFO:tasks.workunit.client.1.smithi165.stdout:3/956: write da/d17/d7a/d7d/fe7 [5924127,13937] 0 2024-09-16T02:06:00.680 INFO:tasks.workunit.client.1.smithi165.stdout:4/803: unlink d4/dc/d18/d37/d53/d64/d8b/d71/f9a 0 2024-09-16T02:06:00.681 INFO:tasks.workunit.client.0.smithi110.stdout:5/348: truncate d5/dd/df/d11/f2f 3672557 0 2024-09-16T02:06:00.682 INFO:tasks.workunit.client.1.smithi165.stdout:5/913: creat de/d60/f129 x:0 0 0 2024-09-16T02:06:00.683 INFO:tasks.workunit.client.0.smithi110.stdout:5/349: write d5/dd/df/d11/f50 [256624,61184] 0 2024-09-16T02:06:00.684 INFO:tasks.workunit.client.1.smithi165.stdout:3/957: write da/d17/de5/d104/d2c/f74 [166207,113237] 0 2024-09-16T02:06:00.686 INFO:tasks.workunit.client.1.smithi165.stdout:5/914: read de/d21/d51/fb4 [5364,48896] 0 2024-09-16T02:06:00.686 INFO:tasks.workunit.client.0.smithi110.stdout:5/350: creat d5/dd/df/d11/d6d/f74 x:0 0 0 2024-09-16T02:06:00.687 INFO:tasks.workunit.client.1.smithi165.stdout:3/958: dread - da/d20/d26/d8c/dd9/f111 zero size 2024-09-16T02:06:00.689 INFO:tasks.workunit.client.0.smithi110.stdout:5/351: creat d5/dd/df/d28/f75 x:0 0 0 2024-09-16T02:06:00.691 INFO:tasks.workunit.client.1.smithi165.stdout:3/959: mknod da/d17/de5/d104/d2c/c141 0 2024-09-16T02:06:00.692 INFO:tasks.workunit.client.1.smithi165.stdout:3/960: chown da/f13e 54171 1 2024-09-16T02:06:00.692 INFO:tasks.workunit.client.0.smithi110.stdout:5/352: symlink d5/d71/l76 0 2024-09-16T02:06:00.694 INFO:tasks.workunit.client.1.smithi165.stdout:4/804: dwrite d4/dc/d28/d3b/fa5 [0,4194304] 0 2024-09-16T02:06:00.694 INFO:tasks.workunit.client.1.smithi165.stdout:5/915: link de/d19/d1c/d84/d92/cdb de/d60/dbc/c12a 0 2024-09-16T02:06:00.698 INFO:tasks.workunit.client.1.smithi165.stdout:6/878: dread d7/f1e [0,4194304] 0 2024-09-16T02:06:00.701 INFO:tasks.workunit.client.1.smithi165.stdout:2/911: dread df/d23/d28/dfa/fd6 [0,4194304] 0 2024-09-16T02:06:00.701 INFO:tasks.workunit.client.1.smithi165.stdout:5/916: truncate de/d21/d26/d3a/d6d/f124 354881 0 2024-09-16T02:06:00.701 INFO:tasks.workunit.client.1.smithi165.stdout:6/879: chown d7/d17/f66 1 1 2024-09-16T02:06:00.703 INFO:tasks.workunit.client.1.smithi165.stdout:2/912: unlink df/d10/f9f 0 2024-09-16T02:06:00.703 INFO:tasks.workunit.client.1.smithi165.stdout:4/805: read d4/dc/d18/d37/d53/d64/d8b/f63 [1398034,8959] 0 2024-09-16T02:06:00.704 INFO:tasks.workunit.client.1.smithi165.stdout:2/913: chown df/d10/d1a/d2d/dd1/d109 12882124 1 2024-09-16T02:06:00.706 INFO:tasks.workunit.client.1.smithi165.stdout:6/880: truncate d7/f9 2654375 0 2024-09-16T02:06:00.706 INFO:tasks.workunit.client.1.smithi165.stdout:5/917: truncate de/d21/d26/d3a/d6d/d95/dab/fe7 100944 0 2024-09-16T02:06:00.708 INFO:tasks.workunit.client.1.smithi165.stdout:6/881: dread d7/d17/d75/d97/dcb/d3d/fa1 [0,4194304] 0 2024-09-16T02:06:00.710 INFO:tasks.workunit.client.1.smithi165.stdout:7/889: sync 2024-09-16T02:06:00.713 INFO:tasks.workunit.client.1.smithi165.stdout:6/882: dwrite d7/d1f/dbc/fe6 [0,4194304] 0 2024-09-16T02:06:00.762 INFO:tasks.workunit.client.0.smithi110.stdout:9/320: sync 2024-09-16T02:06:00.766 INFO:tasks.workunit.client.1.smithi165.stdout:8/919: sync 2024-09-16T02:06:00.766 INFO:tasks.workunit.client.1.smithi165.stdout:0/793: sync 2024-09-16T02:06:00.766 INFO:tasks.workunit.client.1.smithi165.stdout:9/916: sync 2024-09-16T02:06:00.767 INFO:tasks.workunit.client.1.smithi165.stdout:9/917: write d7/d1f/d27/f3e [514845,52621] 0 2024-09-16T02:06:00.773 INFO:tasks.workunit.client.1.smithi165.stdout:0/794: dwrite d0/d1e/d39/d48/d5f/d82/d91/feb [0,4194304] 0 2024-09-16T02:06:00.795 INFO:tasks.workunit.client.0.smithi110.stdout:9/321: mkdir d1/dd/d6a 0 2024-09-16T02:06:00.796 INFO:tasks.workunit.client.0.smithi110.stdout:5/353: write d5/dd/f10 [3816200,83222] 0 2024-09-16T02:06:00.796 INFO:tasks.workunit.client.1.smithi165.stdout:5/918: write de/d19/d1c/d84/f96 [3512524,24678] 0 2024-09-16T02:06:00.800 INFO:tasks.workunit.client.0.smithi110.stdout:9/322: dwrite d1/f3 [8388608,4194304] 0 2024-09-16T02:06:00.879 INFO:tasks.workunit.client.1.smithi165.stdout:3/961: truncate da/d17/d7a/dab/f116 2029303 0 2024-09-16T02:06:00.881 INFO:tasks.workunit.client.0.smithi110.stdout:5/354: mkdir d5/dd/df/d28/d77 0 2024-09-16T02:06:00.881 INFO:tasks.workunit.client.0.smithi110.stdout:5/355: stat d5/f13 0 2024-09-16T02:06:00.882 INFO:tasks.workunit.client.0.smithi110.stdout:9/323: mknod d1/d5/d8/de/d1f/c6b 0 2024-09-16T02:06:00.882 INFO:tasks.workunit.client.0.smithi110.stdout:5/356: chown d5/f51 5434 1 2024-09-16T02:06:00.883 INFO:tasks.workunit.client.0.smithi110.stdout:9/324: write d1/d1b/d23/f4c [4007465,37434] 0 2024-09-16T02:06:00.883 INFO:tasks.workunit.client.1.smithi165.stdout:8/920: mkdir dd/d11/d14/d3f/d25/d36/d85/d126/d13e 0 2024-09-16T02:06:00.888 INFO:tasks.workunit.client.0.smithi110.stdout:5/357: dwrite d5/dd/df/d11/f50 [0,4194304] 0 2024-09-16T02:06:00.890 INFO:tasks.workunit.client.0.smithi110.stdout:5/358: write d5/dd/df/d11/d6d/f74 [400992,64860] 0 2024-09-16T02:06:00.905 INFO:tasks.workunit.client.1.smithi165.stdout:6/883: symlink d7/dc/lfe 0 2024-09-16T02:06:00.905 INFO:tasks.workunit.client.1.smithi165.stdout:0/795: dread d0/d2a/fda [0,4194304] 0 2024-09-16T02:06:00.905 INFO:tasks.workunit.client.1.smithi165.stdout:9/918: creat d7/d32/d38/d53/d56/dca/dd2/d11d/f127 x:0 0 0 2024-09-16T02:06:00.905 INFO:tasks.workunit.client.0.smithi110.stdout:9/325: fsync d1/d5/d8/f40 0 2024-09-16T02:06:00.906 INFO:tasks.workunit.client.0.smithi110.stdout:5/359: mknod d5/d36/d45/c78 0 2024-09-16T02:06:00.908 INFO:tasks.workunit.client.1.smithi165.stdout:2/914: rename df/d23/d28/f94 to df/d10/d1a/f10f 0 2024-09-16T02:06:00.909 INFO:tasks.workunit.client.1.smithi165.stdout:7/890: creat d0/df/d83/f124 x:0 0 0 2024-09-16T02:06:00.910 INFO:tasks.workunit.client.1.smithi165.stdout:4/806: truncate d4/fad 2407294 0 2024-09-16T02:06:00.911 INFO:tasks.workunit.client.1.smithi165.stdout:3/962: getdents da/d17/de5/d104/d2c/d10c/d6b/d120 0 2024-09-16T02:06:00.911 INFO:tasks.workunit.client.0.smithi110.stdout:5/360: unlink d5/d36/l40 0 2024-09-16T02:06:00.913 INFO:tasks.workunit.client.0.smithi110.stdout:9/326: mkdir d1/dd/d6a/d6c 0 2024-09-16T02:06:00.915 INFO:tasks.workunit.client.0.smithi110.stdout:5/361: rename d5/d36/f53 to d5/d36/d3d/f79 0 2024-09-16T02:06:00.916 INFO:tasks.workunit.client.0.smithi110.stdout:9/327: mknod d1/dd/d6a/c6d 0 2024-09-16T02:06:00.917 INFO:tasks.workunit.client.0.smithi110.stdout:0/426: sync 2024-09-16T02:06:00.917 INFO:tasks.workunit.client.0.smithi110.stdout:1/418: sync 2024-09-16T02:06:00.917 INFO:tasks.workunit.client.0.smithi110.stdout:8/328: sync 2024-09-16T02:06:00.918 INFO:tasks.workunit.client.1.smithi165.stdout:2/915: dread df/fc5 [0,4194304] 0 2024-09-16T02:06:00.920 INFO:tasks.workunit.client.1.smithi165.stdout:0/796: mknod d0/d1e/d39/d48/d5f/c103 0 2024-09-16T02:06:00.921 INFO:tasks.workunit.client.0.smithi110.stdout:1/419: symlink d0/d1/d4/d46/d75/l8b 0 2024-09-16T02:06:00.922 INFO:tasks.workunit.client.0.smithi110.stdout:8/329: rename d3/d12/d5e/c6d to d3/d12/d5e/c75 0 2024-09-16T02:06:00.924 INFO:tasks.workunit.client.1.smithi165.stdout:8/921: rmdir dd/d11/d14/d3f/d25/d36/d81/dd2/d53/db7/d13c 0 2024-09-16T02:06:00.925 INFO:tasks.workunit.client.0.smithi110.stdout:1/420: chown d0/d1/d4/d46/d64/c84 3111 1 2024-09-16T02:06:00.926 INFO:tasks.workunit.client.1.smithi165.stdout:8/922: write dd/d11/d14/d3f/d25/d36/d81/dd2/f71 [522291,85100] 0 2024-09-16T02:06:00.927 INFO:tasks.workunit.client.1.smithi165.stdout:5/919: rename de/d19/d1c/d84/d92/cdb to de/d21/c12b 0 2024-09-16T02:06:00.933 INFO:tasks.workunit.client.1.smithi165.stdout:0/797: mknod d0/d1e/d39/d48/c104 0 2024-09-16T02:06:00.933 INFO:tasks.workunit.client.0.smithi110.stdout:0/427: link d3/d6/d43/d55/d59/f5c d3/d6/d43/d55/f7d 0 2024-09-16T02:06:00.934 INFO:tasks.workunit.client.1.smithi165.stdout:0/798: write d0/d1e/d39/d48/d74/ff8 [3095619,61439] 0 2024-09-16T02:06:00.934 INFO:tasks.workunit.client.1.smithi165.stdout:0/799: write d0/d1e/d20/f100 [645956,37270] 0 2024-09-16T02:06:00.935 INFO:tasks.workunit.client.1.smithi165.stdout:3/963: link da/d20/d26/fa7 da/d17/de5/d104/d2c/d10c/d6b/d120/f142 0 2024-09-16T02:06:00.935 INFO:tasks.workunit.client.0.smithi110.stdout:8/330: getdents d3/d2b/d27/d45/d68 0 2024-09-16T02:06:00.939 INFO:tasks.workunit.client.0.smithi110.stdout:1/421: rename d0/d1/d2a/l77 to d0/d1/d2a/d32/d6e/l8c 0 2024-09-16T02:06:00.939 INFO:tasks.workunit.client.0.smithi110.stdout:1/422: read - d0/d1/d2a/f7e zero size 2024-09-16T02:06:00.941 INFO:tasks.workunit.client.0.smithi110.stdout:1/423: write d0/d1/d2a/f78 [235213,34445] 0 2024-09-16T02:06:00.941 INFO:tasks.workunit.client.1.smithi165.stdout:3/964: dread da/d17/de5/d104/d2c/d10c/fe0 [0,4194304] 0 2024-09-16T02:06:00.942 INFO:tasks.workunit.client.1.smithi165.stdout:8/923: dread dd/d11/d14/d3f/d25/d36/d81/dd2/f65 [0,4194304] 0 2024-09-16T02:06:00.944 INFO:tasks.workunit.client.0.smithi110.stdout:5/362: truncate d5/f61 83506 0 2024-09-16T02:06:00.945 INFO:tasks.workunit.client.0.smithi110.stdout:5/363: stat d5/dd/df/d28/f75 0 2024-09-16T02:06:00.946 INFO:tasks.workunit.client.1.smithi165.stdout:6/884: rename d7/dc/f94 to d7/d17/d75/d97/dcb/d74/db7/de0/fff 0 2024-09-16T02:06:00.947 INFO:tasks.workunit.client.0.smithi110.stdout:1/424: mkdir d0/da/d8d 0 2024-09-16T02:06:00.948 INFO:tasks.workunit.client.1.smithi165.stdout:5/920: truncate de/d21/d51/fb4 166449 0 2024-09-16T02:06:00.949 INFO:tasks.workunit.client.1.smithi165.stdout:2/916: getdents df/d10/d1a/dbc 0 2024-09-16T02:06:00.950 INFO:tasks.workunit.client.0.smithi110.stdout:5/364: truncate d5/dd/df/f38 42610 0 2024-09-16T02:06:00.950 INFO:tasks.workunit.client.0.smithi110.stdout:0/428: dread d3/d4/f1d [0,4194304] 0 2024-09-16T02:06:00.953 INFO:tasks.workunit.client.0.smithi110.stdout:1/425: read d0/d1/d2a/f37 [50736,69012] 0 2024-09-16T02:06:00.955 INFO:tasks.workunit.client.1.smithi165.stdout:0/800: readlink d0/d1e/l89 0 2024-09-16T02:06:00.957 INFO:tasks.workunit.client.0.smithi110.stdout:5/365: dwrite d5/f51 [0,4194304] 0 2024-09-16T02:06:00.957 INFO:tasks.workunit.client.0.smithi110.stdout:0/429: chown d3/d6/d43/d55/d59/f5c 413900 1 2024-09-16T02:06:00.957 INFO:tasks.workunit.client.1.smithi165.stdout:9/919: getdents d7/d1f/d54 0 2024-09-16T02:06:00.959 INFO:tasks.workunit.client.1.smithi165.stdout:9/920: dread - d7/df/d37/d65/f103 zero size 2024-09-16T02:06:00.960 INFO:tasks.workunit.client.1.smithi165.stdout:5/921: dread de/d19/d1c/d84/f96 [0,4194304] 0 2024-09-16T02:06:00.961 INFO:tasks.workunit.client.1.smithi165.stdout:5/922: fsync de/d21/d26/d3a/dd5/fd7 0 2024-09-16T02:06:00.962 INFO:tasks.workunit.client.1.smithi165.stdout:5/923: dread - de/d19/d1c/d84/fb7 zero size 2024-09-16T02:06:00.962 INFO:tasks.workunit.client.1.smithi165.stdout:5/924: fsync de/d21/d26/f123 0 2024-09-16T02:06:00.963 INFO:tasks.workunit.client.0.smithi110.stdout:0/430: mkdir d3/d4/dc/d14/d7e 0 2024-09-16T02:06:00.965 INFO:tasks.workunit.client.0.smithi110.stdout:8/331: dwrite d3/d2b/f1e [4194304,4194304] 0 2024-09-16T02:06:00.967 INFO:tasks.workunit.client.0.smithi110.stdout:5/366: rename d5/d36/d45/l55 to d5/dd/df/d28/d6f/l7a 0 2024-09-16T02:06:00.967 INFO:tasks.workunit.client.0.smithi110.stdout:1/426: dread d0/da/f5c [0,4194304] 0 2024-09-16T02:06:00.968 INFO:tasks.workunit.client.1.smithi165.stdout:7/891: truncate d0/d2c/dc8/dea/f10c 3966829 0 2024-09-16T02:06:00.974 INFO:tasks.workunit.client.1.smithi165.stdout:4/807: rename d4/dc/d20/d67/f76 to d4/dc/d20/d4e/f106 0 2024-09-16T02:06:00.976 INFO:tasks.workunit.client.1.smithi165.stdout:6/885: mknod d7/dc/df/d1a/d4d/d5f/da7/c100 0 2024-09-16T02:06:00.979 INFO:tasks.workunit.client.1.smithi165.stdout:2/917: creat df/d23/d28/d9a/d86/f110 x:0 0 0 2024-09-16T02:06:00.983 INFO:tasks.workunit.client.0.smithi110.stdout:5/367: creat d5/dd/df/d11/d6d/f7b x:0 0 0 2024-09-16T02:06:00.984 INFO:tasks.workunit.client.1.smithi165.stdout:0/801: symlink d0/d1e/d20/d28/da7/l105 0 2024-09-16T02:06:00.984 INFO:tasks.workunit.client.0.smithi110.stdout:5/368: read d5/d36/d45/d47/f57 [80308,138] 0 2024-09-16T02:06:00.985 INFO:tasks.workunit.client.0.smithi110.stdout:5/369: write d5/d36/f64 [1807957,77028] 0 2024-09-16T02:06:00.987 INFO:tasks.workunit.client.0.smithi110.stdout:5/370: fsync d5/dd/df/d11/d6d/f73 0 2024-09-16T02:06:00.989 INFO:tasks.workunit.client.0.smithi110.stdout:0/431: write d3/d6/d43/d55/d59/f5c [1524946,75320] 0 2024-09-16T02:06:00.991 INFO:tasks.workunit.client.0.smithi110.stdout:8/332: dread d3/d2b/f2e [0,4194304] 0 2024-09-16T02:06:00.993 INFO:tasks.workunit.client.0.smithi110.stdout:1/427: symlink d0/d1/d4/d46/d64/d79/l8e 0 2024-09-16T02:06:00.994 INFO:tasks.workunit.client.1.smithi165.stdout:3/965: symlink da/d17/d7a/d131/d140/l143 0 2024-09-16T02:06:00.995 INFO:tasks.workunit.client.1.smithi165.stdout:7/892: write d0/d4b/d63/f9e [1594028,70871] 0 2024-09-16T02:06:00.996 INFO:tasks.workunit.client.1.smithi165.stdout:8/924: creat dd/d11/d14/d3f/db3/dbe/f13f x:0 0 0 2024-09-16T02:06:01.002 INFO:tasks.workunit.client.1.smithi165.stdout:8/925: dwrite dd/d11/d14/d70/d7b/d9a/fd6 [0,4194304] 0 2024-09-16T02:06:01.004 INFO:tasks.workunit.client.1.smithi165.stdout:0/802: dread d0/d1e/d39/d48/d5f/d82/f9b [0,4194304] 0 2024-09-16T02:06:01.052 INFO:tasks.workunit.client.0.smithi110.stdout:6/483: sync 2024-09-16T02:06:01.052 INFO:tasks.workunit.client.0.smithi110.stdout:7/311: sync 2024-09-16T02:06:01.067 INFO:tasks.workunit.client.0.smithi110.stdout:6/484: dread d0/d2/d5/d84/d16/f3b [0,4194304] 0 2024-09-16T02:06:01.091 INFO:tasks.workunit.client.1.smithi165.stdout:9/921: write d7/d14/f89 [1728737,126839] 0 2024-09-16T02:06:01.091 INFO:tasks.workunit.client.1.smithi165.stdout:6/886: mkdir d7/dc/d7f/d101 0 2024-09-16T02:06:01.092 INFO:tasks.workunit.client.0.smithi110.stdout:7/312: mknod d3/d15/d38/d4f/d10/d2c/c57 0 2024-09-16T02:06:01.093 INFO:tasks.workunit.client.1.smithi165.stdout:6/887: read d7/d17/d75/fb4 [482175,89310] 0 2024-09-16T02:06:01.098 INFO:tasks.workunit.client.0.smithi110.stdout:6/485: unlink d0/d29/d2a/d2f/d34/f64 0 2024-09-16T02:06:01.100 INFO:tasks.workunit.client.0.smithi110.stdout:8/333: dwrite d3/f3d [0,4194304] 0 2024-09-16T02:06:01.100 INFO:tasks.workunit.client.0.smithi110.stdout:8/334: stat d3/d2b/c18 0 2024-09-16T02:06:01.102 INFO:tasks.workunit.client.1.smithi165.stdout:2/918: write df/d23/d28/d3b/f56 [4394760,79418] 0 2024-09-16T02:06:01.104 INFO:tasks.workunit.client.1.smithi165.stdout:3/966: truncate da/d17/de5/d104/d91/f100 26116 0 2024-09-16T02:06:01.105 INFO:tasks.workunit.client.1.smithi165.stdout:3/967: chown da/d17/de5/d104/d2c/d10c/f112 234573 1 2024-09-16T02:06:01.106 INFO:tasks.workunit.client.0.smithi110.stdout:8/335: dwrite d3/d31/f50 [0,4194304] 0 2024-09-16T02:06:01.107 INFO:tasks.workunit.client.0.smithi110.stdout:1/428: getdents d0/d1/d4 0 2024-09-16T02:06:01.108 INFO:tasks.workunit.client.0.smithi110.stdout:1/429: truncate d0/da/f81 204651 0 2024-09-16T02:06:01.112 INFO:tasks.workunit.client.1.smithi165.stdout:0/803: read - d0/d1e/d39/d48/d45/f60 zero size 2024-09-16T02:06:01.113 INFO:tasks.workunit.client.0.smithi110.stdout:7/313: truncate d3/f27 3009297 0 2024-09-16T02:06:01.120 INFO:tasks.workunit.client.1.smithi165.stdout:8/926: write dd/d11/d14/d3f/d25/d36/f64 [5356449,106414] 0 2024-09-16T02:06:01.125 INFO:tasks.workunit.client.0.smithi110.stdout:8/336: write d3/d2b/d27/d45/f5b [609606,27849] 0 2024-09-16T02:06:01.126 INFO:tasks.workunit.client.0.smithi110.stdout:8/337: stat d3/d2b/d27/f4d 0 2024-09-16T02:06:01.131 INFO:tasks.workunit.client.0.smithi110.stdout:6/486: getdents d0/d2/d5/d84/d16 0 2024-09-16T02:06:01.133 INFO:tasks.workunit.client.0.smithi110.stdout:1/430: dwrite d0/d25/f3b [0,4194304] 0 2024-09-16T02:06:01.134 INFO:tasks.workunit.client.0.smithi110.stdout:8/338: dwrite d3/f3d [0,4194304] 0 2024-09-16T02:06:01.142 INFO:tasks.workunit.client.0.smithi110.stdout:8/339: dwrite d3/d12/d1a/d36/d60/d62/f73 [0,4194304] 0 2024-09-16T02:06:01.144 INFO:tasks.workunit.client.0.smithi110.stdout:7/314: truncate d3/d15/d38/d4f/d10/f29 2334956 0 2024-09-16T02:06:01.151 INFO:tasks.workunit.client.0.smithi110.stdout:6/487: mkdir d0/d29/d2a/d2f/d49/d9c 0 2024-09-16T02:06:01.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/315: dread d3/d15/d38/d4f/d10/d11/f2d [0,4194304] 0 2024-09-16T02:06:01.154 INFO:tasks.workunit.client.0.smithi110.stdout:6/488: chown d0/l35 72945882 1 2024-09-16T02:06:01.156 INFO:tasks.workunit.client.0.smithi110.stdout:1/431: getdents d0/d1/d4/d46/d64 0 2024-09-16T02:06:01.156 INFO:tasks.workunit.client.0.smithi110.stdout:6/489: readlink d0/d2/d5/d1e/d48/l60 0 2024-09-16T02:06:01.158 INFO:tasks.workunit.client.0.smithi110.stdout:7/316: unlink d3/d15/d38/d4f/fc 0 2024-09-16T02:06:01.160 INFO:tasks.workunit.client.0.smithi110.stdout:6/490: write d0/d2/d5/d1e/d48/f74 [994516,37392] 0 2024-09-16T02:06:01.165 INFO:tasks.workunit.client.0.smithi110.stdout:6/491: creat d0/d29/d2a/d2d/d98/f9d x:0 0 0 2024-09-16T02:06:01.166 INFO:tasks.workunit.client.0.smithi110.stdout:7/317: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/f4b [0,4194304] 0 2024-09-16T02:06:01.166 INFO:tasks.workunit.client.0.smithi110.stdout:6/492: chown d0/d29/d2a/c4c 291563 1 2024-09-16T02:06:01.167 INFO:tasks.workunit.client.0.smithi110.stdout:6/493: fsync d0/d2/d18/d1d/f3d 0 2024-09-16T02:06:01.171 INFO:tasks.workunit.client.0.smithi110.stdout:6/494: fdatasync d0/d2/d18/f59 0 2024-09-16T02:06:01.173 INFO:tasks.workunit.client.0.smithi110.stdout:7/318: dwrite f1 [4194304,4194304] 0 2024-09-16T02:06:01.176 INFO:tasks.workunit.client.1.smithi165.stdout:4/808: symlink d4/dc/d28/d2b/l107 0 2024-09-16T02:06:01.177 INFO:tasks.workunit.client.0.smithi110.stdout:4/423: sync 2024-09-16T02:06:01.177 INFO:tasks.workunit.client.1.smithi165.stdout:9/922: mkdir d7/d14/d80/d128 0 2024-09-16T02:06:01.180 INFO:tasks.workunit.client.1.smithi165.stdout:6/888: rename d7/d17/d75/d97/dcb/d74/de3/fea to d7/d17/d75/d97/dcb/d3d/d5d/d73/f102 0 2024-09-16T02:06:01.181 INFO:tasks.workunit.client.1.smithi165.stdout:5/925: link de/d19/d1c/c27 de/d21/d26/d3a/d6d/d95/dab/c12c 0 2024-09-16T02:06:01.181 INFO:tasks.workunit.client.0.smithi110.stdout:6/495: dwrite d0/d2/d5/d84/f6d [0,4194304] 0 2024-09-16T02:06:01.182 INFO:tasks.workunit.client.1.smithi165.stdout:5/926: write de/f1d [2876391,130731] 0 2024-09-16T02:06:01.182 INFO:tasks.workunit.client.0.smithi110.stdout:7/319: dwrite d3/d15/d38/d4f/d2e/f4c [0,4194304] 0 2024-09-16T02:06:01.186 INFO:tasks.workunit.client.1.smithi165.stdout:7/893: fsync d0/df/d33/f4a 0 2024-09-16T02:06:01.189 INFO:tasks.workunit.client.0.smithi110.stdout:6/496: fsync d0/d29/f3f 0 2024-09-16T02:06:01.190 INFO:tasks.workunit.client.0.smithi110.stdout:7/320: dread d3/d15/d38/d4f/d10/f3d [0,4194304] 0 2024-09-16T02:06:01.191 INFO:tasks.workunit.client.1.smithi165.stdout:3/968: creat da/d17/de5/d104/d2c/f144 x:0 0 0 2024-09-16T02:06:01.194 INFO:tasks.workunit.client.1.smithi165.stdout:2/919: dwrite df/d23/d28/d3b/d6d/d8b/fd5 [0,4194304] 0 2024-09-16T02:06:01.196 INFO:tasks.workunit.client.1.smithi165.stdout:2/920: chown df/d10/d1a/d2d/dd1/ld4 129 1 2024-09-16T02:06:01.198 INFO:tasks.workunit.client.1.smithi165.stdout:0/804: write d0/d1e/d39/d48/fef [1259801,46021] 0 2024-09-16T02:06:01.199 INFO:tasks.workunit.client.0.smithi110.stdout:8/340: dwrite d3/d2b/f70 [0,4194304] 0 2024-09-16T02:06:01.199 INFO:tasks.workunit.client.1.smithi165.stdout:2/921: write df/d23/d28/d87/ffe [379437,58089] 0 2024-09-16T02:06:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:00 smithi165 ceph-mon[34621]: pgmap v24: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 113 MiB/s rd, 357 MiB/s wr, 680 op/s 2024-09-16T02:06:01.205 INFO:tasks.workunit.client.1.smithi165.stdout:4/809: mkdir d4/dc/d18/d108 0 2024-09-16T02:06:01.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:00 smithi110 ceph-mon[27634]: pgmap v24: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 113 MiB/s rd, 357 MiB/s wr, 680 op/s 2024-09-16T02:06:01.210 INFO:tasks.workunit.client.1.smithi165.stdout:9/923: unlink d7/d14/f89 0 2024-09-16T02:06:01.212 INFO:tasks.workunit.client.0.smithi110.stdout:8/341: fdatasync d3/f3c 0 2024-09-16T02:06:01.213 INFO:tasks.workunit.client.1.smithi165.stdout:6/889: rmdir d7/dc/df/d1a/d4d/da8 39 2024-09-16T02:06:01.213 INFO:tasks.workunit.client.0.smithi110.stdout:8/342: stat d3/d12/d1a/d36/d60/d62 0 2024-09-16T02:06:01.214 INFO:tasks.workunit.client.0.smithi110.stdout:7/321: mknod d3/d15/d38/d4f/d10/d11/d3e/d40/d50/c58 0 2024-09-16T02:06:01.214 INFO:tasks.workunit.client.1.smithi165.stdout:6/890: write d7/dc/df/d1a/d4d/f4e [1763185,127315] 0 2024-09-16T02:06:01.216 INFO:tasks.workunit.client.0.smithi110.stdout:1/432: truncate d0/d1/f53 1359237 0 2024-09-16T02:06:01.217 INFO:tasks.workunit.client.0.smithi110.stdout:3/395: sync 2024-09-16T02:06:01.218 INFO:tasks.workunit.client.0.smithi110.stdout:2/411: sync 2024-09-16T02:06:01.219 INFO:tasks.workunit.client.0.smithi110.stdout:6/497: rename d0/l35 to d0/d2/l9e 0 2024-09-16T02:06:01.220 INFO:tasks.workunit.client.1.smithi165.stdout:2/922: dread df/d10/d37/f74 [0,4194304] 0 2024-09-16T02:06:01.221 INFO:tasks.workunit.client.1.smithi165.stdout:5/927: creat de/d19/d67/d74/f12d x:0 0 0 2024-09-16T02:06:01.225 INFO:tasks.workunit.client.0.smithi110.stdout:7/322: dread - d3/d15/d38/d4f/d10/f35 zero size 2024-09-16T02:06:01.225 INFO:tasks.workunit.client.0.smithi110.stdout:7/323: stat d3/d15/d38/d4f/c43 0 2024-09-16T02:06:01.227 INFO:tasks.workunit.client.0.smithi110.stdout:1/433: creat d0/d1/d2a/d32/d6e/f8f x:0 0 0 2024-09-16T02:06:01.232 INFO:tasks.workunit.client.0.smithi110.stdout:6/498: rename d0/d2/d5/d84/l85 to d0/d2/d5/d84/l9f 0 2024-09-16T02:06:01.233 INFO:tasks.workunit.client.0.smithi110.stdout:2/412: dread d0/da/f2c [0,4194304] 0 2024-09-16T02:06:01.234 INFO:tasks.workunit.client.1.smithi165.stdout:4/810: creat d4/dc/d18/f109 x:0 0 0 2024-09-16T02:06:01.235 INFO:tasks.workunit.client.1.smithi165.stdout:0/805: dwrite d0/d1e/f24 [0,4194304] 0 2024-09-16T02:06:01.236 INFO:tasks.workunit.client.0.smithi110.stdout:7/324: creat d3/d15/d38/d4f/d2e/f59 x:0 0 0 2024-09-16T02:06:01.238 INFO:tasks.workunit.client.1.smithi165.stdout:9/924: rename d7/d32/d38/d53/d56/dca to d7/d32/d38/d53/d56/dca/dd2/d129 22 2024-09-16T02:06:01.239 INFO:tasks.workunit.client.0.smithi110.stdout:4/424: write f3 [639657,87018] 0 2024-09-16T02:06:01.243 INFO:tasks.workunit.client.1.smithi165.stdout:6/891: unlink d7/dc/df/d1a/c1c 0 2024-09-16T02:06:01.244 INFO:tasks.workunit.client.0.smithi110.stdout:3/396: rename d8/d29/f41 to d8/d48/f8e 0 2024-09-16T02:06:01.246 INFO:tasks.workunit.client.1.smithi165.stdout:2/923: creat df/d23/ddc/f111 x:0 0 0 2024-09-16T02:06:01.247 INFO:tasks.workunit.client.1.smithi165.stdout:2/924: write df/d23/d28/d3b/d6d/d8b/fb3 [2742144,52261] 0 2024-09-16T02:06:01.247 INFO:tasks.workunit.client.1.smithi165.stdout:5/928: mknod de/d19/d1c/d49/da5/db1/c12e 0 2024-09-16T02:06:01.249 INFO:tasks.workunit.client.1.smithi165.stdout:7/894: mkdir d0/df/d125 0 2024-09-16T02:06:01.250 INFO:tasks.workunit.client.1.smithi165.stdout:7/895: chown d0/d4b 249 1 2024-09-16T02:06:01.250 INFO:tasks.workunit.client.1.smithi165.stdout:7/896: dread - d0/df/d42/fdb zero size 2024-09-16T02:06:01.256 INFO:tasks.workunit.client.1.smithi165.stdout:6/892: dread d7/dc/df/d1a/f2d [0,4194304] 0 2024-09-16T02:06:01.256 INFO:tasks.workunit.client.0.smithi110.stdout:3/397: fdatasync d8/f1e 0 2024-09-16T02:06:01.257 INFO:tasks.workunit.client.1.smithi165.stdout:6/893: chown d7/dc/df/d1a/d4d/f6b 2142408912 1 2024-09-16T02:06:01.260 INFO:tasks.workunit.client.0.smithi110.stdout:1/434: rename d0/f56 to d0/d1/d4/d46/d75/f90 0 2024-09-16T02:06:01.260 INFO:tasks.workunit.client.0.smithi110.stdout:3/398: dread d8/dc/d1b/d36/f71 [0,4194304] 0 2024-09-16T02:06:01.261 INFO:tasks.workunit.client.0.smithi110.stdout:3/399: write d8/dc/d1b/f35 [4515458,54817] 0 2024-09-16T02:06:01.263 INFO:tasks.workunit.client.1.smithi165.stdout:0/806: mknod d0/d1e/d39/d48/d5f/ddf/c106 0 2024-09-16T02:06:01.264 INFO:tasks.workunit.client.1.smithi165.stdout:9/925: readlink d7/d32/d38/d58/d99/ldc 0 2024-09-16T02:06:01.269 INFO:tasks.workunit.client.0.smithi110.stdout:1/435: mkdir d0/d91 0 2024-09-16T02:06:01.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/343: dwrite d3/d31/f3e [0,4194304] 0 2024-09-16T02:06:01.270 INFO:tasks.workunit.client.1.smithi165.stdout:5/929: write de/d21/d26/d3a/d54/f89 [4033074,125792] 0 2024-09-16T02:06:01.273 INFO:tasks.workunit.client.1.smithi165.stdout:7/897: write d0/d4b/d58/f10a [545513,89904] 0 2024-09-16T02:06:01.273 INFO:tasks.workunit.client.1.smithi165.stdout:7/898: readlink d0/df/d7/ld9 0 2024-09-16T02:06:01.276 INFO:tasks.workunit.client.0.smithi110.stdout:7/325: write d3/f19 [219452,361] 0 2024-09-16T02:06:01.278 INFO:tasks.workunit.client.1.smithi165.stdout:8/927: getdents dd/d11/d14/d3f/d25/d36/d85 0 2024-09-16T02:06:01.279 INFO:tasks.workunit.client.0.smithi110.stdout:6/499: dwrite d0/d2/f1c [0,4194304] 0 2024-09-16T02:06:01.281 INFO:tasks.workunit.client.1.smithi165.stdout:6/894: mkdir d7/dc/d7f/d103 0 2024-09-16T02:06:01.282 INFO:tasks.workunit.client.0.smithi110.stdout:6/500: truncate d0/d2/d5/d55/f8f 777373 0 2024-09-16T02:06:01.283 INFO:tasks.workunit.client.0.smithi110.stdout:6/501: write d0/f83 [297881,97995] 0 2024-09-16T02:06:01.284 INFO:tasks.workunit.client.1.smithi165.stdout:4/811: creat d4/dc/d28/d3b/df0/f10a x:0 0 0 2024-09-16T02:06:01.285 INFO:tasks.workunit.client.0.smithi110.stdout:6/502: truncate d0/d2/d57/d7a/f86 364137 0 2024-09-16T02:06:01.286 INFO:tasks.workunit.client.1.smithi165.stdout:4/812: read - d4/dc/d18/d37/d53/d64/d8b/df4/ff6 zero size 2024-09-16T02:06:01.286 INFO:tasks.workunit.client.0.smithi110.stdout:4/425: write d4/d8/d17/f26 [3145727,60741] 0 2024-09-16T02:06:01.286 INFO:tasks.workunit.client.1.smithi165.stdout:0/807: fsync d0/d1e/d39/d48/ff7 0 2024-09-16T02:06:01.288 INFO:tasks.workunit.client.1.smithi165.stdout:9/926: fsync d7/d1f/ddb/f108 0 2024-09-16T02:06:01.289 INFO:tasks.workunit.client.1.smithi165.stdout:2/925: mknod df/dbb/ded/c112 0 2024-09-16T02:06:01.289 INFO:tasks.workunit.client.0.smithi110.stdout:8/344: truncate d3/d12/d1a/d36/d60/d62/d5f/f69 597248 0 2024-09-16T02:06:01.290 INFO:tasks.workunit.client.1.smithi165.stdout:0/808: chown d0/d1e/d20/d28/d6d/lfc 94841181 1 2024-09-16T02:06:01.290 INFO:tasks.workunit.client.1.smithi165.stdout:4/813: write d4/dc/d28/d3b/df0/f10a [95047,60468] 0 2024-09-16T02:06:01.292 INFO:tasks.workunit.client.1.smithi165.stdout:2/926: dread - df/d23/ddc/f111 zero size 2024-09-16T02:06:01.295 INFO:tasks.workunit.client.1.smithi165.stdout:4/814: write d4/dc/d20/d4e/fa7 [179248,31323] 0 2024-09-16T02:06:01.296 INFO:tasks.workunit.client.1.smithi165.stdout:3/969: dwrite da/d17/de5/d104/d2c/f36 [0,4194304] 0 2024-09-16T02:06:01.297 INFO:tasks.workunit.client.1.smithi165.stdout:2/927: chown df/d23/d28/d9a/d86/fd2 473 1 2024-09-16T02:06:01.298 INFO:tasks.workunit.client.0.smithi110.stdout:3/400: write d8/dc/d1b/f3e [558318,60203] 0 2024-09-16T02:06:01.300 INFO:tasks.workunit.client.1.smithi165.stdout:5/930: mkdir de/d19/d1c/d12f 0 2024-09-16T02:06:01.300 INFO:tasks.workunit.client.0.smithi110.stdout:1/436: write d0/d1/f23 [3065736,43888] 0 2024-09-16T02:06:01.304 INFO:tasks.workunit.client.0.smithi110.stdout:8/345: unlink d3/d12/d1d/c34 0 2024-09-16T02:06:01.305 INFO:tasks.workunit.client.1.smithi165.stdout:8/928: getdents dd/d11/d11b 0 2024-09-16T02:06:01.306 INFO:tasks.workunit.client.0.smithi110.stdout:3/401: dwrite d8/dc/d1b/d36/d3b/f49 [0,4194304] 0 2024-09-16T02:06:01.309 INFO:tasks.workunit.client.0.smithi110.stdout:7/326: getdents d3/d15/d44 0 2024-09-16T02:06:01.310 INFO:tasks.workunit.client.1.smithi165.stdout:6/895: dwrite d7/d1f/f32 [0,4194304] 0 2024-09-16T02:06:01.310 INFO:tasks.workunit.client.1.smithi165.stdout:4/815: write d4/dc/fbd [2102965,81802] 0 2024-09-16T02:06:01.310 INFO:tasks.workunit.client.1.smithi165.stdout:6/896: stat d7/d1f/l54 0 2024-09-16T02:06:01.312 INFO:tasks.workunit.client.1.smithi165.stdout:4/816: dread - d4/dc/d18/d37/d53/d64/d8b/ff8 zero size 2024-09-16T02:06:01.313 INFO:tasks.workunit.client.1.smithi165.stdout:2/928: mkdir df/d10/d1a/d2d/dd1/d113 0 2024-09-16T02:06:01.314 INFO:tasks.workunit.client.0.smithi110.stdout:4/426: link d4/d8/d31/d80/d18/f34 d4/d8/d17/d23/f82 0 2024-09-16T02:06:01.314 INFO:tasks.workunit.client.1.smithi165.stdout:2/929: chown df/d10/d1a/d2d/f58 3 1 2024-09-16T02:06:01.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/927: mkdir d7/df/d37/d12a 0 2024-09-16T02:06:01.316 INFO:tasks.workunit.client.0.smithi110.stdout:6/503: dwrite d0/d29/f32 [0,4194304] 0 2024-09-16T02:06:01.318 INFO:tasks.workunit.client.0.smithi110.stdout:8/346: dwrite d3/d12/d1a/d36/d60/f64 [0,4194304] 0 2024-09-16T02:06:01.321 INFO:tasks.workunit.client.1.smithi165.stdout:7/899: truncate d0/d4b/db4/ff4 2206557 0 2024-09-16T02:06:01.322 INFO:tasks.workunit.client.0.smithi110.stdout:6/504: write d0/d29/d2a/d2f/f58 [2439297,104846] 0 2024-09-16T02:06:01.325 INFO:tasks.workunit.client.0.smithi110.stdout:3/402: dread d8/d29/f2d [0,4194304] 0 2024-09-16T02:06:01.327 INFO:tasks.workunit.client.1.smithi165.stdout:0/809: rename d0/d1e/d39/d48/c5e to d0/d1e/d20/d28/d6d/d87/c107 0 2024-09-16T02:06:01.328 INFO:tasks.workunit.client.1.smithi165.stdout:6/897: read d7/d17/d75/f7d [25711,97186] 0 2024-09-16T02:06:01.329 INFO:tasks.workunit.client.1.smithi165.stdout:4/817: creat d4/dc/d20/f10b x:0 0 0 2024-09-16T02:06:01.331 INFO:tasks.workunit.client.0.smithi110.stdout:8/347: dread - d3/d2b/d27/f59 zero size 2024-09-16T02:06:01.331 INFO:tasks.workunit.client.0.smithi110.stdout:4/427: dread f3 [0,4194304] 0 2024-09-16T02:06:01.332 INFO:tasks.workunit.client.0.smithi110.stdout:8/348: readlink d3/d2b/d27/d45/l55 0 2024-09-16T02:06:01.332 INFO:tasks.workunit.client.0.smithi110.stdout:4/428: chown d4/f10 2974991 1 2024-09-16T02:06:01.332 INFO:tasks.workunit.client.1.smithi165.stdout:9/928: mkdir d7/d32/d4a/da8/dd9/d12b 0 2024-09-16T02:06:01.334 INFO:tasks.workunit.client.1.smithi165.stdout:8/929: fdatasync dd/d11/d14/f1e 0 2024-09-16T02:06:01.336 INFO:tasks.workunit.client.1.smithi165.stdout:7/900: mkdir d0/d2c/dc8/d103/d126 0 2024-09-16T02:06:01.338 INFO:tasks.workunit.client.1.smithi165.stdout:0/810: creat d0/d1e/d20/d28/d9a/f108 x:0 0 0 2024-09-16T02:06:01.339 INFO:tasks.workunit.client.0.smithi110.stdout:7/327: symlink d3/d15/l5a 0 2024-09-16T02:06:01.340 INFO:tasks.workunit.client.0.smithi110.stdout:3/403: stat d8/d48/d5b/f63 0 2024-09-16T02:06:01.346 INFO:tasks.workunit.client.0.smithi110.stdout:7/328: dwrite d3/f34 [0,4194304] 0 2024-09-16T02:06:01.348 INFO:tasks.workunit.client.0.smithi110.stdout:3/404: dread d8/dc/d1b/d3a/d43/d58/f6c [0,4194304] 0 2024-09-16T02:06:01.349 INFO:tasks.workunit.client.0.smithi110.stdout:3/405: chown d8/l33 0 1 2024-09-16T02:06:01.349 INFO:tasks.workunit.client.0.smithi110.stdout:3/406: read - d8/f51 zero size 2024-09-16T02:06:01.350 INFO:tasks.workunit.client.0.smithi110.stdout:3/407: dread - d8/dc/f84 zero size 2024-09-16T02:06:01.351 INFO:tasks.workunit.client.0.smithi110.stdout:3/408: read - d8/f56 zero size 2024-09-16T02:06:01.352 INFO:tasks.workunit.client.0.smithi110.stdout:4/429: unlink d4/d8/d31/d5d/f6a 0 2024-09-16T02:06:01.353 INFO:tasks.workunit.client.0.smithi110.stdout:6/505: chown d0/d29/d2a/d2f/d49/c63 160 1 2024-09-16T02:06:01.354 INFO:tasks.workunit.client.0.smithi110.stdout:6/506: write d0/d2/d5/d84/d16/f72 [946588,114833] 0 2024-09-16T02:06:01.355 INFO:tasks.workunit.client.0.smithi110.stdout:1/437: link d0/da/f6a d0/da/f92 0 2024-09-16T02:06:01.355 INFO:tasks.workunit.client.1.smithi165.stdout:4/818: symlink d4/dc0/l10c 0 2024-09-16T02:06:01.355 INFO:tasks.workunit.client.1.smithi165.stdout:6/898: creat d7/dc/df/d1a/d4d/d5f/da7/f104 x:0 0 0 2024-09-16T02:06:01.356 INFO:tasks.workunit.client.0.smithi110.stdout:6/507: chown d0/d29/d2a/d2d/d98/f9d 13 1 2024-09-16T02:06:01.356 INFO:tasks.workunit.client.1.smithi165.stdout:9/929: dread - d7/df/d67/fab zero size 2024-09-16T02:06:01.357 INFO:tasks.workunit.client.1.smithi165.stdout:7/901: fsync d0/d2c/f8d 0 2024-09-16T02:06:01.357 INFO:tasks.workunit.client.0.smithi110.stdout:6/508: write d0/d29/d2a/d2f/f99 [759358,28275] 0 2024-09-16T02:06:01.358 INFO:tasks.workunit.client.1.smithi165.stdout:9/930: fsync d7/d32/d38/d53/d56/d95/f6a 0 2024-09-16T02:06:01.360 INFO:tasks.workunit.client.1.smithi165.stdout:2/930: link df/d10/c21 df/d23/d28/d3b/d6d/d8b/c114 0 2024-09-16T02:06:01.360 INFO:tasks.workunit.client.1.smithi165.stdout:2/931: chown df/d10/d1a 1847 1 2024-09-16T02:06:01.364 INFO:tasks.workunit.client.1.smithi165.stdout:7/902: stat d0/d3d/f6b 0 2024-09-16T02:06:01.366 INFO:tasks.workunit.client.0.smithi110.stdout:1/438: mknod d0/d1/d4/d46/d51/c93 0 2024-09-16T02:06:01.366 INFO:tasks.workunit.client.0.smithi110.stdout:1/439: stat d0/d1/d4/d46/d7a 0 2024-09-16T02:06:01.368 INFO:tasks.workunit.client.0.smithi110.stdout:6/509: mkdir d0/d2/d57/da0 0 2024-09-16T02:06:01.369 INFO:tasks.workunit.client.1.smithi165.stdout:8/930: dread dd/d11/d14/d70/d7b/f84 [0,4194304] 0 2024-09-16T02:06:01.369 INFO:tasks.workunit.client.0.smithi110.stdout:7/329: write d3/d15/d38/d4f/d10/d11/f28 [339711,119168] 0 2024-09-16T02:06:01.369 INFO:tasks.workunit.client.0.smithi110.stdout:3/409: symlink d8/dc/d1b/l8f 0 2024-09-16T02:06:01.371 INFO:tasks.workunit.client.1.smithi165.stdout:9/931: fsync d7/df/d37/d43/d88/fa6 0 2024-09-16T02:06:01.371 INFO:tasks.workunit.client.1.smithi165.stdout:8/931: write dd/d11/d14/d3f/db3/dbe/f105 [915195,22502] 0 2024-09-16T02:06:01.372 INFO:tasks.workunit.client.1.smithi165.stdout:4/819: mkdir d4/dc/d28/d2b/d10d 0 2024-09-16T02:06:01.375 INFO:tasks.workunit.client.1.smithi165.stdout:0/811: dwrite d0/d2a/d70/f8b [0,4194304] 0 2024-09-16T02:06:01.376 INFO:tasks.workunit.client.1.smithi165.stdout:2/932: rename df/d10/d64/lad to df/d10/db4/l115 0 2024-09-16T02:06:01.377 INFO:tasks.workunit.client.0.smithi110.stdout:4/430: symlink d4/d8/d31/d6f/l83 0 2024-09-16T02:06:01.379 INFO:tasks.workunit.client.1.smithi165.stdout:7/903: mkdir d0/d3d/dd5/d127 0 2024-09-16T02:06:01.380 INFO:tasks.workunit.client.1.smithi165.stdout:7/904: chown d0/df/d42/fa3 1143199 1 2024-09-16T02:06:01.380 INFO:tasks.workunit.client.0.smithi110.stdout:1/440: creat d0/d1/d4/d46/d64/d79/f94 x:0 0 0 2024-09-16T02:06:01.380 INFO:tasks.workunit.client.1.smithi165.stdout:7/905: write d0/d4b/d63/f8f [1299017,78602] 0 2024-09-16T02:06:01.381 INFO:tasks.workunit.client.0.smithi110.stdout:6/510: creat d0/d29/fa1 x:0 0 0 2024-09-16T02:06:01.387 INFO:tasks.workunit.client.0.smithi110.stdout:4/431: mkdir d4/d8/d31/d5d/d84 0 2024-09-16T02:06:01.387 INFO:tasks.workunit.client.1.smithi165.stdout:9/932: dread d7/df/d37/d43/d88/fa6 [0,4194304] 0 2024-09-16T02:06:01.388 INFO:tasks.workunit.client.1.smithi165.stdout:4/820: mknod d4/dc/d18/d37/d53/d64/d8b/c10e 0 2024-09-16T02:06:01.389 INFO:tasks.workunit.client.1.smithi165.stdout:0/812: unlink d0/d61/cd7 0 2024-09-16T02:06:01.391 INFO:tasks.workunit.client.1.smithi165.stdout:0/813: dread - d0/d1e/d39/d48/d45/db3/ffb zero size 2024-09-16T02:06:01.401 INFO:tasks.workunit.client.0.smithi110.stdout:8/349: rename d3/c19 to d3/d12/d1a/d6c/c76 0 2024-09-16T02:06:01.401 INFO:tasks.workunit.client.1.smithi165.stdout:6/899: link d7/l15 d7/dc/d7f/dd2/d3c/dcd/l105 0 2024-09-16T02:06:01.402 INFO:tasks.workunit.client.1.smithi165.stdout:6/900: chown d7/d17/d75/dc1 170265976 1 2024-09-16T02:06:01.405 INFO:tasks.workunit.client.1.smithi165.stdout:9/933: write d7/d14/d7a/f101 [1245399,68850] 0 2024-09-16T02:06:01.407 INFO:tasks.workunit.client.0.smithi110.stdout:7/330: link d3/d15/d38/d4f/d10/d2c/c36 d3/d15/d38/d4f/d10/d11/d3e/d40/c5b 0 2024-09-16T02:06:01.407 INFO:tasks.workunit.client.1.smithi165.stdout:9/934: stat d7/d1f/ddb/cf3 0 2024-09-16T02:06:01.407 INFO:tasks.workunit.client.0.smithi110.stdout:4/432: dread d4/f10 [0,4194304] 0 2024-09-16T02:06:01.408 INFO:tasks.workunit.client.1.smithi165.stdout:6/901: dwrite d7/f57 [4194304,4194304] 0 2024-09-16T02:06:01.408 INFO:tasks.workunit.client.1.smithi165.stdout:2/933: mkdir df/d116 0 2024-09-16T02:06:01.408 INFO:tasks.workunit.client.0.smithi110.stdout:7/331: chown d3/d15/d38/d4f/fe 43016 1 2024-09-16T02:06:01.409 INFO:tasks.workunit.client.0.smithi110.stdout:8/350: readlink d3/d12/d1a/l28 0 2024-09-16T02:06:01.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/371: sync 2024-09-16T02:06:01.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/432: sync 2024-09-16T02:06:01.411 INFO:tasks.workunit.client.0.smithi110.stdout:9/328: sync 2024-09-16T02:06:01.412 INFO:tasks.workunit.client.0.smithi110.stdout:9/329: fsync d1/f3 0 2024-09-16T02:06:01.414 INFO:tasks.workunit.client.0.smithi110.stdout:0/433: write d3/d6/d43/d55/d59/f5c [51635,114301] 0 2024-09-16T02:06:01.415 INFO:tasks.workunit.client.0.smithi110.stdout:6/511: getdents d0/d2 0 2024-09-16T02:06:01.415 INFO:tasks.workunit.client.0.smithi110.stdout:1/441: write d0/da/f36 [354134,77237] 0 2024-09-16T02:06:01.417 INFO:tasks.workunit.client.1.smithi165.stdout:2/934: creat df/d23/d28/d87/f117 x:0 0 0 2024-09-16T02:06:01.417 INFO:tasks.workunit.client.0.smithi110.stdout:7/332: getdents d3/d15/d3a 0 2024-09-16T02:06:01.418 INFO:tasks.workunit.client.0.smithi110.stdout:1/442: truncate d0/d1/d4/d46/d64/d79/f94 1022196 0 2024-09-16T02:06:01.419 INFO:tasks.workunit.client.0.smithi110.stdout:7/333: write d3/d15/d38/d4f/fe [1569508,15164] 0 2024-09-16T02:06:01.421 INFO:tasks.workunit.client.1.smithi165.stdout:7/906: creat d0/d4b/db4/f128 x:0 0 0 2024-09-16T02:06:01.423 INFO:tasks.workunit.client.0.smithi110.stdout:5/372: symlink d5/d36/d45/l7c 0 2024-09-16T02:06:01.424 INFO:tasks.workunit.client.1.smithi165.stdout:8/932: truncate dd/d9e/f12c 5398814 0 2024-09-16T02:06:01.425 INFO:tasks.workunit.client.0.smithi110.stdout:3/410: dwrite d8/dc/d1b/d36/d3b/f81 [0,4194304] 0 2024-09-16T02:06:01.426 INFO:tasks.workunit.client.1.smithi165.stdout:2/935: creat df/d23/d28/d3b/d82/f118 x:0 0 0 2024-09-16T02:06:01.428 INFO:tasks.workunit.client.1.smithi165.stdout:9/935: dread d7/d32/f39 [0,4194304] 0 2024-09-16T02:06:01.428 INFO:tasks.workunit.client.0.smithi110.stdout:9/330: rename d1/d5/d8/de/f46 to d1/d1b/f6e 0 2024-09-16T02:06:01.429 INFO:tasks.workunit.client.1.smithi165.stdout:4/821: write d4/fad [1025450,101112] 0 2024-09-16T02:06:01.430 INFO:tasks.workunit.client.0.smithi110.stdout:9/331: dread - d1/d2b/d2e/f4d zero size 2024-09-16T02:06:01.430 INFO:tasks.workunit.client.1.smithi165.stdout:0/814: creat d0/f109 x:0 0 0 2024-09-16T02:06:01.432 INFO:tasks.workunit.client.0.smithi110.stdout:8/351: creat d3/d12/d1a/d36/d60/d62/d5f/f77 x:0 0 0 2024-09-16T02:06:01.433 INFO:tasks.workunit.client.0.smithi110.stdout:4/433: truncate d4/d8/d17/d23/f74 2390627 0 2024-09-16T02:06:01.434 INFO:tasks.workunit.client.0.smithi110.stdout:9/332: dread d1/f3 [8388608,4194304] 0 2024-09-16T02:06:01.435 INFO:tasks.workunit.client.1.smithi165.stdout:2/936: dwrite df/d10/d1a/d2d/dd1/ff7 [0,4194304] 0 2024-09-16T02:06:01.436 INFO:tasks.workunit.client.1.smithi165.stdout:7/907: rename d0/ff6 to d0/d2c/dc8/dea/f129 0 2024-09-16T02:06:01.437 INFO:tasks.workunit.client.0.smithi110.stdout:1/443: mknod d0/d1/d4/d46/d64/d79/c95 0 2024-09-16T02:06:01.437 INFO:tasks.workunit.client.0.smithi110.stdout:2/413: sync 2024-09-16T02:06:01.440 INFO:tasks.workunit.client.1.smithi165.stdout:4/822: creat d4/dc/d28/d3b/f10f x:0 0 0 2024-09-16T02:06:01.442 INFO:tasks.workunit.client.0.smithi110.stdout:3/411: creat d8/d48/d5b/d6a/f90 x:0 0 0 2024-09-16T02:06:01.443 INFO:tasks.workunit.client.1.smithi165.stdout:0/815: write d0/fba [2099566,97691] 0 2024-09-16T02:06:01.444 INFO:tasks.workunit.client.0.smithi110.stdout:0/434: rename d3/d4/f1d to d3/d4/d41/f7f 0 2024-09-16T02:06:01.446 INFO:tasks.workunit.client.0.smithi110.stdout:3/412: stat d8/dc/d1b/d3a/d43/d58/f6c 0 2024-09-16T02:06:01.446 INFO:tasks.workunit.client.0.smithi110.stdout:5/373: dwrite d5/dd/df/d28/f6b [0,4194304] 0 2024-09-16T02:06:01.448 INFO:tasks.workunit.client.1.smithi165.stdout:4/823: dwrite f1 [4194304,4194304] 0 2024-09-16T02:06:01.448 INFO:tasks.workunit.client.0.smithi110.stdout:3/413: truncate d8/dc/f7e 4871247 0 2024-09-16T02:06:01.448 INFO:tasks.workunit.client.1.smithi165.stdout:8/933: dread dd/d11/d14/d3f/d25/fa8 [0,4194304] 0 2024-09-16T02:06:01.449 INFO:tasks.workunit.client.0.smithi110.stdout:5/374: chown d5/dd/f10 556 1 2024-09-16T02:06:01.452 INFO:tasks.workunit.client.0.smithi110.stdout:8/352: read d3/fe [2011036,68010] 0 2024-09-16T02:06:01.457 INFO:tasks.workunit.client.1.smithi165.stdout:7/908: mkdir d0/d3d/d9f/ddc/d12a 0 2024-09-16T02:06:01.457 INFO:tasks.workunit.client.0.smithi110.stdout:3/414: dwrite d8/dc/d1b/f60 [0,4194304] 0 2024-09-16T02:06:01.459 INFO:tasks.workunit.client.1.smithi165.stdout:2/937: dread df/f3f [0,4194304] 0 2024-09-16T02:06:01.459 INFO:tasks.workunit.client.0.smithi110.stdout:2/414: rmdir d0/da/d18/d25 39 2024-09-16T02:06:01.460 INFO:tasks.workunit.client.0.smithi110.stdout:2/415: stat d0/da/f7c 0 2024-09-16T02:06:01.460 INFO:tasks.workunit.client.0.smithi110.stdout:3/415: fdatasync d8/d48/d5b/d6a/d75/d8b/f8d 0 2024-09-16T02:06:01.461 INFO:tasks.workunit.client.1.smithi165.stdout:9/936: creat d7/d14/d80/d102/f12c x:0 0 0 2024-09-16T02:06:01.461 INFO:tasks.workunit.client.0.smithi110.stdout:2/416: read d0/db/f27 [2363081,69659] 0 2024-09-16T02:06:01.461 INFO:tasks.workunit.client.0.smithi110.stdout:3/416: truncate d8/d29/f42 292376 0 2024-09-16T02:06:01.462 INFO:tasks.workunit.client.1.smithi165.stdout:2/938: truncate df/d23/ddc/f111 546236 0 2024-09-16T02:06:01.462 INFO:tasks.workunit.client.0.smithi110.stdout:2/417: chown d0/da/c38 4067 1 2024-09-16T02:06:01.462 INFO:tasks.workunit.client.0.smithi110.stdout:1/444: write d0/d1/d4/d46/d75/f90 [4541018,47298] 0 2024-09-16T02:06:01.463 INFO:tasks.workunit.client.1.smithi165.stdout:2/939: readlink df/d10/d64/ldb 0 2024-09-16T02:06:01.466 INFO:tasks.workunit.client.1.smithi165.stdout:0/816: symlink d0/d47/l10a 0 2024-09-16T02:06:01.466 INFO:tasks.workunit.client.1.smithi165.stdout:7/909: dwrite d0/df/d65/f6e [0,4194304] 0 2024-09-16T02:06:01.466 INFO:tasks.workunit.client.0.smithi110.stdout:7/334: rename d3/d15/d38/d4f/l41 to d3/d15/d38/d4f/d10/d11/d3e/d40/d50/l5c 0 2024-09-16T02:06:01.469 INFO:tasks.workunit.client.1.smithi165.stdout:6/902: link d7/dc/df/d1a/d4d/d5f/le5 d7/dc/df/d1a/d4d/l106 0 2024-09-16T02:06:01.469 INFO:tasks.workunit.client.0.smithi110.stdout:7/335: dread d3/d15/d38/d4f/d10/d11/f2d [0,4194304] 0 2024-09-16T02:06:01.471 INFO:tasks.workunit.client.0.smithi110.stdout:4/434: symlink d4/l85 0 2024-09-16T02:06:01.471 INFO:tasks.workunit.client.0.smithi110.stdout:4/435: write d4/f11 [4734080,40715] 0 2024-09-16T02:06:01.473 INFO:tasks.workunit.client.1.smithi165.stdout:4/824: unlink d4/dc/d18/d37/d53/c84 0 2024-09-16T02:06:01.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/436: write d4/d8/d31/d80/d18/f4d [322221,87653] 0 2024-09-16T02:06:01.477 INFO:tasks.workunit.client.1.smithi165.stdout:8/934: rename dd/d11/d14/d3f/d25/d36/d81/dd2/d53/c5c to dd/d11/d14/d70/d7b/df2/c140 0 2024-09-16T02:06:01.477 INFO:tasks.workunit.client.0.smithi110.stdout:6/512: link d0/d2/d5/c28 d0/d29/d2a/d2f/d34/ca2 0 2024-09-16T02:06:01.478 INFO:tasks.workunit.client.1.smithi165.stdout:8/935: readlink dd/d11/d14/d3f/d72/l10f 0 2024-09-16T02:06:01.479 INFO:tasks.workunit.client.0.smithi110.stdout:5/375: fsync d5/dd/df/f35 0 2024-09-16T02:06:01.482 INFO:tasks.workunit.client.0.smithi110.stdout:9/333: mkdir d1/dd/d6a/d6c/d6f 0 2024-09-16T02:06:01.482 INFO:tasks.workunit.client.1.smithi165.stdout:2/940: unlink df/d10/d1a/dca/ld7 0 2024-09-16T02:06:01.483 INFO:tasks.workunit.client.1.smithi165.stdout:4/825: dwrite d4/dc/d28/d3b/df0/f10a [0,4194304] 0 2024-09-16T02:06:01.483 INFO:tasks.workunit.client.1.smithi165.stdout:3/970: sync 2024-09-16T02:06:01.485 INFO:tasks.workunit.client.0.smithi110.stdout:2/418: creat d0/db/d33/d70/f8a x:0 0 0 2024-09-16T02:06:01.486 INFO:tasks.workunit.client.1.smithi165.stdout:0/817: creat d0/d1e/d39/d48/d5f/ddf/f10b x:0 0 0 2024-09-16T02:06:01.488 INFO:tasks.workunit.client.1.smithi165.stdout:4/826: write d4/dc/d28/d3b/f10f [926011,70846] 0 2024-09-16T02:06:01.491 INFO:tasks.workunit.client.1.smithi165.stdout:4/827: write d4/dc/d20/d4e/fa7 [671209,27852] 0 2024-09-16T02:06:01.492 INFO:tasks.workunit.client.1.smithi165.stdout:9/937: mknod d7/d32/d38/d58/dbb/c12d 0 2024-09-16T02:06:01.492 INFO:tasks.workunit.client.1.smithi165.stdout:0/818: truncate d0/d1e/d39/d99/fbd 5039122 0 2024-09-16T02:06:01.492 INFO:tasks.workunit.client.1.smithi165.stdout:8/936: dwrite dd/d11/d38/d74/f11c [0,4194304] 0 2024-09-16T02:06:01.492 INFO:tasks.workunit.client.0.smithi110.stdout:7/336: symlink d3/d15/d38/d4f/d2e/l5d 0 2024-09-16T02:06:01.494 INFO:tasks.workunit.client.0.smithi110.stdout:7/337: dread - d3/d15/d38/d4f/d2e/f59 zero size 2024-09-16T02:06:01.495 INFO:tasks.workunit.client.1.smithi165.stdout:8/937: fsync dd/d11/d14/d3f/db3/dbe/f13f 0 2024-09-16T02:06:01.495 INFO:tasks.workunit.client.1.smithi165.stdout:0/819: write d0/d47/f65 [5150149,115975] 0 2024-09-16T02:06:01.495 INFO:tasks.workunit.client.0.smithi110.stdout:0/435: creat d3/d4/dc/d14/d76/f80 x:0 0 0 2024-09-16T02:06:01.496 INFO:tasks.workunit.client.1.smithi165.stdout:2/941: rename df/d23/d28/l3c to df/d10/d1a/d2d/dd1/l119 0 2024-09-16T02:06:01.496 INFO:tasks.workunit.client.1.smithi165.stdout:9/938: dread d7/d32/f39 [0,4194304] 0 2024-09-16T02:06:01.497 INFO:tasks.workunit.client.0.smithi110.stdout:4/437: fsync d4/d8/d31/d80/d18/f34 0 2024-09-16T02:06:01.497 INFO:tasks.workunit.client.1.smithi165.stdout:3/971: rmdir da/d17/de5/d104/d2c/d2d 39 2024-09-16T02:06:01.498 INFO:tasks.workunit.client.0.smithi110.stdout:1/445: dread d0/d1/d2a/d32/f4f [0,4194304] 0 2024-09-16T02:06:01.499 INFO:tasks.workunit.client.1.smithi165.stdout:9/939: truncate d7/d1f/ddb/f121 688377 0 2024-09-16T02:06:01.500 INFO:tasks.workunit.client.1.smithi165.stdout:9/940: stat d7/d32/d38/d53/d56/d95/f124 0 2024-09-16T02:06:01.502 INFO:tasks.workunit.client.1.smithi165.stdout:7/910: creat d0/d2c/d85/f12b x:0 0 0 2024-09-16T02:06:01.504 INFO:tasks.workunit.client.0.smithi110.stdout:2/419: unlink d0/d5f/l68 0 2024-09-16T02:06:01.505 INFO:tasks.workunit.client.0.smithi110.stdout:3/417: mknod d8/d48/d5b/d6a/d75/d88/c91 0 2024-09-16T02:06:01.507 INFO:tasks.workunit.client.1.smithi165.stdout:8/938: write dd/d11/daa/fcb [547908,73448] 0 2024-09-16T02:06:01.509 INFO:tasks.workunit.client.0.smithi110.stdout:8/353: dwrite d3/d12/d1a/d36/f4f [0,4194304] 0 2024-09-16T02:06:01.509 INFO:tasks.workunit.client.1.smithi165.stdout:8/939: dread - dd/d11/d38/da6/f131 zero size 2024-09-16T02:06:01.510 INFO:tasks.workunit.client.1.smithi165.stdout:2/942: creat df/dbb/ded/f11a x:0 0 0 2024-09-16T02:06:01.510 INFO:tasks.workunit.client.0.smithi110.stdout:8/354: chown d3/d12/d1a/d36/d60/d62/l54 6524346 1 2024-09-16T02:06:01.511 INFO:tasks.workunit.client.1.smithi165.stdout:2/943: dread - df/d23/d28/d3b/d82/f118 zero size 2024-09-16T02:06:01.512 INFO:tasks.workunit.client.1.smithi165.stdout:2/944: write df/d23/d28/f53 [1966395,30306] 0 2024-09-16T02:06:01.512 INFO:tasks.workunit.client.1.smithi165.stdout:6/903: write d7/d17/d75/d97/dcb/d3d/d5d/d73/fe7 [3315553,126982] 0 2024-09-16T02:06:01.516 INFO:tasks.workunit.client.1.smithi165.stdout:4/828: creat d4/dbc/f110 x:0 0 0 2024-09-16T02:06:01.517 INFO:tasks.workunit.client.0.smithi110.stdout:9/334: symlink d1/d5/d20/d55/l70 0 2024-09-16T02:06:01.519 INFO:tasks.workunit.client.1.smithi165.stdout:0/820: truncate d0/d1e/d20/f46 3916749 0 2024-09-16T02:06:01.520 INFO:tasks.workunit.client.0.smithi110.stdout:0/436: mkdir d3/d4/dc/d14/d7e/d81 0 2024-09-16T02:06:01.520 INFO:tasks.workunit.client.1.smithi165.stdout:7/911: dread d0/df/d33/d2a/fb0 [0,4194304] 0 2024-09-16T02:06:01.521 INFO:tasks.workunit.client.1.smithi165.stdout:8/940: write dd/d11/d14/d3f/d25/fa8 [4904028,1968] 0 2024-09-16T02:06:01.524 INFO:tasks.workunit.client.0.smithi110.stdout:3/418: rename d8/dc/d1b/d36/d3b to d8/d48/d5b/d92 0 2024-09-16T02:06:01.525 INFO:tasks.workunit.client.1.smithi165.stdout:3/972: symlink da/d17/d7a/d7d/da8/l145 0 2024-09-16T02:06:01.529 INFO:tasks.workunit.client.0.smithi110.stdout:9/335: rmdir d1/dd 39 2024-09-16T02:06:01.530 INFO:tasks.workunit.client.1.smithi165.stdout:9/941: creat d7/df/d37/d12a/f12e x:0 0 0 2024-09-16T02:06:01.531 INFO:tasks.workunit.client.0.smithi110.stdout:7/338: dwrite d3/f8 [4194304,4194304] 0 2024-09-16T02:06:01.532 INFO:tasks.workunit.client.0.smithi110.stdout:4/438: dread d4/d8/d31/d80/d18/f43 [0,4194304] 0 2024-09-16T02:06:01.532 INFO:tasks.workunit.client.0.smithi110.stdout:2/420: link d0/db/d33/d70/f5a d0/db/d47/f8b 0 2024-09-16T02:06:01.533 INFO:tasks.workunit.client.1.smithi165.stdout:4/829: mkdir d4/dc/d18/d111 0 2024-09-16T02:06:01.534 INFO:tasks.workunit.client.0.smithi110.stdout:2/421: read d0/db/d33/d70/d41/f44 [885443,48952] 0 2024-09-16T02:06:01.535 INFO:tasks.workunit.client.0.smithi110.stdout:4/439: dread d4/f10 [0,4194304] 0 2024-09-16T02:06:01.535 INFO:tasks.workunit.client.0.smithi110.stdout:0/437: rename d3/d4/d6d/f71 to d3/f82 0 2024-09-16T02:06:01.536 INFO:tasks.workunit.client.0.smithi110.stdout:7/339: dread d3/d15/d38/d4f/d10/d11/d3e/d40/f4a [0,4194304] 0 2024-09-16T02:06:01.536 INFO:tasks.workunit.client.0.smithi110.stdout:0/438: readlink d3/l3d 0 2024-09-16T02:06:01.539 INFO:tasks.workunit.client.0.smithi110.stdout:4/440: write d4/d8/d31/d73/f66 [705023,57925] 0 2024-09-16T02:06:01.539 INFO:tasks.workunit.client.1.smithi165.stdout:0/821: symlink d0/d1e/d20/d28/d6d/daf/dc0/l10c 0 2024-09-16T02:06:01.540 INFO:tasks.workunit.client.1.smithi165.stdout:5/931: sync 2024-09-16T02:06:01.541 INFO:tasks.workunit.client.0.smithi110.stdout:7/340: chown d3/d15/d38/d4f/d10/d11/d3e/d40/f4b 1079076 1 2024-09-16T02:06:01.541 INFO:tasks.workunit.client.0.smithi110.stdout:1/446: getdents d0/d1/d4/d46/d64 0 2024-09-16T02:06:01.542 INFO:tasks.workunit.client.1.smithi165.stdout:7/912: mknod d0/df/d7/c12c 0 2024-09-16T02:06:01.542 INFO:tasks.workunit.client.0.smithi110.stdout:7/341: chown d3/d15/d38 8171 1 2024-09-16T02:06:01.545 INFO:tasks.workunit.client.0.smithi110.stdout:2/422: dwrite d0/db/d47/f60 [0,4194304] 0 2024-09-16T02:06:01.545 INFO:tasks.workunit.client.1.smithi165.stdout:8/941: rmdir dd/d7f 39 2024-09-16T02:06:01.546 INFO:tasks.workunit.client.0.smithi110.stdout:2/423: write d0/da/f26 [2153257,37396] 0 2024-09-16T02:06:01.549 INFO:tasks.workunit.client.1.smithi165.stdout:6/904: mkdir d7/dc/df/d107 0 2024-09-16T02:06:01.552 INFO:tasks.workunit.client.1.smithi165.stdout:2/945: rename df/d23/d28/f32 to df/d10/db4/f11b 0 2024-09-16T02:06:01.556 INFO:tasks.workunit.client.1.smithi165.stdout:0/822: symlink d0/d1e/d39/d48/d5f/d96/da4/l10d 0 2024-09-16T02:06:01.558 INFO:tasks.workunit.client.0.smithi110.stdout:4/441: truncate d4/d8/d31/f39 2299127 0 2024-09-16T02:06:01.560 INFO:tasks.workunit.client.1.smithi165.stdout:3/973: dwrite da/d17/de5/f11a [0,4194304] 0 2024-09-16T02:06:01.560 INFO:tasks.workunit.client.1.smithi165.stdout:3/974: chown da/d20 2757 1 2024-09-16T02:06:01.561 INFO:tasks.workunit.client.1.smithi165.stdout:9/942: symlink d7/d32/d4a/da8/dd9/d12b/l12f 0 2024-09-16T02:06:01.562 INFO:tasks.workunit.client.1.smithi165.stdout:2/946: symlink df/d10/d1a/d2d/l11c 0 2024-09-16T02:06:01.563 INFO:tasks.workunit.client.0.smithi110.stdout:0/439: creat d3/d4/dc/d75/f83 x:0 0 0 2024-09-16T02:06:01.565 INFO:tasks.workunit.client.1.smithi165.stdout:5/932: write de/d19/f33 [683980,68701] 0 2024-09-16T02:06:01.565 INFO:tasks.workunit.client.1.smithi165.stdout:7/913: mknod d0/d3d/dd5/d127/c12d 0 2024-09-16T02:06:01.565 INFO:tasks.workunit.client.0.smithi110.stdout:7/342: mknod d3/c5e 0 2024-09-16T02:06:01.567 INFO:tasks.workunit.client.1.smithi165.stdout:2/947: write df/d23/d28/d9a/d86/fd2 [3971834,637] 0 2024-09-16T02:06:01.567 INFO:tasks.workunit.client.0.smithi110.stdout:9/336: creat d1/d1b/d23/f71 x:0 0 0 2024-09-16T02:06:01.570 INFO:tasks.workunit.client.1.smithi165.stdout:3/975: dwrite da/d17/de5/d104/d2c/d10c/f93 [0,4194304] 0 2024-09-16T02:06:01.570 INFO:tasks.workunit.client.1.smithi165.stdout:8/942: write dd/d11/d14/d70/d7b/f12f [734514,63194] 0 2024-09-16T02:06:01.571 INFO:tasks.workunit.client.0.smithi110.stdout:8/355: link d3/d12/d5e/c75 d3/d12/d1a/d36/c78 0 2024-09-16T02:06:01.573 INFO:tasks.workunit.client.0.smithi110.stdout:0/440: symlink d3/d6/d43/d55/l84 0 2024-09-16T02:06:01.574 INFO:tasks.workunit.client.1.smithi165.stdout:4/830: dread d4/dc/d28/f4a [0,4194304] 0 2024-09-16T02:06:01.575 INFO:tasks.workunit.client.0.smithi110.stdout:0/441: dread d3/d6/d43/d55/f6f [0,4194304] 0 2024-09-16T02:06:01.576 INFO:tasks.workunit.client.1.smithi165.stdout:8/943: dread dd/d11/d38/d74/f11c [0,4194304] 0 2024-09-16T02:06:01.578 INFO:tasks.workunit.client.0.smithi110.stdout:7/343: creat d3/d15/d38/d4f/d10/d11/f5f x:0 0 0 2024-09-16T02:06:01.578 INFO:tasks.workunit.client.1.smithi165.stdout:3/976: read da/d17/de5/d104/d2c/d10c/d6b/f12f [148489,62315] 0 2024-09-16T02:06:01.579 INFO:tasks.workunit.client.1.smithi165.stdout:5/933: readlink de/l1b 0 2024-09-16T02:06:01.581 INFO:tasks.workunit.client.0.smithi110.stdout:1/447: link d0/d1/d2a/l60 d0/d1/d4/d46/d51/l96 0 2024-09-16T02:06:01.584 INFO:tasks.workunit.client.0.smithi110.stdout:8/356: mknod d3/d12/d5e/c79 0 2024-09-16T02:06:01.585 INFO:tasks.workunit.client.0.smithi110.stdout:8/357: chown d3/d2b/d27/f47 76990 1 2024-09-16T02:06:01.587 INFO:tasks.workunit.client.0.smithi110.stdout:0/442: dread d3/d6/d43/d55/f7d [0,4194304] 0 2024-09-16T02:06:01.589 INFO:tasks.workunit.client.0.smithi110.stdout:7/344: rmdir d3/d15/d44 39 2024-09-16T02:06:01.593 INFO:tasks.workunit.client.1.smithi165.stdout:2/948: dwrite df/d23/d28/dfa/fd6 [0,4194304] 0 2024-09-16T02:06:01.594 INFO:tasks.workunit.client.1.smithi165.stdout:6/905: link d7/dc/df/d1a/d4d/d5f/da7/caa d7/d17/d75/d97/dcb/d3d/ddd/c108 0 2024-09-16T02:06:01.596 INFO:tasks.workunit.client.0.smithi110.stdout:8/358: symlink d3/d2b/l7a 0 2024-09-16T02:06:01.598 INFO:tasks.workunit.client.1.smithi165.stdout:0/823: truncate d0/d1e/d39/f6a 6656318 0 2024-09-16T02:06:01.605 INFO:tasks.workunit.client.0.smithi110.stdout:7/345: creat d3/d15/d38/d4f/d10/d11/d3e/d40/f60 x:0 0 0 2024-09-16T02:06:01.605 INFO:tasks.workunit.client.0.smithi110.stdout:8/359: dwrite d3/d12/d1a/d36/d60/d62/d5f/f77 [0,4194304] 0 2024-09-16T02:06:01.609 INFO:tasks.workunit.client.0.smithi110.stdout:0/443: mkdir d3/d4/d85 0 2024-09-16T02:06:01.610 INFO:tasks.workunit.client.1.smithi165.stdout:6/906: mknod d7/d17/d75/d97/dcb/d74/db7/c109 0 2024-09-16T02:06:01.611 INFO:tasks.workunit.client.0.smithi110.stdout:1/448: dwrite d0/d1/d4/f31 [0,4194304] 0 2024-09-16T02:06:01.612 INFO:tasks.workunit.client.0.smithi110.stdout:1/449: stat d0/d1/l48 0 2024-09-16T02:06:01.612 INFO:tasks.workunit.client.0.smithi110.stdout:9/337: rename d1/d2b/d2e/c42 to d1/d2b/c72 0 2024-09-16T02:06:01.613 INFO:tasks.workunit.client.0.smithi110.stdout:9/338: read - d1/d2b/d2e/f4d zero size 2024-09-16T02:06:01.614 INFO:tasks.workunit.client.1.smithi165.stdout:4/831: mknod d4/c112 0 2024-09-16T02:06:01.615 INFO:tasks.workunit.client.0.smithi110.stdout:9/339: write d1/d5/d8/f17 [7315505,52263] 0 2024-09-16T02:06:01.615 INFO:tasks.workunit.client.0.smithi110.stdout:8/360: symlink d3/d2b/d27/l7b 0 2024-09-16T02:06:01.620 INFO:tasks.workunit.client.1.smithi165.stdout:9/943: rename d7/d1f/f114 to d7/d32/d38/d53/d56/dca/f130 0 2024-09-16T02:06:01.620 INFO:tasks.workunit.client.0.smithi110.stdout:0/444: rmdir d3/d4/dc/d14 39 2024-09-16T02:06:01.621 INFO:tasks.workunit.client.1.smithi165.stdout:9/944: chown d7/df/d37/d43/d88/lbd 6 1 2024-09-16T02:06:01.622 INFO:tasks.workunit.client.0.smithi110.stdout:1/450: rmdir d0/d1/d2a/d32/d40 39 2024-09-16T02:06:01.624 INFO:tasks.workunit.client.1.smithi165.stdout:8/944: symlink dd/d7f/l141 0 2024-09-16T02:06:01.625 INFO:tasks.workunit.client.1.smithi165.stdout:8/945: chown dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/lec 767506 1 2024-09-16T02:06:01.626 INFO:tasks.workunit.client.1.smithi165.stdout:8/946: write dd/d11/f55 [1539626,96787] 0 2024-09-16T02:06:01.628 INFO:tasks.workunit.client.0.smithi110.stdout:0/445: dwrite d3/f1a [4194304,4194304] 0 2024-09-16T02:06:01.630 INFO:tasks.workunit.client.1.smithi165.stdout:5/934: link de/d21/d26/f113 de/d21/d26/d3a/d54/d8c/f130 0 2024-09-16T02:06:01.631 INFO:tasks.workunit.client.1.smithi165.stdout:5/935: write de/f1d [78001,51057] 0 2024-09-16T02:06:01.632 INFO:tasks.workunit.client.1.smithi165.stdout:7/914: rmdir d0/df/d125 0 2024-09-16T02:06:01.633 INFO:tasks.workunit.client.0.smithi110.stdout:8/361: rename d3/fd to d3/d12/d1a/d36/d60/f7c 0 2024-09-16T02:06:01.634 INFO:tasks.workunit.client.1.smithi165.stdout:6/907: symlink d7/d17/d75/d97/dcb/d3d/d5d/d73/l10a 0 2024-09-16T02:06:01.635 INFO:tasks.workunit.client.1.smithi165.stdout:6/908: chown d7/dc/df/d1a/d4d/d5f/f88 7257 1 2024-09-16T02:06:01.636 INFO:tasks.workunit.client.1.smithi165.stdout:6/909: readlink l1 0 2024-09-16T02:06:01.636 INFO:tasks.workunit.client.1.smithi165.stdout:4/832: unlink d4/dc/d18/d37/dc9/fe3 0 2024-09-16T02:06:01.640 INFO:tasks.workunit.client.0.smithi110.stdout:9/340: creat d1/dd/d6a/d6c/f73 x:0 0 0 2024-09-16T02:06:01.642 INFO:tasks.workunit.client.1.smithi165.stdout:9/945: symlink d7/d14/d80/d102/l131 0 2024-09-16T02:06:01.644 INFO:tasks.workunit.client.1.smithi165.stdout:9/946: dread d7/d32/f39 [0,4194304] 0 2024-09-16T02:06:01.646 INFO:tasks.workunit.client.0.smithi110.stdout:7/346: getdents d3/d15/d38/d4f/d10 0 2024-09-16T02:06:01.647 INFO:tasks.workunit.client.1.smithi165.stdout:8/947: mkdir dd/d11/de4/d142 0 2024-09-16T02:06:01.651 INFO:tasks.workunit.client.1.smithi165.stdout:2/949: truncate df/d23/d28/d3b/d6d/d8b/fd5 686281 0 2024-09-16T02:06:01.652 INFO:tasks.workunit.client.0.smithi110.stdout:1/451: link d0/da/f5c d0/d1/d2a/d32/d40/f97 0 2024-09-16T02:06:01.652 INFO:tasks.workunit.client.1.smithi165.stdout:8/948: dwrite dd/d11/f135 [0,4194304] 0 2024-09-16T02:06:01.654 INFO:tasks.workunit.client.1.smithi165.stdout:5/936: rmdir de/d21/d26/de6 39 2024-09-16T02:06:01.655 INFO:tasks.workunit.client.1.smithi165.stdout:8/949: truncate dd/d11/d14/d3f/d25/d36/f128 376736 0 2024-09-16T02:06:01.659 INFO:tasks.workunit.client.1.smithi165.stdout:6/910: creat d7/d17/d75/d97/dcb/d74/db7/f10b x:0 0 0 2024-09-16T02:06:01.660 INFO:tasks.workunit.client.1.smithi165.stdout:6/911: stat d7/dc/df/d1a/d4d/d5f/f88 0 2024-09-16T02:06:01.663 INFO:tasks.workunit.client.0.smithi110.stdout:1/452: fdatasync d0/d1/d4/f24 0 2024-09-16T02:06:01.663 INFO:tasks.workunit.client.0.smithi110.stdout:9/341: dwrite d1/d5/d8/f40 [0,4194304] 0 2024-09-16T02:06:01.666 INFO:tasks.workunit.client.0.smithi110.stdout:0/446: mkdir d3/d4/dc/d14/d7e/d81/d86 0 2024-09-16T02:06:01.666 INFO:tasks.workunit.client.1.smithi165.stdout:0/824: creat d0/d1e/d39/d48/d5f/f10e x:0 0 0 2024-09-16T02:06:01.666 INFO:tasks.workunit.client.1.smithi165.stdout:6/912: dread d7/d17/d75/d97/dcb/d74/db7/de0/fc3 [0,4194304] 0 2024-09-16T02:06:01.668 INFO:tasks.workunit.client.0.smithi110.stdout:8/362: getdents d3/d2b 0 2024-09-16T02:06:01.669 INFO:tasks.workunit.client.0.smithi110.stdout:9/342: creat d1/d5/d20/f74 x:0 0 0 2024-09-16T02:06:01.670 INFO:tasks.workunit.client.0.smithi110.stdout:7/347: dread d3/f27 [0,4194304] 0 2024-09-16T02:06:01.674 INFO:tasks.workunit.client.1.smithi165.stdout:5/937: mkdir de/d21/d26/d3a/d54/d8c/dc7/d131 0 2024-09-16T02:06:01.675 INFO:tasks.workunit.client.1.smithi165.stdout:5/938: readlink de/d19/d67/d74/lb0 0 2024-09-16T02:06:01.676 INFO:tasks.workunit.client.0.smithi110.stdout:9/343: rmdir d1/d5/d8/d26 39 2024-09-16T02:06:01.679 INFO:tasks.workunit.client.1.smithi165.stdout:6/913: dread d7/fe [0,4194304] 0 2024-09-16T02:06:01.680 INFO:tasks.workunit.client.1.smithi165.stdout:4/833: link d4/dc/d18/f9b d4/dc/d20/d4e/d73/f113 0 2024-09-16T02:06:01.682 INFO:tasks.workunit.client.1.smithi165.stdout:3/977: getdents da/d17/de5/d104/d2c/d2d/d6c/db5 0 2024-09-16T02:06:01.682 INFO:tasks.workunit.client.1.smithi165.stdout:6/914: dread d7/dc/d7f/dd2/f44 [0,4194304] 0 2024-09-16T02:06:01.682 INFO:tasks.workunit.client.0.smithi110.stdout:0/447: creat d3/d4/dc/d10/f87 x:0 0 0 2024-09-16T02:06:01.683 INFO:tasks.workunit.client.1.smithi165.stdout:0/825: chown d0/d1e/d39/f7c 0 1 2024-09-16T02:06:01.683 INFO:tasks.workunit.client.0.smithi110.stdout:0/448: write d3/d4/dc/d75/f83 [718567,52231] 0 2024-09-16T02:06:01.683 INFO:tasks.workunit.client.0.smithi110.stdout:8/363: symlink d3/d12/d1d/l7d 0 2024-09-16T02:06:01.685 INFO:tasks.workunit.client.0.smithi110.stdout:8/364: write d3/d12/d1d/f71 [4671932,49883] 0 2024-09-16T02:06:01.685 INFO:tasks.workunit.client.1.smithi165.stdout:9/947: symlink d7/d32/d38/d68/l132 0 2024-09-16T02:06:01.686 INFO:tasks.workunit.client.0.smithi110.stdout:7/348: symlink d3/d15/d44/l61 0 2024-09-16T02:06:01.688 INFO:tasks.workunit.client.0.smithi110.stdout:0/449: creat d3/d6/d43/d55/d59/f88 x:0 0 0 2024-09-16T02:06:01.688 INFO:tasks.workunit.client.0.smithi110.stdout:0/450: fdatasync d3/d4/dc/d14/d76/f80 0 2024-09-16T02:06:01.692 INFO:tasks.workunit.client.1.smithi165.stdout:7/915: rename d0/df/d33/f34 to d0/df/d33/f12e 0 2024-09-16T02:06:01.694 INFO:tasks.workunit.client.0.smithi110.stdout:1/453: dread d0/d1/d4/d46/d75/f90 [0,4194304] 0 2024-09-16T02:06:01.694 INFO:tasks.workunit.client.0.smithi110.stdout:1/454: fdatasync d0/da/f81 0 2024-09-16T02:06:01.695 INFO:tasks.workunit.client.1.smithi165.stdout:8/950: unlink dd/d11/d14/d3f/d25/d36/d81/dd2/c5b 0 2024-09-16T02:06:01.695 INFO:tasks.workunit.client.0.smithi110.stdout:8/365: symlink d3/d12/d1a/d36/d60/d62/l7e 0 2024-09-16T02:06:01.697 INFO:tasks.workunit.client.1.smithi165.stdout:4/834: mkdir d4/dc/d20/d67/d114 0 2024-09-16T02:06:01.697 INFO:tasks.workunit.client.1.smithi165.stdout:4/835: fdatasync d4/dc/dea/ff3 0 2024-09-16T02:06:01.699 INFO:tasks.workunit.client.1.smithi165.stdout:3/978: mkdir da/d17/d7a/d7d/d146 0 2024-09-16T02:06:01.700 INFO:tasks.workunit.client.1.smithi165.stdout:0/826: mkdir d0/d2a/d70/d10f 0 2024-09-16T02:06:01.701 INFO:tasks.workunit.client.1.smithi165.stdout:2/950: write df/d23/d66/f8d [2646680,65176] 0 2024-09-16T02:06:01.701 INFO:tasks.workunit.client.1.smithi165.stdout:0/827: chown d0/d1e/d20/d28/d6d/d87/cd3 54 1 2024-09-16T02:06:01.703 INFO:tasks.workunit.client.1.smithi165.stdout:9/948: creat d7/d32/d4a/da8/f133 x:0 0 0 2024-09-16T02:06:01.703 INFO:tasks.workunit.client.0.smithi110.stdout:9/344: truncate d1/d5/d20/f39 2758301 0 2024-09-16T02:06:01.704 INFO:tasks.workunit.client.0.smithi110.stdout:9/345: chown d1/d5/d20/d55 53 1 2024-09-16T02:06:01.704 INFO:tasks.workunit.client.1.smithi165.stdout:9/949: chown d7/d14/d7a 8 1 2024-09-16T02:06:01.705 INFO:tasks.workunit.client.0.smithi110.stdout:1/455: symlink d0/da/d7c/l98 0 2024-09-16T02:06:01.706 INFO:tasks.workunit.client.1.smithi165.stdout:7/916: chown d0/df/c20 3128410 1 2024-09-16T02:06:01.707 INFO:tasks.workunit.client.0.smithi110.stdout:8/366: mkdir d3/d2b/d65/d7f 0 2024-09-16T02:06:01.710 INFO:tasks.workunit.client.1.smithi165.stdout:5/939: dwrite de/d21/f9f [0,4194304] 0 2024-09-16T02:06:01.710 INFO:tasks.workunit.client.1.smithi165.stdout:9/950: dread d7/d32/d85/d8a/fc2 [0,4194304] 0 2024-09-16T02:06:01.710 INFO:tasks.workunit.client.0.smithi110.stdout:7/349: rename d3/d15/d38/d4f/d2e/d4e to d3/d62 0 2024-09-16T02:06:01.711 INFO:tasks.workunit.client.1.smithi165.stdout:0/828: dwrite d0/d1e/d39/f49 [0,4194304] 0 2024-09-16T02:06:01.712 INFO:tasks.workunit.client.0.smithi110.stdout:9/346: mkdir d1/dd/d6a/d6c/d75 0 2024-09-16T02:06:01.714 INFO:tasks.workunit.client.1.smithi165.stdout:6/915: mknod d7/dc/df/d5b/c10c 0 2024-09-16T02:06:01.714 INFO:tasks.workunit.client.0.smithi110.stdout:1/456: chown d0/d1/f53 1407 1 2024-09-16T02:06:01.715 INFO:tasks.workunit.client.1.smithi165.stdout:8/951: dread dd/fdd [0,4194304] 0 2024-09-16T02:06:01.715 INFO:tasks.workunit.client.1.smithi165.stdout:6/916: write d7/d17/d75/d97/dcb/d74/db7/de0/fc6 [914975,60838] 0 2024-09-16T02:06:01.717 INFO:tasks.workunit.client.1.smithi165.stdout:6/917: write d7/d1f/dbc/fe6 [2316864,46449] 0 2024-09-16T02:06:01.717 INFO:tasks.workunit.client.1.smithi165.stdout:3/979: rename da/d17/f4b to da/d17/de5/d104/d2c/db7/f147 0 2024-09-16T02:06:01.720 INFO:tasks.workunit.client.0.smithi110.stdout:8/367: creat d3/d2b/f80 x:0 0 0 2024-09-16T02:06:01.721 INFO:tasks.workunit.client.0.smithi110.stdout:8/368: write d3/f9 [894101,32434] 0 2024-09-16T02:06:01.723 INFO:tasks.workunit.client.0.smithi110.stdout:0/451: truncate d3/f1a 428093 0 2024-09-16T02:06:01.723 INFO:tasks.workunit.client.1.smithi165.stdout:2/951: mkdir df/d10/d37/de7/d11d 0 2024-09-16T02:06:01.725 INFO:tasks.workunit.client.0.smithi110.stdout:0/452: write d3/d4/dc/d10/f87 [641237,62501] 0 2024-09-16T02:06:01.729 INFO:tasks.workunit.client.1.smithi165.stdout:7/917: chown d0/d4b/f5d 1964921 1 2024-09-16T02:06:01.730 INFO:tasks.workunit.client.0.smithi110.stdout:8/369: chown d3/d12/f26 5458 1 2024-09-16T02:06:01.730 INFO:tasks.workunit.client.1.smithi165.stdout:5/940: dread de/f5b [0,4194304] 0 2024-09-16T02:06:01.732 INFO:tasks.workunit.client.0.smithi110.stdout:7/350: mknod d3/d15/d3a/c63 0 2024-09-16T02:06:01.732 INFO:tasks.workunit.client.0.smithi110.stdout:7/351: stat d3/d15/d38/d4f/d10/f35 0 2024-09-16T02:06:01.734 INFO:tasks.workunit.client.0.smithi110.stdout:7/352: write d3/d15/d38/d4f/d2e/f59 [411362,68640] 0 2024-09-16T02:06:01.735 INFO:tasks.workunit.client.1.smithi165.stdout:7/918: dwrite d0/df/d33/dc2/fe2 [0,4194304] 0 2024-09-16T02:06:01.735 INFO:tasks.workunit.client.1.smithi165.stdout:4/836: fdatasync d4/dc/d18/f34 0 2024-09-16T02:06:01.736 INFO:tasks.workunit.client.0.smithi110.stdout:9/347: creat d1/d5/d8/d26/f76 x:0 0 0 2024-09-16T02:06:01.737 INFO:tasks.workunit.client.0.smithi110.stdout:9/348: readlink d1/l32 0 2024-09-16T02:06:01.737 INFO:tasks.workunit.client.0.smithi110.stdout:9/349: stat d1/d5/d8/de/d1f/f48 0 2024-09-16T02:06:01.738 INFO:tasks.workunit.client.1.smithi165.stdout:4/837: write d4/dc/d18/d37/d53/d64/d8b/f70 [2487581,388] 0 2024-09-16T02:06:01.738 INFO:tasks.workunit.client.0.smithi110.stdout:9/350: fdatasync d1/f52 0 2024-09-16T02:06:01.739 INFO:tasks.workunit.client.1.smithi165.stdout:4/838: readlink d4/d40/l9d 0 2024-09-16T02:06:01.739 INFO:tasks.workunit.client.0.smithi110.stdout:1/457: creat d0/da/d8d/f99 x:0 0 0 2024-09-16T02:06:01.740 INFO:tasks.workunit.client.0.smithi110.stdout:1/458: chown d0/d25/c52 34 1 2024-09-16T02:06:01.742 INFO:tasks.workunit.client.0.smithi110.stdout:8/370: fsync d3/f3c 0 2024-09-16T02:06:01.742 INFO:tasks.workunit.client.1.smithi165.stdout:7/919: dread d0/df/d33/d2a/f94 [8388608,4194304] 0 2024-09-16T02:06:01.743 INFO:tasks.workunit.client.1.smithi165.stdout:7/920: stat d0/d3d 0 2024-09-16T02:06:01.744 INFO:tasks.workunit.client.0.smithi110.stdout:0/453: getdents d3/d4/d85 0 2024-09-16T02:06:01.745 INFO:tasks.workunit.client.1.smithi165.stdout:9/951: dread d7/df/d67/f7b [0,4194304] 0 2024-09-16T02:06:01.747 INFO:tasks.workunit.client.1.smithi165.stdout:6/918: unlink d7/dc/df/d1a/d4d/d5f/da7/fdf 0 2024-09-16T02:06:01.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/353: stat d3/l47 0 2024-09-16T02:06:01.751 INFO:tasks.workunit.client.0.smithi110.stdout:0/454: dwrite d3/d4/dc/d10/f3c [0,4194304] 0 2024-09-16T02:06:01.752 INFO:tasks.workunit.client.1.smithi165.stdout:9/952: dwrite d7/f22 [0,4194304] 0 2024-09-16T02:06:01.752 INFO:tasks.workunit.client.0.smithi110.stdout:9/351: rename d1/d5/d8/d29/f60 to d1/dd/d6a/f77 0 2024-09-16T02:06:01.753 INFO:tasks.workunit.client.0.smithi110.stdout:7/354: dread d3/f34 [0,4194304] 0 2024-09-16T02:06:01.753 INFO:tasks.workunit.client.0.smithi110.stdout:7/355: fdatasync d3/f19 0 2024-09-16T02:06:01.756 INFO:tasks.workunit.client.0.smithi110.stdout:7/356: fdatasync d3/d15/d38/d4f/d2e/f59 0 2024-09-16T02:06:01.756 INFO:tasks.workunit.client.0.smithi110.stdout:1/459: readlink d0/d1/d2a/l2d 0 2024-09-16T02:06:01.757 INFO:tasks.workunit.client.0.smithi110.stdout:0/455: read d3/d6/f39 [1181350,58731] 0 2024-09-16T02:06:01.758 INFO:tasks.workunit.client.0.smithi110.stdout:1/460: dread d0/d1/d4/f24 [0,4194304] 0 2024-09-16T02:06:01.759 INFO:tasks.workunit.client.1.smithi165.stdout:9/953: dwrite d7/d1f/ddb/f108 [4194304,4194304] 0 2024-09-16T02:06:01.759 INFO:tasks.workunit.client.1.smithi165.stdout:9/954: chown d7/d32/d4a/da8/dd9 6519 1 2024-09-16T02:06:01.761 INFO:tasks.workunit.client.0.smithi110.stdout:8/371: creat d3/d12/d1a/d36/d60/f81 x:0 0 0 2024-09-16T02:06:01.762 INFO:tasks.workunit.client.0.smithi110.stdout:1/461: truncate d0/d25/d63/f6b 604076 0 2024-09-16T02:06:01.769 INFO:tasks.workunit.client.0.smithi110.stdout:9/352: creat d1/d5/d20/d55/f78 x:0 0 0 2024-09-16T02:06:01.770 INFO:tasks.workunit.client.1.smithi165.stdout:7/921: chown d0/df/d33/ca2 588677 1 2024-09-16T02:06:01.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/922: write d0/f3 [2291758,37922] 0 2024-09-16T02:06:01.773 INFO:tasks.workunit.client.1.smithi165.stdout:6/919: readlink d7/dc/df/d1a/d4d/d5f/le5 0 2024-09-16T02:06:01.773 INFO:tasks.workunit.client.1.smithi165.stdout:3/980: dwrite da/d17/de5/d104/d2c/d10c/d9c/da6/fdf [0,4194304] 0 2024-09-16T02:06:01.774 INFO:tasks.workunit.client.0.smithi110.stdout:8/372: dread - d3/d12/f5c zero size 2024-09-16T02:06:01.776 INFO:tasks.workunit.client.0.smithi110.stdout:8/373: truncate d3/d12/d1a/f5d 1492719 0 2024-09-16T02:06:01.776 INFO:tasks.workunit.client.0.smithi110.stdout:8/374: stat d3/d2b/f1e 0 2024-09-16T02:06:01.777 INFO:tasks.workunit.client.0.smithi110.stdout:8/375: chown d3/d2b/d65/d7f 0 1 2024-09-16T02:06:01.777 INFO:tasks.workunit.client.0.smithi110.stdout:1/462: fsync d0/f47 0 2024-09-16T02:06:01.785 INFO:tasks.workunit.client.0.smithi110.stdout:1/463: dwrite d0/d1/d2a/d32/f41 [0,4194304] 0 2024-09-16T02:06:01.786 INFO:tasks.workunit.client.0.smithi110.stdout:9/353: rename d1/d5/d8 to d1/dd/d6a/d6c/d6f/d79 0 2024-09-16T02:06:01.788 INFO:tasks.workunit.client.0.smithi110.stdout:1/464: write d0/d1/d2a/d32/d6e/f8a [580197,105632] 0 2024-09-16T02:06:01.790 INFO:tasks.workunit.client.1.smithi165.stdout:4/839: mkdir d4/dc/d28/d2b/d10d/d115 0 2024-09-16T02:06:01.792 INFO:tasks.workunit.client.1.smithi165.stdout:8/952: creat dd/d11/d14/d70/f143 x:0 0 0 2024-09-16T02:06:01.792 INFO:tasks.workunit.client.0.smithi110.stdout:8/376: unlink d3/l7 0 2024-09-16T02:06:01.795 INFO:tasks.workunit.client.0.smithi110.stdout:0/456: write d3/f1b [7123302,89670] 0 2024-09-16T02:06:01.798 INFO:tasks.workunit.client.1.smithi165.stdout:5/941: write de/d60/fb2 [240823,117905] 0 2024-09-16T02:06:01.798 INFO:tasks.workunit.client.0.smithi110.stdout:9/354: creat d1/dd/d6a/f7a x:0 0 0 2024-09-16T02:06:01.799 INFO:tasks.workunit.client.0.smithi110.stdout:7/357: link d3/d15/d38/d4f/d10/d11/c2f d3/d15/d38/d4f/d10/c64 0 2024-09-16T02:06:01.800 INFO:tasks.workunit.client.1.smithi165.stdout:3/981: write da/d17/dcc/f24 [3063831,38620] 0 2024-09-16T02:06:01.800 INFO:tasks.workunit.client.0.smithi110.stdout:7/358: stat d3/d15/d38/d4f/c43 0 2024-09-16T02:06:01.801 INFO:tasks.workunit.client.1.smithi165.stdout:4/840: dwrite d4/dc/d18/d37/d53/d64/fcb [0,4194304] 0 2024-09-16T02:06:01.801 INFO:tasks.workunit.client.0.smithi110.stdout:8/377: symlink d3/d12/d1a/d36/l82 0 2024-09-16T02:06:01.802 INFO:tasks.workunit.client.0.smithi110.stdout:7/359: write d3/d15/d38/d4f/d2e/f4c [319508,18770] 0 2024-09-16T02:06:01.803 INFO:tasks.workunit.client.0.smithi110.stdout:7/360: fsync d3/d15/d38/d4f/fd 0 2024-09-16T02:06:01.804 INFO:tasks.workunit.client.0.smithi110.stdout:0/457: chown d3/d4/dc/f49 80935 1 2024-09-16T02:06:01.809 INFO:tasks.workunit.client.1.smithi165.stdout:8/953: rename dd/d11/d38/d74 to dd/d11/d14/d3f/d25/d144 0 2024-09-16T02:06:01.811 INFO:tasks.workunit.client.1.smithi165.stdout:7/923: symlink d0/df/d83/l12f 0 2024-09-16T02:06:01.815 INFO:tasks.workunit.client.1.smithi165.stdout:7/924: dread d0/df/d33/d2a/fb0 [0,4194304] 0 2024-09-16T02:06:01.815 INFO:tasks.workunit.client.0.smithi110.stdout:0/458: mkdir d3/d4/dc/d14/d7e/d81/d89 0 2024-09-16T02:06:01.816 INFO:tasks.workunit.client.0.smithi110.stdout:9/355: creat d1/dd/d6a/d6c/d75/f7b x:0 0 0 2024-09-16T02:06:01.817 INFO:tasks.workunit.client.1.smithi165.stdout:9/955: creat d7/d1f/d27/f134 x:0 0 0 2024-09-16T02:06:01.818 INFO:tasks.workunit.client.0.smithi110.stdout:0/459: symlink d3/d4/d6d/l8a 0 2024-09-16T02:06:01.824 INFO:tasks.workunit.client.1.smithi165.stdout:9/956: dwrite d7/df/d67/d92/d93/db6/ffc [0,4194304] 0 2024-09-16T02:06:01.825 INFO:tasks.workunit.client.0.smithi110.stdout:0/460: rename d3/d4/dc/d14/d62 to d3/d4/dc/d70/d8b 0 2024-09-16T02:06:01.826 INFO:tasks.workunit.client.1.smithi165.stdout:8/954: rmdir dd/d11/d14/d3f/d25/d144 39 2024-09-16T02:06:01.827 INFO:tasks.workunit.client.0.smithi110.stdout:9/356: dread d1/d2b/d2e/d38/d3d/f4e [0,4194304] 0 2024-09-16T02:06:01.831 INFO:tasks.workunit.client.1.smithi165.stdout:3/982: rename da/d20/d26/d8c/fc4 to da/d20/d26/f148 0 2024-09-16T02:06:01.832 INFO:tasks.workunit.client.1.smithi165.stdout:4/841: dread d4/dc/d18/d37/d53/d64/d8b/f86 [0,4194304] 0 2024-09-16T02:06:01.833 INFO:tasks.workunit.client.0.smithi110.stdout:0/461: unlink d3/d4/d41/f7b 0 2024-09-16T02:06:01.833 INFO:tasks.workunit.client.1.smithi165.stdout:6/920: write d7/d17/d75/d97/dcb/d3d/ddd/f51 [220601,26926] 0 2024-09-16T02:06:01.834 INFO:tasks.workunit.client.0.smithi110.stdout:8/378: dwrite d3/d2b/f58 [0,4194304] 0 2024-09-16T02:06:01.835 INFO:tasks.workunit.client.1.smithi165.stdout:6/921: write d7/dc/df/d1a/f4f [3082041,59887] 0 2024-09-16T02:06:01.835 INFO:tasks.workunit.client.0.smithi110.stdout:9/357: mkdir d1/d1b/d23/d7c 0 2024-09-16T02:06:01.836 INFO:tasks.workunit.client.1.smithi165.stdout:6/922: write d7/dc/df/fda [37197,97993] 0 2024-09-16T02:06:01.836 INFO:tasks.workunit.client.1.smithi165.stdout:9/957: creat d7/d32/d38/f135 x:0 0 0 2024-09-16T02:06:01.837 INFO:tasks.workunit.client.1.smithi165.stdout:9/958: fsync d7/d32/d38/d53/ff0 0 2024-09-16T02:06:01.837 INFO:tasks.workunit.client.0.smithi110.stdout:9/358: fdatasync d1/f3 0 2024-09-16T02:06:01.837 INFO:tasks.workunit.client.1.smithi165.stdout:6/923: stat d7/d17/d75/d97/dcb/d3d/dd0 0 2024-09-16T02:06:01.842 INFO:tasks.workunit.client.0.smithi110.stdout:0/462: creat d3/d4/d41/f8c x:0 0 0 2024-09-16T02:06:01.843 INFO:tasks.workunit.client.0.smithi110.stdout:7/361: dwrite d3/d15/d38/d4f/d10/f35 [0,4194304] 0 2024-09-16T02:06:01.843 INFO:tasks.workunit.client.1.smithi165.stdout:5/942: truncate de/d19/d1c/d49/da5/db1/fe1 387021 0 2024-09-16T02:06:01.845 INFO:tasks.workunit.client.1.smithi165.stdout:7/925: write d0/d4b/d63/f8b [2828456,107611] 0 2024-09-16T02:06:01.845 INFO:tasks.workunit.client.0.smithi110.stdout:8/379: fdatasync d3/d12/d1a/d36/f72 0 2024-09-16T02:06:01.846 INFO:tasks.workunit.client.1.smithi165.stdout:5/943: truncate de/d21/d26/d11a/f11c 1020751 0 2024-09-16T02:06:01.846 INFO:tasks.workunit.client.1.smithi165.stdout:4/842: read d4/dc/d28/d2b/f41 [1047223,52458] 0 2024-09-16T02:06:01.848 INFO:tasks.workunit.client.1.smithi165.stdout:9/959: mknod d7/df/c136 0 2024-09-16T02:06:01.848 INFO:tasks.workunit.client.0.smithi110.stdout:8/380: stat d3/d12/d1a/d36/c42 0 2024-09-16T02:06:01.850 INFO:tasks.workunit.client.0.smithi110.stdout:9/359: dwrite d1/dd/d6a/d6c/f73 [0,4194304] 0 2024-09-16T02:06:01.850 INFO:tasks.workunit.client.0.smithi110.stdout:8/381: fdatasync d3/f3d 0 2024-09-16T02:06:01.850 INFO:tasks.workunit.client.1.smithi165.stdout:6/924: mkdir d7/dc/d7f/dd2/d3c/dcd/d10d 0 2024-09-16T02:06:01.852 INFO:tasks.workunit.client.0.smithi110.stdout:0/463: mknod d3/d4/d6d/c8d 0 2024-09-16T02:06:01.853 INFO:tasks.workunit.client.0.smithi110.stdout:7/362: dread d3/d15/d38/d4f/d10/f35 [0,4194304] 0 2024-09-16T02:06:01.855 INFO:tasks.workunit.client.1.smithi165.stdout:3/983: creat da/d57/d8d/dff/f149 x:0 0 0 2024-09-16T02:06:01.855 INFO:tasks.workunit.client.1.smithi165.stdout:8/955: dwrite dd/ff [0,4194304] 0 2024-09-16T02:06:01.858 INFO:tasks.workunit.client.1.smithi165.stdout:0/829: sync 2024-09-16T02:06:01.860 INFO:tasks.workunit.client.1.smithi165.stdout:5/944: unlink de/d21/d26/d3a/d6d/dad/cfa 0 2024-09-16T02:06:01.862 INFO:tasks.workunit.client.1.smithi165.stdout:4/843: rename d4/dc/d18/d37/d53/f5a to d4/dc/d18/d37/d53/d64/d91/f116 0 2024-09-16T02:06:01.862 INFO:tasks.workunit.client.1.smithi165.stdout:0/830: write d0/d2a/d70/f8b [841720,117265] 0 2024-09-16T02:06:01.863 INFO:tasks.workunit.client.0.smithi110.stdout:0/464: write d3/d4/dc/f68 [596632,35683] 0 2024-09-16T02:06:01.865 INFO:tasks.workunit.client.1.smithi165.stdout:9/960: mknod d7/d55/c137 0 2024-09-16T02:06:01.865 INFO:tasks.workunit.client.0.smithi110.stdout:7/363: mkdir d3/d62/d65 0 2024-09-16T02:06:01.866 INFO:tasks.workunit.client.1.smithi165.stdout:4/844: chown d4/dc/d20/d4e/d73 75386 1 2024-09-16T02:06:01.866 INFO:tasks.workunit.client.1.smithi165.stdout:5/945: fsync de/d21/d51/fda 0 2024-09-16T02:06:01.867 INFO:tasks.workunit.client.1.smithi165.stdout:6/925: creat d7/dc/df/d1a/d4d/d5f/f10e x:0 0 0 2024-09-16T02:06:01.868 INFO:tasks.workunit.client.1.smithi165.stdout:3/984: dwrite da/d20/d26/f30 [0,4194304] 0 2024-09-16T02:06:01.869 INFO:tasks.workunit.client.1.smithi165.stdout:0/831: truncate d0/d2a/f5c 1089178 0 2024-09-16T02:06:01.871 INFO:tasks.workunit.client.0.smithi110.stdout:9/360: rename d1/d2b/d2e/d38/d3d/c5f to d1/dd/c7d 0 2024-09-16T02:06:01.872 INFO:tasks.workunit.client.1.smithi165.stdout:3/985: write da/d17/de5/d104/d2c/d10c/d6b/f90 [3254051,31487] 0 2024-09-16T02:06:01.872 INFO:tasks.workunit.client.0.smithi110.stdout:9/361: chown d1/dd/d6a/d6c/d6f/d79/d26 0 1 2024-09-16T02:06:01.873 INFO:tasks.workunit.client.1.smithi165.stdout:3/986: readlink da/d20/d26/la0 0 2024-09-16T02:06:01.873 INFO:tasks.workunit.client.1.smithi165.stdout:9/961: dread d7/f22 [0,4194304] 0 2024-09-16T02:06:01.873 INFO:tasks.workunit.client.0.smithi110.stdout:0/465: write d3/d6/f3b [1712512,100509] 0 2024-09-16T02:06:01.874 INFO:tasks.workunit.client.1.smithi165.stdout:3/987: write da/d20/d26/d8c/f118 [2257584,81841] 0 2024-09-16T02:06:01.875 INFO:tasks.workunit.client.0.smithi110.stdout:9/362: chown d1/d2b/d2e/f41 9 1 2024-09-16T02:06:01.875 INFO:tasks.workunit.client.1.smithi165.stdout:9/962: chown d7/d32/d38/d53/d56/d95/f124 27 1 2024-09-16T02:06:01.879 INFO:tasks.workunit.client.1.smithi165.stdout:4/845: mkdir d4/dc/d28/d3b/d117 0 2024-09-16T02:06:01.882 INFO:tasks.workunit.client.1.smithi165.stdout:4/846: write d4/dc/d18/d37/d53/d64/d8b/f61 [3636526,80796] 0 2024-09-16T02:06:01.883 INFO:tasks.workunit.client.1.smithi165.stdout:5/946: symlink de/d21/d26/d3a/d6d/de2/l132 0 2024-09-16T02:06:01.884 INFO:tasks.workunit.client.1.smithi165.stdout:0/832: symlink d0/d1e/d39/d99/l110 0 2024-09-16T02:06:01.888 INFO:tasks.workunit.client.1.smithi165.stdout:8/956: chown dd/d34/c79 16870 1 2024-09-16T02:06:01.893 INFO:tasks.workunit.client.1.smithi165.stdout:9/963: rename d7/df/d37/f107 to d7/d14/d80/d102/f138 0 2024-09-16T02:06:01.895 INFO:tasks.workunit.client.0.smithi110.stdout:7/364: write d3/f27 [3612485,50730] 0 2024-09-16T02:06:01.896 INFO:tasks.workunit.client.0.smithi110.stdout:0/466: chown d3/d4/dc/l31 714465 1 2024-09-16T02:06:01.897 INFO:tasks.workunit.client.0.smithi110.stdout:0/467: chown d3/d4/dc/d70/f72 888677 1 2024-09-16T02:06:01.897 INFO:tasks.workunit.client.0.smithi110.stdout:7/365: read d3/d15/d38/d4f/d10/d11/d3e/d40/f4b [2805516,125566] 0 2024-09-16T02:06:01.899 INFO:tasks.workunit.client.1.smithi165.stdout:4/847: mkdir d4/dc/d20/d118 0 2024-09-16T02:06:01.901 INFO:tasks.workunit.client.1.smithi165.stdout:4/848: stat d4/dc/d28/d3b/f10f 0 2024-09-16T02:06:01.901 INFO:tasks.workunit.client.1.smithi165.stdout:5/947: mknod de/d19/d1c/d84/daa/c133 0 2024-09-16T02:06:01.901 INFO:tasks.workunit.client.1.smithi165.stdout:4/849: chown d4/dc/d18/d37/d53/d64/faa 43 1 2024-09-16T02:06:01.901 INFO:tasks.workunit.client.1.smithi165.stdout:5/948: write de/d21/d26/d3a/d6d/d95/dab/fe7 [591163,93728] 0 2024-09-16T02:06:01.902 INFO:tasks.workunit.client.1.smithi165.stdout:0/833: rename d0/d1e/d20/d28/d9a/fa0 to d0/d1e/d20/d28/d9a/f111 0 2024-09-16T02:06:01.903 INFO:tasks.workunit.client.1.smithi165.stdout:6/926: write d7/dc/f72 [1633772,34817] 0 2024-09-16T02:06:01.904 INFO:tasks.workunit.client.1.smithi165.stdout:8/957: read - dd/d11/d14/d3f/d72/fd4 zero size 2024-09-16T02:06:01.906 INFO:tasks.workunit.client.0.smithi110.stdout:0/468: creat d3/d4/dc/d10/f8e x:0 0 0 2024-09-16T02:06:01.907 INFO:tasks.workunit.client.1.smithi165.stdout:8/958: chown dd/d11/d14/d70/d7b/d9a/f11a 540613 1 2024-09-16T02:06:01.910 INFO:tasks.workunit.client.1.smithi165.stdout:4/850: dwrite d4/dc/d20/d45/f101 [0,4194304] 0 2024-09-16T02:06:01.912 INFO:tasks.workunit.client.1.smithi165.stdout:0/834: dwrite d0/d1e/f93 [0,4194304] 0 2024-09-16T02:06:01.912 INFO:tasks.workunit.client.1.smithi165.stdout:3/988: write da/d17/de5/d104/fca [2263316,42012] 0 2024-09-16T02:06:01.912 INFO:tasks.workunit.client.1.smithi165.stdout:4/851: fdatasync d4/dc/d18/d37/d53/d64/d91/f103 0 2024-09-16T02:06:01.916 INFO:tasks.workunit.client.0.smithi110.stdout:0/469: link d3/d4/c7 d3/d4/dc/d70/d8b/c8f 0 2024-09-16T02:06:01.916 INFO:tasks.workunit.client.1.smithi165.stdout:3/989: chown da/c44 750270 1 2024-09-16T02:06:01.917 INFO:tasks.workunit.client.1.smithi165.stdout:0/835: creat d0/d1e/d39/d48/f112 x:0 0 0 2024-09-16T02:06:01.920 INFO:tasks.workunit.client.1.smithi165.stdout:8/959: rename dd/d11/d14/d70/d7b/df2/dfc to dd/d11/d14/d3f/d25/d36/d85/d126/d145 0 2024-09-16T02:06:01.924 INFO:tasks.workunit.client.1.smithi165.stdout:6/927: fsync d7/dc/df/d1a/f47 0 2024-09-16T02:06:01.925 INFO:tasks.workunit.client.0.smithi110.stdout:9/363: truncate d1/d1b/d23/f4c 3563254 0 2024-09-16T02:06:01.925 INFO:tasks.workunit.client.1.smithi165.stdout:3/990: creat da/d20/d26/d8c/f14a x:0 0 0 2024-09-16T02:06:01.925 INFO:tasks.workunit.client.1.smithi165.stdout:4/852: truncate d4/dbc/fbb 4807249 0 2024-09-16T02:06:01.925 INFO:tasks.workunit.client.1.smithi165.stdout:6/928: dread - d7/dc/df/d1a/d4d/d5f/f10e zero size 2024-09-16T02:06:01.926 INFO:tasks.workunit.client.1.smithi165.stdout:4/853: fdatasync d4/dc/fbd 0 2024-09-16T02:06:01.926 INFO:tasks.workunit.client.1.smithi165.stdout:0/836: rmdir d0/d1e/d39/d48/d45/db3 39 2024-09-16T02:06:01.926 INFO:tasks.workunit.client.0.smithi110.stdout:9/364: fsync d1/dd/f10 0 2024-09-16T02:06:01.928 INFO:tasks.workunit.client.1.smithi165.stdout:8/960: dread - dd/d11/d14/d70/fe9 zero size 2024-09-16T02:06:01.928 INFO:tasks.workunit.client.0.smithi110.stdout:7/366: dwrite d3/f32 [0,4194304] 0 2024-09-16T02:06:01.929 INFO:tasks.workunit.client.1.smithi165.stdout:3/991: dread da/d17/dcc/f77 [0,4194304] 0 2024-09-16T02:06:01.931 INFO:tasks.workunit.client.1.smithi165.stdout:9/964: getdents d7/d32/d38/d53/d56/dca 0 2024-09-16T02:06:01.932 INFO:tasks.workunit.client.1.smithi165.stdout:9/965: dread - d7/df/d67/fab zero size 2024-09-16T02:06:01.936 INFO:tasks.workunit.client.1.smithi165.stdout:4/854: symlink d4/dc/d20/d45/l119 0 2024-09-16T02:06:01.938 INFO:tasks.workunit.client.1.smithi165.stdout:0/837: write d0/d1e/d39/d48/d45/db3/ffb [923522,58873] 0 2024-09-16T02:06:01.940 INFO:tasks.workunit.client.1.smithi165.stdout:3/992: rename da/d17/de5/d104/d2c/d2d/d6c/db5/cdd to da/d17/de5/d104/d2c/d10c/d6b/d120/c14b 0 2024-09-16T02:06:01.941 INFO:tasks.workunit.client.1.smithi165.stdout:0/838: mkdir d0/d1e/d39/d48/d113 0 2024-09-16T02:06:01.941 INFO:tasks.workunit.client.1.smithi165.stdout:3/993: readlink da/d17/d7a/d7d/da8/l102 0 2024-09-16T02:06:01.942 INFO:tasks.workunit.client.1.smithi165.stdout:9/966: rename f2 to d7/d32/d38/d58/d99/f139 0 2024-09-16T02:06:01.944 INFO:tasks.workunit.client.1.smithi165.stdout:0/839: symlink d0/d1e/d39/d99/l114 0 2024-09-16T02:06:01.944 INFO:tasks.workunit.client.1.smithi165.stdout:8/961: getdents dd/d11/d14/d3f/d25/d36/d85/d126 0 2024-09-16T02:06:01.947 INFO:tasks.workunit.client.1.smithi165.stdout:9/967: mknod d7/df/d37/d43/d88/c13a 0 2024-09-16T02:06:01.949 INFO:tasks.workunit.client.1.smithi165.stdout:8/962: symlink dd/d11/d14/d70/d7b/l146 0 2024-09-16T02:06:01.950 INFO:tasks.workunit.client.1.smithi165.stdout:3/994: dread da/d17/de5/d104/f34 [0,4194304] 0 2024-09-16T02:06:01.951 INFO:tasks.workunit.client.1.smithi165.stdout:9/968: rename d7/d1f/d27 to d7/d14/d13b 0 2024-09-16T02:06:01.953 INFO:tasks.workunit.client.1.smithi165.stdout:8/963: unlink f9 0 2024-09-16T02:06:01.957 INFO:tasks.workunit.client.1.smithi165.stdout:3/995: creat da/d17/de5/d104/d2c/d2d/f14c x:0 0 0 2024-09-16T02:06:01.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/855: write d4/dc/d28/f4a [512012,43489] 0 2024-09-16T02:06:01.959 INFO:tasks.workunit.client.1.smithi165.stdout:6/929: dwrite d7/d17/f69 [0,4194304] 0 2024-09-16T02:06:01.961 INFO:tasks.workunit.client.1.smithi165.stdout:3/996: truncate da/d17/de5/d104/d2c/f36 4257689 0 2024-09-16T02:06:01.961 INFO:tasks.workunit.client.1.smithi165.stdout:8/964: rename dd/d11/d14/d3f/db3/dbe/c97 to dd/d11/d14/c147 0 2024-09-16T02:06:01.961 INFO:tasks.workunit.client.1.smithi165.stdout:4/856: creat d4/d40/d4f/f11a x:0 0 0 2024-09-16T02:06:01.962 INFO:tasks.workunit.client.1.smithi165.stdout:2/952: sync 2024-09-16T02:06:01.964 INFO:tasks.workunit.client.1.smithi165.stdout:3/997: mknod da/d17/c14d 0 2024-09-16T02:06:01.966 INFO:tasks.workunit.client.1.smithi165.stdout:8/965: truncate dd/d11/d14/d3f/db3/dbe/f13f 170051 0 2024-09-16T02:06:01.967 INFO:tasks.workunit.client.1.smithi165.stdout:2/953: fsync df/d23/d28/d9a/f9d 0 2024-09-16T02:06:01.969 INFO:tasks.workunit.client.1.smithi165.stdout:6/930: getdents d7/dc/df/d1a/d4d 0 2024-09-16T02:06:01.972 INFO:tasks.workunit.client.1.smithi165.stdout:0/840: dwrite d0/d1e/f26 [0,4194304] 0 2024-09-16T02:06:01.974 INFO:tasks.workunit.client.1.smithi165.stdout:4/857: write d4/dc/d18/d37/fa4 [1019860,8603] 0 2024-09-16T02:06:01.975 INFO:tasks.workunit.client.1.smithi165.stdout:2/954: unlink df/d10/d1a/d2d/dd1/f7c 0 2024-09-16T02:06:01.976 INFO:tasks.workunit.client.1.smithi165.stdout:4/858: chown d4/fc3 22222272 1 2024-09-16T02:06:01.977 INFO:tasks.workunit.client.1.smithi165.stdout:8/966: mknod dd/d11/d14/c148 0 2024-09-16T02:06:01.977 INFO:tasks.workunit.client.1.smithi165.stdout:9/969: dwrite d7/d32/d85/d8a/fb2 [0,4194304] 0 2024-09-16T02:06:01.977 INFO:tasks.workunit.client.1.smithi165.stdout:6/931: creat d7/d17/d75/d97/dcb/d74/de3/f10f x:0 0 0 2024-09-16T02:06:01.978 INFO:tasks.workunit.client.1.smithi165.stdout:2/955: stat df/d10/d1a/d2d/dd1/ff7 0 2024-09-16T02:06:01.982 INFO:tasks.workunit.client.1.smithi165.stdout:3/998: rename da/d17/d7a/d7d/fb3 to da/d17/de5/d104/d2c/d2d/f14e 0 2024-09-16T02:06:01.984 INFO:tasks.workunit.client.1.smithi165.stdout:2/956: creat df/d10/d1a/d2d/dd1/f11e x:0 0 0 2024-09-16T02:06:01.985 INFO:tasks.workunit.client.1.smithi165.stdout:0/841: creat d0/d2a/d70/d10f/f115 x:0 0 0 2024-09-16T02:06:01.986 INFO:tasks.workunit.client.1.smithi165.stdout:2/957: readlink df/d23/d28/d9a/d86/la8 0 2024-09-16T02:06:01.987 INFO:tasks.workunit.client.1.smithi165.stdout:4/859: mknod d4/dc/dea/dfb/c11b 0 2024-09-16T02:06:01.989 INFO:tasks.workunit.client.0.smithi110.stdout:7/367: symlink d3/d15/d38/d4f/l66 0 2024-09-16T02:06:01.992 INFO:tasks.workunit.client.1.smithi165.stdout:6/932: creat d7/d17/d75/d97/dcb/d3d/d5d/dcc/f110 x:0 0 0 2024-09-16T02:06:01.992 INFO:tasks.workunit.client.0.smithi110.stdout:7/368: mknod d3/d62/c67 0 2024-09-16T02:06:01.993 INFO:tasks.workunit.client.0.smithi110.stdout:9/365: dwrite d1/dd/d6a/d6c/d6f/d79/de/f1c [0,4194304] 0 2024-09-16T02:06:01.993 INFO:tasks.workunit.client.1.smithi165.stdout:6/933: truncate d7/d17/d75/d97/dcb/d74/de3/f10f 568733 0 2024-09-16T02:06:01.994 INFO:tasks.workunit.client.1.smithi165.stdout:6/934: chown d7/d17 236533286 1 2024-09-16T02:06:01.995 INFO:tasks.workunit.client.0.smithi110.stdout:7/369: rmdir d3/d15/d38/d4f 39 2024-09-16T02:06:01.997 INFO:tasks.workunit.client.0.smithi110.stdout:9/366: creat d1/dd/d6a/d6c/d6f/f7e x:0 0 0 2024-09-16T02:06:01.998 INFO:tasks.workunit.client.0.smithi110.stdout:9/367: truncate d1/d5/d20/f74 1039140 0 2024-09-16T02:06:01.999 INFO:tasks.workunit.client.1.smithi165.stdout:9/970: dwrite d7/d32/d85/fd7 [0,4194304] 0 2024-09-16T02:06:02.000 INFO:tasks.workunit.client.1.smithi165.stdout:3/999: creat da/d17/de5/d104/d2c/de8/d13a/f14f x:0 0 0 2024-09-16T02:06:02.001 INFO:tasks.workunit.client.1.smithi165.stdout:0/842: mknod d0/d1e/d39/c116 0 2024-09-16T02:06:02.002 INFO:tasks.workunit.client.1.smithi165.stdout:8/967: mknod dd/c149 0 2024-09-16T02:06:02.005 INFO:tasks.workunit.client.1.smithi165.stdout:4/860: creat d4/dc/d18/d37/d53/d64/d8b/d71/de9/f11c x:0 0 0 2024-09-16T02:06:02.005 INFO:tasks.workunit.client.1.smithi165.stdout:2/958: creat df/d10/d37/f11f x:0 0 0 2024-09-16T02:06:02.008 INFO:tasks.workunit.client.1.smithi165.stdout:0/843: fsync d0/f15 0 2024-09-16T02:06:02.010 INFO:tasks.workunit.client.1.smithi165.stdout:0/844: chown d0/d47/l7d 6 1 2024-09-16T02:06:02.011 INFO:tasks.workunit.client.1.smithi165.stdout:6/935: dwrite d7/dc/d7f/dd2/d3c/f70 [0,4194304] 0 2024-09-16T02:06:02.011 INFO:tasks.workunit.client.0.smithi110.stdout:9/368: chown d1/d1b/d23/f4c 49954 1 2024-09-16T02:06:02.012 INFO:tasks.workunit.client.1.smithi165.stdout:0/845: chown d0/d1e/d39/d48/d74/dc6/fec 2 1 2024-09-16T02:06:02.013 INFO:tasks.workunit.client.0.smithi110.stdout:7/370: creat d3/d15/d38/d4f/d10/d11/f68 x:0 0 0 2024-09-16T02:06:02.016 INFO:tasks.workunit.client.1.smithi165.stdout:2/959: mkdir df/d10/d1a/d120 0 2024-09-16T02:06:02.016 INFO:tasks.workunit.client.1.smithi165.stdout:2/960: chown df/d10/c17 2 1 2024-09-16T02:06:02.018 INFO:tasks.workunit.client.0.smithi110.stdout:7/371: symlink d3/d15/d38/l69 0 2024-09-16T02:06:02.019 INFO:tasks.workunit.client.1.smithi165.stdout:4/861: creat d4/dc/d28/d2b/d10d/d115/f11d x:0 0 0 2024-09-16T02:06:02.019 INFO:tasks.workunit.client.0.smithi110.stdout:9/369: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f45 [0,4194304] 0 2024-09-16T02:06:02.020 INFO:tasks.workunit.client.1.smithi165.stdout:6/936: dread d7/dc/d7f/dd2/f6f [0,4194304] 0 2024-09-16T02:06:02.021 INFO:tasks.workunit.client.1.smithi165.stdout:7/926: sync 2024-09-16T02:06:02.023 INFO:tasks.workunit.client.1.smithi165.stdout:9/971: truncate d7/df/d37/f83 4158955 0 2024-09-16T02:06:02.024 INFO:tasks.workunit.client.1.smithi165.stdout:8/968: creat dd/d11/d14/d3f/d25/d36/d81/d118/f14a x:0 0 0 2024-09-16T02:06:02.026 INFO:tasks.workunit.client.1.smithi165.stdout:6/937: read d7/d1f/f27 [3574962,75765] 0 2024-09-16T02:06:02.027 INFO:tasks.workunit.client.1.smithi165.stdout:2/961: mknod df/d10/c121 0 2024-09-16T02:06:02.028 INFO:tasks.workunit.client.0.smithi110.stdout:7/372: creat d3/d15/d38/f6a x:0 0 0 2024-09-16T02:06:02.030 INFO:tasks.workunit.client.1.smithi165.stdout:9/972: unlink d7/d32/d38/d53/d5c/cf7 0 2024-09-16T02:06:02.032 INFO:tasks.workunit.client.1.smithi165.stdout:2/962: creat df/d10/d1a/d68/db9/f122 x:0 0 0 2024-09-16T02:06:02.032 INFO:tasks.workunit.client.0.smithi110.stdout:9/370: dwrite d1/d1b/f1d [0,4194304] 0 2024-09-16T02:06:02.033 INFO:tasks.workunit.client.1.smithi165.stdout:6/938: mkdir d7/dc/d7f/dd2/d3c/dcd/d111 0 2024-09-16T02:06:02.036 INFO:tasks.workunit.client.1.smithi165.stdout:4/862: dread d4/dc/dea/ff3 [0,4194304] 0 2024-09-16T02:06:02.036 INFO:tasks.workunit.client.1.smithi165.stdout:4/863: dread - d4/dc/d20/d4e/fe5 zero size 2024-09-16T02:06:02.037 INFO:tasks.workunit.client.1.smithi165.stdout:8/969: rename dd/d62/c12b to dd/d11/d14/d3f/d25/d36/d81/dd2/d53/c14b 0 2024-09-16T02:06:02.037 INFO:tasks.workunit.client.1.smithi165.stdout:8/970: stat dd/d11/d38/da6/db0 0 2024-09-16T02:06:02.038 INFO:tasks.workunit.client.1.smithi165.stdout:9/973: mknod d7/df/c13c 0 2024-09-16T02:06:02.040 INFO:tasks.workunit.client.1.smithi165.stdout:2/963: unlink df/d23/d28/d9a/d86/ff4 0 2024-09-16T02:06:02.041 INFO:tasks.workunit.client.1.smithi165.stdout:6/939: fsync d7/dc/d7f/dd2/f44 0 2024-09-16T02:06:02.041 INFO:tasks.workunit.client.1.smithi165.stdout:7/927: getdents d0/d3d/d9f/ddc/da8 0 2024-09-16T02:06:02.043 INFO:tasks.workunit.client.1.smithi165.stdout:7/928: read - d0/df/d42/fdb zero size 2024-09-16T02:06:02.043 INFO:tasks.workunit.client.1.smithi165.stdout:4/864: creat d4/dc/dea/dfb/f11e x:0 0 0 2024-09-16T02:06:02.043 INFO:tasks.workunit.client.1.smithi165.stdout:8/971: mkdir dd/d11/d14/d70/d7b/d9a/d14c 0 2024-09-16T02:06:02.044 INFO:tasks.workunit.client.1.smithi165.stdout:9/974: mkdir d7/df/d37/d43/d88/d13d 0 2024-09-16T02:06:02.050 INFO:tasks.workunit.client.1.smithi165.stdout:7/929: rmdir d0/d3d/d9f/ddc 39 2024-09-16T02:06:02.051 INFO:tasks.workunit.client.1.smithi165.stdout:7/930: stat d0/df/d7/c51 0 2024-09-16T02:06:02.051 INFO:tasks.workunit.client.1.smithi165.stdout:4/865: dread - d4/d40/d4f/fbe zero size 2024-09-16T02:06:02.052 INFO:tasks.workunit.client.1.smithi165.stdout:4/866: readlink d4/dc/d18/d37/l9e 0 2024-09-16T02:06:02.052 INFO:tasks.workunit.client.1.smithi165.stdout:9/975: symlink d7/d32/d38/d53/d5c/d61/d8f/l13e 0 2024-09-16T02:06:02.052 INFO:tasks.workunit.client.1.smithi165.stdout:4/867: fdatasync d4/fc3 0 2024-09-16T02:06:02.052 INFO:tasks.workunit.client.0.smithi110.stdout:7/373: getdents d3/d15/d38 0 2024-09-16T02:06:02.054 INFO:tasks.workunit.client.1.smithi165.stdout:6/940: creat d7/dc/df/d107/f112 x:0 0 0 2024-09-16T02:06:02.054 INFO:tasks.workunit.client.1.smithi165.stdout:8/972: mkdir dd/d9e/d14d 0 2024-09-16T02:06:02.055 INFO:tasks.workunit.client.1.smithi165.stdout:7/931: fdatasync d0/df/d33/d2a/fb0 0 2024-09-16T02:06:02.055 INFO:tasks.workunit.client.1.smithi165.stdout:8/973: read - dd/d11/d14/d70/f143 zero size 2024-09-16T02:06:02.056 INFO:tasks.workunit.client.0.smithi110.stdout:7/374: rename d3/d15/d38/d4f/d10/d2c/c46 to d3/d15/d38/d4f/d10/d11/d3e/d40/c6b 0 2024-09-16T02:06:02.058 INFO:tasks.workunit.client.0.smithi110.stdout:7/375: write d3/d15/d38/d4f/d2e/f4c [4825037,15079] 0 2024-09-16T02:06:02.061 INFO:tasks.workunit.client.1.smithi165.stdout:6/941: chown d7/dc/c92 38 1 2024-09-16T02:06:02.062 INFO:tasks.workunit.client.1.smithi165.stdout:8/974: chown dd/d34/c121 30821716 1 2024-09-16T02:06:02.062 INFO:tasks.workunit.client.0.smithi110.stdout:9/371: dwrite d1/d1b/f22 [0,4194304] 0 2024-09-16T02:06:02.063 INFO:tasks.workunit.client.1.smithi165.stdout:7/932: fsync d0/f60 0 2024-09-16T02:06:02.063 INFO:tasks.workunit.client.1.smithi165.stdout:8/975: write dd/d11/d14/d70/d7b/d9a/fd6 [3869250,18757] 0 2024-09-16T02:06:02.064 INFO:tasks.workunit.client.1.smithi165.stdout:8/976: write dd/d11/f130 [733959,20894] 0 2024-09-16T02:06:02.067 INFO:tasks.workunit.client.1.smithi165.stdout:6/942: creat d7/d17/d75/d97/dcb/f113 x:0 0 0 2024-09-16T02:06:02.070 INFO:tasks.workunit.client.0.smithi110.stdout:9/372: dwrite d1/dd/d6a/d6c/d75/f7b [0,4194304] 0 2024-09-16T02:06:02.072 INFO:tasks.workunit.client.1.smithi165.stdout:9/976: getdents d7/d32/d38/d58 0 2024-09-16T02:06:02.072 INFO:tasks.workunit.client.0.smithi110.stdout:9/373: mknod d1/d5/d20/d55/c7f 0 2024-09-16T02:06:02.073 INFO:tasks.workunit.client.1.smithi165.stdout:4/868: getdents d4/dc/d18/d37/dc9 0 2024-09-16T02:06:02.074 INFO:tasks.workunit.client.1.smithi165.stdout:9/977: chown d7/d32 882 1 2024-09-16T02:06:02.074 INFO:tasks.workunit.client.1.smithi165.stdout:7/933: creat d0/df/d42/f130 x:0 0 0 2024-09-16T02:06:02.074 INFO:tasks.workunit.client.0.smithi110.stdout:9/374: write d1/dd/d6a/d6c/d6f/f7e [429410,42740] 0 2024-09-16T02:06:02.075 INFO:tasks.workunit.client.0.smithi110.stdout:9/375: rmdir d1/dd 39 2024-09-16T02:06:02.076 INFO:tasks.workunit.client.1.smithi165.stdout:2/964: dwrite df/d10/d1a/d2d/f58 [0,4194304] 0 2024-09-16T02:06:02.078 INFO:tasks.workunit.client.0.smithi110.stdout:9/376: rmdir d1/dd/d6a/d6c/d6f 39 2024-09-16T02:06:02.081 INFO:tasks.workunit.client.1.smithi165.stdout:7/934: dread - d0/d4b/db4/dba/fd6 zero size 2024-09-16T02:06:02.082 INFO:tasks.workunit.client.0.smithi110.stdout:9/377: mknod d1/dd/d6a/d6c/d6f/d79/de/d1f/c80 0 2024-09-16T02:06:02.084 INFO:tasks.workunit.client.1.smithi165.stdout:9/978: truncate d7/d1f/ddb/fea 1884218 0 2024-09-16T02:06:02.084 INFO:tasks.workunit.client.1.smithi165.stdout:2/965: chown df/d23/d28/d3b/f56 1132 1 2024-09-16T02:06:02.084 INFO:tasks.workunit.client.1.smithi165.stdout:8/977: dwrite dd/d9e/dd0/fed [0,4194304] 0 2024-09-16T02:06:02.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/378: creat d1/d1b/d23/d7c/f81 x:0 0 0 2024-09-16T02:06:02.086 INFO:tasks.workunit.client.0.smithi110.stdout:9/379: fdatasync d1/dd/f58 0 2024-09-16T02:06:02.087 INFO:tasks.workunit.client.1.smithi165.stdout:6/943: dwrite d7/d17/d75/d97/dcb/d74/db7/fde [0,4194304] 0 2024-09-16T02:06:02.089 INFO:tasks.workunit.client.1.smithi165.stdout:4/869: truncate d4/dc/d18/d37/d53/d64/d8b/d71/de9/f11c 547825 0 2024-09-16T02:06:02.098 INFO:tasks.workunit.client.1.smithi165.stdout:9/979: fdatasync d7/d32/d38/d58/d99/f139 0 2024-09-16T02:06:02.098 INFO:tasks.workunit.client.1.smithi165.stdout:7/935: mknod d0/d3d/d9f/ddc/da8/ddd/c131 0 2024-09-16T02:06:02.098 INFO:tasks.workunit.client.1.smithi165.stdout:2/966: rename df/d23/d28/dfa/l10a to df/dbb/ded/l123 0 2024-09-16T02:06:02.098 INFO:tasks.workunit.client.0.smithi110.stdout:9/380: write d1/dd/d6a/d6c/d6f/d79/de/f3b [2766609,27886] 0 2024-09-16T02:06:02.101 INFO:tasks.workunit.client.1.smithi165.stdout:8/978: dwrite dd/d34/dd7/f10a [0,4194304] 0 2024-09-16T02:06:02.103 INFO:tasks.workunit.client.0.smithi110.stdout:9/381: mkdir d1/d5/d20/d55/d82 0 2024-09-16T02:06:02.106 INFO:tasks.workunit.client.0.smithi110.stdout:9/382: mkdir d1/d5/d20/d83 0 2024-09-16T02:06:02.110 INFO:tasks.workunit.client.0.smithi110.stdout:9/383: mknod d1/dd/d6a/d6c/d6f/d79/d26/d5b/c84 0 2024-09-16T02:06:02.115 INFO:tasks.workunit.client.0.smithi110.stdout:9/384: getdents d1/d1b 0 2024-09-16T02:06:02.121 INFO:tasks.workunit.client.0.smithi110.stdout:9/385: dwrite d1/d5/d20/f39 [0,4194304] 0 2024-09-16T02:06:02.122 INFO:tasks.workunit.client.0.smithi110.stdout:9/386: readlink d1/dd/d6a/d6c/d6f/d79/de/l37 0 2024-09-16T02:06:02.144 INFO:tasks.workunit.client.1.smithi165.stdout:9/980: symlink d7/d1f/l13f 0 2024-09-16T02:06:02.146 INFO:tasks.workunit.client.1.smithi165.stdout:7/936: creat d0/d4b/f132 x:0 0 0 2024-09-16T02:06:02.147 INFO:tasks.workunit.client.1.smithi165.stdout:9/981: rmdir d7/d32/d38/d53/d5c/d61 39 2024-09-16T02:06:02.150 INFO:tasks.workunit.client.1.smithi165.stdout:7/937: creat d0/d3d/d9f/ddc/d12a/f133 x:0 0 0 2024-09-16T02:06:02.150 INFO:tasks.workunit.client.1.smithi165.stdout:8/979: dwrite dd/d11/d14/d3f/d25/d144/f11c [0,4194304] 0 2024-09-16T02:06:02.151 INFO:tasks.workunit.client.1.smithi165.stdout:9/982: dread - d7/df/d37/d43/fe7 zero size 2024-09-16T02:06:02.153 INFO:tasks.workunit.client.1.smithi165.stdout:7/938: mkdir d0/d3d/dd5/d127/d134 0 2024-09-16T02:06:02.155 INFO:tasks.workunit.client.1.smithi165.stdout:8/980: mknod dd/d11/d11b/c14e 0 2024-09-16T02:06:02.156 INFO:tasks.workunit.client.1.smithi165.stdout:7/939: write d0/d3d/d9f/ddc/d12a/f133 [215400,40565] 0 2024-09-16T02:06:02.156 INFO:tasks.workunit.client.0.smithi110.stdout:9/387: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/f4a [0,4194304] 0 2024-09-16T02:06:02.158 INFO:tasks.workunit.client.0.smithi110.stdout:9/388: write d1/f52 [525207,15023] 0 2024-09-16T02:06:02.162 INFO:tasks.workunit.client.1.smithi165.stdout:8/981: rename dd/d11/d14/d3f/d25/d36/d81/f10b to dd/d11/d14/d3f/d25/d36/d81/dd2/d89/dc5/f14f 0 2024-09-16T02:06:02.163 INFO:tasks.workunit.client.1.smithi165.stdout:7/940: mknod d0/d4b/db4/dba/dd7/c135 0 2024-09-16T02:06:02.165 INFO:tasks.workunit.client.0.smithi110.stdout:9/389: dwrite d1/d1b/d23/f71 [0,4194304] 0 2024-09-16T02:06:02.166 INFO:tasks.workunit.client.1.smithi165.stdout:5/949: sync 2024-09-16T02:06:02.167 INFO:tasks.workunit.client.1.smithi165.stdout:4/870: write d4/dc/d18/f23 [4510859,3420] 0 2024-09-16T02:06:02.169 INFO:tasks.workunit.client.1.smithi165.stdout:4/871: chown d4/dc/d20/d4e/f72 397037461 1 2024-09-16T02:06:02.170 INFO:tasks.workunit.client.1.smithi165.stdout:5/950: creat de/d21/d51/f134 x:0 0 0 2024-09-16T02:06:02.173 INFO:tasks.workunit.client.1.smithi165.stdout:2/967: dwrite df/d23/d28/d3b/f7a [0,4194304] 0 2024-09-16T02:06:02.178 INFO:tasks.workunit.client.1.smithi165.stdout:7/941: link d0/c4c d0/df/dfd/c136 0 2024-09-16T02:06:02.180 INFO:tasks.workunit.client.1.smithi165.stdout:2/968: symlink df/d10/d1a/d2d/dd1/l124 0 2024-09-16T02:06:02.182 INFO:tasks.workunit.client.1.smithi165.stdout:7/942: write d0/d3d/dd5/fe7 [3750829,34156] 0 2024-09-16T02:06:02.182 INFO:tasks.workunit.client.1.smithi165.stdout:5/951: creat de/d19/d1c/d12f/f135 x:0 0 0 2024-09-16T02:06:02.183 INFO:tasks.workunit.client.1.smithi165.stdout:8/982: write dd/d11/d14/d3f/d25/d144/d7d/fd9 [4027590,124629] 0 2024-09-16T02:06:02.184 INFO:tasks.workunit.client.1.smithi165.stdout:9/983: dwrite d7/df/d37/fa9 [0,4194304] 0 2024-09-16T02:06:02.184 INFO:tasks.workunit.client.0.smithi110.stdout:9/390: truncate d1/dd/d6a/d6c/d6f/d79/d26/f45 4055149 0 2024-09-16T02:06:02.185 INFO:tasks.workunit.client.1.smithi165.stdout:2/969: write df/d10/d37/f11f [202691,45378] 0 2024-09-16T02:06:02.185 INFO:tasks.workunit.client.0.smithi110.stdout:9/391: fsync d1/dd/d6a/d6c/d6f/d79/de/f1c 0 2024-09-16T02:06:02.187 INFO:tasks.workunit.client.1.smithi165.stdout:9/984: stat d7/d32/d4a/da8/f133 0 2024-09-16T02:06:02.188 INFO:tasks.workunit.client.1.smithi165.stdout:7/943: write d0/d3d/f5b [3391625,26277] 0 2024-09-16T02:06:02.189 INFO:tasks.workunit.client.1.smithi165.stdout:5/952: mknod de/d21/d26/d3a/c136 0 2024-09-16T02:06:02.190 INFO:tasks.workunit.client.1.smithi165.stdout:2/970: chown df/d23/d28/dfa/lbf 0 1 2024-09-16T02:06:02.191 INFO:tasks.workunit.client.0.smithi110.stdout:9/392: rename d1/f3f to d1/dd/d6a/d6c/d6f/d79/d26/f85 0 2024-09-16T02:06:02.191 INFO:tasks.workunit.client.1.smithi165.stdout:7/944: stat d0/l79 0 2024-09-16T02:06:02.193 INFO:tasks.workunit.client.1.smithi165.stdout:4/872: dwrite d4/dc/d18/d37/d53/d64/f75 [0,4194304] 0 2024-09-16T02:06:02.194 INFO:tasks.workunit.client.1.smithi165.stdout:7/945: chown d0/df/d7/fe 4971233 1 2024-09-16T02:06:02.197 INFO:tasks.workunit.client.1.smithi165.stdout:2/971: chown df/d23/d66/faa 8094 1 2024-09-16T02:06:02.198 INFO:tasks.workunit.client.1.smithi165.stdout:4/873: unlink d4/dc/d20/d67/c83 0 2024-09-16T02:06:02.200 INFO:tasks.workunit.client.1.smithi165.stdout:7/946: mknod d0/d3d/d9f/ddc/dcb/de6/c137 0 2024-09-16T02:06:02.200 INFO:tasks.workunit.client.1.smithi165.stdout:5/953: link de/d19/d1c/d4d/f7a de/d21/d26/d94/f137 0 2024-09-16T02:06:02.203 INFO:tasks.workunit.client.1.smithi165.stdout:7/947: creat d0/d2c/dc8/d103/f138 x:0 0 0 2024-09-16T02:06:02.205 INFO:tasks.workunit.client.1.smithi165.stdout:5/954: creat de/d21/d26/d3a/d54/d8c/dc7/d110/f138 x:0 0 0 2024-09-16T02:06:02.205 INFO:tasks.workunit.client.1.smithi165.stdout:2/972: dwrite df/d23/d28/dfa/db1/f10e [0,4194304] 0 2024-09-16T02:06:02.207 INFO:tasks.workunit.client.1.smithi165.stdout:5/955: mkdir de/d60/d139 0 2024-09-16T02:06:02.209 INFO:tasks.workunit.client.1.smithi165.stdout:7/948: rename d0/df/d33/d2a/f94 to d0/d4b/db4/dba/dc4/f139 0 2024-09-16T02:06:02.209 INFO:tasks.workunit.client.1.smithi165.stdout:7/949: fdatasync d0/d2c/dc8/d103/de9/f119 0 2024-09-16T02:06:02.212 INFO:tasks.workunit.client.1.smithi165.stdout:2/973: creat df/d10/f125 x:0 0 0 2024-09-16T02:06:02.213 INFO:tasks.workunit.client.0.smithi110.stdout:9/393: rmdir d1 39 2024-09-16T02:06:02.216 INFO:tasks.workunit.client.1.smithi165.stdout:2/974: mknod df/d23/d28/d3b/d6d/d8b/c126 0 2024-09-16T02:06:02.217 INFO:tasks.workunit.client.1.smithi165.stdout:9/985: write d7/f35 [449809,79147] 0 2024-09-16T02:06:02.217 INFO:tasks.workunit.client.1.smithi165.stdout:5/956: creat de/d19/d1c/f13a x:0 0 0 2024-09-16T02:06:02.218 INFO:tasks.workunit.client.1.smithi165.stdout:9/986: write d7/fd [4236738,21333] 0 2024-09-16T02:06:02.219 INFO:tasks.workunit.client.1.smithi165.stdout:2/975: chown df/d10/d1a/d68/db9/f122 49600176 1 2024-09-16T02:06:02.219 INFO:tasks.workunit.client.1.smithi165.stdout:5/957: dread - de/d21/d4e/f11d zero size 2024-09-16T02:06:02.220 INFO:tasks.workunit.client.1.smithi165.stdout:5/958: readlink de/d19/d67/l7c 0 2024-09-16T02:06:02.220 INFO:tasks.workunit.client.1.smithi165.stdout:7/950: creat d0/df/d83/f13a x:0 0 0 2024-09-16T02:06:02.222 INFO:tasks.workunit.client.1.smithi165.stdout:7/951: write d0/df/d7/f93 [935827,115300] 0 2024-09-16T02:06:02.223 INFO:tasks.workunit.client.1.smithi165.stdout:5/959: symlink de/d19/d1c/d84/d92/l13b 0 2024-09-16T02:06:02.225 INFO:tasks.workunit.client.1.smithi165.stdout:7/952: read d0/d4b/d63/f8f [1345199,10910] 0 2024-09-16T02:06:02.228 INFO:tasks.workunit.client.1.smithi165.stdout:4/874: dwrite d4/d40/d4f/f78 [0,4194304] 0 2024-09-16T02:06:02.231 INFO:tasks.workunit.client.0.smithi110.stdout:9/394: dwrite d1/dd/f10 [0,4194304] 0 2024-09-16T02:06:02.235 INFO:tasks.workunit.client.1.smithi165.stdout:4/875: write d4/dc/d18/d37/d53/d64/d8b/f8a [146828,85162] 0 2024-09-16T02:06:02.238 INFO:tasks.workunit.client.1.smithi165.stdout:5/960: dwrite de/d21/d26/d9a/f121 [0,4194304] 0 2024-09-16T02:06:02.238 INFO:tasks.workunit.client.1.smithi165.stdout:2/976: dwrite df/d23/d28/f81 [0,4194304] 0 2024-09-16T02:06:02.238 INFO:tasks.workunit.client.1.smithi165.stdout:7/953: link d0/d4b/db4/dba/dc4/c111 d0/d2c/d85/d8c/d115/c13b 0 2024-09-16T02:06:02.240 INFO:tasks.workunit.client.1.smithi165.stdout:4/876: readlink d4/dc/d20/d67/lf9 0 2024-09-16T02:06:02.243 INFO:tasks.workunit.client.1.smithi165.stdout:7/954: read - d0/d4b/db4/dda/ff0 zero size 2024-09-16T02:06:02.245 INFO:tasks.workunit.client.1.smithi165.stdout:4/877: getdents d4/dc/d18/d37/d53/d64/da0 0 2024-09-16T02:06:02.246 INFO:tasks.workunit.client.1.smithi165.stdout:4/878: write f1 [6178183,40869] 0 2024-09-16T02:06:02.248 INFO:tasks.workunit.client.1.smithi165.stdout:4/879: chown d4/dc/fbd 687046 1 2024-09-16T02:06:02.250 INFO:tasks.workunit.client.1.smithi165.stdout:4/880: chown d4/dc/d20/d67/lf9 1559 1 2024-09-16T02:06:02.252 INFO:tasks.workunit.client.1.smithi165.stdout:0/846: sync 2024-09-16T02:06:02.252 INFO:tasks.workunit.client.1.smithi165.stdout:6/944: sync 2024-09-16T02:06:02.252 INFO:tasks.workunit.client.1.smithi165.stdout:5/961: truncate de/d21/d4e/f55 924849 0 2024-09-16T02:06:02.252 INFO:tasks.workunit.client.1.smithi165.stdout:7/955: dwrite d0/df/d83/f13a [0,4194304] 0 2024-09-16T02:06:02.255 INFO:tasks.workunit.client.1.smithi165.stdout:4/881: stat d4/dc0/ld5 0 2024-09-16T02:06:02.255 INFO:tasks.workunit.client.1.smithi165.stdout:0/847: readlink d0/d47/l7d 0 2024-09-16T02:06:02.256 INFO:tasks.workunit.client.1.smithi165.stdout:7/956: rmdir d0/d3d/dd5/d127 39 2024-09-16T02:06:02.259 INFO:tasks.workunit.client.1.smithi165.stdout:6/945: rmdir d7/d17/d75/d97/dcb/d74/db7 39 2024-09-16T02:06:02.260 INFO:tasks.workunit.client.1.smithi165.stdout:2/977: dwrite df/d10/d64/f91 [0,4194304] 0 2024-09-16T02:06:02.263 INFO:tasks.workunit.client.1.smithi165.stdout:0/848: symlink d0/d1e/d39/d48/d45/db3/l117 0 2024-09-16T02:06:02.264 INFO:tasks.workunit.client.1.smithi165.stdout:7/957: write d0/d4b/ff9 [953983,112551] 0 2024-09-16T02:06:02.265 INFO:tasks.workunit.client.1.smithi165.stdout:4/882: rmdir d4/dc/d18/d37/d53/d64/d8b/d71 39 2024-09-16T02:06:02.265 INFO:tasks.workunit.client.0.smithi110.stdout:9/395: dread d1/d1b/f6e [0,4194304] 0 2024-09-16T02:06:02.267 INFO:tasks.workunit.client.1.smithi165.stdout:6/946: truncate d7/d17/d75/d97/dcb/d3d/ddd/fc5 1431382 0 2024-09-16T02:06:02.268 INFO:tasks.workunit.client.1.smithi165.stdout:2/978: creat df/d10/d1a/d2d/dd1/d113/f127 x:0 0 0 2024-09-16T02:06:02.268 INFO:tasks.workunit.client.1.smithi165.stdout:0/849: dread - d0/d2a/d70/d10f/f115 zero size 2024-09-16T02:06:02.269 INFO:tasks.workunit.client.1.smithi165.stdout:4/883: mkdir d4/dc/d20/d67/d11f 0 2024-09-16T02:06:02.270 INFO:tasks.workunit.client.0.smithi110.stdout:9/396: dread d1/d1b/d23/f71 [0,4194304] 0 2024-09-16T02:06:02.272 INFO:tasks.workunit.client.1.smithi165.stdout:6/947: mkdir d7/d17/d75/d97/dcb/d3d/ddd/d114 0 2024-09-16T02:06:02.273 INFO:tasks.workunit.client.1.smithi165.stdout:2/979: chown df/d23/d28/d9a/d86/fd2 44723434 1 2024-09-16T02:06:02.274 INFO:tasks.workunit.client.0.smithi110.stdout:9/397: mkdir d1/dd/d6a/d6c/d75/d86 0 2024-09-16T02:06:02.275 INFO:tasks.workunit.client.0.smithi110.stdout:9/398: dread - d1/d1b/d23/d7c/f81 zero size 2024-09-16T02:06:02.275 INFO:tasks.workunit.client.1.smithi165.stdout:7/958: dread d0/df/d33/d2a/fb0 [0,4194304] 0 2024-09-16T02:06:02.276 INFO:tasks.workunit.client.1.smithi165.stdout:4/884: unlink d4/dc/d28/d30/c35 0 2024-09-16T02:06:02.277 INFO:tasks.workunit.client.1.smithi165.stdout:0/850: rename d0/fb to d0/d2a/d70/d10f/f118 0 2024-09-16T02:06:02.278 INFO:tasks.workunit.client.1.smithi165.stdout:5/962: dwrite de/d21/d26/d94/f137 [0,4194304] 0 2024-09-16T02:06:02.281 INFO:tasks.workunit.client.1.smithi165.stdout:2/980: rmdir df/d23/d28/d9a/d86 39 2024-09-16T02:06:02.283 INFO:tasks.workunit.client.1.smithi165.stdout:2/981: chown df/d23/d28/dfa/d98/l104 905329 1 2024-09-16T02:06:02.288 INFO:tasks.workunit.client.1.smithi165.stdout:7/959: dwrite d0/df/d83/f124 [0,4194304] 0 2024-09-16T02:06:02.292 INFO:tasks.workunit.client.1.smithi165.stdout:6/948: rename d7/d17/d75/d97/dcb/d3d/c65 to d7/d17/d75/d97/dcb/d74/c115 0 2024-09-16T02:06:02.292 INFO:tasks.workunit.client.1.smithi165.stdout:4/885: dwrite d4/dc/d18/d37/d53/d64/d8b/d71/f7d [0,4194304] 0 2024-09-16T02:06:02.294 INFO:tasks.workunit.client.1.smithi165.stdout:0/851: write d0/f15 [1463201,19205] 0 2024-09-16T02:06:02.295 INFO:tasks.workunit.client.1.smithi165.stdout:6/949: readlink d7/dc/d7f/dd2/l60 0 2024-09-16T02:06:02.297 INFO:tasks.workunit.client.1.smithi165.stdout:7/960: symlink d0/d3d/dd5/l13c 0 2024-09-16T02:06:02.298 INFO:tasks.workunit.client.1.smithi165.stdout:2/982: write df/d23/d28/dfa/f71 [3922466,35722] 0 2024-09-16T02:06:02.301 INFO:tasks.workunit.client.1.smithi165.stdout:7/961: unlink d0/df/d42/l123 0 2024-09-16T02:06:02.301 INFO:tasks.workunit.client.0.smithi110.stdout:9/399: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/f57 [0,4194304] 0 2024-09-16T02:06:02.302 INFO:tasks.workunit.client.1.smithi165.stdout:0/852: symlink d0/d1e/d39/d48/d5f/d96/l119 0 2024-09-16T02:06:02.303 INFO:tasks.workunit.client.0.smithi110.stdout:9/400: read d1/d1b/f6e [974471,57140] 0 2024-09-16T02:06:02.304 INFO:tasks.workunit.client.0.smithi110.stdout:9/401: fsync d1/dd/d6a/d6c/d6f/d79/de/f3b 0 2024-09-16T02:06:02.305 INFO:tasks.workunit.client.1.smithi165.stdout:4/886: dwrite d4/dc/d18/f109 [0,4194304] 0 2024-09-16T02:06:02.307 INFO:tasks.workunit.client.0.smithi110.stdout:9/402: creat d1/dd/f87 x:0 0 0 2024-09-16T02:06:02.309 INFO:tasks.workunit.client.0.smithi110.stdout:9/403: truncate d1/d1b/f1d 4539455 0 2024-09-16T02:06:02.310 INFO:tasks.workunit.client.1.smithi165.stdout:6/950: getdents d7/d17/d75 0 2024-09-16T02:06:02.310 INFO:tasks.workunit.client.1.smithi165.stdout:2/983: symlink df/d23/d28/d9a/l128 0 2024-09-16T02:06:02.311 INFO:tasks.workunit.client.1.smithi165.stdout:5/963: dread de/d21/d26/d3a/d54/f79 [0,4194304] 0 2024-09-16T02:06:02.312 INFO:tasks.workunit.client.1.smithi165.stdout:0/853: unlink d0/d1e/d20/d28/d6d/daf/dc0/l10c 0 2024-09-16T02:06:02.317 INFO:tasks.workunit.client.1.smithi165.stdout:6/951: chown d7/dc/d7f/dd2/l60 65 1 2024-09-16T02:06:02.319 INFO:tasks.workunit.client.1.smithi165.stdout:5/964: creat de/d21/d26/d11a/d11f/f13c x:0 0 0 2024-09-16T02:06:02.320 INFO:tasks.workunit.client.1.smithi165.stdout:4/887: dwrite d4/dc/d20/d4e/fe5 [0,4194304] 0 2024-09-16T02:06:02.322 INFO:tasks.workunit.client.1.smithi165.stdout:2/984: getdents df/d23/d28/d3b/d6d 0 2024-09-16T02:06:02.322 INFO:tasks.workunit.client.1.smithi165.stdout:6/952: mknod d7/dc/c116 0 2024-09-16T02:06:02.324 INFO:tasks.workunit.client.1.smithi165.stdout:4/888: chown d4/cf 474061613 1 2024-09-16T02:06:02.324 INFO:tasks.workunit.client.1.smithi165.stdout:2/985: chown df/d23/d28/f53 7028 1 2024-09-16T02:06:02.325 INFO:tasks.workunit.client.1.smithi165.stdout:5/965: symlink de/d21/d26/d3a/d126/l13d 0 2024-09-16T02:06:02.325 INFO:tasks.workunit.client.1.smithi165.stdout:6/953: chown d7/dc/d7f/dd2/fb3 43 1 2024-09-16T02:06:02.326 INFO:tasks.workunit.client.1.smithi165.stdout:5/966: stat de/f117 0 2024-09-16T02:06:02.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/983: sync 2024-09-16T02:06:02.328 INFO:tasks.workunit.client.1.smithi165.stdout:4/889: mkdir d4/dc/d18/d111/d120 0 2024-09-16T02:06:02.328 INFO:tasks.workunit.client.1.smithi165.stdout:2/986: write df/d23/d28/dfa/fd6 [4766349,69002] 0 2024-09-16T02:06:02.330 INFO:tasks.workunit.client.1.smithi165.stdout:7/962: dread d0/d4b/db4/dba/fbd [0,4194304] 0 2024-09-16T02:06:02.330 INFO:tasks.workunit.client.1.smithi165.stdout:6/954: stat d7/dc/df/d1a/d4d/d5f/da7/c100 0 2024-09-16T02:06:02.331 INFO:tasks.workunit.client.1.smithi165.stdout:2/987: stat df/d10/d37/cc7 0 2024-09-16T02:06:02.332 INFO:tasks.workunit.client.1.smithi165.stdout:5/967: mknod de/d21/d26/d3a/d6d/d95/c13e 0 2024-09-16T02:06:02.333 INFO:tasks.workunit.client.1.smithi165.stdout:4/890: mknod d4/dc/d18/d37/dc9/c121 0 2024-09-16T02:06:02.334 INFO:tasks.workunit.client.1.smithi165.stdout:7/963: mknod d0/d3d/d9f/ddc/c13d 0 2024-09-16T02:06:02.336 INFO:tasks.workunit.client.1.smithi165.stdout:7/964: dread - d0/d2c/dc8/d103/f138 zero size 2024-09-16T02:06:02.337 INFO:tasks.workunit.client.0.smithi110.stdout:9/404: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f45 [0,4194304] 0 2024-09-16T02:06:02.337 INFO:tasks.workunit.client.1.smithi165.stdout:2/988: mknod df/d10/d1a/d68/db9/c129 0 2024-09-16T02:06:02.337 INFO:tasks.workunit.client.1.smithi165.stdout:0/854: dread d0/d1e/d39/d48/d6e/f76 [0,4194304] 0 2024-09-16T02:06:02.338 INFO:tasks.workunit.client.1.smithi165.stdout:4/891: unlink d4/dc0/l10c 0 2024-09-16T02:06:02.340 INFO:tasks.workunit.client.1.smithi165.stdout:5/968: mkdir de/d60/d139/d13f 0 2024-09-16T02:06:02.341 INFO:tasks.workunit.client.1.smithi165.stdout:0/855: write d0/d1e/d39/d48/fe8 [2484950,120754] 0 2024-09-16T02:06:02.342 INFO:tasks.workunit.client.1.smithi165.stdout:7/965: mknod d0/d4b/c13e 0 2024-09-16T02:06:02.343 INFO:tasks.workunit.client.1.smithi165.stdout:2/989: symlink df/d10/l12a 0 2024-09-16T02:06:02.344 INFO:tasks.workunit.client.1.smithi165.stdout:7/966: fsync d0/d3d/d9f/ddc/f108 0 2024-09-16T02:06:02.345 INFO:tasks.workunit.client.1.smithi165.stdout:4/892: symlink d4/dc/d28/d2b/d10d/d115/l122 0 2024-09-16T02:06:02.346 INFO:tasks.workunit.client.1.smithi165.stdout:5/969: creat de/d21/d26/d3a/d54/d8c/dc7/d110/f140 x:0 0 0 2024-09-16T02:06:02.348 INFO:tasks.workunit.client.1.smithi165.stdout:7/967: unlink d0/c1e 0 2024-09-16T02:06:02.349 INFO:tasks.workunit.client.1.smithi165.stdout:7/968: truncate d0/d2c/dc8/dea/f129 6193018 0 2024-09-16T02:06:02.350 INFO:tasks.workunit.client.1.smithi165.stdout:0/856: truncate d0/d1e/d20/d28/d6d/d87/f88 505101 0 2024-09-16T02:06:02.354 INFO:tasks.workunit.client.1.smithi165.stdout:6/955: write d7/d17/d75/d97/dcb/d3d/ddd/fa3 [12694,95346] 0 2024-09-16T02:06:02.356 INFO:tasks.workunit.client.1.smithi165.stdout:2/990: dread df/d23/f50 [0,4194304] 0 2024-09-16T02:06:02.357 INFO:tasks.workunit.client.1.smithi165.stdout:0/857: mknod d0/d1e/d39/d48/d74/c11a 0 2024-09-16T02:06:02.357 INFO:tasks.workunit.client.1.smithi165.stdout:6/956: symlink d7/d17/d75/d97/dcb/d3d/ddd/l117 0 2024-09-16T02:06:02.359 INFO:tasks.workunit.client.1.smithi165.stdout:2/991: mkdir df/d10/d1a/d2d/dd1/d12b 0 2024-09-16T02:06:02.365 INFO:tasks.workunit.client.1.smithi165.stdout:4/893: truncate f1 4967264 0 2024-09-16T02:06:02.366 INFO:tasks.workunit.client.1.smithi165.stdout:6/957: creat d7/dc/f118 x:0 0 0 2024-09-16T02:06:02.369 INFO:tasks.workunit.client.1.smithi165.stdout:4/894: read - d4/dc/d18/d37/d53/d64/d8b/df4/ff6 zero size 2024-09-16T02:06:02.370 INFO:tasks.workunit.client.1.smithi165.stdout:7/969: dwrite d0/df/d33/f29 [0,4194304] 0 2024-09-16T02:06:02.371 INFO:tasks.workunit.client.1.smithi165.stdout:6/958: fdatasync d7/d17/d75/d97/dcb/d3d/dd0/fec 0 2024-09-16T02:06:02.372 INFO:tasks.workunit.client.1.smithi165.stdout:4/895: stat d4/dc/d28/f4a 0 2024-09-16T02:06:02.377 INFO:tasks.workunit.client.1.smithi165.stdout:4/896: fdatasync d4/dc/d18/d37/fa4 0 2024-09-16T02:06:02.377 INFO:tasks.workunit.client.1.smithi165.stdout:5/970: dwrite de/fc3 [0,4194304] 0 2024-09-16T02:06:02.378 INFO:tasks.workunit.client.1.smithi165.stdout:6/959: rmdir d7/d17/d75/d97/dcb/d74 39 2024-09-16T02:06:02.380 INFO:tasks.workunit.client.1.smithi165.stdout:0/858: dwrite d0/d2a/fca [0,4194304] 0 2024-09-16T02:06:02.385 INFO:tasks.workunit.client.1.smithi165.stdout:2/992: dread df/d23/d28/d3b/f56 [0,4194304] 0 2024-09-16T02:06:02.385 INFO:tasks.workunit.client.1.smithi165.stdout:7/970: truncate d0/df/d33/d2a/dd2/f70 324838 0 2024-09-16T02:06:02.387 INFO:tasks.workunit.client.1.smithi165.stdout:7/971: write d0/f12 [3659006,60423] 0 2024-09-16T02:06:02.387 INFO:tasks.workunit.client.1.smithi165.stdout:5/971: chown de/d19/d67/d74/l86 110267 1 2024-09-16T02:06:02.389 INFO:tasks.workunit.client.1.smithi165.stdout:0/859: chown d0/d1e/d20/f100 6699 1 2024-09-16T02:06:02.389 INFO:tasks.workunit.client.1.smithi165.stdout:4/897: symlink d4/dc/d18/d37/d53/d64/d8b/d71/de9/l123 0 2024-09-16T02:06:02.391 INFO:tasks.workunit.client.1.smithi165.stdout:5/972: chown de/d21/d26/d94/d9d/led 901 1 2024-09-16T02:06:02.393 INFO:tasks.workunit.client.1.smithi165.stdout:5/973: mkdir de/d60/dbc/df3/d141 0 2024-09-16T02:06:02.395 INFO:tasks.workunit.client.1.smithi165.stdout:4/898: creat d4/dc/d28/d2b/f124 x:0 0 0 2024-09-16T02:06:02.397 INFO:tasks.workunit.client.1.smithi165.stdout:0/860: read d0/d47/f59 [2210495,110215] 0 2024-09-16T02:06:02.398 INFO:tasks.workunit.client.1.smithi165.stdout:4/899: unlink d4/dc/d20/lb7 0 2024-09-16T02:06:02.400 INFO:tasks.workunit.client.1.smithi165.stdout:5/974: link de/d19/d1c/d49/da5/l112 de/d21/d26/d9a/l142 0 2024-09-16T02:06:02.402 INFO:tasks.workunit.client.1.smithi165.stdout:0/861: truncate d0/d1e/d39/f6a 6864830 0 2024-09-16T02:06:02.403 INFO:tasks.workunit.client.1.smithi165.stdout:5/975: read de/d21/fef [186796,128810] 0 2024-09-16T02:06:02.405 INFO:tasks.workunit.client.1.smithi165.stdout:5/976: write de/d19/d1c/d84/daa/ff7 [94175,119089] 0 2024-09-16T02:06:02.407 INFO:tasks.workunit.client.1.smithi165.stdout:7/972: dread d0/f3 [0,4194304] 0 2024-09-16T02:06:02.408 INFO:tasks.workunit.client.1.smithi165.stdout:9/987: sync 2024-09-16T02:06:02.412 INFO:tasks.workunit.client.1.smithi165.stdout:9/988: truncate d7/d32/f39 1544737 0 2024-09-16T02:06:02.412 INFO:tasks.workunit.client.1.smithi165.stdout:7/973: truncate d0/d2c/dc8/d103/de9/f119 714254 0 2024-09-16T02:06:02.413 INFO:tasks.workunit.client.1.smithi165.stdout:4/900: write d4/dc/d18/d37/d53/d64/faa [728693,62862] 0 2024-09-16T02:06:02.415 INFO:tasks.workunit.client.1.smithi165.stdout:0/862: write d0/d1e/d39/d48/d45/fb9 [185589,128998] 0 2024-09-16T02:06:02.415 INFO:tasks.workunit.client.1.smithi165.stdout:6/960: dwrite d7/d17/d75/d97/dcb/f78 [0,4194304] 0 2024-09-16T02:06:02.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/974: mknod d0/d4b/d58/c13f 0 2024-09-16T02:06:02.420 INFO:tasks.workunit.client.1.smithi165.stdout:5/977: dwrite de/d21/d26/d94/f137 [0,4194304] 0 2024-09-16T02:06:02.423 INFO:tasks.workunit.client.1.smithi165.stdout:4/901: creat d4/dc/d20/dc2/dd6/f125 x:0 0 0 2024-09-16T02:06:02.423 INFO:tasks.workunit.client.1.smithi165.stdout:0/863: creat d0/d1e/d39/d99/f11b x:0 0 0 2024-09-16T02:06:02.424 INFO:tasks.workunit.client.1.smithi165.stdout:6/961: truncate d7/dc/df/d1a/d4d/fa6 844383 0 2024-09-16T02:06:02.424 INFO:tasks.workunit.client.1.smithi165.stdout:9/989: dread d7/d14/d13b/f3e [0,4194304] 0 2024-09-16T02:06:02.424 INFO:tasks.workunit.client.1.smithi165.stdout:5/978: mkdir de/d19/d67/db9/d143 0 2024-09-16T02:06:02.424 INFO:tasks.workunit.client.1.smithi165.stdout:0/864: rmdir d0/d1e/d39/d48/d74 39 2024-09-16T02:06:02.427 INFO:tasks.workunit.client.1.smithi165.stdout:0/865: stat d0/f9 0 2024-09-16T02:06:02.427 INFO:tasks.workunit.client.1.smithi165.stdout:9/990: readlink d7/d14/d13b/d49/lbc 0 2024-09-16T02:06:02.427 INFO:tasks.workunit.client.1.smithi165.stdout:4/902: creat d4/dc/d28/d3b/d117/f126 x:0 0 0 2024-09-16T02:06:02.430 INFO:tasks.workunit.client.1.smithi165.stdout:5/979: mkdir de/d19/d1c/d49/da5/db1/dea/d144 0 2024-09-16T02:06:02.432 INFO:tasks.workunit.client.1.smithi165.stdout:4/903: fdatasync d4/dc/d28/f5f 0 2024-09-16T02:06:02.433 INFO:tasks.workunit.client.1.smithi165.stdout:6/962: dread d7/d17/d75/d97/dcb/d3d/ddd/fc5 [0,4194304] 0 2024-09-16T02:06:02.434 INFO:tasks.workunit.client.1.smithi165.stdout:9/991: getdents d7/d32/d4a/da8/dd9 0 2024-09-16T02:06:02.434 INFO:tasks.workunit.client.1.smithi165.stdout:0/866: dwrite d0/d1e/d39/d99/fbd [0,4194304] 0 2024-09-16T02:06:02.434 INFO:tasks.workunit.client.1.smithi165.stdout:5/980: symlink de/d19/d1c/d84/daa/l145 0 2024-09-16T02:06:02.438 INFO:tasks.workunit.client.1.smithi165.stdout:4/904: rename d4/d40/c56 to d4/d40/c127 0 2024-09-16T02:06:02.440 INFO:tasks.workunit.client.1.smithi165.stdout:5/981: mkdir de/d21/d26/d3a/d54/d8c/dc7/d110/d146 0 2024-09-16T02:06:02.441 INFO:tasks.workunit.client.1.smithi165.stdout:5/982: fsync f6 0 2024-09-16T02:06:02.443 INFO:tasks.workunit.client.1.smithi165.stdout:9/992: dwrite d7/d32/d38/d68/fd3 [0,4194304] 0 2024-09-16T02:06:02.444 INFO:tasks.workunit.client.1.smithi165.stdout:6/963: stat d7/d17/d75/d97/dcb/d74/db7/f10b 0 2024-09-16T02:06:02.444 INFO:tasks.workunit.client.1.smithi165.stdout:5/983: fdatasync de/d21/d26/d11a/d11f/f13c 0 2024-09-16T02:06:02.448 INFO:tasks.workunit.client.1.smithi165.stdout:6/964: write d7/d17/d75/d97/dcb/d3d/d5d/d73/f102 [683869,74775] 0 2024-09-16T02:06:02.449 INFO:tasks.workunit.client.1.smithi165.stdout:6/965: chown d7/d17/d75/dc1/cc9 210400841 1 2024-09-16T02:06:02.451 INFO:tasks.workunit.client.1.smithi165.stdout:6/966: chown d7/dc/df/d1a/fbb 2982 1 2024-09-16T02:06:02.451 INFO:tasks.workunit.client.1.smithi165.stdout:5/984: rename de/d19/df6 to de/d21/d26/d94/da8/d147 0 2024-09-16T02:06:02.452 INFO:tasks.workunit.client.1.smithi165.stdout:4/905: link d4/d40/d4f/c6e d4/dc/d18/d37/d53/d64/d8b/d71/de9/c128 0 2024-09-16T02:06:02.453 INFO:tasks.workunit.client.1.smithi165.stdout:5/985: write de/f14 [12348448,67460] 0 2024-09-16T02:06:02.454 INFO:tasks.workunit.client.1.smithi165.stdout:6/967: symlink d7/d17/d75/d97/dcb/d74/db7/l119 0 2024-09-16T02:06:02.456 INFO:tasks.workunit.client.1.smithi165.stdout:9/993: rename d7/df/c4b to d7/d32/d38/d53/d5c/d61/dd5/c140 0 2024-09-16T02:06:02.461 INFO:tasks.workunit.client.1.smithi165.stdout:5/986: rename de/d19/d67/lcb to de/d21/d26/d3a/d6d/de2/d101/l148 0 2024-09-16T02:06:02.463 INFO:tasks.workunit.client.1.smithi165.stdout:6/968: truncate d7/d17/d75/d97/dcb/d3d/fa1 1328034 0 2024-09-16T02:06:02.463 INFO:tasks.workunit.client.1.smithi165.stdout:5/987: chown de/d60/f129 79938 1 2024-09-16T02:06:02.464 INFO:tasks.workunit.client.1.smithi165.stdout:4/906: dwrite d4/dc/d28/f4a [0,4194304] 0 2024-09-16T02:06:02.464 INFO:tasks.workunit.client.1.smithi165.stdout:0/867: dwrite d0/d2a/d70/d10f/f118 [0,4194304] 0 2024-09-16T02:06:02.470 INFO:tasks.workunit.client.1.smithi165.stdout:0/868: symlink d0/d1e/d20/d28/da7/db4/l11c 0 2024-09-16T02:06:02.470 INFO:tasks.workunit.client.1.smithi165.stdout:4/907: symlink d4/dc/d18/d37/d53/d64/d91/l129 0 2024-09-16T02:06:02.472 INFO:tasks.workunit.client.1.smithi165.stdout:5/988: creat de/d19/d67/db9/d143/f149 x:0 0 0 2024-09-16T02:06:02.473 INFO:tasks.workunit.client.1.smithi165.stdout:6/969: getdents d7/d17/d75 0 2024-09-16T02:06:02.474 INFO:tasks.workunit.client.1.smithi165.stdout:9/994: write d7/df/d37/d43/fe7 [935239,83674] 0 2024-09-16T02:06:02.476 INFO:tasks.workunit.client.1.smithi165.stdout:9/995: truncate d7/d32/d38/f135 186958 0 2024-09-16T02:06:02.477 INFO:tasks.workunit.client.1.smithi165.stdout:4/908: rename d4/dc/d28/d2b/c8c to d4/dc/d28/d3b/d117/c12a 0 2024-09-16T02:06:02.478 INFO:tasks.workunit.client.1.smithi165.stdout:5/989: creat de/d21/d26/d3a/d54/f14a x:0 0 0 2024-09-16T02:06:02.480 INFO:tasks.workunit.client.1.smithi165.stdout:6/970: unlink d7/dc/df/d5b/c8b 0 2024-09-16T02:06:02.481 INFO:tasks.workunit.client.1.smithi165.stdout:9/996: mkdir d7/d32/d38/d68/d7f/d113/d141 0 2024-09-16T02:06:02.483 INFO:tasks.workunit.client.1.smithi165.stdout:5/990: unlink de/d19/d1c/d4d/f7e 0 2024-09-16T02:06:02.486 INFO:tasks.workunit.client.1.smithi165.stdout:6/971: dwrite d7/d17/d75/d97/dcb/d3d/dd0/fec [0,4194304] 0 2024-09-16T02:06:02.488 INFO:tasks.workunit.client.1.smithi165.stdout:6/972: read d7/dc/d7f/fed [4050115,7395] 0 2024-09-16T02:06:02.488 INFO:tasks.workunit.client.1.smithi165.stdout:5/991: mknod de/d21/d26/d94/d9d/d108/c14b 0 2024-09-16T02:06:02.491 INFO:tasks.workunit.client.1.smithi165.stdout:6/973: creat d7/d1f/da4/f11a x:0 0 0 2024-09-16T02:06:02.496 INFO:tasks.workunit.client.1.smithi165.stdout:4/909: getdents d4/dc/d18/d37/d53/d64/d91 0 2024-09-16T02:06:02.497 INFO:tasks.workunit.client.1.smithi165.stdout:4/910: fdatasync d4/dc/d18/d37/d53/f51 0 2024-09-16T02:06:02.497 INFO:tasks.workunit.client.1.smithi165.stdout:5/992: rename de/d19/d67/db9 to de/d19/d1c/d49/d14c 0 2024-09-16T02:06:02.498 INFO:tasks.workunit.client.1.smithi165.stdout:0/869: truncate d0/d1e/d39/f49 1657812 0 2024-09-16T02:06:02.500 INFO:tasks.workunit.client.1.smithi165.stdout:6/974: rename d7/dc/cae to d7/dc/d7f/d103/c11b 0 2024-09-16T02:06:02.501 INFO:tasks.workunit.client.1.smithi165.stdout:4/911: mknod d4/dc/d28/d2b/d42/c12b 0 2024-09-16T02:06:02.501 INFO:tasks.workunit.client.1.smithi165.stdout:8/984: sync 2024-09-16T02:06:02.501 INFO:tasks.workunit.client.1.smithi165.stdout:4/912: stat d4/f44 0 2024-09-16T02:06:02.502 INFO:tasks.workunit.client.1.smithi165.stdout:0/870: symlink d0/d61/l11d 0 2024-09-16T02:06:02.503 INFO:tasks.workunit.client.1.smithi165.stdout:5/993: mknod de/d19/d1c/d49/da5/c14d 0 2024-09-16T02:06:02.504 INFO:tasks.workunit.client.1.smithi165.stdout:9/997: write d7/df/f40 [3270758,48037] 0 2024-09-16T02:06:02.504 INFO:tasks.workunit.client.1.smithi165.stdout:4/913: creat d4/dc/d18/f12c x:0 0 0 2024-09-16T02:06:02.505 INFO:tasks.workunit.client.1.smithi165.stdout:6/975: dread d7/dc/df/d1a/d4d/d5f/f84 [0,4194304] 0 2024-09-16T02:06:02.505 INFO:tasks.workunit.client.1.smithi165.stdout:8/985: mknod dd/d11/d14/d70/d7b/df2/c150 0 2024-09-16T02:06:02.506 INFO:tasks.workunit.client.1.smithi165.stdout:0/871: symlink d0/d1e/d39/d48/d5f/d96/da4/dbb/l11e 0 2024-09-16T02:06:02.509 INFO:tasks.workunit.client.1.smithi165.stdout:9/998: symlink d7/d55/l142 0 2024-09-16T02:06:02.514 INFO:tasks.workunit.client.1.smithi165.stdout:5/994: symlink de/d21/d26/l14e 0 2024-09-16T02:06:02.515 INFO:tasks.workunit.client.1.smithi165.stdout:9/999: creat d7/d14/d7a/f143 x:0 0 0 2024-09-16T02:06:02.516 INFO:tasks.workunit.client.1.smithi165.stdout:0/872: symlink d0/l11f 0 2024-09-16T02:06:02.517 INFO:tasks.workunit.client.1.smithi165.stdout:5/995: creat de/d21/d26/d3a/d54/d8c/dc7/d110/f14f x:0 0 0 2024-09-16T02:06:02.518 INFO:tasks.workunit.client.1.smithi165.stdout:4/914: write d4/dc/d28/d30/fd0 [844302,31373] 0 2024-09-16T02:06:02.519 INFO:tasks.workunit.client.1.smithi165.stdout:8/986: write dd/d11/d14/f1d [4029529,85494] 0 2024-09-16T02:06:02.520 INFO:tasks.workunit.client.1.smithi165.stdout:0/873: write d0/d1e/d39/d48/d74/dc6/fec [326225,50866] 0 2024-09-16T02:06:02.520 INFO:tasks.workunit.client.1.smithi165.stdout:6/976: getdents d7/dc/df/d1a/d4d/d5f/da7 0 2024-09-16T02:06:02.521 INFO:tasks.workunit.client.1.smithi165.stdout:2/993: sync 2024-09-16T02:06:02.521 INFO:tasks.workunit.client.1.smithi165.stdout:7/975: sync 2024-09-16T02:06:02.522 INFO:tasks.workunit.client.1.smithi165.stdout:5/996: mknod de/d21/d26/d94/da8/d147/d11b/c150 0 2024-09-16T02:06:02.524 INFO:tasks.workunit.client.1.smithi165.stdout:7/976: read d0/d3d/d9f/fbe [924744,43029] 0 2024-09-16T02:06:02.524 INFO:tasks.workunit.client.1.smithi165.stdout:6/977: chown d7/dc/df/d1a/d4d/d5f/f9f 7 1 2024-09-16T02:06:02.528 INFO:tasks.workunit.client.1.smithi165.stdout:2/994: write df/d23/d28/dfa/db1/f10e [3122472,92816] 0 2024-09-16T02:06:02.528 INFO:tasks.workunit.client.1.smithi165.stdout:0/874: rmdir d0/d1e/d39/d48/d45/db3 39 2024-09-16T02:06:02.528 INFO:tasks.workunit.client.1.smithi165.stdout:2/995: write df/d10/d37/f3d [2237849,20112] 0 2024-09-16T02:06:02.529 INFO:tasks.workunit.client.1.smithi165.stdout:4/915: truncate d4/d40/d4f/f78 96553 0 2024-09-16T02:06:02.530 INFO:tasks.workunit.client.1.smithi165.stdout:6/978: read d7/d17/d75/d97/dcb/d3d/d5d/d73/f102 [399161,102542] 0 2024-09-16T02:06:02.533 INFO:tasks.workunit.client.1.smithi165.stdout:6/979: dread - d7/dc/d7f/fd1 zero size 2024-09-16T02:06:02.536 INFO:tasks.workunit.client.1.smithi165.stdout:4/916: write d4/dc/d18/d37/d53/d64/d8b/f86 [4078200,68406] 0 2024-09-16T02:06:02.537 INFO:tasks.workunit.client.1.smithi165.stdout:6/980: unlink d7/c2c 0 2024-09-16T02:06:02.538 INFO:tasks.workunit.client.1.smithi165.stdout:8/987: dread dd/d11/d14/d3f/d25/d36/f64 [0,4194304] 0 2024-09-16T02:06:02.538 INFO:tasks.workunit.client.1.smithi165.stdout:0/875: truncate d0/f9 4694104 0 2024-09-16T02:06:02.539 INFO:tasks.workunit.client.1.smithi165.stdout:2/996: mknod df/d10/d1a/d120/c12c 0 2024-09-16T02:06:02.540 INFO:tasks.workunit.client.1.smithi165.stdout:7/977: getdents d0/d4b/d58 0 2024-09-16T02:06:02.541 INFO:tasks.workunit.client.1.smithi165.stdout:6/981: symlink d7/d17/d75/d97/dcb/d3d/d5d/l11c 0 2024-09-16T02:06:02.542 INFO:tasks.workunit.client.1.smithi165.stdout:2/997: creat df/d23/d28/d3b/d82/f12d x:0 0 0 2024-09-16T02:06:02.543 INFO:tasks.workunit.client.1.smithi165.stdout:5/997: dread de/d21/d51/f5e [0,4194304] 0 2024-09-16T02:06:02.545 INFO:tasks.workunit.client.1.smithi165.stdout:2/998: write df/d10/d1a/d2d/f58 [898970,8081] 0 2024-09-16T02:06:02.546 INFO:tasks.workunit.client.1.smithi165.stdout:7/978: unlink d0/d2c/d85/fac 0 2024-09-16T02:06:02.552 INFO:tasks.workunit.client.1.smithi165.stdout:8/988: dread dd/d11/d14/d3f/d25/d36/d81/dd2/f63 [0,4194304] 0 2024-09-16T02:06:02.552 INFO:tasks.workunit.client.1.smithi165.stdout:5/998: rename de/d19/d1c/d4d/c9b to de/d21/d26/d94/dc2/c151 0 2024-09-16T02:06:02.553 INFO:tasks.workunit.client.1.smithi165.stdout:5/999: chown de/d19/d1c/d84 451717926 1 2024-09-16T02:06:02.555 INFO:tasks.workunit.client.1.smithi165.stdout:6/982: link d7/d17/d75/d97/dcb/d3d/fa1 d7/d1f/dbc/f11d 0 2024-09-16T02:06:02.557 INFO:tasks.workunit.client.1.smithi165.stdout:0/876: dwrite d0/d1e/d39/d48/d45/db3/fe2 [0,4194304] 0 2024-09-16T02:06:02.563 INFO:tasks.workunit.client.1.smithi165.stdout:2/999: dread df/d23/d28/dfa/f71 [0,4194304] 0 2024-09-16T02:06:02.563 INFO:tasks.workunit.client.1.smithi165.stdout:8/989: dwrite dd/d11/d14/d70/f143 [0,4194304] 0 2024-09-16T02:06:02.565 INFO:tasks.workunit.client.1.smithi165.stdout:7/979: dread d0/d4b/db4/dba/fca [0,4194304] 0 2024-09-16T02:06:02.568 INFO:tasks.workunit.client.1.smithi165.stdout:6/983: dwrite d7/d17/d75/d97/dcb/d3d/d5d/dcc/f110 [0,4194304] 0 2024-09-16T02:06:02.575 INFO:tasks.workunit.client.1.smithi165.stdout:8/990: dwrite dd/d11/d14/d3f/d25/d36/d81/d118/f14a [0,4194304] 0 2024-09-16T02:06:02.579 INFO:tasks.workunit.client.1.smithi165.stdout:8/991: stat dd/d11/d14/d70/d7b/d9a/f122 0 2024-09-16T02:06:02.582 INFO:tasks.workunit.client.1.smithi165.stdout:6/984: dread d7/d17/d75/d97/fdb [0,4194304] 0 2024-09-16T02:06:02.584 INFO:tasks.workunit.client.1.smithi165.stdout:6/985: chown d7/dc/d7f/dd2/d3c/dcd/fd8 36608973 1 2024-09-16T02:06:02.587 INFO:tasks.workunit.client.1.smithi165.stdout:8/992: dwrite dd/d11/d14/d70/d7b/d9a/f11a [0,4194304] 0 2024-09-16T02:06:02.589 INFO:tasks.workunit.client.1.smithi165.stdout:6/986: getdents d7/d1f/dbc 0 2024-09-16T02:06:02.592 INFO:tasks.workunit.client.1.smithi165.stdout:6/987: read d7/d17/d75/d97/dcb/d74/db7/de0/fc3 [85419,25258] 0 2024-09-16T02:06:02.593 INFO:tasks.workunit.client.1.smithi165.stdout:8/993: link dd/d11/d38/da6/db0/fbf dd/d11/d14/d3f/f151 0 2024-09-16T02:06:02.594 INFO:tasks.workunit.client.1.smithi165.stdout:8/994: write dd/d62/f111 [2785911,4207] 0 2024-09-16T02:06:02.596 INFO:tasks.workunit.client.1.smithi165.stdout:6/988: getdents d7/d1f 0 2024-09-16T02:06:02.597 INFO:tasks.workunit.client.1.smithi165.stdout:8/995: symlink dd/d11/d11b/l152 0 2024-09-16T02:06:02.598 INFO:tasks.workunit.client.1.smithi165.stdout:6/989: write d7/dc/d7f/dd2/d3c/dcd/fd8 [291217,14933] 0 2024-09-16T02:06:02.599 INFO:tasks.workunit.client.1.smithi165.stdout:7/980: dread d0/df/f5f [0,4194304] 0 2024-09-16T02:06:02.600 INFO:tasks.workunit.client.1.smithi165.stdout:8/996: unlink dd/c78 0 2024-09-16T02:06:02.600 INFO:tasks.workunit.client.1.smithi165.stdout:6/990: fdatasync d7/f1e 0 2024-09-16T02:06:02.600 INFO:tasks.workunit.client.1.smithi165.stdout:7/981: readlink d0/d2c/l30 0 2024-09-16T02:06:02.604 INFO:tasks.workunit.client.1.smithi165.stdout:8/997: link dd/f6c dd/d7f/f153 0 2024-09-16T02:06:02.608 INFO:tasks.workunit.client.1.smithi165.stdout:8/998: unlink dd/d11/f55 0 2024-09-16T02:06:02.609 INFO:tasks.workunit.client.1.smithi165.stdout:7/982: dwrite d0/d4b/db4/dda/fe5 [0,4194304] 0 2024-09-16T02:06:02.609 INFO:tasks.workunit.client.1.smithi165.stdout:6/991: dwrite d7/d17/d75/d97/dcb/d74/de3/f10f [0,4194304] 0 2024-09-16T02:06:02.611 INFO:tasks.workunit.client.1.smithi165.stdout:8/999: fdatasync dd/d11/d14/d70/d7b/f12f 0 2024-09-16T02:06:02.621 INFO:tasks.workunit.client.1.smithi165.stdout:6/992: link d7/f57 d7/d17/d75/d97/dcb/d3d/dd0/f11e 0 2024-09-16T02:06:02.622 INFO:tasks.workunit.client.1.smithi165.stdout:6/993: chown d7/d17/d75/d97/dcb/d3d/ddd/d114 18036 1 2024-09-16T02:06:02.626 INFO:tasks.workunit.client.1.smithi165.stdout:6/994: symlink d7/dc/df/d1a/d4d/da8/l11f 0 2024-09-16T02:06:02.626 INFO:tasks.workunit.client.1.smithi165.stdout:7/983: link d0/d3d/dd5/d127/c12d d0/d4b/d58/c140 0 2024-09-16T02:06:02.628 INFO:tasks.workunit.client.1.smithi165.stdout:6/995: dread d7/dc/d7f/dd2/f6f [0,4194304] 0 2024-09-16T02:06:02.630 INFO:tasks.workunit.client.1.smithi165.stdout:6/996: creat d7/d17/d75/dc1/f120 x:0 0 0 2024-09-16T02:06:02.632 INFO:tasks.workunit.client.1.smithi165.stdout:6/997: fsync d7/dc/f48 0 2024-09-16T02:06:02.636 INFO:tasks.workunit.client.1.smithi165.stdout:6/998: mknod d7/d17/d75/d97/dcb/d3d/dd0/c121 0 2024-09-16T02:06:02.637 INFO:tasks.workunit.client.1.smithi165.stdout:7/984: write d0/d4b/f5d [4790650,24406] 0 2024-09-16T02:06:02.639 INFO:tasks.workunit.client.1.smithi165.stdout:7/985: truncate d0/d4b/d63/f9e 4708246 0 2024-09-16T02:06:02.640 INFO:tasks.workunit.client.1.smithi165.stdout:6/999: link d7/dc/df/d1a/d4d/d5f/le5 d7/dc/df/l122 0 2024-09-16T02:06:02.641 INFO:tasks.workunit.client.1.smithi165.stdout:7/986: unlink d0/df/d33/d2a/dd2/f70 0 2024-09-16T02:06:02.643 INFO:tasks.workunit.client.1.smithi165.stdout:7/987: creat d0/f141 x:0 0 0 2024-09-16T02:06:02.645 INFO:tasks.workunit.client.1.smithi165.stdout:7/988: mknod d0/d3d/d9f/dc5/c142 0 2024-09-16T02:06:02.645 INFO:tasks.workunit.client.1.smithi165.stdout:7/989: chown d0/d4b/d63/c95 5098448 1 2024-09-16T02:06:02.647 INFO:tasks.workunit.client.1.smithi165.stdout:7/990: creat d0/d3d/d9f/ddc/dcb/f143 x:0 0 0 2024-09-16T02:06:02.648 INFO:tasks.workunit.client.1.smithi165.stdout:7/991: rmdir d0/d4b/db4/dba/dc4 39 2024-09-16T02:06:02.654 INFO:tasks.workunit.client.1.smithi165.stdout:4/917: sync 2024-09-16T02:06:02.656 INFO:tasks.workunit.client.1.smithi165.stdout:4/918: truncate d4/dc/d28/d3b/d117/f126 121299 0 2024-09-16T02:06:02.656 INFO:tasks.workunit.client.1.smithi165.stdout:7/992: dread d0/d4b/db4/ff4 [0,4194304] 0 2024-09-16T02:06:02.656 INFO:tasks.workunit.client.1.smithi165.stdout:7/993: read - d0/df/d83/fe8 zero size 2024-09-16T02:06:02.657 INFO:tasks.workunit.client.1.smithi165.stdout:4/919: write d4/dc/d18/d37/d53/d64/d8b/f86 [2063763,36156] 0 2024-09-16T02:06:02.659 INFO:tasks.workunit.client.1.smithi165.stdout:7/994: mkdir d0/df/d33/d2a/dd2/d144 0 2024-09-16T02:06:02.660 INFO:tasks.workunit.client.1.smithi165.stdout:4/920: symlink d4/dc/d18/d37/d53/d64/d8b/df4/l12d 0 2024-09-16T02:06:02.661 INFO:tasks.workunit.client.1.smithi165.stdout:7/995: creat d0/d4b/db4/dba/d10d/f145 x:0 0 0 2024-09-16T02:06:02.662 INFO:tasks.workunit.client.1.smithi165.stdout:4/921: unlink d4/dc/d28/d3b/lc8 0 2024-09-16T02:06:02.663 INFO:tasks.workunit.client.1.smithi165.stdout:4/922: write d4/dc/d28/d2b/f74 [1979602,114829] 0 2024-09-16T02:06:02.663 INFO:tasks.workunit.client.1.smithi165.stdout:7/996: unlink d0/d4b/d58/c62 0 2024-09-16T02:06:02.665 INFO:tasks.workunit.client.1.smithi165.stdout:7/997: symlink d0/d4b/d58/l146 0 2024-09-16T02:06:02.665 INFO:tasks.workunit.client.1.smithi165.stdout:4/923: mknod d4/dc/d28/c12e 0 2024-09-16T02:06:02.667 INFO:tasks.workunit.client.1.smithi165.stdout:4/924: fsync d4/dc/d18/d37/d53/d64/d8b/ff8 0 2024-09-16T02:06:02.667 INFO:tasks.workunit.client.1.smithi165.stdout:7/998: rename d0/d3d/d9f/fbe to d0/df/d33/d2a/f147 0 2024-09-16T02:06:02.668 INFO:tasks.workunit.client.1.smithi165.stdout:4/925: chown d4/dc/d28/d2b/d10d/d115/f11d 1225 1 2024-09-16T02:06:02.668 INFO:tasks.workunit.client.1.smithi165.stdout:7/999: stat d0/d3d/d9f/dc5/cec 0 2024-09-16T02:06:02.669 INFO:tasks.workunit.client.1.smithi165.stdout:4/926: rename d4/dbc/f110 to d4/dc/d20/f12f 0 2024-09-16T02:06:02.671 INFO:tasks.workunit.client.1.smithi165.stdout:4/927: symlink d4/dc/d28/d3b/d117/l130 0 2024-09-16T02:06:02.675 INFO:tasks.workunit.client.0.smithi110.stdout:5/376: sync 2024-09-16T02:06:02.675 INFO:tasks.workunit.client.0.smithi110.stdout:6/513: sync 2024-09-16T02:06:02.677 INFO:tasks.workunit.client.0.smithi110.stdout:5/377: rmdir d5/dd/df 39 2024-09-16T02:06:02.682 INFO:tasks.workunit.client.0.smithi110.stdout:5/378: link d5/dd/df/d11/c46 d5/d71/c7d 0 2024-09-16T02:06:02.682 INFO:tasks.workunit.client.0.smithi110.stdout:5/379: write d5/f1e [4098995,53170] 0 2024-09-16T02:06:02.684 INFO:tasks.workunit.client.0.smithi110.stdout:5/380: dread - d5/dd/df/d28/f30 zero size 2024-09-16T02:06:02.686 INFO:tasks.workunit.client.0.smithi110.stdout:5/381: getdents d5/dd/df/d28/d77 0 2024-09-16T02:06:02.687 INFO:tasks.workunit.client.1.smithi165.stdout:4/928: dread d4/dc/d28/d3b/f90 [0,4194304] 0 2024-09-16T02:06:02.688 INFO:tasks.workunit.client.1.smithi165.stdout:4/929: write d4/dc/d20/d45/f97 [3350613,79670] 0 2024-09-16T02:06:02.690 INFO:tasks.workunit.client.0.smithi110.stdout:6/514: truncate d0/d2/d5/d84/f6d 292274 0 2024-09-16T02:06:02.692 INFO:tasks.workunit.client.0.smithi110.stdout:6/515: creat d0/d29/d2a/d2f/fa3 x:0 0 0 2024-09-16T02:06:02.693 INFO:tasks.workunit.client.1.smithi165.stdout:4/930: write d4/dc/fdf [1039301,91383] 0 2024-09-16T02:06:02.694 INFO:tasks.workunit.client.0.smithi110.stdout:6/516: chown d0/d29/d2a/d2f/d49/l66 15318607 1 2024-09-16T02:06:02.695 INFO:tasks.workunit.client.1.smithi165.stdout:4/931: mkdir d4/dc/d28/d131 0 2024-09-16T02:06:02.696 INFO:tasks.workunit.client.0.smithi110.stdout:6/517: creat d0/d2/d18/d1d/fa4 x:0 0 0 2024-09-16T02:06:02.697 INFO:tasks.workunit.client.0.smithi110.stdout:6/518: read - d0/d29/d2a/d2d/d98/f9d zero size 2024-09-16T02:06:02.701 INFO:tasks.workunit.client.0.smithi110.stdout:6/519: link d0/d2/d5/d55/f8f d0/d29/d2a/fa5 0 2024-09-16T02:06:02.702 INFO:tasks.workunit.client.1.smithi165.stdout:4/932: write d4/dc/d18/d37/d53/d64/d91/fbf [30038,4318] 0 2024-09-16T02:06:02.702 INFO:tasks.workunit.client.0.smithi110.stdout:6/520: write d0/d2/f1c [4870329,74386] 0 2024-09-16T02:06:02.703 INFO:tasks.workunit.client.1.smithi165.stdout:0/877: sync 2024-09-16T02:06:02.704 INFO:tasks.workunit.client.0.smithi110.stdout:6/521: creat d0/d2/d5/d84/d62/fa6 x:0 0 0 2024-09-16T02:06:02.704 INFO:tasks.workunit.client.1.smithi165.stdout:4/933: symlink d4/l132 0 2024-09-16T02:06:02.705 INFO:tasks.workunit.client.1.smithi165.stdout:0/878: chown d0/d1e/d20/d28/c42 0 1 2024-09-16T02:06:02.706 INFO:tasks.workunit.client.1.smithi165.stdout:0/879: readlink d0/d1e/d20/d28/da7/db4/lf6 0 2024-09-16T02:06:02.707 INFO:tasks.workunit.client.1.smithi165.stdout:4/934: creat d4/dc/d18/d111/d120/f133 x:0 0 0 2024-09-16T02:06:02.707 INFO:tasks.workunit.client.1.smithi165.stdout:0/880: write d0/d1e/d39/d48/d45/db3/ffb [1037460,48799] 0 2024-09-16T02:06:02.708 INFO:tasks.workunit.client.0.smithi110.stdout:6/522: getdents d0/d2/d5/d1e 0 2024-09-16T02:06:02.708 INFO:tasks.workunit.client.1.smithi165.stdout:4/935: write d4/dc/d20/d45/f101 [4319203,8231] 0 2024-09-16T02:06:02.710 INFO:tasks.workunit.client.1.smithi165.stdout:0/881: creat d0/d61/f120 x:0 0 0 2024-09-16T02:06:02.710 INFO:tasks.workunit.client.0.smithi110.stdout:6/523: symlink d0/d29/la7 0 2024-09-16T02:06:02.712 INFO:tasks.workunit.client.1.smithi165.stdout:4/936: unlink d4/dc/d18/d37/d53/d64/d91/la9 0 2024-09-16T02:06:02.713 INFO:tasks.workunit.client.1.smithi165.stdout:0/882: mknod d0/d1e/d39/d48/d5f/c121 0 2024-09-16T02:06:02.715 INFO:tasks.workunit.client.1.smithi165.stdout:4/937: unlink d4/dc/dea/ff3 0 2024-09-16T02:06:02.717 INFO:tasks.workunit.client.0.smithi110.stdout:6/524: dwrite d0/d2/f42 [4194304,4194304] 0 2024-09-16T02:06:02.719 INFO:tasks.workunit.client.1.smithi165.stdout:4/938: mkdir d4/dc/dea/d134 0 2024-09-16T02:06:02.723 INFO:tasks.workunit.client.1.smithi165.stdout:4/939: mkdir d4/dc/d18/d37/d53/d64/d8b/d71/d135 0 2024-09-16T02:06:02.724 INFO:tasks.workunit.client.0.smithi110.stdout:6/525: dwrite d0/d29/d2a/d2f/f58 [4194304,4194304] 0 2024-09-16T02:06:02.725 INFO:tasks.workunit.client.1.smithi165.stdout:4/940: mkdir d4/dc/d20/d4e/d73/d136 0 2024-09-16T02:06:02.726 INFO:tasks.workunit.client.0.smithi110.stdout:6/526: dread - d0/d29/f53 zero size 2024-09-16T02:06:02.726 INFO:tasks.workunit.client.0.smithi110.stdout:6/527: chown d0/d2/f1c 25 1 2024-09-16T02:06:02.727 INFO:tasks.workunit.client.1.smithi165.stdout:0/883: truncate d0/d1e/d39/d48/d5f/d82/fa5 156966 0 2024-09-16T02:06:02.730 INFO:tasks.workunit.client.0.smithi110.stdout:6/528: creat d0/d29/d2a/d2d/d98/fa8 x:0 0 0 2024-09-16T02:06:02.732 INFO:tasks.workunit.client.1.smithi165.stdout:4/941: rename d4/dc/d18/d37/d53/d64/d8b/ff8 to d4/d40/f137 0 2024-09-16T02:06:02.733 INFO:tasks.workunit.client.0.smithi110.stdout:6/529: creat d0/d29/d2a/fa9 x:0 0 0 2024-09-16T02:06:02.734 INFO:tasks.workunit.client.1.smithi165.stdout:4/942: chown d4/dc/d18/d37/d53/d64/d91/le4 1 1 2024-09-16T02:06:02.734 INFO:tasks.workunit.client.0.smithi110.stdout:6/530: write d0/d2/f69 [879579,75066] 0 2024-09-16T02:06:02.737 INFO:tasks.workunit.client.0.smithi110.stdout:6/531: mkdir d0/d29/d2a/d2d/daa 0 2024-09-16T02:06:02.737 INFO:tasks.workunit.client.0.smithi110.stdout:6/532: chown d0/d2/d5/d84/d16/f3b 30 1 2024-09-16T02:06:02.740 INFO:tasks.workunit.client.1.smithi165.stdout:4/943: dwrite d4/d40/d4f/f11a [0,4194304] 0 2024-09-16T02:06:02.744 INFO:tasks.workunit.client.0.smithi110.stdout:6/533: dwrite d0/d2/d18/d1d/f3d [0,4194304] 0 2024-09-16T02:06:02.747 INFO:tasks.workunit.client.0.smithi110.stdout:6/534: mkdir d0/d29/d2a/dab 0 2024-09-16T02:06:02.751 INFO:tasks.workunit.client.0.smithi110.stdout:6/535: creat d0/d2/d18/d1d/fac x:0 0 0 2024-09-16T02:06:02.753 INFO:tasks.workunit.client.1.smithi165.stdout:0/884: dread d0/d1e/d39/d48/f8f [0,4194304] 0 2024-09-16T02:06:02.756 INFO:tasks.workunit.client.0.smithi110.stdout:6/536: dread d0/d2/d18/d1d/f3d [0,4194304] 0 2024-09-16T02:06:02.756 INFO:tasks.workunit.client.1.smithi165.stdout:0/885: unlink d0/le 0 2024-09-16T02:06:02.759 INFO:tasks.workunit.client.0.smithi110.stdout:6/537: rename d0/d29/d2a/c4c to d0/d2/d5/d94/cad 0 2024-09-16T02:06:02.762 INFO:tasks.workunit.client.0.smithi110.stdout:6/538: readlink d0/d2/d5/d84/l9f 0 2024-09-16T02:06:02.762 INFO:tasks.workunit.client.0.smithi110.stdout:6/539: stat d0/d2/d5/d84/d16/c79 0 2024-09-16T02:06:02.768 INFO:tasks.workunit.client.0.smithi110.stdout:6/540: link d0/d2/d5/c70 d0/d2/d5/d84/cae 0 2024-09-16T02:06:02.769 INFO:tasks.workunit.client.0.smithi110.stdout:6/541: fdatasync d0/d29/d2a/d2f/f99 0 2024-09-16T02:06:02.769 INFO:tasks.workunit.client.1.smithi165.stdout:0/886: write d0/d47/f6f [704046,89081] 0 2024-09-16T02:06:02.771 INFO:tasks.workunit.client.0.smithi110.stdout:6/542: creat d0/d29/d2a/d2d/d8b/faf x:0 0 0 2024-09-16T02:06:02.772 INFO:tasks.workunit.client.1.smithi165.stdout:4/944: dread d4/dbc/fbb [0,4194304] 0 2024-09-16T02:06:02.773 INFO:tasks.workunit.client.1.smithi165.stdout:4/945: write d4/dc/d20/d4e/fe5 [2937595,43753] 0 2024-09-16T02:06:02.777 INFO:tasks.workunit.client.1.smithi165.stdout:4/946: unlink d4/dc/d18/d37/d53/c95 0 2024-09-16T02:06:02.778 INFO:tasks.workunit.client.0.smithi110.stdout:6/543: getdents d0/d2/d5/d84 0 2024-09-16T02:06:02.779 INFO:tasks.workunit.client.1.smithi165.stdout:0/887: readlink d0/d1e/d39/d99/lfa 0 2024-09-16T02:06:02.779 INFO:tasks.workunit.client.1.smithi165.stdout:4/947: symlink d4/dc/d20/d45/l138 0 2024-09-16T02:06:02.781 INFO:tasks.workunit.client.1.smithi165.stdout:4/948: dread d4/dc0/dd3/fe2 [0,4194304] 0 2024-09-16T02:06:02.783 INFO:tasks.workunit.client.1.smithi165.stdout:0/888: creat d0/d1e/d39/d48/d5f/d82/d91/f122 x:0 0 0 2024-09-16T02:06:02.783 INFO:tasks.workunit.client.1.smithi165.stdout:0/889: readlink d0/d1e/d39/d48/d45/db3/l117 0 2024-09-16T02:06:02.784 INFO:tasks.workunit.client.0.smithi110.stdout:6/544: write d0/d29/d2a/f37 [1191457,129426] 0 2024-09-16T02:06:02.784 INFO:tasks.workunit.client.1.smithi165.stdout:0/890: chown d0/d1e 6506 1 2024-09-16T02:06:02.785 INFO:tasks.workunit.client.0.smithi110.stdout:6/545: stat d0/d2/d5/d84/cae 0 2024-09-16T02:06:02.786 INFO:tasks.workunit.client.0.smithi110.stdout:6/546: fdatasync d0/d2/d57/d7a/f9a 0 2024-09-16T02:06:02.787 INFO:tasks.workunit.client.0.smithi110.stdout:6/547: truncate d0/d2/d18/d1d/fac 865127 0 2024-09-16T02:06:02.788 INFO:tasks.workunit.client.0.smithi110.stdout:6/548: dread d0/d29/d2a/fa5 [0,4194304] 0 2024-09-16T02:06:02.790 INFO:tasks.workunit.client.0.smithi110.stdout:6/549: mknod d0/d2/d18/cb0 0 2024-09-16T02:06:02.790 INFO:tasks.workunit.client.0.smithi110.stdout:6/550: readlink d0/d29/d2a/d2f/l6f 0 2024-09-16T02:06:02.792 INFO:tasks.workunit.client.0.smithi110.stdout:6/551: truncate d0/f47 2201244 0 2024-09-16T02:06:02.793 INFO:tasks.workunit.client.1.smithi165.stdout:0/891: dwrite d0/d1e/d20/d28/d9a/f111 [0,4194304] 0 2024-09-16T02:06:02.793 INFO:tasks.workunit.client.0.smithi110.stdout:6/552: stat d0/d29 0 2024-09-16T02:06:02.793 INFO:tasks.workunit.client.0.smithi110.stdout:6/553: fdatasync d0/d2/d5/d84/d16/f72 0 2024-09-16T02:06:02.795 INFO:tasks.workunit.client.1.smithi165.stdout:0/892: mknod d0/d1e/d39/d99/c123 0 2024-09-16T02:06:02.796 INFO:tasks.workunit.client.1.smithi165.stdout:4/949: dread d4/dc/d28/d3b/df0/f10a [0,4194304] 0 2024-09-16T02:06:02.797 INFO:tasks.workunit.client.0.smithi110.stdout:6/554: read d0/d2/d5/d84/f41 [2591719,126224] 0 2024-09-16T02:06:02.798 INFO:tasks.workunit.client.1.smithi165.stdout:0/893: rmdir d0/d2a/d70 39 2024-09-16T02:06:02.799 INFO:tasks.workunit.client.1.smithi165.stdout:0/894: chown d0/d1e/d39/d48/d74/dc6/fd4 36 1 2024-09-16T02:06:02.806 INFO:tasks.workunit.client.1.smithi165.stdout:0/895: dwrite d0/d1e/d39/d99/ff1 [0,4194304] 0 2024-09-16T02:06:02.807 INFO:tasks.workunit.client.0.smithi110.stdout:6/555: dread d0/d2/d5/d84/d16/f13 [0,4194304] 0 2024-09-16T02:06:02.809 INFO:tasks.workunit.client.0.smithi110.stdout:6/556: fsync d0/d2/d5/d84/f6d 0 2024-09-16T02:06:02.820 INFO:tasks.workunit.client.0.smithi110.stdout:6/557: dread d0/d2/d5/d84/d16/f7b [0,4194304] 0 2024-09-16T02:06:02.822 INFO:tasks.workunit.client.1.smithi165.stdout:0/896: dread d0/d1e/d20/d28/d6d/d87/fa9 [0,4194304] 0 2024-09-16T02:06:02.823 INFO:tasks.workunit.client.0.smithi110.stdout:6/558: link d0/d29/d2a/d2f/d49/l92 d0/d29/d2a/d2d/daa/lb1 0 2024-09-16T02:06:02.823 INFO:tasks.workunit.client.1.smithi165.stdout:0/897: write d0/d1e/d39/d48/d5f/d82/f8a [1696141,75701] 0 2024-09-16T02:06:02.825 INFO:tasks.workunit.client.0.smithi110.stdout:6/559: mknod d0/d2/d57/da0/cb2 0 2024-09-16T02:06:02.826 INFO:tasks.workunit.client.1.smithi165.stdout:0/898: link d0/l14 d0/d1e/d20/d28/d9a/l124 0 2024-09-16T02:06:02.827 INFO:tasks.workunit.client.0.smithi110.stdout:6/560: mknod d0/d29/d2a/d2f/d49/cb3 0 2024-09-16T02:06:02.829 INFO:tasks.workunit.client.0.smithi110.stdout:6/561: rename d0/d2/d18/c21 to d0/d2/d5/cb4 0 2024-09-16T02:06:02.831 INFO:tasks.workunit.client.1.smithi165.stdout:0/899: link d0/d1e/d39/d48/d45/f60 d0/d1e/d39/d48/d5f/f125 0 2024-09-16T02:06:02.831 INFO:tasks.workunit.client.0.smithi110.stdout:6/562: creat d0/d2/d5/d1e/fb5 x:0 0 0 2024-09-16T02:06:02.833 INFO:tasks.workunit.client.0.smithi110.stdout:6/563: creat d0/d29/d2a/d2d/d98/fb6 x:0 0 0 2024-09-16T02:06:02.834 INFO:tasks.workunit.client.0.smithi110.stdout:6/564: mkdir d0/d2/db7 0 2024-09-16T02:06:02.837 INFO:tasks.workunit.client.1.smithi165.stdout:0/900: dwrite d0/d2a/d70/d10f/f118 [0,4194304] 0 2024-09-16T02:06:02.842 INFO:tasks.workunit.client.0.smithi110.stdout:6/565: fdatasync d0/d2/f25 0 2024-09-16T02:06:02.847 INFO:tasks.workunit.client.0.smithi110.stdout:6/566: rename d0/d29/d2a/d2f/d49 to d0/d2/d5/db8 0 2024-09-16T02:06:02.849 INFO:tasks.workunit.client.0.smithi110.stdout:6/567: dread d0/f83 [0,4194304] 0 2024-09-16T02:06:02.850 INFO:tasks.workunit.client.0.smithi110.stdout:6/568: fdatasync d0/d29/d2a/d2f/f99 0 2024-09-16T02:06:02.852 INFO:tasks.workunit.client.0.smithi110.stdout:6/569: unlink d0/d29/c65 0 2024-09-16T02:06:02.854 INFO:tasks.workunit.client.0.smithi110.stdout:6/570: getdents d0/d29/d2a/dab 0 2024-09-16T02:06:02.855 INFO:tasks.workunit.client.0.smithi110.stdout:6/571: read d0/d2/d5/d84/d16/f72 [936002,17316] 0 2024-09-16T02:06:02.857 INFO:tasks.workunit.client.0.smithi110.stdout:6/572: fdatasync d0/d29/d2a/d2f/f5f 0 2024-09-16T02:06:02.857 INFO:tasks.workunit.client.0.smithi110.stdout:6/573: chown d0/d29/d2a 178407 1 2024-09-16T02:06:02.858 INFO:tasks.workunit.client.0.smithi110.stdout:6/574: chown d0/d29/d2a 1 1 2024-09-16T02:06:02.861 INFO:tasks.workunit.client.0.smithi110.stdout:6/575: rename d0/d2/d5/d84/f54 to d0/d29/d2a/fb9 0 2024-09-16T02:06:02.873 INFO:tasks.workunit.client.0.smithi110.stdout:6/576: dread d0/d2/f3a [0,4194304] 0 2024-09-16T02:06:02.883 INFO:tasks.workunit.client.0.smithi110.stdout:6/577: dread - d0/d2/d18/d1d/fa4 zero size 2024-09-16T02:06:02.884 INFO:tasks.workunit.client.0.smithi110.stdout:2/424: sync 2024-09-16T02:06:02.884 INFO:tasks.workunit.client.0.smithi110.stdout:3/419: sync 2024-09-16T02:06:02.884 INFO:tasks.workunit.client.0.smithi110.stdout:3/420: stat d8/dc/d1b/d36/f40 0 2024-09-16T02:06:02.893 INFO:tasks.workunit.client.0.smithi110.stdout:2/425: dwrite d0/da/d18/d25/d3b/f43 [0,4194304] 0 2024-09-16T02:06:02.893 INFO:tasks.workunit.client.0.smithi110.stdout:3/421: dwrite d8/dc/f84 [0,4194304] 0 2024-09-16T02:06:02.896 INFO:tasks.workunit.client.0.smithi110.stdout:3/422: mknod d8/dc/d1b/d36/c93 0 2024-09-16T02:06:02.899 INFO:tasks.workunit.client.0.smithi110.stdout:2/426: rename d0/db/d33/d70/f5d to d0/db/d33/d70/f8c 0 2024-09-16T02:06:02.900 INFO:tasks.workunit.client.0.smithi110.stdout:2/427: stat d0/l40 0 2024-09-16T02:06:02.902 INFO:tasks.workunit.client.0.smithi110.stdout:3/423: symlink d8/d48/d7c/l94 0 2024-09-16T02:06:02.903 INFO:tasks.workunit.client.0.smithi110.stdout:3/424: rename d8/dc/d1b/d3a to d8/dc/d1b/d3a/d95 22 2024-09-16T02:06:02.905 INFO:tasks.workunit.client.0.smithi110.stdout:2/428: creat d0/db/d33/f8d x:0 0 0 2024-09-16T02:06:02.908 INFO:tasks.workunit.client.0.smithi110.stdout:3/425: dread d8/d29/d45/f5f [0,4194304] 0 2024-09-16T02:06:02.910 INFO:tasks.workunit.client.0.smithi110.stdout:3/426: creat d8/d29/f96 x:0 0 0 2024-09-16T02:06:02.910 INFO:tasks.workunit.client.0.smithi110.stdout:2/429: link d0/c6e d0/da/d18/d25/d3b/c8e 0 2024-09-16T02:06:02.911 INFO:tasks.workunit.client.0.smithi110.stdout:2/430: fdatasync d0/da/d18/dc/f7f 0 2024-09-16T02:06:02.912 INFO:tasks.workunit.client.0.smithi110.stdout:6/578: dwrite d0/d2/d5/d84/d16/f7b [0,4194304] 0 2024-09-16T02:06:02.912 INFO:tasks.workunit.client.0.smithi110.stdout:3/427: write d8/dc/d1b/d1c/f7a [742457,4815] 0 2024-09-16T02:06:02.913 INFO:tasks.workunit.client.0.smithi110.stdout:2/431: chown d0/db/d33/d46/f7a 662248 1 2024-09-16T02:06:02.914 INFO:tasks.workunit.client.0.smithi110.stdout:3/428: chown d8/dc/d1b/d3a/d43/f67 129106859 1 2024-09-16T02:06:02.915 INFO:tasks.workunit.client.0.smithi110.stdout:6/579: truncate d0/f47 2064008 0 2024-09-16T02:06:02.920 INFO:tasks.workunit.client.0.smithi110.stdout:6/580: unlink d0/d29/d2a/d2f/f73 0 2024-09-16T02:06:02.922 INFO:tasks.workunit.client.0.smithi110.stdout:6/581: mkdir d0/d2/d5/d94/dba 0 2024-09-16T02:06:02.923 INFO:tasks.workunit.client.0.smithi110.stdout:2/432: dwrite d0/da/d18/dc/f1f [0,4194304] 0 2024-09-16T02:06:02.923 INFO:tasks.workunit.client.1.smithi165.stdout:0/901: sync 2024-09-16T02:06:02.923 INFO:tasks.workunit.client.1.smithi165.stdout:4/950: sync 2024-09-16T02:06:02.928 INFO:tasks.workunit.client.0.smithi110.stdout:6/582: symlink d0/d2/d57/d75/lbb 0 2024-09-16T02:06:02.930 INFO:tasks.workunit.client.1.smithi165.stdout:4/951: mkdir d4/dc/d28/d2b/d139 0 2024-09-16T02:06:02.931 INFO:tasks.workunit.client.0.smithi110.stdout:6/583: stat d0/d2/l9e 0 2024-09-16T02:06:02.933 INFO:tasks.workunit.client.0.smithi110.stdout:6/584: symlink d0/d2/d5/lbc 0 2024-09-16T02:06:02.935 INFO:tasks.workunit.client.1.smithi165.stdout:4/952: link d4/d40/c6b d4/dc/d20/d45/c13a 0 2024-09-16T02:06:02.935 INFO:tasks.workunit.client.0.smithi110.stdout:6/585: fdatasync d0/d2/d5/f88 0 2024-09-16T02:06:02.937 INFO:tasks.workunit.client.0.smithi110.stdout:3/429: dwrite d8/f15 [0,4194304] 0 2024-09-16T02:06:02.938 INFO:tasks.workunit.client.1.smithi165.stdout:4/953: unlink d4/dc/d20/d4e/le0 0 2024-09-16T02:06:02.941 INFO:tasks.workunit.client.1.smithi165.stdout:4/954: mknod d4/dc/dea/dfb/c13b 0 2024-09-16T02:06:02.942 INFO:tasks.workunit.client.1.smithi165.stdout:0/902: dwrite d0/d2a/fda [0,4194304] 0 2024-09-16T02:06:02.944 INFO:tasks.workunit.client.1.smithi165.stdout:0/903: readlink d0/d1e/d39/d48/d45/db3/lf3 0 2024-09-16T02:06:02.947 INFO:tasks.workunit.client.1.smithi165.stdout:0/904: creat d0/d1e/d20/d28/da7/f126 x:0 0 0 2024-09-16T02:06:02.951 INFO:tasks.workunit.client.1.smithi165.stdout:0/905: chown d0/d1e/d20/f46 3 1 2024-09-16T02:06:02.954 INFO:tasks.workunit.client.1.smithi165.stdout:4/955: write d4/dc/d18/d37/d53/d64/fd9 [678438,98410] 0 2024-09-16T02:06:02.955 INFO:tasks.workunit.client.1.smithi165.stdout:0/906: truncate d0/d1e/d39/d48/d5f/f125 661322 0 2024-09-16T02:06:02.956 INFO:tasks.workunit.client.1.smithi165.stdout:4/956: truncate d4/dc/d28/f5f 27056 0 2024-09-16T02:06:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:02 smithi110 ceph-mon[27634]: pgmap v25: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 91 MiB/s rd, 246 MiB/s wr, 479 op/s 2024-09-16T02:06:02.957 INFO:tasks.workunit.client.1.smithi165.stdout:0/907: chown d0/d1e/d20/d28/d9a/l124 1 1 2024-09-16T02:06:02.960 INFO:tasks.workunit.client.1.smithi165.stdout:0/908: read d0/d1e/f93 [299991,24994] 0 2024-09-16T02:06:02.961 INFO:tasks.workunit.client.1.smithi165.stdout:4/957: rename d4/dc/d18/d37/d53/d64/d8b/l5e to d4/dc/d18/d37/d53/d64/d8b/d71/de9/l13c 0 2024-09-16T02:06:02.966 INFO:tasks.workunit.client.1.smithi165.stdout:0/909: dwrite d0/d47/f65 [4194304,4194304] 0 2024-09-16T02:06:02.972 INFO:tasks.workunit.client.1.smithi165.stdout:0/910: dwrite d0/d1e/d20/f7f [0,4194304] 0 2024-09-16T02:06:02.978 INFO:tasks.workunit.client.1.smithi165.stdout:0/911: link d0/la d0/d61/l127 0 2024-09-16T02:06:02.980 INFO:tasks.workunit.client.1.smithi165.stdout:0/912: chown d0/d1e/d39/d48/d5f/d96/da4/dbb/lc4 185 1 2024-09-16T02:06:02.980 INFO:tasks.workunit.client.1.smithi165.stdout:4/958: dread d4/dc/f19 [0,4194304] 0 2024-09-16T02:06:02.981 INFO:tasks.workunit.client.1.smithi165.stdout:4/959: readlink d4/dc/d20/dc4/led 0 2024-09-16T02:06:02.991 INFO:tasks.workunit.client.0.smithi110.stdout:6/586: symlink d0/d2/db7/lbd 0 2024-09-16T02:06:02.992 INFO:tasks.workunit.client.0.smithi110.stdout:3/430: mkdir d8/dc/d1b/d36/d57/d97 0 2024-09-16T02:06:02.994 INFO:tasks.workunit.client.0.smithi110.stdout:3/431: symlink d8/dc/d1b/d36/d57/l98 0 2024-09-16T02:06:02.998 INFO:tasks.workunit.client.0.smithi110.stdout:6/587: rename d0/d2/db7 to d0/d2/d5/d1e/d48/dbe 0 2024-09-16T02:06:03.002 INFO:tasks.workunit.client.0.smithi110.stdout:3/432: getdents d8/dc/d1b/d1c 0 2024-09-16T02:06:03.005 INFO:tasks.workunit.client.1.smithi165.stdout:0/913: dread d0/d1e/d39/d48/d45/f95 [0,4194304] 0 2024-09-16T02:06:03.006 INFO:tasks.workunit.client.1.smithi165.stdout:4/960: dwrite d4/dc0/fc6 [0,4194304] 0 2024-09-16T02:06:03.012 INFO:tasks.workunit.client.1.smithi165.stdout:0/914: truncate d0/d1e/d39/d48/d45/f37 247809 0 2024-09-16T02:06:03.015 INFO:tasks.workunit.client.1.smithi165.stdout:4/961: dwrite d4/dc/dea/dfb/f11e [0,4194304] 0 2024-09-16T02:06:03.019 INFO:tasks.workunit.client.1.smithi165.stdout:4/962: mkdir d4/dc/d28/d2b/d42/d99/dee/d13d 0 2024-09-16T02:06:03.022 INFO:tasks.workunit.client.1.smithi165.stdout:0/915: dwrite d0/fba [4194304,4194304] 0 2024-09-16T02:06:03.022 INFO:tasks.workunit.client.1.smithi165.stdout:4/963: stat d4/dc/d18/d37/fa4 0 2024-09-16T02:06:03.025 INFO:tasks.workunit.client.1.smithi165.stdout:0/916: write d0/d1e/f24 [2052485,96670] 0 2024-09-16T02:06:03.026 INFO:tasks.workunit.client.1.smithi165.stdout:0/917: write d0/d61/f120 [246581,56652] 0 2024-09-16T02:06:03.027 INFO:tasks.workunit.client.1.smithi165.stdout:4/964: truncate f1 1529216 0 2024-09-16T02:06:03.028 INFO:tasks.workunit.client.1.smithi165.stdout:0/918: fsync d0/d1e/d39/d48/d74/dc6/fec 0 2024-09-16T02:06:03.029 INFO:tasks.workunit.client.1.smithi165.stdout:0/919: read d0/f30 [523407,18118] 0 2024-09-16T02:06:03.032 INFO:tasks.workunit.client.1.smithi165.stdout:0/920: mkdir d0/d1e/d39/d48/d5f/d96/da4/d128 0 2024-09-16T02:06:03.033 INFO:tasks.workunit.client.1.smithi165.stdout:0/921: dread - d0/d1e/d39/d48/ff7 zero size 2024-09-16T02:06:03.034 INFO:tasks.workunit.client.1.smithi165.stdout:0/922: write d0/d1e/d20/f7f [1639544,58009] 0 2024-09-16T02:06:03.036 INFO:tasks.workunit.client.1.smithi165.stdout:0/923: chown d0/d1e/d39/f49 545 1 2024-09-16T02:06:03.037 INFO:tasks.workunit.client.1.smithi165.stdout:0/924: stat d0/d1e/d20/d9c 0 2024-09-16T02:06:03.044 INFO:tasks.workunit.client.1.smithi165.stdout:4/965: dread d4/dc/d20/f62 [0,4194304] 0 2024-09-16T02:06:03.044 INFO:tasks.workunit.client.1.smithi165.stdout:0/925: dwrite d0/d2a/d70/f8b [4194304,4194304] 0 2024-09-16T02:06:03.046 INFO:tasks.workunit.client.1.smithi165.stdout:4/966: creat d4/dc/d18/f13e x:0 0 0 2024-09-16T02:06:03.049 INFO:tasks.workunit.client.1.smithi165.stdout:0/926: getdents d0/d1e/d39/d48/d5f 0 2024-09-16T02:06:03.053 INFO:tasks.workunit.client.1.smithi165.stdout:0/927: readlink d0/d1e/d39/l52 0 2024-09-16T02:06:03.054 INFO:tasks.workunit.client.1.smithi165.stdout:4/967: dwrite d4/dc/d18/d37/d53/d64/faa [0,4194304] 0 2024-09-16T02:06:03.056 INFO:tasks.workunit.client.0.smithi110.stdout:4/442: sync 2024-09-16T02:06:03.057 INFO:tasks.workunit.client.1.smithi165.stdout:4/968: symlink d4/dc/d20/dc2/dd6/l13f 0 2024-09-16T02:06:03.059 INFO:tasks.workunit.client.1.smithi165.stdout:4/969: read d4/dc/d18/f109 [419052,88220] 0 2024-09-16T02:06:03.066 INFO:tasks.workunit.client.1.smithi165.stdout:4/970: dwrite d4/dc/d18/f13e [0,4194304] 0 2024-09-16T02:06:03.071 INFO:tasks.workunit.client.1.smithi165.stdout:4/971: mkdir d4/dc/d18/d108/d140 0 2024-09-16T02:06:03.073 INFO:tasks.workunit.client.1.smithi165.stdout:0/928: dwrite d0/d1e/d39/f49 [0,4194304] 0 2024-09-16T02:06:03.076 INFO:tasks.workunit.client.1.smithi165.stdout:0/929: read d0/d1e/f24 [4136087,6424] 0 2024-09-16T02:06:03.077 INFO:tasks.workunit.client.1.smithi165.stdout:4/972: rename d4/c2e to d4/d40/c141 0 2024-09-16T02:06:03.078 INFO:tasks.workunit.client.0.smithi110.stdout:6/588: write d0/d29/f53 [619972,53459] 0 2024-09-16T02:06:03.079 INFO:tasks.workunit.client.1.smithi165.stdout:4/973: chown d4/dc/d28/d2b/c32 14 1 2024-09-16T02:06:03.080 INFO:tasks.workunit.client.0.smithi110.stdout:3/433: chown d8/dc/d1b/d36/l44 251301735 1 2024-09-16T02:06:03.080 INFO:tasks.workunit.client.0.smithi110.stdout:3/434: readlink d8/d48/d5b/d92/l78 0 2024-09-16T02:06:03.084 INFO:tasks.workunit.client.1.smithi165.stdout:4/974: unlink d4/dc/d18/d37/d53/d64/d8b/d71/lb0 0 2024-09-16T02:06:03.087 INFO:tasks.workunit.client.0.smithi110.stdout:4/443: rename d4/f10 to d4/f86 0 2024-09-16T02:06:03.088 INFO:tasks.workunit.client.0.smithi110.stdout:3/435: dwrite d8/d29/d45/f59 [0,4194304] 0 2024-09-16T02:06:03.089 INFO:tasks.workunit.client.0.smithi110.stdout:3/436: fsync d8/dc/f84 0 2024-09-16T02:06:03.092 INFO:tasks.workunit.client.0.smithi110.stdout:3/437: fsync d8/dc/d1b/d36/f40 0 2024-09-16T02:06:03.093 INFO:tasks.workunit.client.1.smithi165.stdout:0/930: dwrite d0/d47/f59 [0,4194304] 0 2024-09-16T02:06:03.095 INFO:tasks.workunit.client.0.smithi110.stdout:4/444: dwrite d4/d8/d31/d80/d3b/f7c [0,4194304] 0 2024-09-16T02:06:03.098 INFO:tasks.workunit.client.0.smithi110.stdout:4/445: write d4/d8/d17/d23/d4c/d6d/d3c/f81 [355272,128811] 0 2024-09-16T02:06:03.107 INFO:tasks.workunit.client.0.smithi110.stdout:4/446: dwrite d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [0,4194304] 0 2024-09-16T02:06:03.114 INFO:tasks.workunit.client.0.smithi110.stdout:6/589: dread d0/d2/d5/d84/d16/f3b [0,4194304] 0 2024-09-16T02:06:03.115 INFO:tasks.workunit.client.0.smithi110.stdout:3/438: dread d8/dc/d1b/d3a/d43/f4e [4194304,4194304] 0 2024-09-16T02:06:03.120 INFO:tasks.workunit.client.0.smithi110.stdout:3/439: symlink d8/dc/d1b/d3a/l99 0 2024-09-16T02:06:03.121 INFO:tasks.workunit.client.0.smithi110.stdout:3/440: write d8/f22 [128647,93964] 0 2024-09-16T02:06:03.122 INFO:tasks.workunit.client.0.smithi110.stdout:6/590: fsync d0/d2/d18/f46 0 2024-09-16T02:06:03.125 INFO:tasks.workunit.client.1.smithi165.stdout:0/931: dwrite d0/d1e/d39/d48/d45/f37 [0,4194304] 0 2024-09-16T02:06:03.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/441: dwrite d8/d29/f42 [0,4194304] 0 2024-09-16T02:06:03.132 INFO:tasks.workunit.client.1.smithi165.stdout:0/932: dwrite d0/d47/f65 [8388608,4194304] 0 2024-09-16T02:06:03.133 INFO:tasks.workunit.client.0.smithi110.stdout:3/442: dread d8/dc/d1b/d3a/f50 [0,4194304] 0 2024-09-16T02:06:03.134 INFO:tasks.workunit.client.0.smithi110.stdout:3/443: chown d8/dc/d1b/d36/d57/l98 0 1 2024-09-16T02:06:03.137 INFO:tasks.workunit.client.0.smithi110.stdout:6/591: truncate d0/d2/f25 4597927 0 2024-09-16T02:06:03.138 INFO:tasks.workunit.client.0.smithi110.stdout:6/592: chown d0/d2/d18/f59 649855 1 2024-09-16T02:06:03.141 INFO:tasks.workunit.client.0.smithi110.stdout:6/593: write d0/d29/d2a/d2f/f58 [8362145,82538] 0 2024-09-16T02:06:03.152 INFO:tasks.workunit.client.0.smithi110.stdout:4/447: dread d4/d8/f67 [0,4194304] 0 2024-09-16T02:06:03.152 INFO:tasks.workunit.client.0.smithi110.stdout:6/594: unlink d0/d2/d5/d1e/l30 0 2024-09-16T02:06:03.156 INFO:tasks.workunit.client.1.smithi165.stdout:4/975: sync 2024-09-16T02:06:03.157 INFO:tasks.workunit.client.0.smithi110.stdout:4/448: creat d4/d8/d17/d23/d35/f87 x:0 0 0 2024-09-16T02:06:03.159 INFO:tasks.workunit.client.0.smithi110.stdout:1/465: sync 2024-09-16T02:06:03.160 INFO:tasks.workunit.client.0.smithi110.stdout:8/382: sync 2024-09-16T02:06:03.160 INFO:tasks.workunit.client.0.smithi110.stdout:0/470: sync 2024-09-16T02:06:03.160 INFO:tasks.workunit.client.0.smithi110.stdout:5/382: sync 2024-09-16T02:06:03.160 INFO:tasks.workunit.client.0.smithi110.stdout:7/376: sync 2024-09-16T02:06:03.160 INFO:tasks.workunit.client.0.smithi110.stdout:9/405: sync 2024-09-16T02:06:03.161 INFO:tasks.workunit.client.1.smithi165.stdout:4/976: dread d4/dc/d28/d3b/f10f [0,4194304] 0 2024-09-16T02:06:03.161 INFO:tasks.workunit.client.0.smithi110.stdout:1/466: chown d0/d1/d4/d46 0 1 2024-09-16T02:06:03.165 INFO:tasks.workunit.client.0.smithi110.stdout:9/406: write d1/dd/d6a/d6c/d6f/d79/f5c [697062,13996] 0 2024-09-16T02:06:03.166 INFO:tasks.workunit.client.0.smithi110.stdout:7/377: symlink d3/d15/d44/l6c 0 2024-09-16T02:06:03.167 INFO:tasks.workunit.client.0.smithi110.stdout:7/378: chown d3/d15/d44 68 1 2024-09-16T02:06:03.168 INFO:tasks.workunit.client.0.smithi110.stdout:6/595: dread d0/d2/f1c [0,4194304] 0 2024-09-16T02:06:03.170 INFO:tasks.workunit.client.0.smithi110.stdout:5/383: dread - d5/dd/df/d11/f58 zero size 2024-09-16T02:06:03.173 INFO:tasks.workunit.client.0.smithi110.stdout:3/444: dwrite d8/dc/d1b/d1c/f26 [0,4194304] 0 2024-09-16T02:06:03.176 INFO:tasks.workunit.client.0.smithi110.stdout:9/407: mknod d1/dd/d6a/d6c/d6f/d79/de/d1f/c88 0 2024-09-16T02:06:03.180 INFO:tasks.workunit.client.0.smithi110.stdout:0/471: unlink d3/d4/dc/d70/d8b/c8f 0 2024-09-16T02:06:03.182 INFO:tasks.workunit.client.0.smithi110.stdout:7/379: creat d3/d15/d38/d4f/d10/f6d x:0 0 0 2024-09-16T02:06:03.183 INFO:tasks.workunit.client.0.smithi110.stdout:4/449: write d4/d8/d17/d23/d4c/d6d/d3c/d3d/f47 [648281,38648] 0 2024-09-16T02:06:03.185 INFO:tasks.workunit.client.0.smithi110.stdout:6/596: dread - d0/d2/d57/d75/f90 zero size 2024-09-16T02:06:03.187 INFO:tasks.workunit.client.0.smithi110.stdout:4/450: write d4/d8/d17/d23/d4c/d6d/d4f/f58 [1329647,32644] 0 2024-09-16T02:06:03.187 INFO:tasks.workunit.client.0.smithi110.stdout:5/384: dread d5/f6 [0,4194304] 0 2024-09-16T02:06:03.189 INFO:tasks.workunit.client.0.smithi110.stdout:4/451: stat d4/d8/d31/d80/l68 0 2024-09-16T02:06:03.189 INFO:tasks.workunit.client.0.smithi110.stdout:5/385: fsync d5/dd/df/d11/f50 0 2024-09-16T02:06:03.190 INFO:tasks.workunit.client.1.smithi165.stdout:4/977: symlink d4/dc/d18/d111/l142 0 2024-09-16T02:06:03.191 INFO:tasks.workunit.client.0.smithi110.stdout:9/408: dread d1/f3 [4194304,4194304] 0 2024-09-16T02:06:03.192 INFO:tasks.workunit.client.0.smithi110.stdout:3/445: rename d8/dc/d1b/d3a/l99 to d8/dc/d1b/d36/l9a 0 2024-09-16T02:06:03.198 INFO:tasks.workunit.client.1.smithi165.stdout:0/933: creat d0/d2a/f129 x:0 0 0 2024-09-16T02:06:03.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:02 smithi165 ceph-mon[34621]: pgmap v25: 65 pgs: 65 active+clean; 2.4 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 91 MiB/s rd, 246 MiB/s wr, 479 op/s 2024-09-16T02:06:03.203 INFO:tasks.workunit.client.0.smithi110.stdout:8/383: truncate d3/d12/d1a/d36/d60/f64 4064545 0 2024-09-16T02:06:03.206 INFO:tasks.workunit.client.0.smithi110.stdout:9/409: rename d1/dd/d6a/d6c/d6f/d79/d26/d5b/c84 to d1/d5/d20/c89 0 2024-09-16T02:06:03.208 INFO:tasks.workunit.client.0.smithi110.stdout:0/472: write d3/d4/dc/d10/f35 [1112146,48818] 0 2024-09-16T02:06:03.208 INFO:tasks.workunit.client.0.smithi110.stdout:9/410: stat d1/dd/d6a/d6c/d6f/d79/f68 0 2024-09-16T02:06:03.209 INFO:tasks.workunit.client.0.smithi110.stdout:1/467: getdents d0/da/d7c 0 2024-09-16T02:06:03.211 INFO:tasks.workunit.client.0.smithi110.stdout:5/386: symlink d5/l7e 0 2024-09-16T02:06:03.211 INFO:tasks.workunit.client.1.smithi165.stdout:0/934: dread d0/d47/f65 [0,4194304] 0 2024-09-16T02:06:03.212 INFO:tasks.workunit.client.0.smithi110.stdout:8/384: mkdir d3/d12/d1a/d36/d60/d83 0 2024-09-16T02:06:03.213 INFO:tasks.workunit.client.0.smithi110.stdout:3/446: rename d8/d29/f2d to d8/dc/d1b/d3a/d43/d58/f9b 0 2024-09-16T02:06:03.214 INFO:tasks.workunit.client.1.smithi165.stdout:4/978: dwrite d4/dc/d28/fd2 [0,4194304] 0 2024-09-16T02:06:03.214 INFO:tasks.workunit.client.0.smithi110.stdout:3/447: chown d8/f1e 223136 1 2024-09-16T02:06:03.217 INFO:tasks.workunit.client.1.smithi165.stdout:0/935: dread d0/d1e/d39/d48/f8f [0,4194304] 0 2024-09-16T02:06:03.217 INFO:tasks.workunit.client.0.smithi110.stdout:4/452: write d4/d8/d17/d23/d4c/d6d/f64 [801382,61434] 0 2024-09-16T02:06:03.218 INFO:tasks.workunit.client.0.smithi110.stdout:6/597: creat d0/d2/d5/db8/fbf x:0 0 0 2024-09-16T02:06:03.218 INFO:tasks.workunit.client.0.smithi110.stdout:7/380: write d3/d15/d38/d4f/d10/f29 [2271520,80262] 0 2024-09-16T02:06:03.226 INFO:tasks.workunit.client.0.smithi110.stdout:0/473: mknod d3/d4/dc/c90 0 2024-09-16T02:06:03.227 INFO:tasks.workunit.client.0.smithi110.stdout:3/448: creat d8/dc/d1b/d36/f9c x:0 0 0 2024-09-16T02:06:03.228 INFO:tasks.workunit.client.0.smithi110.stdout:3/449: chown d8/dc/f84 46 1 2024-09-16T02:06:03.229 INFO:tasks.workunit.client.1.smithi165.stdout:0/936: creat d0/f12a x:0 0 0 2024-09-16T02:06:03.229 INFO:tasks.workunit.client.1.smithi165.stdout:4/979: write d4/d40/f79 [531545,34790] 0 2024-09-16T02:06:03.235 INFO:tasks.workunit.client.0.smithi110.stdout:0/474: mknod d3/d6/d43/d55/c91 0 2024-09-16T02:06:03.236 INFO:tasks.workunit.client.1.smithi165.stdout:4/980: truncate d4/dc/d18/f9b 3022378 0 2024-09-16T02:06:03.237 INFO:tasks.workunit.client.0.smithi110.stdout:3/450: unlink d8/dc/d1b/l8f 0 2024-09-16T02:06:03.238 INFO:tasks.workunit.client.0.smithi110.stdout:9/411: truncate d1/f4f 217131 0 2024-09-16T02:06:03.238 INFO:tasks.workunit.client.0.smithi110.stdout:5/387: dread d5/dd/df/d11/f32 [0,4194304] 0 2024-09-16T02:06:03.239 INFO:tasks.workunit.client.1.smithi165.stdout:0/937: write d0/d1e/d39/d48/d6e/fce [984787,97497] 0 2024-09-16T02:06:03.240 INFO:tasks.workunit.client.1.smithi165.stdout:4/981: mkdir d4/dc/d18/d143 0 2024-09-16T02:06:03.242 INFO:tasks.workunit.client.0.smithi110.stdout:4/453: dwrite d4/d8/d17/d23/f37 [4194304,4194304] 0 2024-09-16T02:06:03.243 INFO:tasks.workunit.client.1.smithi165.stdout:0/938: mkdir d0/d12b 0 2024-09-16T02:06:03.245 INFO:tasks.workunit.client.0.smithi110.stdout:5/388: rmdir d5/dd/df/d28 39 2024-09-16T02:06:03.246 INFO:tasks.workunit.client.0.smithi110.stdout:6/598: creat d0/d2/fc0 x:0 0 0 2024-09-16T02:06:03.247 INFO:tasks.workunit.client.0.smithi110.stdout:7/381: creat d3/d15/d38/d4f/f6e x:0 0 0 2024-09-16T02:06:03.247 INFO:tasks.workunit.client.0.smithi110.stdout:8/385: link d3/d12/c43 d3/d12/d1d/c84 0 2024-09-16T02:06:03.248 INFO:tasks.workunit.client.0.smithi110.stdout:7/382: chown d3/d15/d38/d4f/d10/d11/c20 1985642419 1 2024-09-16T02:06:03.256 INFO:tasks.workunit.client.0.smithi110.stdout:4/454: mknod d4/d8/d17/d23/d4c/d6d/d3c/d3d/c88 0 2024-09-16T02:06:03.257 INFO:tasks.workunit.client.0.smithi110.stdout:4/455: chown d4/d8/d31/d80/d18/f29 33612 1 2024-09-16T02:06:03.257 INFO:tasks.workunit.client.1.smithi165.stdout:0/939: getdents d0 0 2024-09-16T02:06:03.258 INFO:tasks.workunit.client.0.smithi110.stdout:3/451: mknod d8/c9d 0 2024-09-16T02:06:03.260 INFO:tasks.workunit.client.0.smithi110.stdout:0/475: dwrite d3/d6/f39 [0,4194304] 0 2024-09-16T02:06:03.260 INFO:tasks.workunit.client.0.smithi110.stdout:5/389: write d5/d36/d3d/f79 [1844130,72850] 0 2024-09-16T02:06:03.261 INFO:tasks.workunit.client.1.smithi165.stdout:0/940: mknod d0/d1e/d39/d48/d5f/d96/c12c 0 2024-09-16T02:06:03.265 INFO:tasks.workunit.client.0.smithi110.stdout:3/452: write d8/d48/f4f [1024015,35079] 0 2024-09-16T02:06:03.267 INFO:tasks.workunit.client.0.smithi110.stdout:4/456: mknod d4/d8/d17/d23/d4c/d6d/c89 0 2024-09-16T02:06:03.268 INFO:tasks.workunit.client.0.smithi110.stdout:6/599: write d0/d2/d5/d84/f41 [747894,84660] 0 2024-09-16T02:06:03.271 INFO:tasks.workunit.client.0.smithi110.stdout:9/412: link d1/dd/d6a/d6c/d6f/d79/de/d1f/l2f d1/d1b/l8a 0 2024-09-16T02:06:03.271 INFO:tasks.workunit.client.0.smithi110.stdout:6/600: write d0/d29/d2a/d2f/f99 [247543,126486] 0 2024-09-16T02:06:03.275 INFO:tasks.workunit.client.0.smithi110.stdout:7/383: link d3/d15/d38/d4f/d10/d2c/c33 d3/d15/d38/d4f/d10/c6f 0 2024-09-16T02:06:03.276 INFO:tasks.workunit.client.0.smithi110.stdout:6/601: mkdir d0/d29/dc1 0 2024-09-16T02:06:03.278 INFO:tasks.workunit.client.0.smithi110.stdout:4/457: creat d4/d8/d17/d23/d4c/d6d/d7f/f8a x:0 0 0 2024-09-16T02:06:03.279 INFO:tasks.workunit.client.0.smithi110.stdout:5/390: creat d5/f7f x:0 0 0 2024-09-16T02:06:03.280 INFO:tasks.workunit.client.0.smithi110.stdout:9/413: mknod d1/d2b/d2e/d38/c8b 0 2024-09-16T02:06:03.282 INFO:tasks.workunit.client.0.smithi110.stdout:3/453: dwrite d8/dc/d1b/d3a/f70 [0,4194304] 0 2024-09-16T02:06:03.282 INFO:tasks.workunit.client.0.smithi110.stdout:6/602: symlink d0/d29/d2a/lc2 0 2024-09-16T02:06:03.282 INFO:tasks.workunit.client.0.smithi110.stdout:8/386: dread d3/f44 [0,4194304] 0 2024-09-16T02:06:03.284 INFO:tasks.workunit.client.0.smithi110.stdout:9/414: stat d1/d2b/d2e/f4d 0 2024-09-16T02:06:03.286 INFO:tasks.workunit.client.1.smithi165.stdout:0/941: dwrite d0/d1e/d39/f6a [0,4194304] 0 2024-09-16T02:06:03.290 INFO:tasks.workunit.client.0.smithi110.stdout:5/391: mknod d5/dd/df/d28/d6f/c80 0 2024-09-16T02:06:03.291 INFO:tasks.workunit.client.0.smithi110.stdout:6/603: unlink d0/d2/d57/c7d 0 2024-09-16T02:06:03.292 INFO:tasks.workunit.client.0.smithi110.stdout:0/476: dwrite d3/d4/f4a [0,4194304] 0 2024-09-16T02:06:03.293 INFO:tasks.workunit.client.0.smithi110.stdout:5/392: chown d5/d36/d45/d47/f57 3095 1 2024-09-16T02:06:03.293 INFO:tasks.workunit.client.0.smithi110.stdout:3/454: symlink d8/d48/d7c/l9e 0 2024-09-16T02:06:03.294 INFO:tasks.workunit.client.0.smithi110.stdout:0/477: chown d3/d4/dc/d14 94974790 1 2024-09-16T02:06:03.295 INFO:tasks.workunit.client.0.smithi110.stdout:9/415: rename d1/d2b/d2e to d1/dd/d6a/d6c/d75/d8c 0 2024-09-16T02:06:03.299 INFO:tasks.workunit.client.0.smithi110.stdout:9/416: read d1/dd/d6a/d6c/d6f/d79/d26/f85 [442700,71432] 0 2024-09-16T02:06:03.301 INFO:tasks.workunit.client.0.smithi110.stdout:5/393: dwrite d5/d36/d3d/f79 [0,4194304] 0 2024-09-16T02:06:03.320 INFO:tasks.workunit.client.1.smithi165.stdout:4/982: sync 2024-09-16T02:06:03.349 INFO:tasks.workunit.client.1.smithi165.stdout:0/942: sync 2024-09-16T02:06:03.370 INFO:tasks.workunit.client.0.smithi110.stdout:2/433: sync 2024-09-16T02:06:03.426 INFO:tasks.workunit.client.1.smithi165.stdout:0/943: fsync d0/f13 0 2024-09-16T02:06:03.437 INFO:tasks.workunit.client.1.smithi165.stdout:0/944: creat d0/d1e/d39/d48/d5f/d82/f12d x:0 0 0 2024-09-16T02:06:03.438 INFO:tasks.workunit.client.1.smithi165.stdout:0/945: chown d0/d1e/d39/d48/d5f/d96/dac/cf9 15945 1 2024-09-16T02:06:03.438 INFO:tasks.workunit.client.0.smithi110.stdout:4/458: link d4/d8/d17/d23/d61/l6c d4/d8/d17/d23/d35/l8b 0 2024-09-16T02:06:03.445 INFO:tasks.workunit.client.1.smithi165.stdout:0/946: chown d0/d1e/d39/c116 471772 1 2024-09-16T02:06:03.446 INFO:tasks.workunit.client.0.smithi110.stdout:4/459: dwrite d4/d8/d31/d80/d18/f43 [4194304,4194304] 0 2024-09-16T02:06:03.446 INFO:tasks.workunit.client.1.smithi165.stdout:0/947: readlink d0/d1e/d20/d28/d6d/daf/lfe 0 2024-09-16T02:06:03.447 INFO:tasks.workunit.client.1.smithi165.stdout:0/948: rename d0/d1e to d0/d1e/d20/d28/d6d/d87/d12e 22 2024-09-16T02:06:03.450 INFO:tasks.workunit.client.1.smithi165.stdout:4/983: getdents d4/dc/d18/d37/d53/d64/d8b/d71 0 2024-09-16T02:06:03.451 INFO:tasks.workunit.client.1.smithi165.stdout:4/984: write d4/dc/d20/d45/f97 [1991713,87022] 0 2024-09-16T02:06:03.451 INFO:tasks.workunit.client.0.smithi110.stdout:2/434: creat d0/da/d18/d25/f8f x:0 0 0 2024-09-16T02:06:03.452 INFO:tasks.workunit.client.0.smithi110.stdout:2/435: stat d0/da/d18/d25/f8f 0 2024-09-16T02:06:03.453 INFO:tasks.workunit.client.1.smithi165.stdout:0/949: creat d0/d61/f12f x:0 0 0 2024-09-16T02:06:03.453 INFO:tasks.workunit.client.1.smithi165.stdout:4/985: chown d4/dc/d18/d37/d53/d64/d8b/d71/f7d 88877091 1 2024-09-16T02:06:03.455 INFO:tasks.workunit.client.1.smithi165.stdout:4/986: readlink d4/dc/d18/d37/d53/d64/d91/le4 0 2024-09-16T02:06:03.459 INFO:tasks.workunit.client.1.smithi165.stdout:0/950: dread d0/d1e/d20/d28/d9a/f111 [0,4194304] 0 2024-09-16T02:06:03.465 INFO:tasks.workunit.client.0.smithi110.stdout:9/417: symlink d1/dd/d6a/d6c/l8d 0 2024-09-16T02:06:03.468 INFO:tasks.workunit.client.1.smithi165.stdout:0/951: creat d0/d1e/d39/d48/d5f/d82/d91/f130 x:0 0 0 2024-09-16T02:06:03.468 INFO:tasks.workunit.client.0.smithi110.stdout:4/460: truncate d4/d8/d31/d80/f24 786761 0 2024-09-16T02:06:03.470 INFO:tasks.workunit.client.1.smithi165.stdout:4/987: unlink d4/dc/d28/d3b/d117/c12a 0 2024-09-16T02:06:03.472 INFO:tasks.workunit.client.1.smithi165.stdout:4/988: dread d4/dc/d18/d37/d53/d64/d8b/d71/de9/f11c [0,4194304] 0 2024-09-16T02:06:03.475 INFO:tasks.workunit.client.0.smithi110.stdout:9/418: dread d1/f4f [0,4194304] 0 2024-09-16T02:06:03.479 INFO:tasks.workunit.client.1.smithi165.stdout:4/989: truncate d4/d40/d4f/fda 692182 0 2024-09-16T02:06:03.482 INFO:tasks.workunit.client.0.smithi110.stdout:7/384: sync 2024-09-16T02:06:03.482 INFO:tasks.workunit.client.0.smithi110.stdout:1/468: sync 2024-09-16T02:06:03.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/469: dread - d0/d1/d2a/f7e zero size 2024-09-16T02:06:03.484 INFO:tasks.workunit.client.0.smithi110.stdout:7/385: write d3/d15/d38/d4f/d10/d11/f68 [1046001,109173] 0 2024-09-16T02:06:03.485 INFO:tasks.workunit.client.0.smithi110.stdout:7/386: fdatasync d3/f13 0 2024-09-16T02:06:03.490 INFO:tasks.workunit.client.0.smithi110.stdout:9/419: dread d1/d1b/f1d [0,4194304] 0 2024-09-16T02:06:03.491 INFO:tasks.workunit.client.1.smithi165.stdout:4/990: creat d4/dc/d28/d2b/f144 x:0 0 0 2024-09-16T02:06:03.492 INFO:tasks.workunit.client.1.smithi165.stdout:4/991: readlink d4/dc/d18/d37/d53/d64/d8b/df4/l12d 0 2024-09-16T02:06:03.493 INFO:tasks.workunit.client.1.smithi165.stdout:4/992: write d4/dc0/fc6 [1596060,44654] 0 2024-09-16T02:06:03.493 INFO:tasks.workunit.client.1.smithi165.stdout:4/993: readlink d4/d40/d4f/lba 0 2024-09-16T02:06:03.494 INFO:tasks.workunit.client.0.smithi110.stdout:9/420: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e 0 2024-09-16T02:06:03.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/994: dwrite d4/dc/d28/f4a [0,4194304] 0 2024-09-16T02:06:03.502 INFO:tasks.workunit.client.0.smithi110.stdout:2/436: mknod d0/db/d47/c90 0 2024-09-16T02:06:03.509 INFO:tasks.workunit.client.1.smithi165.stdout:4/995: dwrite d4/dc/d20/dc2/dd6/ff1 [0,4194304] 0 2024-09-16T02:06:03.509 INFO:tasks.workunit.client.0.smithi110.stdout:2/437: link d0/db/d47/d48/c80 d0/db/d33/d70/d39/d87/c91 0 2024-09-16T02:06:03.513 INFO:tasks.workunit.client.0.smithi110.stdout:7/387: dread d3/f26 [0,4194304] 0 2024-09-16T02:06:03.516 INFO:tasks.workunit.client.1.smithi165.stdout:4/996: creat d4/dc/d18/d37/d53/d64/d8b/d71/d135/f145 x:0 0 0 2024-09-16T02:06:03.517 INFO:tasks.workunit.client.1.smithi165.stdout:4/997: chown d4/dc/d18/d111/l142 405 1 2024-09-16T02:06:03.518 INFO:tasks.workunit.client.1.smithi165.stdout:4/998: dread - d4/dc/d20/dc2/fdb zero size 2024-09-16T02:06:03.520 INFO:tasks.workunit.client.1.smithi165.stdout:4/999: stat d4/dc/d28/fb5 0 2024-09-16T02:06:03.522 INFO:tasks.workunit.client.0.smithi110.stdout:7/388: dwrite d3/d15/d38/d4f/d10/d11/f28 [0,4194304] 0 2024-09-16T02:06:03.527 INFO:tasks.workunit.client.0.smithi110.stdout:7/389: creat d3/d15/d38/d4f/d10/d11/d3e/d40/f70 x:0 0 0 2024-09-16T02:06:03.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/421: dread d1/d5/f18 [4194304,4194304] 0 2024-09-16T02:06:03.530 INFO:tasks.workunit.client.0.smithi110.stdout:9/422: mknod d1/d5/d20/c8f 0 2024-09-16T02:06:03.537 INFO:tasks.workunit.client.0.smithi110.stdout:9/423: dwrite d1/dd/f10 [4194304,4194304] 0 2024-09-16T02:06:03.540 INFO:tasks.workunit.client.0.smithi110.stdout:9/424: read d1/dd/d6a/d6c/d6f/d79/f5c [570610,5488] 0 2024-09-16T02:06:03.541 INFO:tasks.workunit.client.0.smithi110.stdout:9/425: dread - d1/d5/d20/d55/f78 zero size 2024-09-16T02:06:03.545 INFO:tasks.workunit.client.0.smithi110.stdout:9/426: dread d1/dd/d6a/d6c/d6f/f7e [0,4194304] 0 2024-09-16T02:06:03.551 INFO:tasks.workunit.client.0.smithi110.stdout:9/427: dwrite f0 [0,4194304] 0 2024-09-16T02:06:03.555 INFO:tasks.workunit.client.0.smithi110.stdout:9/428: symlink d1/d5/d20/l90 0 2024-09-16T02:06:03.561 INFO:tasks.workunit.client.0.smithi110.stdout:9/429: getdents d1/dd/d6a/d6c/d6f/d79/d29 0 2024-09-16T02:06:03.562 INFO:tasks.workunit.client.0.smithi110.stdout:9/430: chown d1/d1b/l66 8472776 1 2024-09-16T02:06:03.566 INFO:tasks.workunit.client.0.smithi110.stdout:3/455: write d8/f2a [783805,5835] 0 2024-09-16T02:06:03.567 INFO:tasks.workunit.client.0.smithi110.stdout:6/604: write d0/d2/d5/f52 [1099058,34759] 0 2024-09-16T02:06:03.567 INFO:tasks.workunit.client.0.smithi110.stdout:3/456: write d8/d48/d5b/d92/f5a [727126,13322] 0 2024-09-16T02:06:03.573 INFO:tasks.workunit.client.1.smithi165.stdout:0/952: creat d0/d1e/f131 x:0 0 0 2024-09-16T02:06:03.575 INFO:tasks.workunit.client.1.smithi165.stdout:0/953: symlink d0/d47/l132 0 2024-09-16T02:06:03.579 INFO:tasks.workunit.client.0.smithi110.stdout:1/470: rmdir d0/d25 39 2024-09-16T02:06:03.580 INFO:tasks.workunit.client.0.smithi110.stdout:1/471: fsync d0/d1/d4/d46/d64/d79/f94 0 2024-09-16T02:06:03.586 INFO:tasks.workunit.client.0.smithi110.stdout:1/472: mkdir d0/d1/d2a/d9a 0 2024-09-16T02:06:03.587 INFO:tasks.workunit.client.1.smithi165.stdout:0/954: dread d0/d1e/d39/d48/d5f/d82/f8a [0,4194304] 0 2024-09-16T02:06:03.587 INFO:tasks.workunit.client.0.smithi110.stdout:4/461: write d4/f15 [3405290,47614] 0 2024-09-16T02:06:03.590 INFO:tasks.workunit.client.0.smithi110.stdout:4/462: symlink d4/d8/d31/d5d/l8c 0 2024-09-16T02:06:03.593 INFO:tasks.workunit.client.0.smithi110.stdout:1/473: dwrite d0/d1/d2a/f7e [0,4194304] 0 2024-09-16T02:06:03.593 INFO:tasks.workunit.client.0.smithi110.stdout:4/463: mknod d4/d8/c8d 0 2024-09-16T02:06:03.594 INFO:tasks.workunit.client.1.smithi165.stdout:0/955: dwrite d0/d1e/d39/d48/d45/fb9 [0,4194304] 0 2024-09-16T02:06:03.594 INFO:tasks.workunit.client.1.smithi165.stdout:0/956: fdatasync d0/d2a/ff4 0 2024-09-16T02:06:03.597 INFO:tasks.workunit.client.1.smithi165.stdout:0/957: creat d0/d61/f133 x:0 0 0 2024-09-16T02:06:03.598 INFO:tasks.workunit.client.1.smithi165.stdout:0/958: read - d0/d1e/d39/d99/f11b zero size 2024-09-16T02:06:03.599 INFO:tasks.workunit.client.1.smithi165.stdout:0/959: write d0/d2a/d70/f8b [1385949,40567] 0 2024-09-16T02:06:03.602 INFO:tasks.workunit.client.0.smithi110.stdout:1/474: dwrite d0/d1/f23 [0,4194304] 0 2024-09-16T02:06:03.603 INFO:tasks.workunit.client.0.smithi110.stdout:1/475: chown d0/d1/d4/d46/d64/d79/f94 29380 1 2024-09-16T02:06:03.607 INFO:tasks.workunit.client.0.smithi110.stdout:1/476: mkdir d0/d1/d4/d46/d7a/d9b 0 2024-09-16T02:06:03.609 INFO:tasks.workunit.client.0.smithi110.stdout:1/477: chown d0/d1/d2a/d32/d6e/f8a 0 1 2024-09-16T02:06:03.609 INFO:tasks.workunit.client.0.smithi110.stdout:0/478: mkdir d3/d92 0 2024-09-16T02:06:03.610 INFO:tasks.workunit.client.0.smithi110.stdout:1/478: write d0/da/d8d/f99 [932220,82176] 0 2024-09-16T02:06:03.610 INFO:tasks.workunit.client.0.smithi110.stdout:8/387: creat d3/f85 x:0 0 0 2024-09-16T02:06:03.613 INFO:tasks.workunit.client.0.smithi110.stdout:1/479: write d0/d25/d63/f89 [517607,110029] 0 2024-09-16T02:06:03.613 INFO:tasks.workunit.client.0.smithi110.stdout:0/479: mkdir d3/d4/d85/d93 0 2024-09-16T02:06:03.614 INFO:tasks.workunit.client.0.smithi110.stdout:8/388: mkdir d3/d2b/d27/d45/d86 0 2024-09-16T02:06:03.615 INFO:tasks.workunit.client.0.smithi110.stdout:0/480: fdatasync d3/d4/dc/f49 0 2024-09-16T02:06:03.617 INFO:tasks.workunit.client.0.smithi110.stdout:8/389: mkdir d3/d12/d1a/d36/d87 0 2024-09-16T02:06:03.618 INFO:tasks.workunit.client.0.smithi110.stdout:0/481: creat d3/d4/dc/d14/d76/f94 x:0 0 0 2024-09-16T02:06:03.628 INFO:tasks.workunit.client.0.smithi110.stdout:5/394: rename d5/dd/df/f1d to d5/d71/f81 0 2024-09-16T02:06:03.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/457: write f2 [1060996,29300] 0 2024-09-16T02:06:03.629 INFO:tasks.workunit.client.0.smithi110.stdout:5/395: fsync d5/f51 0 2024-09-16T02:06:03.631 INFO:tasks.workunit.client.0.smithi110.stdout:0/482: dread d3/d6/d43/d55/f7d [0,4194304] 0 2024-09-16T02:06:03.632 INFO:tasks.workunit.client.0.smithi110.stdout:2/438: rename d0/db/d33/d46 to d0/db/d33/d70/d39/d7b/d92 0 2024-09-16T02:06:03.633 INFO:tasks.workunit.client.0.smithi110.stdout:2/439: chown d0/da/l6b 9118334 1 2024-09-16T02:06:03.634 INFO:tasks.workunit.client.0.smithi110.stdout:0/483: symlink d3/d6/d4b/l95 0 2024-09-16T02:06:03.637 INFO:tasks.workunit.client.0.smithi110.stdout:2/440: dread - d0/db/d33/d70/d41/f4f zero size 2024-09-16T02:06:03.638 INFO:tasks.workunit.client.0.smithi110.stdout:9/431: rename d1/d2b/c72 to d1/dd/d6a/d6c/d75/d8c/d38/d3d/c91 0 2024-09-16T02:06:03.642 INFO:tasks.workunit.client.0.smithi110.stdout:9/432: write d1/d5/d20/d55/f78 [796373,30215] 0 2024-09-16T02:06:03.643 INFO:tasks.workunit.client.0.smithi110.stdout:4/464: rename d4/d8/d17/c5f to d4/d8/d31/d80/d3b/d55/c8e 0 2024-09-16T02:06:03.643 INFO:tasks.workunit.client.1.smithi165.stdout:0/960: write d0/d1e/d20/d28/f33 [2643465,37598] 0 2024-09-16T02:06:03.644 INFO:tasks.workunit.client.1.smithi165.stdout:0/961: chown d0/d1e/d20/d28/da7/db4/lc1 2 1 2024-09-16T02:06:03.645 INFO:tasks.workunit.client.0.smithi110.stdout:9/433: dread - d1/dd/d6a/d6c/d6f/d79/d26/f76 zero size 2024-09-16T02:06:03.646 INFO:tasks.workunit.client.0.smithi110.stdout:2/441: dwrite d0/da/f84 [0,4194304] 0 2024-09-16T02:06:03.647 INFO:tasks.workunit.client.0.smithi110.stdout:9/434: write d1/dd/f58 [934128,84384] 0 2024-09-16T02:06:03.648 INFO:tasks.workunit.client.1.smithi165.stdout:0/962: truncate d0/d1e/d20/f46 1340339 0 2024-09-16T02:06:03.648 INFO:tasks.workunit.client.0.smithi110.stdout:5/396: dread f0 [0,4194304] 0 2024-09-16T02:06:03.648 INFO:tasks.workunit.client.0.smithi110.stdout:2/442: chown d0/db/d33/f6d 382243 1 2024-09-16T02:06:03.651 INFO:tasks.workunit.client.0.smithi110.stdout:3/458: dread d8/dc/d1b/f24 [0,4194304] 0 2024-09-16T02:06:03.651 INFO:tasks.workunit.client.1.smithi165.stdout:0/963: read - d0/d1e/d39/d48/d74/dc6/fdd zero size 2024-09-16T02:06:03.651 INFO:tasks.workunit.client.0.smithi110.stdout:4/465: symlink d4/d8/d31/l8f 0 2024-09-16T02:06:03.655 INFO:tasks.workunit.client.0.smithi110.stdout:2/443: rename d0/da/c35 to d0/db/d33/d70/c93 0 2024-09-16T02:06:03.658 INFO:tasks.workunit.client.0.smithi110.stdout:9/435: creat d1/dd/d6a/d6c/d6f/d79/d26/f92 x:0 0 0 2024-09-16T02:06:03.659 INFO:tasks.workunit.client.0.smithi110.stdout:8/390: dwrite d3/d2b/f70 [0,4194304] 0 2024-09-16T02:06:03.659 INFO:tasks.workunit.client.0.smithi110.stdout:4/466: dread d4/d8/d17/d23/d4c/d6d/f64 [0,4194304] 0 2024-09-16T02:06:03.661 INFO:tasks.workunit.client.0.smithi110.stdout:4/467: chown d4/f21 5504547 1 2024-09-16T02:06:03.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/444: dwrite d0/da/d18/d25/d3b/f43 [0,4194304] 0 2024-09-16T02:06:03.666 INFO:tasks.workunit.client.0.smithi110.stdout:2/445: chown d0/da/d18/dc/f57 5822404 1 2024-09-16T02:06:03.710 INFO:tasks.workunit.client.0.smithi110.stdout:8/391: dread d3/d12/d1d/f1f [0,4194304] 0 2024-09-16T02:06:03.713 INFO:tasks.workunit.client.1.smithi165.stdout:0/964: link d0/f23 d0/d1e/d39/d48/d5f/d96/dac/f134 0 2024-09-16T02:06:03.717 INFO:tasks.workunit.client.1.smithi165.stdout:0/965: mknod d0/d1e/d39/d48/d5f/c135 0 2024-09-16T02:06:03.717 INFO:tasks.workunit.client.1.smithi165.stdout:0/966: chown d0/l17 11030 1 2024-09-16T02:06:03.717 INFO:tasks.workunit.client.0.smithi110.stdout:8/392: dwrite d3/d12/d1a/d36/f72 [0,4194304] 0 2024-09-16T02:06:03.814 INFO:tasks.workunit.client.1.smithi165.stdout:0/967: creat d0/d2a/d70/d10f/f136 x:0 0 0 2024-09-16T02:06:03.815 INFO:tasks.workunit.client.0.smithi110.stdout:3/459: creat d8/dc/d1b/f9f x:0 0 0 2024-09-16T02:06:03.817 INFO:tasks.workunit.client.0.smithi110.stdout:5/397: link d5/dd/l60 d5/d36/d45/d47/l82 0 2024-09-16T02:06:03.818 INFO:tasks.workunit.client.0.smithi110.stdout:5/398: dread - d5/dd/df/d28/f75 zero size 2024-09-16T02:06:03.819 INFO:tasks.workunit.client.0.smithi110.stdout:9/436: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93 0 2024-09-16T02:06:03.819 INFO:tasks.workunit.client.0.smithi110.stdout:4/468: dread d4/f2c [0,4194304] 0 2024-09-16T02:06:03.820 INFO:tasks.workunit.client.0.smithi110.stdout:2/446: symlink d0/db/d33/l94 0 2024-09-16T02:06:03.821 INFO:tasks.workunit.client.0.smithi110.stdout:3/460: creat d8/dc/d1b/d3a/d43/fa0 x:0 0 0 2024-09-16T02:06:03.824 INFO:tasks.workunit.client.0.smithi110.stdout:9/437: mkdir d1/dd/d6a/d6c/d6f/d79/de/d94 0 2024-09-16T02:06:03.825 INFO:tasks.workunit.client.0.smithi110.stdout:8/393: creat d3/d12/f88 x:0 0 0 2024-09-16T02:06:03.825 INFO:tasks.workunit.client.0.smithi110.stdout:9/438: fdatasync d1/dd/d6a/d6c/d75/d8c/f4d 0 2024-09-16T02:06:03.826 INFO:tasks.workunit.client.0.smithi110.stdout:3/461: symlink d8/d48/d5b/d6a/d75/d88/la1 0 2024-09-16T02:06:03.827 INFO:tasks.workunit.client.0.smithi110.stdout:9/439: chown d1/dd/d6a/d6c/d6f/d79/d29/c2c 243375 1 2024-09-16T02:06:03.827 INFO:tasks.workunit.client.0.smithi110.stdout:3/462: truncate d8/f22 1752297 0 2024-09-16T02:06:03.828 INFO:tasks.workunit.client.0.smithi110.stdout:5/399: fdatasync d5/dd/df/d11/f2f 0 2024-09-16T02:06:03.829 INFO:tasks.workunit.client.0.smithi110.stdout:3/463: chown d8/dc/d1b/f2c 2381937 1 2024-09-16T02:06:03.829 INFO:tasks.workunit.client.0.smithi110.stdout:4/469: mkdir d4/d8/d31/d80/d90 0 2024-09-16T02:06:03.832 INFO:tasks.workunit.client.1.smithi165.stdout:0/968: readlink d0/d1e/d39/d48/d5f/d96/dac/lae 0 2024-09-16T02:06:03.833 INFO:tasks.workunit.client.0.smithi110.stdout:5/400: mknod d5/d36/d45/d47/c83 0 2024-09-16T02:06:03.834 INFO:tasks.workunit.client.0.smithi110.stdout:8/394: symlink d3/d2b/d27/d45/d86/l89 0 2024-09-16T02:06:03.835 INFO:tasks.workunit.client.0.smithi110.stdout:9/440: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f76 [0,4194304] 0 2024-09-16T02:06:03.838 INFO:tasks.workunit.client.1.smithi165.stdout:0/969: dwrite d0/d1e/d39/d48/d45/fb9 [0,4194304] 0 2024-09-16T02:06:03.839 INFO:tasks.workunit.client.0.smithi110.stdout:4/470: mkdir d4/d8/d91 0 2024-09-16T02:06:03.840 INFO:tasks.workunit.client.1.smithi165.stdout:0/970: write d0/d1e/d39/d48/d45/db3/ffb [800644,43556] 0 2024-09-16T02:06:03.842 INFO:tasks.workunit.client.0.smithi110.stdout:9/441: dwrite d1/dd/f58 [0,4194304] 0 2024-09-16T02:06:03.844 INFO:tasks.workunit.client.0.smithi110.stdout:5/401: write d5/dd/df/d11/f2f [2051943,57010] 0 2024-09-16T02:06:03.847 INFO:tasks.workunit.client.1.smithi165.stdout:0/971: write d0/ff [2922806,89628] 0 2024-09-16T02:06:03.853 INFO:tasks.workunit.client.0.smithi110.stdout:5/402: dwrite d5/d36/f67 [0,4194304] 0 2024-09-16T02:06:03.853 INFO:tasks.workunit.client.0.smithi110.stdout:3/464: creat d8/dc/d1b/fa2 x:0 0 0 2024-09-16T02:06:03.854 INFO:tasks.workunit.client.0.smithi110.stdout:5/403: fdatasync d5/f51 0 2024-09-16T02:06:03.854 INFO:tasks.workunit.client.1.smithi165.stdout:0/972: truncate d0/d1e/d39/f4f 4403761 0 2024-09-16T02:06:03.855 INFO:tasks.workunit.client.1.smithi165.stdout:0/973: chown d0/d1e/cfd 3225482 1 2024-09-16T02:06:03.856 INFO:tasks.workunit.client.0.smithi110.stdout:8/395: rmdir d3/d2b/d27/d45/d68 0 2024-09-16T02:06:03.858 INFO:tasks.workunit.client.0.smithi110.stdout:4/471: rename d4/d8/d17/c48 to d4/c92 0 2024-09-16T02:06:03.859 INFO:tasks.workunit.client.0.smithi110.stdout:8/396: creat d3/d12/d1a/d36/f8a x:0 0 0 2024-09-16T02:06:03.860 INFO:tasks.workunit.client.0.smithi110.stdout:8/397: stat d3/d2b/f2e 0 2024-09-16T02:06:03.862 INFO:tasks.workunit.client.0.smithi110.stdout:5/404: rename d5/dd/df/d11/c72 to d5/dd/df/d28/c84 0 2024-09-16T02:06:03.862 INFO:tasks.workunit.client.1.smithi165.stdout:0/974: dwrite d0/d1e/d20/d28/f33 [0,4194304] 0 2024-09-16T02:06:03.863 INFO:tasks.workunit.client.0.smithi110.stdout:3/465: truncate d8/d48/d5b/d92/f8a 613556 0 2024-09-16T02:06:03.863 INFO:tasks.workunit.client.0.smithi110.stdout:5/405: truncate d5/f2c 1263088 0 2024-09-16T02:06:03.863 INFO:tasks.workunit.client.0.smithi110.stdout:9/442: getdents d1 0 2024-09-16T02:06:03.864 INFO:tasks.workunit.client.0.smithi110.stdout:5/406: truncate d5/f2c 1840993 0 2024-09-16T02:06:03.865 INFO:tasks.workunit.client.0.smithi110.stdout:4/472: unlink d4/c7 0 2024-09-16T02:06:03.866 INFO:tasks.workunit.client.0.smithi110.stdout:8/398: chown d3/d2b/f4a 70038 1 2024-09-16T02:06:03.867 INFO:tasks.workunit.client.0.smithi110.stdout:4/473: chown d4/d8/d17/d23/d4c/c7d 578611 1 2024-09-16T02:06:03.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/466: rename d8/dc/d1b/d36/d57/l98 to d8/dc/d1b/d36/la3 0 2024-09-16T02:06:03.870 INFO:tasks.workunit.client.0.smithi110.stdout:5/407: truncate d5/f13 1452293 0 2024-09-16T02:06:03.870 INFO:tasks.workunit.client.0.smithi110.stdout:9/443: truncate d1/d1b/d23/d7c/f81 849878 0 2024-09-16T02:06:03.876 INFO:tasks.workunit.client.1.smithi165.stdout:0/975: link d0/d1e/cfd d0/d1e/d39/d48/d5f/d82/c137 0 2024-09-16T02:06:03.877 INFO:tasks.workunit.client.0.smithi110.stdout:4/474: mkdir d4/d8/d31/d6f/d93 0 2024-09-16T02:06:03.877 INFO:tasks.workunit.client.0.smithi110.stdout:8/399: creat d3/d12/d1a/d36/f8b x:0 0 0 2024-09-16T02:06:03.877 INFO:tasks.workunit.client.0.smithi110.stdout:5/408: fsync f0 0 2024-09-16T02:06:03.878 INFO:tasks.workunit.client.0.smithi110.stdout:3/467: creat d8/dc/d1b/d1c/fa4 x:0 0 0 2024-09-16T02:06:03.879 INFO:tasks.workunit.client.1.smithi165.stdout:0/976: mknod d0/d1e/d20/d28/d6d/daf/dc0/c138 0 2024-09-16T02:06:03.880 INFO:tasks.workunit.client.1.smithi165.stdout:0/977: dread - d0/d1e/d20/d28/d6d/ff5 zero size 2024-09-16T02:06:03.880 INFO:tasks.workunit.client.0.smithi110.stdout:9/444: write d1/dd/d6a/d6c/d6f/d79/de/d1f/f48 [3311938,94332] 0 2024-09-16T02:06:03.884 INFO:tasks.workunit.client.1.smithi165.stdout:0/978: mknod d0/d1e/d20/d28/d6d/c139 0 2024-09-16T02:06:03.886 INFO:tasks.workunit.client.0.smithi110.stdout:3/468: dwrite d8/d48/d5b/f63 [0,4194304] 0 2024-09-16T02:06:03.889 INFO:tasks.workunit.client.1.smithi165.stdout:0/979: dwrite d0/d1e/d39/d48/fe8 [0,4194304] 0 2024-09-16T02:06:03.892 INFO:tasks.workunit.client.0.smithi110.stdout:8/400: mknod d3/d12/d1a/d36/c8c 0 2024-09-16T02:06:03.893 INFO:tasks.workunit.client.0.smithi110.stdout:4/475: creat d4/d8/d31/d80/d18/f94 x:0 0 0 2024-09-16T02:06:03.893 INFO:tasks.workunit.client.0.smithi110.stdout:9/445: rmdir d1/d1b/d23/d7c 39 2024-09-16T02:06:03.896 INFO:tasks.workunit.client.0.smithi110.stdout:3/469: rename d8/dc/d1b/d3a/d43/d58 to d8/dc/d1b/d3a/d43/da5 0 2024-09-16T02:06:03.896 INFO:tasks.workunit.client.0.smithi110.stdout:5/409: fdatasync d5/f61 0 2024-09-16T02:06:03.898 INFO:tasks.workunit.client.1.smithi165.stdout:0/980: dwrite d0/f2e [0,4194304] 0 2024-09-16T02:06:03.898 INFO:tasks.workunit.client.0.smithi110.stdout:4/476: creat d4/d8/d17/d23/d4c/d6d/f95 x:0 0 0 2024-09-16T02:06:03.900 INFO:tasks.workunit.client.0.smithi110.stdout:8/401: mkdir d3/d2b/d27/d45/d66/d6b/d8d 0 2024-09-16T02:06:03.901 INFO:tasks.workunit.client.0.smithi110.stdout:5/410: mkdir d5/dd/df/d11/d6d/d85 0 2024-09-16T02:06:03.904 INFO:tasks.workunit.client.1.smithi165.stdout:0/981: creat d0/d1e/d39/d48/d5f/d96/f13a x:0 0 0 2024-09-16T02:06:03.907 INFO:tasks.workunit.client.0.smithi110.stdout:8/402: mknod d3/d2b/d27/d45/d66/d6b/c8e 0 2024-09-16T02:06:03.909 INFO:tasks.workunit.client.0.smithi110.stdout:5/411: mkdir d5/dd/df/d28/d6f/d86 0 2024-09-16T02:06:03.910 INFO:tasks.workunit.client.1.smithi165.stdout:0/982: mkdir d0/d1e/d39/d99/d13b 0 2024-09-16T02:06:03.912 INFO:tasks.workunit.client.0.smithi110.stdout:4/477: creat d4/d8/d31/d6f/d93/f96 x:0 0 0 2024-09-16T02:06:03.915 INFO:tasks.workunit.client.1.smithi165.stdout:0/983: unlink d0/d1e/d20/d28/c2d 0 2024-09-16T02:06:03.917 INFO:tasks.workunit.client.0.smithi110.stdout:5/412: creat d5/dd/df/d11/f87 x:0 0 0 2024-09-16T02:06:03.919 INFO:tasks.workunit.client.1.smithi165.stdout:0/984: dread d0/d2a/fda [0,4194304] 0 2024-09-16T02:06:03.924 INFO:tasks.workunit.client.0.smithi110.stdout:4/478: rename d4/d8/d17/d23/d4c/d6d/d3c/l7a to d4/d8/d31/d80/l97 0 2024-09-16T02:06:03.925 INFO:tasks.workunit.client.1.smithi165.stdout:0/985: read d0/d1e/d39/d48/d45/f4b [1645214,82645] 0 2024-09-16T02:06:03.928 INFO:tasks.workunit.client.1.smithi165.stdout:0/986: creat d0/d1e/d39/d48/d5f/ddf/f13c x:0 0 0 2024-09-16T02:06:03.929 INFO:tasks.workunit.client.1.smithi165.stdout:0/987: fsync d0/d2a/d70/f84 0 2024-09-16T02:06:03.930 INFO:tasks.workunit.client.1.smithi165.stdout:0/988: rmdir d0/d47 39 2024-09-16T02:06:03.935 INFO:tasks.workunit.client.0.smithi110.stdout:9/446: write d1/dd/d6a/d6c/d75/d8c/f3a [998869,106549] 0 2024-09-16T02:06:03.937 INFO:tasks.workunit.client.1.smithi165.stdout:0/989: rmdir d0/d1e/d39/d48/d5f/d96/da4/d128 0 2024-09-16T02:06:03.938 INFO:tasks.workunit.client.0.smithi110.stdout:5/413: dread d5/dd/f4c [0,4194304] 0 2024-09-16T02:06:03.939 INFO:tasks.workunit.client.0.smithi110.stdout:3/470: truncate d8/dc/d1b/f60 1753224 0 2024-09-16T02:06:03.940 INFO:tasks.workunit.client.1.smithi165.stdout:0/990: unlink d0/d1e/f93 0 2024-09-16T02:06:03.941 INFO:tasks.workunit.client.0.smithi110.stdout:5/414: creat d5/d36/d45/d47/f88 x:0 0 0 2024-09-16T02:06:03.943 INFO:tasks.workunit.client.0.smithi110.stdout:3/471: mknod d8/d48/d4b/ca6 0 2024-09-16T02:06:03.944 INFO:tasks.workunit.client.0.smithi110.stdout:3/472: chown d8/c14 446 1 2024-09-16T02:06:03.946 INFO:tasks.workunit.client.0.smithi110.stdout:3/473: truncate d8/f2a 1529554 0 2024-09-16T02:06:03.947 INFO:tasks.workunit.client.0.smithi110.stdout:3/474: chown d8/f1e 13 1 2024-09-16T02:06:03.952 INFO:tasks.workunit.client.0.smithi110.stdout:8/403: dwrite d3/d31/f49 [0,4194304] 0 2024-09-16T02:06:03.955 INFO:tasks.workunit.client.1.smithi165.stdout:0/991: dread d0/d2a/fca [0,4194304] 0 2024-09-16T02:06:03.957 INFO:tasks.workunit.client.0.smithi110.stdout:5/415: dread d5/d36/d45/f56 [0,4194304] 0 2024-09-16T02:06:03.959 INFO:tasks.workunit.client.1.smithi165.stdout:0/992: fsync d0/f13 0 2024-09-16T02:06:03.959 INFO:tasks.workunit.client.0.smithi110.stdout:9/447: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e [0,4194304] 0 2024-09-16T02:06:03.959 INFO:tasks.workunit.client.0.smithi110.stdout:3/475: dwrite d8/dc/d1b/d3a/d43/f4e [0,4194304] 0 2024-09-16T02:06:03.960 INFO:tasks.workunit.client.1.smithi165.stdout:0/993: dread - d0/d1e/d39/d48/d5f/ddf/f10b zero size 2024-09-16T02:06:03.961 INFO:tasks.workunit.client.1.smithi165.stdout:0/994: chown d0/d1e/d39 0 1 2024-09-16T02:06:03.965 INFO:tasks.workunit.client.1.smithi165.stdout:0/995: write d0/d1e/d39/d48/d5f/f10e [1029783,23797] 0 2024-09-16T02:06:03.968 INFO:tasks.workunit.client.0.smithi110.stdout:8/404: dread d3/d2b/d27/f2d [0,4194304] 0 2024-09-16T02:06:03.969 INFO:tasks.workunit.client.0.smithi110.stdout:5/416: truncate f0 3240138 0 2024-09-16T02:06:03.973 INFO:tasks.workunit.client.0.smithi110.stdout:5/417: stat d5/d36/d45/d47/c83 0 2024-09-16T02:06:03.973 INFO:tasks.workunit.client.0.smithi110.stdout:3/476: creat d8/d48/d5b/d6a/fa7 x:0 0 0 2024-09-16T02:06:03.973 INFO:tasks.workunit.client.0.smithi110.stdout:9/448: rename d1/d5/d20/d55/c7f to d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/c95 0 2024-09-16T02:06:03.973 INFO:tasks.workunit.client.0.smithi110.stdout:9/449: chown d1 12454 1 2024-09-16T02:06:03.975 INFO:tasks.workunit.client.0.smithi110.stdout:4/479: dread d4/d8/d17/d23/d35/f4b [0,4194304] 0 2024-09-16T02:06:03.977 INFO:tasks.workunit.client.1.smithi165.stdout:0/996: mknod d0/d47/c13d 0 2024-09-16T02:06:03.977 INFO:tasks.workunit.client.0.smithi110.stdout:4/480: chown d4/d8/d17/d23/d35/f87 962233 1 2024-09-16T02:06:03.978 INFO:tasks.workunit.client.1.smithi165.stdout:0/997: write d0/d2a/d70/f8b [8055379,103063] 0 2024-09-16T02:06:03.980 INFO:tasks.workunit.client.1.smithi165.stdout:0/998: unlink d0/d1e/d39/d48/d5f/d96/dac/lae 0 2024-09-16T02:06:03.984 INFO:tasks.workunit.client.0.smithi110.stdout:9/450: symlink d1/d5/d20/d83/l96 0 2024-09-16T02:06:03.985 INFO:tasks.workunit.client.1.smithi165.stdout:0/999: mkdir d0/d1e/d39/d48/d45/db3/d13e 0 2024-09-16T02:06:03.986 INFO:tasks.workunit.client.0.smithi110.stdout:5/418: write d5/dd/f4c [3101911,54630] 0 2024-09-16T02:06:03.986 INFO:tasks.workunit.client.0.smithi110.stdout:4/481: dread d4/d8/d31/d80/d3b/f7c [0,4194304] 0 2024-09-16T02:06:03.987 INFO:tasks.workunit.client.0.smithi110.stdout:8/405: rename d3/d12/d5e to d3/d12/d8f 0 2024-09-16T02:06:03.988 INFO:tasks.workunit.client.1.smithi165.stderr:+ rm -rf -- ./tmp.tw6tRZH6tb 2024-09-16T02:06:03.990 INFO:tasks.workunit.client.0.smithi110.stdout:5/419: mkdir d5/d71/d89 0 2024-09-16T02:06:03.991 INFO:tasks.workunit.client.0.smithi110.stdout:9/451: dwrite d1/d1b/f1d [0,4194304] 0 2024-09-16T02:06:03.992 INFO:tasks.workunit.client.0.smithi110.stdout:8/406: chown d3/d12/l6a 614983 1 2024-09-16T02:06:03.995 INFO:tasks.workunit.client.0.smithi110.stdout:3/477: getdents d8/dc/d1b/d36/d57 0 2024-09-16T02:06:03.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/420: rename d5/dd/df/d28/c2a to d5/dd/df/d11/c8a 0 2024-09-16T02:06:04.001 INFO:tasks.workunit.client.0.smithi110.stdout:3/478: mkdir d8/d48/d5b/d6a/d75/da8 0 2024-09-16T02:06:04.003 INFO:tasks.workunit.client.0.smithi110.stdout:8/407: rename d3/d12/d1a/d36/d60/f7c to d3/d12/d1a/d36/d87/f90 0 2024-09-16T02:06:04.007 INFO:tasks.workunit.client.0.smithi110.stdout:5/421: mknod d5/dd/df/c8b 0 2024-09-16T02:06:04.009 INFO:tasks.workunit.client.0.smithi110.stdout:8/408: unlink d3/d2b/d27/d45/f5b 0 2024-09-16T02:06:04.010 INFO:tasks.workunit.client.0.smithi110.stdout:5/422: chown d5/f59 94431 1 2024-09-16T02:06:04.010 INFO:tasks.workunit.client.0.smithi110.stdout:3/479: dwrite d8/d48/d5b/d92/f5a [0,4194304] 0 2024-09-16T02:06:04.014 INFO:tasks.workunit.client.0.smithi110.stdout:4/482: dwrite d4/d8/d17/d23/d4c/d6d/f62 [0,4194304] 0 2024-09-16T02:06:04.017 INFO:tasks.workunit.client.0.smithi110.stdout:9/452: dwrite d1/dd/d6a/d6c/d75/d8c/d38/d3d/f4e [0,4194304] 0 2024-09-16T02:06:04.021 INFO:tasks.workunit.client.0.smithi110.stdout:8/409: dwrite d3/d2b/f80 [0,4194304] 0 2024-09-16T02:06:04.023 INFO:tasks.workunit.client.0.smithi110.stdout:3/480: mkdir d8/d48/d7c/d87/da9 0 2024-09-16T02:06:04.025 INFO:tasks.workunit.client.0.smithi110.stdout:4/483: unlink d4/f2c 0 2024-09-16T02:06:04.025 INFO:tasks.workunit.client.0.smithi110.stdout:3/481: chown d8/d48/d5b/d92/l7b 658128 1 2024-09-16T02:06:04.028 INFO:tasks.workunit.client.0.smithi110.stdout:9/453: creat d1/dd/d6a/d6c/d6f/d79/d29/f97 x:0 0 0 2024-09-16T02:06:04.028 INFO:tasks.workunit.client.0.smithi110.stdout:5/423: link d5/dd/df/d28/f75 d5/f8c 0 2024-09-16T02:06:04.030 INFO:tasks.workunit.client.0.smithi110.stdout:4/484: mkdir d4/d8/d17/d6b/d98 0 2024-09-16T02:06:04.030 INFO:tasks.workunit.client.0.smithi110.stdout:3/482: mknod d8/d48/d5b/caa 0 2024-09-16T02:06:04.032 INFO:tasks.workunit.client.0.smithi110.stdout:8/410: dread d3/d12/d1a/d36/d60/d62/d5f/f69 [0,4194304] 0 2024-09-16T02:06:04.034 INFO:tasks.workunit.client.0.smithi110.stdout:5/424: truncate d5/f59 550039 0 2024-09-16T02:06:04.034 INFO:tasks.workunit.client.0.smithi110.stdout:8/411: dread d3/d2b/f4a [0,4194304] 0 2024-09-16T02:06:04.035 INFO:tasks.workunit.client.0.smithi110.stdout:3/483: mkdir d8/d29/d45/dab 0 2024-09-16T02:06:04.040 INFO:tasks.workunit.client.0.smithi110.stdout:9/454: truncate d1/dd/d6a/d6c/d6f/d79/de/f1c 105709 0 2024-09-16T02:06:04.042 INFO:tasks.workunit.client.0.smithi110.stdout:5/425: mknod d5/c8d 0 2024-09-16T02:06:04.043 INFO:tasks.workunit.client.0.smithi110.stdout:3/484: mkdir d8/d48/d5b/d6a/d75/d88/dac 0 2024-09-16T02:06:04.045 INFO:tasks.workunit.client.0.smithi110.stdout:8/412: dwrite d3/d12/d1a/d36/d60/d62/f73 [0,4194304] 0 2024-09-16T02:06:04.047 INFO:tasks.workunit.client.0.smithi110.stdout:8/413: stat d3/d2b/d27/f67 0 2024-09-16T02:06:04.048 INFO:tasks.workunit.client.0.smithi110.stdout:8/414: chown d3/d31/c32 3474 1 2024-09-16T02:06:04.050 INFO:tasks.workunit.client.0.smithi110.stdout:5/426: dwrite d5/dd/df/f3f [0,4194304] 0 2024-09-16T02:06:04.052 INFO:tasks.workunit.client.0.smithi110.stdout:5/427: write d5/dd/df/d11/f2f [1101575,77596] 0 2024-09-16T02:06:04.056 INFO:tasks.workunit.client.0.smithi110.stdout:3/485: creat d8/dc/d1b/d36/d83/fad x:0 0 0 2024-09-16T02:06:04.058 INFO:tasks.workunit.client.0.smithi110.stdout:3/486: write d8/d48/d5b/f63 [1783340,64601] 0 2024-09-16T02:06:04.059 INFO:tasks.workunit.client.0.smithi110.stdout:7/390: sync 2024-09-16T02:06:04.062 INFO:tasks.workunit.client.0.smithi110.stdout:5/428: mkdir d5/dd/df/d28/d6f/d8e 0 2024-09-16T02:06:04.065 INFO:tasks.workunit.client.0.smithi110.stdout:4/485: dread d4/fc [0,4194304] 0 2024-09-16T02:06:04.066 INFO:tasks.workunit.client.0.smithi110.stdout:7/391: write d3/d15/d38/d4f/d10/f35 [5075307,5633] 0 2024-09-16T02:06:04.066 INFO:tasks.workunit.client.0.smithi110.stdout:8/415: dwrite d3/d2b/f1e [0,4194304] 0 2024-09-16T02:06:04.068 INFO:tasks.workunit.client.0.smithi110.stdout:5/429: mkdir d5/d71/d8f 0 2024-09-16T02:06:04.068 INFO:tasks.workunit.client.0.smithi110.stdout:9/455: write d1/d2b/f2d [117743,83852] 0 2024-09-16T02:06:04.069 INFO:tasks.workunit.client.0.smithi110.stdout:5/430: chown d5/dd/df/d28 1821629 1 2024-09-16T02:06:04.071 INFO:tasks.workunit.client.0.smithi110.stdout:7/392: dread d3/d15/d38/d4f/f22 [0,4194304] 0 2024-09-16T02:06:04.080 INFO:tasks.workunit.client.0.smithi110.stdout:8/416: write d3/fe [4916801,48606] 0 2024-09-16T02:06:04.083 INFO:tasks.workunit.client.0.smithi110.stdout:7/393: creat d3/d15/d38/d4f/d2e/f71 x:0 0 0 2024-09-16T02:06:04.084 INFO:tasks.workunit.client.0.smithi110.stdout:5/431: mkdir d5/dd/d90 0 2024-09-16T02:06:04.084 INFO:tasks.workunit.client.0.smithi110.stdout:9/456: mknod d1/dd/d6a/d6c/d6f/d79/de/d94/c98 0 2024-09-16T02:06:04.084 INFO:tasks.workunit.client.0.smithi110.stdout:4/486: dwrite d4/d8/d31/d80/d18/f34 [0,4194304] 0 2024-09-16T02:06:04.088 INFO:tasks.workunit.client.0.smithi110.stdout:4/487: write d4/d8/d17/f26 [2812240,98719] 0 2024-09-16T02:06:04.093 INFO:tasks.workunit.client.0.smithi110.stdout:7/394: creat d3/d15/d38/d4f/d10/d2c/f72 x:0 0 0 2024-09-16T02:06:04.094 INFO:tasks.workunit.client.0.smithi110.stdout:7/395: write d3/d15/d38/d4f/fe [90980,112914] 0 2024-09-16T02:06:04.096 INFO:tasks.workunit.client.0.smithi110.stdout:8/417: unlink d3/d12/f2f 0 2024-09-16T02:06:04.108 INFO:tasks.workunit.client.0.smithi110.stdout:7/396: dwrite d3/d15/d38/d4f/d2e/f4c [0,4194304] 0 2024-09-16T02:06:04.108 INFO:tasks.workunit.client.0.smithi110.stdout:4/488: write d4/f21 [5130556,122525] 0 2024-09-16T02:06:04.112 INFO:tasks.workunit.client.0.smithi110.stdout:8/418: dwrite d3/d12/d1a/f5d [0,4194304] 0 2024-09-16T02:06:04.114 INFO:tasks.workunit.client.0.smithi110.stdout:5/432: dwrite d5/d71/f81 [0,4194304] 0 2024-09-16T02:06:04.117 INFO:tasks.workunit.client.0.smithi110.stdout:8/419: write d3/d12/d1d/f1f [176004,22351] 0 2024-09-16T02:06:04.118 INFO:tasks.workunit.client.0.smithi110.stdout:5/433: write d5/d71/f81 [1965911,68109] 0 2024-09-16T02:06:04.119 INFO:tasks.workunit.client.0.smithi110.stdout:9/457: dwrite d1/dd/f58 [4194304,4194304] 0 2024-09-16T02:06:04.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/434: write d5/dd/df/f3f [1930545,62588] 0 2024-09-16T02:06:04.122 INFO:tasks.workunit.client.0.smithi110.stdout:7/397: mkdir d3/d15/d38/d4f/d10/d11/d73 0 2024-09-16T02:06:04.129 INFO:tasks.workunit.client.0.smithi110.stdout:9/458: dwrite d1/fc [8388608,4194304] 0 2024-09-16T02:06:04.132 INFO:tasks.workunit.client.0.smithi110.stdout:5/435: dwrite d5/dd/df/d11/f2f [0,4194304] 0 2024-09-16T02:06:04.138 INFO:tasks.workunit.client.0.smithi110.stdout:9/459: mknod d1/dd/d6a/d6c/d75/c99 0 2024-09-16T02:06:04.140 INFO:tasks.workunit.client.0.smithi110.stdout:9/460: chown d1/dd/d6a/d6c/d75/d8c/d38/d3d/l61 32217083 1 2024-09-16T02:06:04.141 INFO:tasks.workunit.client.0.smithi110.stdout:9/461: chown d1/dd/d6a/d6c/d6f/d79/f5c 8 1 2024-09-16T02:06:04.143 INFO:tasks.workunit.client.0.smithi110.stdout:5/436: creat d5/dd/df/d11/f91 x:0 0 0 2024-09-16T02:06:04.145 INFO:tasks.workunit.client.0.smithi110.stdout:9/462: mknod d1/d5/d20/c9a 0 2024-09-16T02:06:04.149 INFO:tasks.workunit.client.0.smithi110.stdout:5/437: mkdir d5/dd/df/d92 0 2024-09-16T02:06:04.151 INFO:tasks.workunit.client.0.smithi110.stdout:9/463: mkdir d1/dd/d6a/d6c/d9b 0 2024-09-16T02:06:04.153 INFO:tasks.workunit.client.0.smithi110.stdout:4/489: write d4/d8/d17/d23/d4c/d6d/d4f/f75 [3432582,47100] 0 2024-09-16T02:06:04.153 INFO:tasks.workunit.client.0.smithi110.stdout:9/464: write d1/dd/d6a/d6c/d75/d8c/f3a [1353501,49777] 0 2024-09-16T02:06:04.156 INFO:tasks.workunit.client.0.smithi110.stdout:7/398: truncate d3/f27 3448338 0 2024-09-16T02:06:04.160 INFO:tasks.workunit.client.0.smithi110.stdout:9/465: dwrite d1/d5/d20/f39 [0,4194304] 0 2024-09-16T02:06:04.162 INFO:tasks.workunit.client.0.smithi110.stdout:4/490: rename d4/d8/d31/d80/d18/f34 to d4/d8/d17/d23/d4c/d6d/f99 0 2024-09-16T02:06:04.164 INFO:tasks.workunit.client.0.smithi110.stdout:9/466: write d1/dd/d6a/d6c/d6f/d79/de/d1f/f4a [2974574,117673] 0 2024-09-16T02:06:04.164 INFO:tasks.workunit.client.0.smithi110.stdout:7/399: dwrite d3/d15/d38/d4f/fe [0,4194304] 0 2024-09-16T02:06:04.169 INFO:tasks.workunit.client.0.smithi110.stdout:4/491: unlink d4/d8/d31/d80/d3b/f77 0 2024-09-16T02:06:04.180 INFO:tasks.workunit.client.0.smithi110.stdout:4/492: link d4/d8/d17/d23/d4c/f5b d4/d8/d31/d80/d3b/d55/f9a 0 2024-09-16T02:06:04.181 INFO:tasks.workunit.client.0.smithi110.stdout:4/493: creat d4/d8/d17/d23/d35/f9b x:0 0 0 2024-09-16T02:06:04.188 INFO:tasks.workunit.client.0.smithi110.stdout:4/494: dwrite f3 [0,4194304] 0 2024-09-16T02:06:04.192 INFO:tasks.workunit.client.0.smithi110.stdout:4/495: dread d4/fc [0,4194304] 0 2024-09-16T02:06:04.194 INFO:tasks.workunit.client.0.smithi110.stdout:4/496: readlink d4/d8/d31/d80/d18/l50 0 2024-09-16T02:06:04.199 INFO:tasks.workunit.client.0.smithi110.stdout:9/467: dread d1/dd/d6a/d6c/d6f/d79/de/f56 [0,4194304] 0 2024-09-16T02:06:04.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:03 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:04.201 INFO:tasks.workunit.client.0.smithi110.stdout:4/497: dwrite d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [4194304,4194304] 0 2024-09-16T02:06:04.204 INFO:tasks.workunit.client.0.smithi110.stdout:6/605: sync 2024-09-16T02:06:04.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:03 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:04.209 INFO:tasks.workunit.client.0.smithi110.stdout:4/498: rmdir d4/d8/d17/d23/d4c/d6d/d3c/d3d 39 2024-09-16T02:06:04.210 INFO:tasks.workunit.client.0.smithi110.stdout:6/606: mkdir d0/d2/d5/d84/d62/dc3 0 2024-09-16T02:06:04.211 INFO:tasks.workunit.client.0.smithi110.stdout:5/438: write d5/dd/df/d11/f32 [3869949,89248] 0 2024-09-16T02:06:04.213 INFO:tasks.workunit.client.0.smithi110.stdout:9/468: dwrite d1/d5/f18 [4194304,4194304] 0 2024-09-16T02:06:04.219 INFO:tasks.workunit.client.0.smithi110.stdout:9/469: fdatasync d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e 0 2024-09-16T02:06:04.221 INFO:tasks.workunit.client.0.smithi110.stdout:5/439: dread d5/d36/f64 [0,4194304] 0 2024-09-16T02:06:04.222 INFO:tasks.workunit.client.0.smithi110.stdout:6/607: dwrite d0/d29/d2a/d2f/fa3 [0,4194304] 0 2024-09-16T02:06:04.224 INFO:tasks.workunit.client.0.smithi110.stdout:5/440: write d5/dd/f4c [224622,46268] 0 2024-09-16T02:06:04.224 INFO:tasks.workunit.client.0.smithi110.stdout:9/470: write d1/dd/d6a/d6c/d75/d8c/f4d [291615,96655] 0 2024-09-16T02:06:04.232 INFO:tasks.workunit.client.0.smithi110.stdout:9/471: fsync d1/f4f 0 2024-09-16T02:06:04.234 INFO:tasks.workunit.client.0.smithi110.stdout:6/608: dwrite d0/d2/d57/d75/f90 [0,4194304] 0 2024-09-16T02:06:04.235 INFO:tasks.workunit.client.0.smithi110.stdout:6/609: stat d0/d29/c91 0 2024-09-16T02:06:04.237 INFO:tasks.workunit.client.0.smithi110.stdout:5/441: dwrite d5/dd/f43 [0,4194304] 0 2024-09-16T02:06:04.238 INFO:tasks.workunit.client.0.smithi110.stdout:9/472: write d1/d1b/d23/f71 [3029858,42843] 0 2024-09-16T02:06:04.240 INFO:tasks.workunit.client.0.smithi110.stdout:9/473: stat d1/d2b/f2d 0 2024-09-16T02:06:04.243 INFO:tasks.workunit.client.0.smithi110.stdout:7/400: dwrite d3/d15/d38/d4f/d10/f39 [0,4194304] 0 2024-09-16T02:06:04.244 INFO:tasks.workunit.client.0.smithi110.stdout:9/474: write d1/dd/f58 [3108323,15190] 0 2024-09-16T02:06:04.245 INFO:tasks.workunit.client.0.smithi110.stdout:5/442: chown d5/dd/df/d28/d6f/c80 1 1 2024-09-16T02:06:04.247 INFO:tasks.workunit.client.0.smithi110.stdout:7/401: chown d3/d15/d38/d4f/d10/c52 884601 1 2024-09-16T02:06:04.249 INFO:tasks.workunit.client.0.smithi110.stdout:6/610: dread d0/d2/d18/f46 [0,4194304] 0 2024-09-16T02:06:04.251 INFO:tasks.workunit.client.0.smithi110.stdout:9/475: mknod d1/dd/d6a/c9c 0 2024-09-16T02:06:04.251 INFO:tasks.workunit.client.0.smithi110.stdout:5/443: creat d5/dd/df/d28/f93 x:0 0 0 2024-09-16T02:06:04.252 INFO:tasks.workunit.client.0.smithi110.stdout:9/476: write d1/f52 [114793,73754] 0 2024-09-16T02:06:04.253 INFO:tasks.workunit.client.0.smithi110.stdout:5/444: write d5/f7f [779591,128358] 0 2024-09-16T02:06:04.254 INFO:tasks.workunit.client.0.smithi110.stdout:7/402: fdatasync d3/d15/d38/d4f/d10/d11/f2b 0 2024-09-16T02:06:04.255 INFO:tasks.workunit.client.0.smithi110.stdout:5/445: write d5/f51 [2826192,93266] 0 2024-09-16T02:06:04.261 INFO:tasks.workunit.client.0.smithi110.stdout:7/403: symlink d3/d15/d38/l74 0 2024-09-16T02:06:04.263 INFO:tasks.workunit.client.0.smithi110.stdout:5/446: dwrite d5/dd/df/d28/f6b [0,4194304] 0 2024-09-16T02:06:04.263 INFO:tasks.workunit.client.0.smithi110.stdout:9/477: mknod d1/dd/d6a/d6c/d75/d86/c9d 0 2024-09-16T02:06:04.267 INFO:tasks.workunit.client.0.smithi110.stdout:9/478: chown d1/dd/d6a/d6c/d75/d8c/d38/d3d 28138 1 2024-09-16T02:06:04.273 INFO:tasks.workunit.client.0.smithi110.stdout:6/611: dread d0/d2/d5/d1e/f44 [0,4194304] 0 2024-09-16T02:06:04.275 INFO:tasks.workunit.client.0.smithi110.stdout:6/612: chown d0/d2/d57/da0 9 1 2024-09-16T02:06:04.276 INFO:tasks.workunit.client.0.smithi110.stdout:7/404: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/f60 [0,4194304] 0 2024-09-16T02:06:04.280 INFO:tasks.workunit.client.0.smithi110.stdout:6/613: rename d0/d2/d5/d84/cae to d0/d2/d5/d55/cc4 0 2024-09-16T02:06:04.284 INFO:tasks.workunit.client.0.smithi110.stdout:6/614: creat d0/d29/d2a/d2d/d98/fc5 x:0 0 0 2024-09-16T02:06:04.286 INFO:tasks.workunit.client.0.smithi110.stdout:6/615: mknod d0/d2/d57/da0/cc6 0 2024-09-16T02:06:04.289 INFO:tasks.workunit.client.0.smithi110.stdout:7/405: dread d3/d15/d38/d4f/d10/f30 [0,4194304] 0 2024-09-16T02:06:04.291 INFO:tasks.workunit.client.0.smithi110.stdout:6/616: rename d0/d29/d2a/d2f/fa3 to d0/fc7 0 2024-09-16T02:06:04.293 INFO:tasks.workunit.client.0.smithi110.stdout:6/617: rmdir d0/d29/d2a/d2d/d8b 39 2024-09-16T02:06:04.295 INFO:tasks.workunit.client.0.smithi110.stdout:6/618: unlink d0/d2/d5/d94/cad 0 2024-09-16T02:06:04.304 INFO:tasks.workunit.client.0.smithi110.stdout:5/447: write d5/dd/df/f38 [649313,48533] 0 2024-09-16T02:06:04.312 INFO:tasks.workunit.client.0.smithi110.stdout:6/619: dread d0/d2/d5/d84/d16/f13 [0,4194304] 0 2024-09-16T02:06:04.314 INFO:tasks.workunit.client.0.smithi110.stdout:5/448: write d5/d36/d3d/f4f [5153048,95650] 0 2024-09-16T02:06:04.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/620: dwrite d0/d2/d57/f95 [0,4194304] 0 2024-09-16T02:06:04.322 INFO:tasks.workunit.client.0.smithi110.stdout:6/621: fsync d0/d2/f3a 0 2024-09-16T02:06:04.325 INFO:tasks.workunit.client.0.smithi110.stdout:5/449: dwrite d5/dd/df/f35 [0,4194304] 0 2024-09-16T02:06:04.327 INFO:tasks.workunit.client.0.smithi110.stdout:6/622: symlink d0/lc8 0 2024-09-16T02:06:04.333 INFO:tasks.workunit.client.0.smithi110.stdout:6/623: read d0/d29/d2a/f2b [524114,89249] 0 2024-09-16T02:06:04.336 INFO:tasks.workunit.client.0.smithi110.stdout:6/624: write d0/d2/f42 [6865478,86529] 0 2024-09-16T02:06:04.337 INFO:tasks.workunit.client.0.smithi110.stdout:6/625: dread - d0/d2/d5/d84/d62/fa6 zero size 2024-09-16T02:06:04.340 INFO:tasks.workunit.client.0.smithi110.stdout:6/626: rename d0/d2/d18/d1d/fac to d0/d2/d5/d94/fc9 0 2024-09-16T02:06:04.342 INFO:tasks.workunit.client.0.smithi110.stdout:6/627: stat d0/d2/d5/d1e/f40 0 2024-09-16T02:06:04.344 INFO:tasks.workunit.client.0.smithi110.stdout:6/628: mknod d0/d29/d2a/cca 0 2024-09-16T02:06:04.345 INFO:tasks.workunit.client.0.smithi110.stdout:6/629: stat d0/d2/d5/d55/f8f 0 2024-09-16T02:06:04.347 INFO:tasks.workunit.client.0.smithi110.stdout:6/630: mknod d0/d2/d5/db8/d9c/ccb 0 2024-09-16T02:06:04.347 INFO:tasks.workunit.client.0.smithi110.stdout:6/631: stat d0/d2/f42 0 2024-09-16T02:06:04.348 INFO:tasks.workunit.client.0.smithi110.stdout:5/450: write d5/dd/f12 [3277481,29790] 0 2024-09-16T02:06:04.349 INFO:tasks.workunit.client.0.smithi110.stdout:6/632: mknod d0/d29/ccc 0 2024-09-16T02:06:04.355 INFO:tasks.workunit.client.0.smithi110.stdout:6/633: rmdir d0/d29/d2a/d2d/d8b 39 2024-09-16T02:06:04.359 INFO:tasks.workunit.client.0.smithi110.stdout:6/634: symlink d0/d2/d5/db8/lcd 0 2024-09-16T02:06:04.359 INFO:tasks.workunit.client.0.smithi110.stdout:6/635: readlink d0/d29/d2a/l77 0 2024-09-16T02:06:04.361 INFO:tasks.workunit.client.0.smithi110.stdout:6/636: truncate d0/d2/d18/d1d/fa4 571754 0 2024-09-16T02:06:04.361 INFO:tasks.workunit.client.0.smithi110.stdout:6/637: write d0/d2/d5/d1e/fb5 [384719,114537] 0 2024-09-16T02:06:04.369 INFO:tasks.workunit.client.0.smithi110.stdout:5/451: dwrite f0 [0,4194304] 0 2024-09-16T02:06:04.370 INFO:tasks.workunit.client.0.smithi110.stdout:6/638: link d0/d29/d2a/f2b d0/d29/d2a/d2d/fce 0 2024-09-16T02:06:04.371 INFO:tasks.workunit.client.0.smithi110.stdout:6/639: dread - d0/d2/d57/d7a/f9a zero size 2024-09-16T02:06:04.372 INFO:tasks.workunit.client.0.smithi110.stdout:6/640: write d0/d2/f42 [4846764,99935] 0 2024-09-16T02:06:04.372 INFO:tasks.workunit.client.0.smithi110.stdout:5/452: creat d5/d71/d89/f94 x:0 0 0 2024-09-16T02:06:04.376 INFO:tasks.workunit.client.0.smithi110.stdout:6/641: truncate d0/d29/d2a/d2d/d8b/faf 952098 0 2024-09-16T02:06:04.377 INFO:tasks.workunit.client.0.smithi110.stdout:5/453: dread d5/dd/df/f35 [0,4194304] 0 2024-09-16T02:06:04.382 INFO:tasks.workunit.client.0.smithi110.stdout:6/642: dwrite d0/d2/d5/d84/d16/f7b [0,4194304] 0 2024-09-16T02:06:04.385 INFO:tasks.workunit.client.0.smithi110.stdout:6/643: fdatasync d0/d2/d18/d1d/f3d 0 2024-09-16T02:06:04.388 INFO:tasks.workunit.client.0.smithi110.stdout:5/454: dread d5/f19 [0,4194304] 0 2024-09-16T02:06:04.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/455: rename d5/d36 to d5/d36/d45/d47/d95 22 2024-09-16T02:06:04.425 INFO:tasks.workunit.client.0.smithi110.stdout:1/480: sync 2024-09-16T02:06:04.441 INFO:tasks.workunit.client.0.smithi110.stdout:6/644: readlink d0/d2/d5/d1e/d48/l60 0 2024-09-16T02:06:04.528 INFO:tasks.workunit.client.0.smithi110.stdout:0/484: sync 2024-09-16T02:06:04.530 INFO:tasks.workunit.client.0.smithi110.stdout:0/485: read d3/d4/f4a [1422238,68731] 0 2024-09-16T02:06:04.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/456: mknod d5/dd/df/d11/c96 0 2024-09-16T02:06:04.534 INFO:tasks.workunit.client.0.smithi110.stdout:1/481: creat d0/d1/d4/d46/d51/f9c x:0 0 0 2024-09-16T02:06:04.534 INFO:tasks.workunit.client.0.smithi110.stdout:6/645: symlink d0/d2/d18/lcf 0 2024-09-16T02:06:04.538 INFO:tasks.workunit.client.0.smithi110.stdout:0/486: dwrite d3/d4/dc/d14/d76/f80 [0,4194304] 0 2024-09-16T02:06:04.542 INFO:tasks.workunit.client.0.smithi110.stdout:5/457: creat d5/dd/df/d28/d6f/d86/f97 x:0 0 0 2024-09-16T02:06:04.544 INFO:tasks.workunit.client.0.smithi110.stdout:1/482: rename d0/da/f85 to d0/da/d8d/f9d 0 2024-09-16T02:06:04.555 INFO:tasks.workunit.client.0.smithi110.stdout:6/646: rmdir d0/d2/d5/d84/d62/dc3 0 2024-09-16T02:06:04.561 INFO:tasks.workunit.client.0.smithi110.stdout:5/458: getdents d5/d71 0 2024-09-16T02:06:04.567 INFO:tasks.workunit.client.0.smithi110.stdout:0/487: write d3/d6/d43/f67 [4915303,56044] 0 2024-09-16T02:06:04.570 INFO:tasks.workunit.client.0.smithi110.stdout:5/459: dwrite d5/dd/df/d28/d6f/d86/f97 [0,4194304] 0 2024-09-16T02:06:04.571 INFO:tasks.workunit.client.0.smithi110.stdout:0/488: mknod d3/d4/d41/c96 0 2024-09-16T02:06:04.574 INFO:tasks.workunit.client.0.smithi110.stdout:5/460: rmdir d5/dd/df 39 2024-09-16T02:06:04.577 INFO:tasks.workunit.client.0.smithi110.stdout:0/489: creat d3/d4/dc/d14/d7e/d81/f97 x:0 0 0 2024-09-16T02:06:04.579 INFO:tasks.workunit.client.0.smithi110.stdout:5/461: chown d5/dd/df/c31 445088458 1 2024-09-16T02:06:04.580 INFO:tasks.workunit.client.0.smithi110.stdout:0/490: mkdir d3/d4/d85/d98 0 2024-09-16T02:06:04.586 INFO:tasks.workunit.client.0.smithi110.stdout:0/491: creat d3/d6/f99 x:0 0 0 2024-09-16T02:06:04.586 INFO:tasks.workunit.client.0.smithi110.stdout:1/483: dread d0/f14 [0,4194304] 0 2024-09-16T02:06:04.587 INFO:tasks.workunit.client.0.smithi110.stdout:6/647: dread d0/d2/d5/f4e [0,4194304] 0 2024-09-16T02:06:04.590 INFO:tasks.workunit.client.0.smithi110.stdout:1/484: unlink d0/d1/d4/d46/d75/f90 0 2024-09-16T02:06:04.591 INFO:tasks.workunit.client.0.smithi110.stdout:6/648: mkdir d0/d29/dd0 0 2024-09-16T02:06:04.593 INFO:tasks.workunit.client.0.smithi110.stdout:0/492: mkdir d3/d92/d9a 0 2024-09-16T02:06:04.594 INFO:tasks.workunit.client.0.smithi110.stdout:1/485: rmdir d0/d1/d4/d46 39 2024-09-16T02:06:04.597 INFO:tasks.workunit.client.0.smithi110.stdout:5/462: link d5/d36/d45/d47/l82 d5/dd/df/d28/d77/l98 0 2024-09-16T02:06:04.600 INFO:tasks.workunit.client.0.smithi110.stdout:0/493: dwrite d3/d4/dc/d14/d76/f80 [0,4194304] 0 2024-09-16T02:06:04.601 INFO:tasks.workunit.client.0.smithi110.stdout:1/486: chown d0/d1/d4/d46/d64/d79/l8e 24872890 1 2024-09-16T02:06:04.604 INFO:tasks.workunit.client.0.smithi110.stdout:1/487: write d0/d1/f68 [1950530,72450] 0 2024-09-16T02:06:04.605 INFO:tasks.workunit.client.0.smithi110.stdout:6/649: write d0/d2/d5/d84/f6d [1120682,115217] 0 2024-09-16T02:06:04.606 INFO:tasks.workunit.client.0.smithi110.stdout:6/650: stat d0/d2/d5/d94 0 2024-09-16T02:06:04.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/463: dwrite d5/dd/df/d11/d6d/f73 [0,4194304] 0 2024-09-16T02:06:04.608 INFO:tasks.workunit.client.0.smithi110.stdout:5/464: stat d5/dd/df/d11/c96 0 2024-09-16T02:06:04.609 INFO:tasks.workunit.client.0.smithi110.stdout:1/488: creat d0/da/d7c/f9e x:0 0 0 2024-09-16T02:06:04.611 INFO:tasks.workunit.client.0.smithi110.stdout:1/489: write d0/d1/d2a/d32/d6e/f8a [1276653,83647] 0 2024-09-16T02:06:04.615 INFO:tasks.workunit.client.0.smithi110.stdout:0/494: creat d3/d4/dc/d14/d7e/d81/d89/f9b x:0 0 0 2024-09-16T02:06:04.617 INFO:tasks.workunit.client.0.smithi110.stdout:0/495: read d3/d4/f11 [808732,47886] 0 2024-09-16T02:06:04.617 INFO:tasks.workunit.client.0.smithi110.stdout:6/651: mkdir d0/d2/d5/db8/dd1 0 2024-09-16T02:06:04.618 INFO:tasks.workunit.client.0.smithi110.stdout:5/465: fsync d5/f13 0 2024-09-16T02:06:04.619 INFO:tasks.workunit.client.0.smithi110.stdout:1/490: mkdir d0/d1/d2a/d32/d9f 0 2024-09-16T02:06:04.619 INFO:tasks.workunit.client.0.smithi110.stdout:2/447: sync 2024-09-16T02:06:04.626 INFO:tasks.workunit.client.0.smithi110.stdout:6/652: getdents d0/d2/d5/d84/d62 0 2024-09-16T02:06:04.627 INFO:tasks.workunit.client.0.smithi110.stdout:1/491: link d0/d25/d63/l45 d0/d91/la0 0 2024-09-16T02:06:04.629 INFO:tasks.workunit.client.0.smithi110.stdout:6/653: write d0/d2/d57/d7a/f9a [373652,87495] 0 2024-09-16T02:06:04.630 INFO:tasks.workunit.client.0.smithi110.stdout:2/448: dwrite d0/db/d33/d70/d39/d7b/d92/f7a [0,4194304] 0 2024-09-16T02:06:04.632 INFO:tasks.workunit.client.0.smithi110.stdout:2/449: readlink d0/db/d47/d48/l55 0 2024-09-16T02:06:04.632 INFO:tasks.workunit.client.0.smithi110.stdout:2/450: dread - d0/db/d33/f6d zero size 2024-09-16T02:06:04.636 INFO:tasks.workunit.client.0.smithi110.stdout:6/654: fdatasync d0/f10 0 2024-09-16T02:06:04.637 INFO:tasks.workunit.client.0.smithi110.stdout:6/655: dread - d0/d2/fc0 zero size 2024-09-16T02:06:04.647 INFO:tasks.workunit.client.0.smithi110.stdout:0/496: dwrite d3/d6/d43/d55/f6f [0,4194304] 0 2024-09-16T02:06:04.648 INFO:tasks.workunit.client.0.smithi110.stdout:0/497: dread - d3/f82 zero size 2024-09-16T02:06:04.649 INFO:tasks.workunit.client.0.smithi110.stdout:0/498: chown d3/d6/d43/d55/c91 6492253 1 2024-09-16T02:06:04.651 INFO:tasks.workunit.client.0.smithi110.stdout:0/499: write d3/d4/dc/d14/d7e/d81/f97 [576581,38352] 0 2024-09-16T02:06:04.652 INFO:tasks.workunit.client.0.smithi110.stdout:2/451: dread d0/db/d33/d70/d41/f4b [0,4194304] 0 2024-09-16T02:06:04.653 INFO:tasks.workunit.client.0.smithi110.stdout:0/500: rmdir d3/d6/d4b 39 2024-09-16T02:06:04.655 INFO:tasks.workunit.client.0.smithi110.stdout:0/501: chown d3/d4/dc/d14/d76/f94 11 1 2024-09-16T02:06:04.655 INFO:tasks.workunit.client.0.smithi110.stdout:2/452: creat d0/db/d47/d48/f95 x:0 0 0 2024-09-16T02:06:04.658 INFO:tasks.workunit.client.0.smithi110.stdout:2/453: creat d0/db/f96 x:0 0 0 2024-09-16T02:06:04.660 INFO:tasks.workunit.client.0.smithi110.stdout:2/454: rename d0/f49 to d0/d5f/f97 0 2024-09-16T02:06:04.661 INFO:tasks.workunit.client.0.smithi110.stdout:5/466: dread d5/dd/f12 [0,4194304] 0 2024-09-16T02:06:04.663 INFO:tasks.workunit.client.0.smithi110.stdout:2/455: getdents d0/da/d18 0 2024-09-16T02:06:04.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/456: creat d0/da/d18/f98 x:0 0 0 2024-09-16T02:06:04.667 INFO:tasks.workunit.client.0.smithi110.stdout:0/502: dread d3/f1a [0,4194304] 0 2024-09-16T02:06:04.667 INFO:tasks.workunit.client.0.smithi110.stdout:1/492: dread d0/d1/d4/f31 [0,4194304] 0 2024-09-16T02:06:04.668 INFO:tasks.workunit.client.0.smithi110.stdout:0/503: creat d3/d6/d43/d55/d59/f9c x:0 0 0 2024-09-16T02:06:04.747 INFO:tasks.workunit.client.0.smithi110.stdout:6/656: write d0/d2/d5/d84/d16/f33 [67492,14858] 0 2024-09-16T02:06:04.752 INFO:tasks.workunit.client.0.smithi110.stdout:6/657: mkdir d0/dd2 0 2024-09-16T02:06:04.755 INFO:tasks.workunit.client.0.smithi110.stdout:0/504: dwrite d3/d4/dc/f49 [0,4194304] 0 2024-09-16T02:06:04.756 INFO:tasks.workunit.client.0.smithi110.stdout:1/493: dwrite d0/d1/d4/d46/d51/f72 [0,4194304] 0 2024-09-16T02:06:04.761 INFO:tasks.workunit.client.0.smithi110.stdout:2/457: unlink d0/da/d18/d25/d3b/f43 0 2024-09-16T02:06:04.767 INFO:tasks.workunit.client.0.smithi110.stdout:2/458: chown d0/db/d47/d48/c80 49264 1 2024-09-16T02:06:04.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/505: creat d3/d4/f9d x:0 0 0 2024-09-16T02:06:04.771 INFO:tasks.workunit.client.0.smithi110.stdout:1/494: rename d0/da/l4d to d0/la1 0 2024-09-16T02:06:04.777 INFO:tasks.workunit.client.0.smithi110.stdout:2/459: creat d0/da/f99 x:0 0 0 2024-09-16T02:06:04.779 INFO:tasks.workunit.client.0.smithi110.stdout:1/495: dwrite d0/da/d7c/f9e [0,4194304] 0 2024-09-16T02:06:04.783 INFO:tasks.workunit.client.0.smithi110.stdout:2/460: symlink d0/db/d33/l9a 0 2024-09-16T02:06:04.784 INFO:tasks.workunit.client.0.smithi110.stdout:1/496: mkdir d0/d1/d2a/d9a/da2 0 2024-09-16T02:06:04.786 INFO:tasks.workunit.client.0.smithi110.stdout:2/461: creat d0/da/d18/dc/f9b x:0 0 0 2024-09-16T02:06:04.788 INFO:tasks.workunit.client.0.smithi110.stdout:2/462: fdatasync d0/db/d33/d70/f4a 0 2024-09-16T02:06:04.791 INFO:tasks.workunit.client.0.smithi110.stdout:2/463: symlink d0/da/d18/dc/l9c 0 2024-09-16T02:06:04.794 INFO:tasks.workunit.client.0.smithi110.stdout:2/464: write d0/db/d33/d70/d58/f82 [170147,60720] 0 2024-09-16T02:06:04.795 INFO:tasks.workunit.client.0.smithi110.stdout:2/465: chown d0/da/d18/d25/f8f 4 1 2024-09-16T02:06:04.795 INFO:tasks.workunit.client.0.smithi110.stdout:2/466: chown d0/db/d33/d70/f4a 12323124 1 2024-09-16T02:06:04.798 INFO:tasks.workunit.client.0.smithi110.stdout:1/497: dread d0/d1/f3f [0,4194304] 0 2024-09-16T02:06:04.800 INFO:tasks.workunit.client.0.smithi110.stdout:2/467: mkdir d0/da/d9d 0 2024-09-16T02:06:04.805 INFO:tasks.workunit.client.0.smithi110.stdout:6/658: dread d0/d29/f32 [0,4194304] 0 2024-09-16T02:06:04.807 INFO:tasks.workunit.client.0.smithi110.stdout:1/498: link d0/d1/d4/d46/d64/c76 d0/d1/d4/d46/ca3 0 2024-09-16T02:06:04.809 INFO:tasks.workunit.client.0.smithi110.stdout:3/487: sync 2024-09-16T02:06:04.811 INFO:tasks.workunit.client.0.smithi110.stdout:6/659: fsync d0/d2/d5/f4e 0 2024-09-16T02:06:04.812 INFO:tasks.workunit.client.0.smithi110.stdout:6/660: stat d0/d2/d5/db8/cb3 0 2024-09-16T02:06:04.813 INFO:tasks.workunit.client.0.smithi110.stdout:1/499: rename d0/d25/l69 to d0/d1/d4/d46/d75/la4 0 2024-09-16T02:06:04.813 INFO:tasks.workunit.client.0.smithi110.stdout:3/488: dread d8/dc/d1b/f35 [4194304,4194304] 0 2024-09-16T02:06:04.814 INFO:tasks.workunit.client.0.smithi110.stdout:1/500: write d0/d25/d63/f19 [2920702,71009] 0 2024-09-16T02:06:04.816 INFO:tasks.workunit.client.0.smithi110.stdout:0/506: write d3/d6/d4b/f4d [3903692,120779] 0 2024-09-16T02:06:04.824 INFO:tasks.workunit.client.0.smithi110.stdout:3/489: creat d8/d48/d5b/d6a/d75/d8b/fae x:0 0 0 2024-09-16T02:06:04.830 INFO:tasks.workunit.client.0.smithi110.stdout:3/490: symlink d8/d48/d5b/d6a/d75/d8b/laf 0 2024-09-16T02:06:04.832 INFO:tasks.workunit.client.0.smithi110.stdout:2/468: write d0/db/d33/d70/f76 [584002,70404] 0 2024-09-16T02:06:04.833 INFO:tasks.workunit.client.0.smithi110.stdout:0/507: dwrite d3/d4/dc/f3e [0,4194304] 0 2024-09-16T02:06:04.834 INFO:tasks.workunit.client.0.smithi110.stdout:3/491: write d8/d48/d5b/d6a/d75/d8b/f8d [340389,75133] 0 2024-09-16T02:06:04.835 INFO:tasks.workunit.client.0.smithi110.stdout:1/501: dread d0/d1/d4/d46/f5e [0,4194304] 0 2024-09-16T02:06:04.837 INFO:tasks.workunit.client.0.smithi110.stdout:2/469: stat d0/db/d33/d70/d39/d7b/d92/f67 0 2024-09-16T02:06:04.838 INFO:tasks.workunit.client.0.smithi110.stdout:2/470: readlink d0/db/d33/l94 0 2024-09-16T02:06:04.840 INFO:tasks.workunit.client.0.smithi110.stdout:2/471: fdatasync d0/db/d33/d70/f8a 0 2024-09-16T02:06:04.841 INFO:tasks.workunit.client.0.smithi110.stdout:0/508: rename d3/d4/d41/f48 to d3/f9e 0 2024-09-16T02:06:04.841 INFO:tasks.workunit.client.0.smithi110.stdout:2/472: stat d0/db/d47/f60 0 2024-09-16T02:06:04.842 INFO:tasks.workunit.client.0.smithi110.stdout:3/492: dwrite d8/f2a [0,4194304] 0 2024-09-16T02:06:04.847 INFO:tasks.workunit.client.0.smithi110.stdout:4/499: sync 2024-09-16T02:06:04.847 INFO:tasks.workunit.client.0.smithi110.stdout:8/420: sync 2024-09-16T02:06:04.847 INFO:tasks.workunit.client.0.smithi110.stdout:9/479: sync 2024-09-16T02:06:04.847 INFO:tasks.workunit.client.0.smithi110.stdout:0/509: rmdir d3/d4/dc/d10 39 2024-09-16T02:06:04.850 INFO:tasks.workunit.client.0.smithi110.stdout:3/493: readlink d8/d29/l8c 0 2024-09-16T02:06:04.852 INFO:tasks.workunit.client.0.smithi110.stdout:3/494: truncate d8/dc/d1b/f31 4968144 0 2024-09-16T02:06:04.853 INFO:tasks.workunit.client.0.smithi110.stdout:2/473: rename d0/db/d33/d70/d39/d7b/d92 to d0/da/d18/dc/d9e 0 2024-09-16T02:06:04.854 INFO:tasks.workunit.client.0.smithi110.stdout:6/661: dwrite d0/d2/d5/d84/f4b [0,4194304] 0 2024-09-16T02:06:04.856 INFO:tasks.workunit.client.0.smithi110.stdout:6/662: write d0/d2/d5/d84/f4b [4526103,51484] 0 2024-09-16T02:06:04.860 INFO:tasks.workunit.client.0.smithi110.stdout:0/510: creat d3/d6/d43/d55/d59/f9f x:0 0 0 2024-09-16T02:06:04.861 INFO:tasks.workunit.client.0.smithi110.stdout:0/511: write d3/f28 [1429663,98567] 0 2024-09-16T02:06:04.861 INFO:tasks.workunit.client.0.smithi110.stdout:9/480: symlink d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/l9e 0 2024-09-16T02:06:04.865 INFO:tasks.workunit.client.0.smithi110.stdout:4/500: rename d4/d8/d17/d23/d4c/d6d/c78 to d4/d8/d31/d73/c9c 0 2024-09-16T02:06:04.869 INFO:tasks.workunit.client.0.smithi110.stdout:2/474: read - d0/db/d33/d70/d39/f3f zero size 2024-09-16T02:06:04.870 INFO:tasks.workunit.client.0.smithi110.stdout:2/475: chown d0/db/d33/l94 17108 1 2024-09-16T02:06:04.872 INFO:tasks.workunit.client.0.smithi110.stdout:1/502: getdents d0/da/d8d 0 2024-09-16T02:06:04.872 INFO:tasks.workunit.client.0.smithi110.stdout:9/481: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e [0,4194304] 0 2024-09-16T02:06:04.873 INFO:tasks.workunit.client.0.smithi110.stdout:1/503: write d0/d1/d2a/d32/d6e/f8f [239580,99613] 0 2024-09-16T02:06:04.874 INFO:tasks.workunit.client.0.smithi110.stdout:8/421: truncate d3/f44 3681781 0 2024-09-16T02:06:04.883 INFO:tasks.workunit.client.0.smithi110.stdout:0/512: mknod d3/d4/d6d/ca0 0 2024-09-16T02:06:04.883 INFO:tasks.workunit.client.0.smithi110.stdout:3/495: creat d8/d48/d5b/d6a/d75/d88/dac/fb0 x:0 0 0 2024-09-16T02:06:04.884 INFO:tasks.workunit.client.0.smithi110.stdout:4/501: mknod d4/d8/d31/c9d 0 2024-09-16T02:06:04.886 INFO:tasks.workunit.client.0.smithi110.stdout:3/496: chown d8/dc/d1b/f24 5986 1 2024-09-16T02:06:04.887 INFO:tasks.workunit.client.0.smithi110.stdout:8/422: creat d3/d12/d1a/d36/d87/f91 x:0 0 0 2024-09-16T02:06:04.888 INFO:tasks.workunit.client.0.smithi110.stdout:4/502: write d4/d8/d31/d80/d18/f4d [1293819,21612] 0 2024-09-16T02:06:04.890 INFO:tasks.workunit.client.0.smithi110.stdout:6/663: dwrite d0/d2/f14 [4194304,4194304] 0 2024-09-16T02:06:04.892 INFO:tasks.workunit.client.0.smithi110.stdout:4/503: write d4/d8/d17/d23/f37 [6130292,102342] 0 2024-09-16T02:06:04.893 INFO:tasks.workunit.client.0.smithi110.stdout:9/482: dread d1/dd/d6a/d6c/d75/d8c/f41 [0,4194304] 0 2024-09-16T02:06:04.901 INFO:tasks.workunit.client.0.smithi110.stdout:8/423: dread d3/fe [0,4194304] 0 2024-09-16T02:06:04.905 INFO:tasks.workunit.client.0.smithi110.stdout:8/424: dread d3/d12/d1a/d36/d60/d62/d5f/f69 [0,4194304] 0 2024-09-16T02:06:04.907 INFO:tasks.workunit.client.0.smithi110.stdout:3/497: read d8/f5c [80359,99099] 0 2024-09-16T02:06:04.911 INFO:tasks.workunit.client.0.smithi110.stdout:4/504: read d4/d8/f5a [173127,51904] 0 2024-09-16T02:06:04.912 INFO:tasks.workunit.client.0.smithi110.stdout:9/483: unlink d1/dd/d6a/f77 0 2024-09-16T02:06:04.915 INFO:tasks.workunit.client.0.smithi110.stdout:8/425: symlink d3/d31/l92 0 2024-09-16T02:06:04.916 INFO:tasks.workunit.client.0.smithi110.stdout:0/513: dread d3/d4/dc/d10/f66 [0,4194304] 0 2024-09-16T02:06:04.917 INFO:tasks.workunit.client.0.smithi110.stdout:1/504: creat d0/d1/fa5 x:0 0 0 2024-09-16T02:06:04.921 INFO:tasks.workunit.client.0.smithi110.stdout:0/514: dwrite d3/d4/dc/d70/f72 [0,4194304] 0 2024-09-16T02:06:04.925 INFO:tasks.workunit.client.0.smithi110.stdout:9/484: symlink d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/l9f 0 2024-09-16T02:06:04.932 INFO:tasks.workunit.client.0.smithi110.stdout:9/485: dwrite d1/dd/d6a/f7a [0,4194304] 0 2024-09-16T02:06:04.934 INFO:tasks.workunit.client.0.smithi110.stdout:3/498: creat d8/dc/d1b/fb1 x:0 0 0 2024-09-16T02:06:04.934 INFO:tasks.workunit.client.0.smithi110.stdout:0/515: mkdir d3/d4/d85/d93/da1 0 2024-09-16T02:06:04.935 INFO:tasks.workunit.client.0.smithi110.stdout:0/516: chown d3/d6/d43/d55/d59 10539841 1 2024-09-16T02:06:04.936 INFO:tasks.workunit.client.0.smithi110.stdout:0/517: write d3/f17 [891732,117412] 0 2024-09-16T02:06:04.937 INFO:tasks.workunit.client.0.smithi110.stdout:0/518: chown d3/d4/f9d 416536448 1 2024-09-16T02:06:04.939 INFO:tasks.workunit.client.0.smithi110.stdout:4/505: creat d4/d8/d17/d23/f9e x:0 0 0 2024-09-16T02:06:04.942 INFO:tasks.workunit.client.0.smithi110.stdout:1/505: link d0/d25/d63/f19 d0/d1/d2a/d32/fa6 0 2024-09-16T02:06:04.943 INFO:tasks.workunit.client.0.smithi110.stdout:9/486: fsync d1/dd/d6a/d6c/d75/d8c/f41 0 2024-09-16T02:06:04.946 INFO:tasks.workunit.client.0.smithi110.stdout:1/506: dread d0/f14 [0,4194304] 0 2024-09-16T02:06:04.947 INFO:tasks.workunit.client.0.smithi110.stdout:0/519: rename d3/d4/d41/f8c to d3/d4/d85/fa2 0 2024-09-16T02:06:04.948 INFO:tasks.workunit.client.0.smithi110.stdout:0/520: truncate d3/d4/d85/fa2 605149 0 2024-09-16T02:06:04.950 INFO:tasks.workunit.client.0.smithi110.stdout:4/506: fdatasync d4/d8/f5a 0 2024-09-16T02:06:04.954 INFO:tasks.workunit.client.0.smithi110.stdout:6/664: dwrite d0/d29/d2a/d2f/f5f [0,4194304] 0 2024-09-16T02:06:04.955 INFO:tasks.workunit.client.0.smithi110.stdout:0/521: unlink d3/d4/dc/d10/f66 0 2024-09-16T02:06:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:04 smithi110 ceph-mon[27634]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 120 MiB/s rd, 311 MiB/s wr, 657 op/s 2024-09-16T02:06:04.957 INFO:tasks.workunit.client.0.smithi110.stdout:0/522: write d3/d6/f99 [15200,28248] 0 2024-09-16T02:06:04.958 INFO:tasks.workunit.client.0.smithi110.stdout:4/507: creat d4/d8/d17/d23/d4c/f9f x:0 0 0 2024-09-16T02:06:04.962 INFO:tasks.workunit.client.0.smithi110.stdout:6/665: dwrite d0/d29/d2a/d2d/d98/fc5 [0,4194304] 0 2024-09-16T02:06:04.965 INFO:tasks.workunit.client.0.smithi110.stdout:4/508: stat d4/d8/c1d 0 2024-09-16T02:06:04.965 INFO:tasks.workunit.client.0.smithi110.stdout:0/523: creat d3/d4/dc/d14/d7e/d81/fa3 x:0 0 0 2024-09-16T02:06:04.967 INFO:tasks.workunit.client.0.smithi110.stdout:1/507: creat d0/d1/d2a/fa7 x:0 0 0 2024-09-16T02:06:04.968 INFO:tasks.workunit.client.0.smithi110.stdout:4/509: chown d4/d8/d17/d23/d4c/d6d/d7f 14 1 2024-09-16T02:06:04.973 INFO:tasks.workunit.client.0.smithi110.stdout:6/666: dwrite d0/d2/d18/d1d/f3d [0,4194304] 0 2024-09-16T02:06:04.975 INFO:tasks.workunit.client.0.smithi110.stdout:4/510: mknod d4/d8/ca0 0 2024-09-16T02:06:04.976 INFO:tasks.workunit.client.0.smithi110.stdout:0/524: dwrite d3/d6/f3b [0,4194304] 0 2024-09-16T02:06:04.977 INFO:tasks.workunit.client.0.smithi110.stdout:0/525: readlink d3/l37 0 2024-09-16T02:06:04.979 INFO:tasks.workunit.client.0.smithi110.stdout:3/499: truncate d8/dc/d7f/f82 63255 0 2024-09-16T02:06:04.988 INFO:tasks.workunit.client.0.smithi110.stdout:0/526: dwrite d3/d6/f3b [0,4194304] 0 2024-09-16T02:06:04.989 INFO:tasks.workunit.client.0.smithi110.stdout:0/527: read d3/d6/d43/d55/f6f [1480715,74246] 0 2024-09-16T02:06:04.990 INFO:tasks.workunit.client.0.smithi110.stdout:0/528: chown d3/d4/dc/c73 289 1 2024-09-16T02:06:04.991 INFO:tasks.workunit.client.0.smithi110.stdout:0/529: truncate d3/d4/f9d 287077 0 2024-09-16T02:06:04.994 INFO:tasks.workunit.client.0.smithi110.stdout:3/500: rename d8/dc/d1b/f3e to d8/d48/d5b/d6a/fb2 0 2024-09-16T02:06:04.997 INFO:tasks.workunit.client.0.smithi110.stdout:4/511: dread d4/f86 [0,4194304] 0 2024-09-16T02:06:05.000 INFO:tasks.workunit.client.0.smithi110.stdout:0/530: creat d3/d6/d43/d55/fa4 x:0 0 0 2024-09-16T02:06:05.001 INFO:tasks.workunit.client.0.smithi110.stdout:3/501: rmdir d8/dc/d1b/d36 39 2024-09-16T02:06:05.003 INFO:tasks.workunit.client.0.smithi110.stdout:3/502: write d8/dc/d1b/d3a/d43/fa0 [739577,14119] 0 2024-09-16T02:06:05.004 INFO:tasks.workunit.client.0.smithi110.stdout:6/667: write d0/d2/f25 [1091161,58319] 0 2024-09-16T02:06:05.005 INFO:tasks.workunit.client.0.smithi110.stdout:1/508: dwrite d0/d1/d2a/f5d [0,4194304] 0 2024-09-16T02:06:05.006 INFO:tasks.workunit.client.0.smithi110.stdout:1/509: readlink d0/d1/d2a/l87 0 2024-09-16T02:06:05.008 INFO:tasks.workunit.client.0.smithi110.stdout:1/510: truncate d0/da/f81 1095912 0 2024-09-16T02:06:05.013 INFO:tasks.workunit.client.0.smithi110.stdout:3/503: creat d8/d48/d7c/d87/fb3 x:0 0 0 2024-09-16T02:06:05.018 INFO:tasks.workunit.client.0.smithi110.stdout:6/668: unlink d0/d2/d5/d84/d16/f61 0 2024-09-16T02:06:05.020 INFO:tasks.workunit.client.0.smithi110.stdout:1/511: mkdir d0/da/d7c/da8 0 2024-09-16T02:06:05.021 INFO:tasks.workunit.client.0.smithi110.stdout:0/531: mknod d3/d4/d85/d93/da1/ca5 0 2024-09-16T02:06:05.022 INFO:tasks.workunit.client.0.smithi110.stdout:0/532: stat d3/d4/dc/d10/f8e 0 2024-09-16T02:06:05.023 INFO:tasks.workunit.client.0.smithi110.stdout:4/512: link d4/d8/d17/d23/d35/f4b d4/d8/d17/fa1 0 2024-09-16T02:06:05.025 INFO:tasks.workunit.client.0.smithi110.stdout:6/669: dread d0/d2/d5/db8/f7e [0,4194304] 0 2024-09-16T02:06:05.028 INFO:tasks.workunit.client.0.smithi110.stdout:0/533: dwrite d3/d6/d4b/f4d [0,4194304] 0 2024-09-16T02:06:05.029 INFO:tasks.workunit.client.0.smithi110.stdout:0/534: write d3/d4/dc/d10/f3c [3247123,64237] 0 2024-09-16T02:06:05.032 INFO:tasks.workunit.client.0.smithi110.stdout:0/535: write d3/d4/dc/d75/f83 [1566238,47580] 0 2024-09-16T02:06:05.033 INFO:tasks.workunit.client.0.smithi110.stdout:0/536: write d3/d6/f3b [3425301,78738] 0 2024-09-16T02:06:05.034 INFO:tasks.workunit.client.0.smithi110.stdout:1/512: truncate d0/d1/d2a/d32/fa6 8303596 0 2024-09-16T02:06:05.042 INFO:tasks.workunit.client.0.smithi110.stdout:0/537: dwrite d3/d4/dc/f68 [0,4194304] 0 2024-09-16T02:06:05.043 INFO:tasks.workunit.client.0.smithi110.stdout:6/670: dread d0/d29/d2a/fb9 [4194304,4194304] 0 2024-09-16T02:06:05.044 INFO:tasks.workunit.client.0.smithi110.stdout:6/671: chown d0/d2/d57/da0 52335312 1 2024-09-16T02:06:05.045 INFO:tasks.workunit.client.0.smithi110.stdout:3/504: dread d8/dc/d7f/f82 [0,4194304] 0 2024-09-16T02:06:05.045 INFO:tasks.workunit.client.0.smithi110.stdout:1/513: read d0/da/f2c [1210492,63134] 0 2024-09-16T02:06:05.046 INFO:tasks.workunit.client.0.smithi110.stdout:0/538: creat d3/d6/d43/d55/d59/fa6 x:0 0 0 2024-09-16T02:06:05.048 INFO:tasks.workunit.client.0.smithi110.stdout:6/672: creat d0/d29/fd3 x:0 0 0 2024-09-16T02:06:05.051 INFO:tasks.workunit.client.0.smithi110.stdout:3/505: symlink d8/d29/d45/lb4 0 2024-09-16T02:06:05.053 INFO:tasks.workunit.client.0.smithi110.stdout:1/514: dread - d0/d1/d2a/d32/d6e/f88 zero size 2024-09-16T02:06:05.056 INFO:tasks.workunit.client.0.smithi110.stdout:0/539: dwrite d3/d6/d43/d55/d59/f5c [0,4194304] 0 2024-09-16T02:06:05.059 INFO:tasks.workunit.client.0.smithi110.stdout:4/513: dwrite d4/d8/d17/d23/d35/f4b [0,4194304] 0 2024-09-16T02:06:05.064 INFO:tasks.workunit.client.0.smithi110.stdout:1/515: creat d0/d91/fa9 x:0 0 0 2024-09-16T02:06:05.065 INFO:tasks.workunit.client.0.smithi110.stdout:0/540: truncate d3/d6/d43/d55/d59/fa6 802880 0 2024-09-16T02:06:05.067 INFO:tasks.workunit.client.0.smithi110.stdout:3/506: dwrite d8/dc/d1b/d3a/d43/f4e [4194304,4194304] 0 2024-09-16T02:06:05.068 INFO:tasks.workunit.client.0.smithi110.stdout:4/514: truncate d4/d8/d17/d23/d4c/d6d/f99 4297422 0 2024-09-16T02:06:05.068 INFO:tasks.workunit.client.0.smithi110.stdout:0/541: mkdir d3/d6/d43/da7 0 2024-09-16T02:06:05.070 INFO:tasks.workunit.client.0.smithi110.stdout:0/542: dread - d3/d6/d43/d55/fa4 zero size 2024-09-16T02:06:05.072 INFO:tasks.workunit.client.0.smithi110.stdout:3/507: mknod d8/dc/d7f/cb5 0 2024-09-16T02:06:05.073 INFO:tasks.workunit.client.0.smithi110.stdout:1/516: dwrite d0/d1/f68 [0,4194304] 0 2024-09-16T02:06:05.076 INFO:tasks.workunit.client.0.smithi110.stdout:4/515: creat d4/d8/d17/d23/d4c/d6d/d4f/fa2 x:0 0 0 2024-09-16T02:06:05.078 INFO:tasks.workunit.client.0.smithi110.stdout:4/516: chown d4/d8/d17/d6b 0 1 2024-09-16T02:06:05.078 INFO:tasks.workunit.client.0.smithi110.stdout:4/517: readlink d4/l9 0 2024-09-16T02:06:05.079 INFO:tasks.workunit.client.0.smithi110.stdout:1/517: unlink d0/d25/l2b 0 2024-09-16T02:06:05.080 INFO:tasks.workunit.client.0.smithi110.stdout:3/508: fdatasync d8/dc/d1b/d36/f9c 0 2024-09-16T02:06:05.083 INFO:tasks.workunit.client.0.smithi110.stdout:0/543: dwrite d3/d6/d43/d55/d59/fa6 [0,4194304] 0 2024-09-16T02:06:05.085 INFO:tasks.workunit.client.0.smithi110.stdout:3/509: rmdir d8/d48/d5b/d92 39 2024-09-16T02:06:05.090 INFO:tasks.workunit.client.0.smithi110.stdout:0/544: truncate d3/f9e 4042708 0 2024-09-16T02:06:05.091 INFO:tasks.workunit.client.0.smithi110.stdout:0/545: stat d3/d4/dc/d14/f19 0 2024-09-16T02:06:05.092 INFO:tasks.workunit.client.0.smithi110.stdout:1/518: rename d0/d1/d4/d46/d75/la4 to d0/d1/d4/laa 0 2024-09-16T02:06:05.093 INFO:tasks.workunit.client.0.smithi110.stdout:1/519: dread d0/d1/d4/f24 [0,4194304] 0 2024-09-16T02:06:05.094 INFO:tasks.workunit.client.0.smithi110.stdout:0/546: mknod d3/ca8 0 2024-09-16T02:06:05.095 INFO:tasks.workunit.client.0.smithi110.stdout:1/520: dread - d0/da/d8d/f9d zero size 2024-09-16T02:06:05.095 INFO:tasks.workunit.client.0.smithi110.stdout:5/467: sync 2024-09-16T02:06:05.095 INFO:tasks.workunit.client.0.smithi110.stdout:7/406: sync 2024-09-16T02:06:05.096 INFO:tasks.workunit.client.0.smithi110.stdout:5/468: chown d5/l24 2620 1 2024-09-16T02:06:05.098 INFO:tasks.workunit.client.0.smithi110.stdout:0/547: unlink d3/d6/d43/d55/c6b 0 2024-09-16T02:06:05.100 INFO:tasks.workunit.client.0.smithi110.stdout:1/521: chown d0/d1/d4/d46/d51/l96 6 1 2024-09-16T02:06:05.101 INFO:tasks.workunit.client.0.smithi110.stdout:5/469: dread d5/dd/f43 [0,4194304] 0 2024-09-16T02:06:05.103 INFO:tasks.workunit.client.0.smithi110.stdout:7/407: rename d3/d15/d38/d4f/d10/f35 to d3/d15/d38/d4f/d10/d11/f75 0 2024-09-16T02:06:05.105 INFO:tasks.workunit.client.0.smithi110.stdout:0/548: creat d3/d92/fa9 x:0 0 0 2024-09-16T02:06:05.109 INFO:tasks.workunit.client.0.smithi110.stdout:0/549: dread d3/d4/dc/d14/d7e/d81/f97 [0,4194304] 0 2024-09-16T02:06:05.110 INFO:tasks.workunit.client.0.smithi110.stdout:5/470: mknod d5/dd/df/d28/d6f/d86/c99 0 2024-09-16T02:06:05.111 INFO:tasks.workunit.client.0.smithi110.stdout:7/408: mkdir d3/d15/d38/d4f/d10/d76 0 2024-09-16T02:06:05.112 INFO:tasks.workunit.client.0.smithi110.stdout:1/522: mkdir d0/d1/dab 0 2024-09-16T02:06:05.113 INFO:tasks.workunit.client.0.smithi110.stdout:3/510: dwrite d8/f2a [4194304,4194304] 0 2024-09-16T02:06:05.113 INFO:tasks.workunit.client.0.smithi110.stdout:7/409: chown d3/d15/d3a/c63 65996 1 2024-09-16T02:06:05.117 INFO:tasks.workunit.client.0.smithi110.stdout:3/511: readlink d8/dc/d1b/d3a/l72 0 2024-09-16T02:06:05.124 INFO:tasks.workunit.client.0.smithi110.stdout:1/523: symlink d0/d1/d4/d46/d64/lac 0 2024-09-16T02:06:05.127 INFO:tasks.workunit.client.0.smithi110.stdout:7/410: symlink d3/d15/d38/d4f/d10/d2c/l77 0 2024-09-16T02:06:05.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/512: creat d8/d48/d5b/d6a/fb6 x:0 0 0 2024-09-16T02:06:05.133 INFO:tasks.workunit.client.0.smithi110.stdout:0/550: rename d3/d4/dc/c40 to d3/d4/dc/d14/d7e/d81/d86/caa 0 2024-09-16T02:06:05.138 INFO:tasks.workunit.client.0.smithi110.stdout:3/513: symlink d8/d48/d5b/d6a/d75/d88/lb7 0 2024-09-16T02:06:05.139 INFO:tasks.workunit.client.0.smithi110.stdout:7/411: dread d3/d15/d38/d4f/d10/d11/f3f [0,4194304] 0 2024-09-16T02:06:05.140 INFO:tasks.workunit.client.0.smithi110.stdout:5/471: dwrite d5/dd/f2b [0,4194304] 0 2024-09-16T02:06:05.141 INFO:tasks.workunit.client.0.smithi110.stdout:7/412: chown d3/d15/d38/d4f/d10 954892 1 2024-09-16T02:06:05.147 INFO:tasks.workunit.client.0.smithi110.stdout:3/514: symlink d8/d48/d5b/d6a/d75/d88/dac/lb8 0 2024-09-16T02:06:05.149 INFO:tasks.workunit.client.0.smithi110.stdout:5/472: creat d5/d36/d3d/f9a x:0 0 0 2024-09-16T02:06:05.153 INFO:tasks.workunit.client.0.smithi110.stdout:1/524: write d0/da/f17 [5302417,2363] 0 2024-09-16T02:06:05.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:04 smithi165 ceph-mon[34621]: pgmap v26: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 120 MiB/s rd, 311 MiB/s wr, 657 op/s 2024-09-16T02:06:05.209 INFO:tasks.workunit.client.0.smithi110.stdout:0/551: rename d3/f9e to d3/d6/d43/fab 0 2024-09-16T02:06:05.209 INFO:tasks.workunit.client.0.smithi110.stdout:7/413: rename d3/d15/d38/d4f/d10 to d3/d15/d38/d4f/d10/d11/d3e/d40/d78 22 2024-09-16T02:06:05.211 INFO:tasks.workunit.client.0.smithi110.stdout:1/525: mkdir d0/d1/dab/dad 0 2024-09-16T02:06:05.214 INFO:tasks.workunit.client.0.smithi110.stdout:3/515: creat d8/fb9 x:0 0 0 2024-09-16T02:06:05.283 INFO:tasks.workunit.client.0.smithi110.stdout:0/552: mknod d3/d92/d9a/cac 0 2024-09-16T02:06:05.283 INFO:tasks.workunit.client.0.smithi110.stdout:7/414: mknod d3/c79 0 2024-09-16T02:06:05.284 INFO:tasks.workunit.client.0.smithi110.stdout:5/473: dwrite d5/dd/df/d28/f75 [0,4194304] 0 2024-09-16T02:06:05.286 INFO:tasks.workunit.client.0.smithi110.stdout:7/415: dread - d3/d15/d38/d4f/f6e zero size 2024-09-16T02:06:05.287 INFO:tasks.workunit.client.0.smithi110.stdout:7/416: fdatasync d3/d15/d38/d4f/fd 0 2024-09-16T02:06:05.287 INFO:tasks.workunit.client.0.smithi110.stdout:7/417: chown f1 97 1 2024-09-16T02:06:05.288 INFO:tasks.workunit.client.0.smithi110.stdout:7/418: write d3/f8 [5840293,52720] 0 2024-09-16T02:06:05.288 INFO:tasks.workunit.client.0.smithi110.stdout:3/516: symlink d8/dc/d1b/d1c/lba 0 2024-09-16T02:06:05.290 INFO:tasks.workunit.client.0.smithi110.stdout:0/553: rmdir d3/d4/d85/d93 39 2024-09-16T02:06:05.291 INFO:tasks.workunit.client.0.smithi110.stdout:1/526: dread d0/d25/f42 [0,4194304] 0 2024-09-16T02:06:05.296 INFO:tasks.workunit.client.0.smithi110.stdout:7/419: mkdir d3/d7a 0 2024-09-16T02:06:05.297 INFO:tasks.workunit.client.0.smithi110.stdout:1/527: mknod d0/d1/d4/d46/d7a/cae 0 2024-09-16T02:06:05.299 INFO:tasks.workunit.client.0.smithi110.stdout:0/554: dwrite d3/f17 [4194304,4194304] 0 2024-09-16T02:06:05.299 INFO:tasks.workunit.client.0.smithi110.stdout:7/420: write d3/f19 [310720,89038] 0 2024-09-16T02:06:05.302 INFO:tasks.workunit.client.0.smithi110.stdout:1/528: symlink d0/d1/d2a/d9a/laf 0 2024-09-16T02:06:05.307 INFO:tasks.workunit.client.0.smithi110.stdout:1/529: creat d0/d1/d2a/d9a/da2/fb0 x:0 0 0 2024-09-16T02:06:05.308 INFO:tasks.workunit.client.0.smithi110.stdout:7/421: dwrite d3/f14 [0,4194304] 0 2024-09-16T02:06:05.310 INFO:tasks.workunit.client.0.smithi110.stdout:7/422: fsync d3/d15/d38/d4f/d10/d11/f28 0 2024-09-16T02:06:05.313 INFO:tasks.workunit.client.0.smithi110.stdout:1/530: mkdir d0/d1/db1 0 2024-09-16T02:06:05.318 INFO:tasks.workunit.client.0.smithi110.stdout:1/531: creat d0/d1/d4/d46/d7a/fb2 x:0 0 0 2024-09-16T02:06:05.320 INFO:tasks.workunit.client.0.smithi110.stdout:0/555: dwrite d3/d6/f21 [0,4194304] 0 2024-09-16T02:06:05.324 INFO:tasks.workunit.client.0.smithi110.stdout:1/532: symlink d0/d1/d2a/d32/d40/lb3 0 2024-09-16T02:06:05.325 INFO:tasks.workunit.client.0.smithi110.stdout:7/423: write d3/d15/d38/d4f/d10/d11/f2b [329522,74352] 0 2024-09-16T02:06:05.330 INFO:tasks.workunit.client.0.smithi110.stdout:7/424: mkdir d3/d15/d38/d4f/d10/d11/d73/d7b 0 2024-09-16T02:06:05.331 INFO:tasks.workunit.client.0.smithi110.stdout:7/425: write d3/f8 [407700,92332] 0 2024-09-16T02:06:05.331 INFO:tasks.workunit.client.0.smithi110.stdout:0/556: link d3/d4/d6d/c6e d3/d4/dc/cad 0 2024-09-16T02:06:05.334 INFO:tasks.workunit.client.0.smithi110.stdout:0/557: creat d3/d4/dc/d75/fae x:0 0 0 2024-09-16T02:06:05.336 INFO:tasks.workunit.client.0.smithi110.stdout:7/426: mknod d3/d15/d38/d4f/d10/d11/d73/d7b/c7c 0 2024-09-16T02:06:05.337 INFO:tasks.workunit.client.0.smithi110.stdout:0/558: truncate d3/d6/d4b/f51 1822449 0 2024-09-16T02:06:05.337 INFO:tasks.workunit.client.0.smithi110.stdout:0/559: stat d3/f28 0 2024-09-16T02:06:05.341 INFO:tasks.workunit.client.0.smithi110.stdout:7/427: dread d3/d15/d38/d4f/d10/f30 [0,4194304] 0 2024-09-16T02:06:05.341 INFO:tasks.workunit.client.0.smithi110.stdout:0/560: chown d3/d6/d43/c53 471 1 2024-09-16T02:06:05.344 INFO:tasks.workunit.client.0.smithi110.stdout:1/533: dread d0/d1/d2a/d32/f3a [0,4194304] 0 2024-09-16T02:06:05.344 INFO:tasks.workunit.client.0.smithi110.stdout:0/561: creat d3/d4/d6d/faf x:0 0 0 2024-09-16T02:06:05.345 INFO:tasks.workunit.client.0.smithi110.stdout:1/534: chown d0/d1/d4/d46/d51/c93 3767419 1 2024-09-16T02:06:05.347 INFO:tasks.workunit.client.0.smithi110.stdout:1/535: creat d0/da/d8d/fb4 x:0 0 0 2024-09-16T02:06:05.354 INFO:tasks.workunit.client.0.smithi110.stdout:1/536: link d0/d1/d2a/d32/f33 d0/da/d7c/fb5 0 2024-09-16T02:06:05.355 INFO:tasks.workunit.client.0.smithi110.stdout:1/537: fdatasync d0/d1/d4/f31 0 2024-09-16T02:06:05.359 INFO:tasks.workunit.client.0.smithi110.stdout:0/562: dread d3/d6/d4b/f4d [4194304,4194304] 0 2024-09-16T02:06:05.361 INFO:tasks.workunit.client.0.smithi110.stdout:0/563: creat d3/d4/dc/d14/d7e/d81/d89/fb0 x:0 0 0 2024-09-16T02:06:05.365 INFO:tasks.workunit.client.0.smithi110.stdout:0/564: symlink d3/d4/d85/d93/da1/lb1 0 2024-09-16T02:06:05.365 INFO:tasks.workunit.client.0.smithi110.stdout:0/565: fsync d3/d4/dc/d75/fae 0 2024-09-16T02:06:05.366 INFO:tasks.workunit.client.0.smithi110.stdout:0/566: chown d3/d6/d43/d55/d59/f5c 1243594213 1 2024-09-16T02:06:05.368 INFO:tasks.workunit.client.0.smithi110.stdout:0/567: unlink d3/d4/dc/d14/d76/f94 0 2024-09-16T02:06:05.370 INFO:tasks.workunit.client.0.smithi110.stdout:0/568: unlink d3/d4/d85/d93/da1/lb1 0 2024-09-16T02:06:05.375 INFO:tasks.workunit.client.0.smithi110.stdout:0/569: dwrite d3/d4/dc/d14/d7e/d81/fa3 [0,4194304] 0 2024-09-16T02:06:05.378 INFO:tasks.workunit.client.0.smithi110.stdout:0/570: mknod d3/d6/d4b/cb2 0 2024-09-16T02:06:05.379 INFO:tasks.workunit.client.0.smithi110.stdout:0/571: fdatasync d3/d6/d43/d55/f7d 0 2024-09-16T02:06:05.381 INFO:tasks.workunit.client.0.smithi110.stdout:0/572: truncate d3/d4/dc/d14/d7e/d81/d89/f9b 758487 0 2024-09-16T02:06:05.384 INFO:tasks.workunit.client.0.smithi110.stdout:0/573: unlink d3/d4/dc/d14/d76/f80 0 2024-09-16T02:06:05.398 INFO:tasks.workunit.client.0.smithi110.stdout:0/574: truncate d3/d6/d43/d55/f7d 4745361 0 2024-09-16T02:06:05.403 INFO:tasks.workunit.client.0.smithi110.stdout:0/575: rmdir d3/d6/d43/d55/d59 39 2024-09-16T02:06:05.408 INFO:tasks.workunit.client.0.smithi110.stdout:0/576: rmdir d3/d4/dc/d14/d7e 39 2024-09-16T02:06:05.423 INFO:tasks.workunit.client.0.smithi110.stdout:2/476: sync 2024-09-16T02:06:05.425 INFO:tasks.workunit.client.0.smithi110.stdout:2/477: mknod d0/da/d18/dc/d9e/c9f 0 2024-09-16T02:06:05.425 INFO:tasks.workunit.client.0.smithi110.stdout:2/478: stat d0/db/d33/d70/d58/f82 0 2024-09-16T02:06:05.429 INFO:tasks.workunit.client.0.smithi110.stdout:2/479: rmdir d0/da/d9d 0 2024-09-16T02:06:05.431 INFO:tasks.workunit.client.0.smithi110.stdout:2/480: mkdir d0/db/d47/d48/da0 0 2024-09-16T02:06:05.431 INFO:tasks.workunit.client.0.smithi110.stdout:2/481: write d0/db/d33/d70/f76 [4974933,24676] 0 2024-09-16T02:06:05.434 INFO:tasks.workunit.client.0.smithi110.stdout:2/482: mkdir d0/db/d47/da1 0 2024-09-16T02:06:05.435 INFO:tasks.workunit.client.0.smithi110.stdout:2/483: read d0/db/f83 [3061322,106623] 0 2024-09-16T02:06:05.436 INFO:tasks.workunit.client.0.smithi110.stdout:2/484: dread - d0/da/d18/dc/f7f zero size 2024-09-16T02:06:05.440 INFO:tasks.workunit.client.0.smithi110.stdout:2/485: creat d0/da/d18/fa2 x:0 0 0 2024-09-16T02:06:05.441 INFO:tasks.workunit.client.0.smithi110.stdout:2/486: fdatasync d0/da/d18/f98 0 2024-09-16T02:06:05.444 INFO:tasks.workunit.client.0.smithi110.stdout:2/487: symlink d0/db/d47/da1/la3 0 2024-09-16T02:06:05.447 INFO:tasks.workunit.client.0.smithi110.stdout:2/488: mknod d0/db/d33/ca4 0 2024-09-16T02:06:05.448 INFO:tasks.workunit.client.0.smithi110.stdout:2/489: read d0/db/d33/d70/d41/f4b [1137323,14014] 0 2024-09-16T02:06:05.452 INFO:tasks.workunit.client.0.smithi110.stdout:2/490: symlink d0/da/d18/dc/d9e/la5 0 2024-09-16T02:06:05.453 INFO:tasks.workunit.client.0.smithi110.stdout:2/491: fdatasync d0/da/d18/dc/f1c 0 2024-09-16T02:06:05.456 INFO:tasks.workunit.client.0.smithi110.stdout:2/492: truncate d0/da/d18/dc/f61 73474 0 2024-09-16T02:06:05.457 INFO:tasks.workunit.client.0.smithi110.stdout:2/493: fdatasync d0/db/d47/f8b 0 2024-09-16T02:06:05.460 INFO:tasks.workunit.client.0.smithi110.stdout:2/494: dread - d0/da/d18/d25/f8f zero size 2024-09-16T02:06:05.462 INFO:tasks.workunit.client.0.smithi110.stdout:2/495: creat d0/db/d33/d70/d58/fa6 x:0 0 0 2024-09-16T02:06:05.468 INFO:tasks.workunit.client.0.smithi110.stdout:2/496: link d0/db/d33/ca4 d0/da/d18/dc/ca7 0 2024-09-16T02:06:05.469 INFO:tasks.workunit.client.0.smithi110.stdout:2/497: chown d0/db/d33/d70/l65 15525 1 2024-09-16T02:06:05.472 INFO:tasks.workunit.client.0.smithi110.stdout:2/498: rename d0/db/c79 to d0/db/d47/d48/da0/ca8 0 2024-09-16T02:06:05.472 INFO:tasks.workunit.client.0.smithi110.stdout:2/499: chown d0/da/f24 5 1 2024-09-16T02:06:05.474 INFO:tasks.workunit.client.0.smithi110.stdout:2/500: mkdir d0/d5f/da9 0 2024-09-16T02:06:05.480 INFO:tasks.workunit.client.0.smithi110.stdout:2/501: dwrite d0/db/d33/d70/f8a [0,4194304] 0 2024-09-16T02:06:05.483 INFO:tasks.workunit.client.0.smithi110.stdout:2/502: truncate d0/da/f2c 1056327 0 2024-09-16T02:06:05.485 INFO:tasks.workunit.client.0.smithi110.stdout:2/503: mkdir d0/db/d47/d48/daa 0 2024-09-16T02:06:05.488 INFO:tasks.workunit.client.0.smithi110.stdout:2/504: creat d0/db/d33/d70/d58/fab x:0 0 0 2024-09-16T02:06:05.489 INFO:tasks.workunit.client.0.smithi110.stdout:2/505: write d0/da/d18/dc/f1c [4208604,105607] 0 2024-09-16T02:06:05.499 INFO:tasks.workunit.client.0.smithi110.stdout:2/506: rename d0/db/d33/d70 to d0/da/d18/dac 0 2024-09-16T02:06:05.500 INFO:tasks.workunit.client.0.smithi110.stdout:2/507: dread - d0/da/d18/dc/f7f zero size 2024-09-16T02:06:05.501 INFO:tasks.workunit.client.0.smithi110.stdout:2/508: fsync d0/da/f24 0 2024-09-16T02:06:05.501 INFO:tasks.workunit.client.0.smithi110.stdout:2/509: stat d0/d5f 0 2024-09-16T02:06:05.504 INFO:tasks.workunit.client.0.smithi110.stdout:2/510: getdents d0/da/d18/dac/d39 0 2024-09-16T02:06:05.517 INFO:tasks.workunit.client.0.smithi110.stdout:2/511: dread d0/db/d47/f50 [0,4194304] 0 2024-09-16T02:06:05.524 INFO:tasks.workunit.client.0.smithi110.stdout:2/512: write d0/da/d18/dac/f5a [3844769,30279] 0 2024-09-16T02:06:05.527 INFO:tasks.workunit.client.0.smithi110.stdout:2/513: fdatasync d0/da/d18/d25/d3b/f53 0 2024-09-16T02:06:05.530 INFO:tasks.workunit.client.0.smithi110.stdout:2/514: mkdir d0/db/d47/da1/dad 0 2024-09-16T02:06:05.530 INFO:tasks.workunit.client.0.smithi110.stdout:2/515: chown d0/da/f28 78404534 1 2024-09-16T02:06:05.532 INFO:tasks.workunit.client.0.smithi110.stdout:2/516: fdatasync d0/da/d18/dac/d39/f3f 0 2024-09-16T02:06:05.544 INFO:tasks.workunit.client.0.smithi110.stdout:2/517: dwrite d0/da/d18/dac/d41/f4b [0,4194304] 0 2024-09-16T02:06:05.550 INFO:tasks.workunit.client.0.smithi110.stdout:2/518: dwrite d0/db/d33/f6c [0,4194304] 0 2024-09-16T02:06:05.553 INFO:tasks.workunit.client.0.smithi110.stdout:2/519: creat d0/da/d18/dac/d41/fae x:0 0 0 2024-09-16T02:06:05.555 INFO:tasks.workunit.client.0.smithi110.stdout:2/520: mkdir d0/da/d18/d25/d3b/daf 0 2024-09-16T02:06:05.557 INFO:tasks.workunit.client.0.smithi110.stdout:2/521: write d0/da/d18/dc/f9b [26557,34865] 0 2024-09-16T02:06:05.560 INFO:tasks.workunit.client.0.smithi110.stdout:2/522: getdents d0/d5f/da9 0 2024-09-16T02:06:05.561 INFO:tasks.workunit.client.0.smithi110.stdout:2/523: rmdir d0/db/d47 39 2024-09-16T02:06:05.561 INFO:tasks.workunit.client.0.smithi110.stdout:2/524: chown d0/db/f27 1 1 2024-09-16T02:06:05.563 INFO:tasks.workunit.client.0.smithi110.stdout:2/525: creat d0/da/d18/dac/d41/fb0 x:0 0 0 2024-09-16T02:06:05.566 INFO:tasks.workunit.client.0.smithi110.stdout:2/526: mknod d0/db/d47/cb1 0 2024-09-16T02:06:05.587 INFO:tasks.workunit.client.0.smithi110.stdout:2/527: dread d0/db/d47/f60 [0,4194304] 0 2024-09-16T02:06:05.588 INFO:tasks.workunit.client.0.smithi110.stdout:2/528: rename d0 to d0/db/d47/d48/da0/db2 22 2024-09-16T02:06:05.589 INFO:tasks.workunit.client.0.smithi110.stdout:2/529: rmdir d0 39 2024-09-16T02:06:05.594 INFO:tasks.workunit.client.0.smithi110.stdout:2/530: mkdir d0/da/d18/dac/d41/db3 0 2024-09-16T02:06:05.598 INFO:tasks.workunit.client.0.smithi110.stdout:2/531: symlink d0/db/d47/lb4 0 2024-09-16T02:06:05.601 INFO:tasks.workunit.client.0.smithi110.stdout:2/532: read d0/da/f28 [2998590,39414] 0 2024-09-16T02:06:05.604 INFO:tasks.workunit.client.0.smithi110.stdout:2/533: mkdir d0/da/db5 0 2024-09-16T02:06:05.607 INFO:tasks.workunit.client.0.smithi110.stdout:2/534: creat d0/db/d47/da1/dad/fb6 x:0 0 0 2024-09-16T02:06:05.609 INFO:tasks.workunit.client.0.smithi110.stdout:2/535: mknod d0/da/d18/dac/d58/cb7 0 2024-09-16T02:06:05.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/536: fdatasync d0/da/d18/dac/f8a 0 2024-09-16T02:06:05.613 INFO:tasks.workunit.client.0.smithi110.stdout:2/537: mkdir d0/da/d18/dac/d41/db3/db8 0 2024-09-16T02:06:05.614 INFO:tasks.workunit.client.0.smithi110.stdout:2/538: truncate d0/db/d33/f8d 391648 0 2024-09-16T02:06:05.618 INFO:tasks.workunit.client.0.smithi110.stdout:2/539: mknod d0/da/d18/dac/d41/db3/db8/cb9 0 2024-09-16T02:06:05.620 INFO:tasks.workunit.client.0.smithi110.stdout:2/540: mknod d0/db/d47/cba 0 2024-09-16T02:06:05.627 INFO:tasks.workunit.client.0.smithi110.stdout:2/541: write d0/da/d18/d25/d3b/f53 [1149904,115385] 0 2024-09-16T02:06:05.637 INFO:tasks.workunit.client.0.smithi110.stdout:2/542: dread d0/db/f83 [0,4194304] 0 2024-09-16T02:06:05.638 INFO:tasks.workunit.client.0.smithi110.stdout:2/543: stat d0/da/d18/dac/l71 0 2024-09-16T02:06:05.641 INFO:tasks.workunit.client.0.smithi110.stdout:2/544: mknod d0/da/db5/cbb 0 2024-09-16T02:06:05.642 INFO:tasks.workunit.client.0.smithi110.stdout:2/545: symlink d0/da/db5/lbc 0 2024-09-16T02:06:05.648 INFO:tasks.workunit.client.0.smithi110.stdout:2/546: dwrite d0/db/d47/f8b [0,4194304] 0 2024-09-16T02:06:05.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/547: dread - d0/d5f/f97 zero size 2024-09-16T02:06:05.743 INFO:tasks.workunit.client.0.smithi110.stdout:2/548: creat d0/db/d47/d48/daa/fbd x:0 0 0 2024-09-16T02:06:05.745 INFO:tasks.workunit.client.0.smithi110.stdout:2/549: creat d0/da/fbe x:0 0 0 2024-09-16T02:06:05.749 INFO:tasks.workunit.client.0.smithi110.stdout:2/550: dread d0/da/d18/dac/f8c [0,4194304] 0 2024-09-16T02:06:05.750 INFO:tasks.workunit.client.0.smithi110.stdout:2/551: chown d0/da/d18/f29 16433939 1 2024-09-16T02:06:05.752 INFO:tasks.workunit.client.0.smithi110.stdout:2/552: fdatasync d0/da/d18/dac/d41/f54 0 2024-09-16T02:06:05.758 INFO:tasks.workunit.client.0.smithi110.stdout:2/553: symlink d0/da/lbf 0 2024-09-16T02:06:05.761 INFO:tasks.workunit.client.0.smithi110.stdout:2/554: dread d0/da/d18/dac/f8a [0,4194304] 0 2024-09-16T02:06:05.763 INFO:tasks.workunit.client.0.smithi110.stdout:2/555: mkdir d0/d5f/dc0 0 2024-09-16T02:06:05.765 INFO:tasks.workunit.client.0.smithi110.stdout:2/556: fdatasync d0/da/d18/dc/f57 0 2024-09-16T02:06:05.766 INFO:tasks.workunit.client.0.smithi110.stdout:2/557: chown d0/db/d33/f8d 12 1 2024-09-16T02:06:05.767 INFO:tasks.workunit.client.0.smithi110.stdout:2/558: dread - d0/da/d18/dac/d41/f85 zero size 2024-09-16T02:06:05.769 INFO:tasks.workunit.client.0.smithi110.stdout:2/559: creat d0/da/d18/dac/d41/fc1 x:0 0 0 2024-09-16T02:06:05.773 INFO:tasks.workunit.client.0.smithi110.stdout:2/560: unlink d0/da/d18/f19 0 2024-09-16T02:06:05.777 INFO:tasks.workunit.client.0.smithi110.stdout:2/561: dread d0/da/d18/dac/d41/f4b [0,4194304] 0 2024-09-16T02:06:05.779 INFO:tasks.workunit.client.0.smithi110.stdout:2/562: creat d0/db/d47/da1/fc2 x:0 0 0 2024-09-16T02:06:05.780 INFO:tasks.workunit.client.0.smithi110.stdout:2/563: fsync d0/da/d18/dac/f5a 0 2024-09-16T02:06:05.780 INFO:tasks.workunit.client.0.smithi110.stdout:2/564: dread - d0/da/d18/d25/f89 zero size 2024-09-16T02:06:05.783 INFO:tasks.workunit.client.0.smithi110.stdout:2/565: fdatasync d0/da/d18/dac/f8c 0 2024-09-16T02:06:05.786 INFO:tasks.workunit.client.0.smithi110.stdout:2/566: creat d0/da/d18/dac/d41/db3/db8/fc3 x:0 0 0 2024-09-16T02:06:05.790 INFO:tasks.workunit.client.0.smithi110.stdout:2/567: dread d0/da/d18/dac/f4a [0,4194304] 0 2024-09-16T02:06:05.790 INFO:tasks.workunit.client.0.smithi110.stdout:2/568: stat d0/db/d47/d48/da0 0 2024-09-16T02:06:05.800 INFO:tasks.workunit.client.0.smithi110.stdout:2/569: dread d0/da/d18/dac/d58/f82 [0,4194304] 0 2024-09-16T02:06:05.802 INFO:tasks.workunit.client.0.smithi110.stdout:2/570: creat d0/db/d47/d48/fc4 x:0 0 0 2024-09-16T02:06:05.805 INFO:tasks.workunit.client.0.smithi110.stdout:2/571: creat d0/fc5 x:0 0 0 2024-09-16T02:06:05.811 INFO:tasks.workunit.client.0.smithi110.stdout:2/572: dwrite d0/db/f36 [4194304,4194304] 0 2024-09-16T02:06:05.811 INFO:tasks.workunit.client.0.smithi110.stdout:2/573: chown d0/db/c75 310077230 1 2024-09-16T02:06:05.813 INFO:tasks.workunit.client.0.smithi110.stdout:2/574: chown d0/da/d18/dac/d39/d87/c91 512374 1 2024-09-16T02:06:05.816 INFO:tasks.workunit.client.0.smithi110.stdout:2/575: write d0/da/d18/dac/d41/db3/db8/fc3 [543292,17316] 0 2024-09-16T02:06:05.820 INFO:tasks.workunit.client.0.smithi110.stdout:2/576: link d0/da/d18/dac/c93 d0/db/d47/d48/cc6 0 2024-09-16T02:06:05.824 INFO:tasks.workunit.client.0.smithi110.stdout:2/577: link d0/db/d47/f50 d0/da/db5/fc7 0 2024-09-16T02:06:05.826 INFO:tasks.workunit.client.0.smithi110.stdout:2/578: symlink d0/da/d18/lc8 0 2024-09-16T02:06:05.829 INFO:tasks.workunit.client.0.smithi110.stdout:2/579: rename d0/l4 to d0/db/d47/d48/lc9 0 2024-09-16T02:06:05.841 INFO:tasks.workunit.client.0.smithi110.stdout:2/580: dwrite d0/da/d18/dac/d41/f54 [0,4194304] 0 2024-09-16T02:06:05.844 INFO:tasks.workunit.client.0.smithi110.stdout:2/581: symlink d0/da/d18/dac/d41/db3/lca 0 2024-09-16T02:06:05.851 INFO:tasks.workunit.client.0.smithi110.stdout:2/582: write d0/da/d18/dc/f57 [2518330,48053] 0 2024-09-16T02:06:05.854 INFO:tasks.workunit.client.0.smithi110.stdout:2/583: mkdir d0/da/d18/dac/d58/dcb 0 2024-09-16T02:06:05.854 INFO:tasks.workunit.client.0.smithi110.stdout:2/584: write d0/da/d18/dac/f8a [4549760,40235] 0 2024-09-16T02:06:05.860 INFO:tasks.workunit.client.0.smithi110.stdout:2/585: dwrite d0/da/d18/dc/f57 [0,4194304] 0 2024-09-16T02:06:05.862 INFO:tasks.workunit.client.0.smithi110.stdout:2/586: creat d0/d5f/da9/fcc x:0 0 0 2024-09-16T02:06:05.867 INFO:tasks.workunit.client.0.smithi110.stdout:2/587: getdents d0/da/d18/d25 0 2024-09-16T02:06:05.867 INFO:tasks.workunit.client.0.smithi110.stdout:2/588: readlink d0/db/d33/l9a 0 2024-09-16T02:06:05.869 INFO:tasks.workunit.client.0.smithi110.stdout:2/589: unlink d0/da/f84 0 2024-09-16T02:06:05.873 INFO:tasks.workunit.client.0.smithi110.stdout:2/590: dread d0/da/d18/dc/f1c [0,4194304] 0 2024-09-16T02:06:05.877 INFO:tasks.workunit.client.0.smithi110.stdout:2/591: rename d0/da/d18/dac to d0/db/d47/d48/dcd 0 2024-09-16T02:06:05.878 INFO:tasks.workunit.client.0.smithi110.stdout:2/592: dread - d0/db/d47/d48/dcd/d41/f85 zero size 2024-09-16T02:06:05.879 INFO:tasks.workunit.client.0.smithi110.stdout:2/593: write d0/db/d47/f8b [149780,116425] 0 2024-09-16T02:06:05.882 INFO:tasks.workunit.client.0.smithi110.stdout:8/426: sync 2024-09-16T02:06:05.882 INFO:tasks.workunit.client.0.smithi110.stdout:9/487: sync 2024-09-16T02:06:05.887 INFO:tasks.workunit.client.0.smithi110.stdout:9/488: stat d1/dd/d6a/d6c/d6f/d79/de/d1f/l59 0 2024-09-16T02:06:05.889 INFO:tasks.workunit.client.0.smithi110.stdout:2/594: dwrite d0/db/d47/da1/dad/fb6 [0,4194304] 0 2024-09-16T02:06:05.891 INFO:tasks.workunit.client.0.smithi110.stdout:9/489: read d1/dd/d6a/d6c/d6f/d79/d26/f85 [3441137,100955] 0 2024-09-16T02:06:05.893 INFO:tasks.workunit.client.0.smithi110.stdout:8/427: truncate d3/d2b/d27/f2d 1152418 0 2024-09-16T02:06:05.894 INFO:tasks.workunit.client.0.smithi110.stdout:2/595: mknod d0/db/d47/d48/da0/cce 0 2024-09-16T02:06:05.899 INFO:tasks.workunit.client.0.smithi110.stdout:2/596: mknod d0/db/d47/d48/dcd/d39/d87/ccf 0 2024-09-16T02:06:05.902 INFO:tasks.workunit.client.0.smithi110.stdout:9/490: dread d1/dd/f10 [0,4194304] 0 2024-09-16T02:06:05.903 INFO:tasks.workunit.client.0.smithi110.stdout:2/597: creat d0/db/d47/d48/fd0 x:0 0 0 2024-09-16T02:06:05.904 INFO:tasks.workunit.client.0.smithi110.stdout:2/598: dread - d0/db/d47/d48/dcd/d41/fb0 zero size 2024-09-16T02:06:05.905 INFO:tasks.workunit.client.0.smithi110.stdout:2/599: chown d0/db/d47/d48/dcd/d39/f86 7429691 1 2024-09-16T02:06:05.915 INFO:tasks.workunit.client.0.smithi110.stdout:2/600: dwrite d0/db/d47/d48/dcd/d58/f82 [4194304,4194304] 0 2024-09-16T02:06:05.920 INFO:tasks.workunit.client.0.smithi110.stdout:9/491: truncate d1/f3 9978401 0 2024-09-16T02:06:05.927 INFO:tasks.workunit.client.0.smithi110.stdout:9/492: truncate d1/dd/d6a/d6c/d6f/d79/f5c 1319231 0 2024-09-16T02:06:05.928 INFO:tasks.workunit.client.0.smithi110.stdout:2/601: getdents d0/db/d47/d48/dcd 0 2024-09-16T02:06:05.932 INFO:tasks.workunit.client.0.smithi110.stdout:2/602: dread d0/db/d47/d48/dcd/f5a [0,4194304] 0 2024-09-16T02:06:05.934 INFO:tasks.workunit.client.0.smithi110.stdout:2/603: chown d0/db/d47/d48/dcd/d58/l59 44659 1 2024-09-16T02:06:05.935 INFO:tasks.workunit.client.0.smithi110.stdout:2/604: write d0/db/d47/d48/dcd/d58/fab [372978,71008] 0 2024-09-16T02:06:05.936 INFO:tasks.workunit.client.0.smithi110.stdout:2/605: stat d0/db/l4e 0 2024-09-16T02:06:05.939 INFO:tasks.workunit.client.0.smithi110.stdout:9/493: write d1/f3 [2961059,18720] 0 2024-09-16T02:06:05.940 INFO:tasks.workunit.client.0.smithi110.stdout:9/494: chown d1/f52 1378 1 2024-09-16T02:06:05.940 INFO:tasks.workunit.client.0.smithi110.stdout:2/606: rename d0/db/d47/d48/c80 to d0/db/d47/d48/dcd/d58/dcb/cd1 0 2024-09-16T02:06:05.942 INFO:tasks.workunit.client.0.smithi110.stdout:9/495: write d1/dd/d6a/d6c/d75/d8c/f4d [782563,90821] 0 2024-09-16T02:06:05.944 INFO:tasks.workunit.client.0.smithi110.stdout:9/496: write d1/dd/d6a/d6c/d6f/d79/d26/f45 [3874863,110550] 0 2024-09-16T02:06:05.948 INFO:tasks.workunit.client.0.smithi110.stdout:2/607: creat d0/da/d18/fd2 x:0 0 0 2024-09-16T02:06:05.950 INFO:tasks.workunit.client.0.smithi110.stdout:9/497: symlink d1/dd/d6a/d6c/d6f/d79/de/d1f/la0 0 2024-09-16T02:06:05.953 INFO:tasks.workunit.client.0.smithi110.stdout:9/498: symlink d1/dd/d6a/d6c/d75/d8c/la1 0 2024-09-16T02:06:05.965 INFO:tasks.workunit.client.0.smithi110.stdout:9/499: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e [0,4194304] 0 2024-09-16T02:06:05.966 INFO:tasks.workunit.client.0.smithi110.stdout:2/608: dread d0/db/f2e [4194304,4194304] 0 2024-09-16T02:06:05.966 INFO:tasks.workunit.client.0.smithi110.stdout:9/500: chown d1/dd/d6a/d6c/d6f/d79/f17 399 1 2024-09-16T02:06:05.967 INFO:tasks.workunit.client.0.smithi110.stdout:2/609: write d0/da/d18/dc/f1f [6255311,33226] 0 2024-09-16T02:06:05.973 INFO:tasks.workunit.client.0.smithi110.stdout:9/501: getdents d1/d1b 0 2024-09-16T02:06:05.980 INFO:tasks.workunit.client.0.smithi110.stdout:9/502: link d1/dd/d6a/d6c/d6f/d79/c9 d1/ca2 0 2024-09-16T02:06:05.980 INFO:tasks.workunit.client.0.smithi110.stdout:2/610: dread d0/db/f2e [0,4194304] 0 2024-09-16T02:06:05.980 INFO:tasks.workunit.client.0.smithi110.stdout:2/611: readlink d0/da/l81 0 2024-09-16T02:06:05.983 INFO:tasks.workunit.client.0.smithi110.stdout:9/503: creat d1/d5/d20/d83/fa3 x:0 0 0 2024-09-16T02:06:05.984 INFO:tasks.workunit.client.0.smithi110.stdout:9/504: chown d1/d1b/l66 6452968 1 2024-09-16T02:06:05.990 INFO:tasks.workunit.client.0.smithi110.stdout:2/612: link d0/db/d47/da1/la3 d0/da/d18/d25/ld3 0 2024-09-16T02:06:05.991 INFO:tasks.workunit.client.0.smithi110.stdout:9/505: link d1/dd/d6a/d6c/d6f/d79/de/d1f/f48 d1/d5/fa4 0 2024-09-16T02:06:05.991 INFO:tasks.workunit.client.0.smithi110.stdout:9/506: chown d1 44 1 2024-09-16T02:06:05.992 INFO:tasks.workunit.client.0.smithi110.stdout:9/507: chown d1/d5/d20/d83/fa3 7201 1 2024-09-16T02:06:05.992 INFO:tasks.workunit.client.0.smithi110.stdout:2/613: symlink d0/d5f/dc0/ld4 0 2024-09-16T02:06:05.998 INFO:tasks.workunit.client.0.smithi110.stdout:9/508: link d1/dd/d6a/d6c/f73 d1/dd/d6a/d6c/d6f/d79/d26/d8e/fa5 0 2024-09-16T02:06:05.999 INFO:tasks.workunit.client.0.smithi110.stdout:2/614: dwrite d0/db/d47/d48/dcd/d58/fab [0,4194304] 0 2024-09-16T02:06:06.001 INFO:tasks.workunit.client.0.smithi110.stdout:2/615: write d0/da/d18/d25/d3b/f53 [1069182,57831] 0 2024-09-16T02:06:06.003 INFO:tasks.workunit.client.0.smithi110.stdout:9/509: rename d1/d5/d20/d83/fa3 to d1/dd/d6a/d6c/d75/fa6 0 2024-09-16T02:06:06.006 INFO:tasks.workunit.client.0.smithi110.stdout:2/616: mkdir d0/db/d47/da1/dad/dd5 0 2024-09-16T02:06:06.007 INFO:tasks.workunit.client.0.smithi110.stdout:2/617: write d0/da/f24 [2260909,77741] 0 2024-09-16T02:06:06.007 INFO:tasks.workunit.client.0.smithi110.stdout:9/510: symlink d1/dd/d6a/d6c/d75/d86/la7 0 2024-09-16T02:06:06.010 INFO:tasks.workunit.client.0.smithi110.stdout:2/618: mknod d0/db/d47/d48/cd6 0 2024-09-16T02:06:06.010 INFO:tasks.workunit.client.0.smithi110.stdout:2/619: readlink d0/db/d33/l94 0 2024-09-16T02:06:06.013 INFO:tasks.workunit.client.0.smithi110.stdout:2/620: mknod d0/da/d18/d25/d3b/cd7 0 2024-09-16T02:06:06.016 INFO:tasks.workunit.client.0.smithi110.stdout:2/621: link d0/db/d47/d48/c64 d0/da/db5/cd8 0 2024-09-16T02:06:06.021 INFO:tasks.workunit.client.0.smithi110.stdout:2/622: link d0/l21 d0/db/d47/d48/dcd/d41/ld9 0 2024-09-16T02:06:06.021 INFO:tasks.workunit.client.0.smithi110.stdout:2/623: readlink d0/da/d18/dc/l9c 0 2024-09-16T02:06:06.025 INFO:tasks.workunit.client.0.smithi110.stdout:2/624: getdents d0/da/d18/dc 0 2024-09-16T02:06:06.032 INFO:tasks.workunit.client.0.smithi110.stdout:9/511: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/f57 [0,4194304] 0 2024-09-16T02:06:06.032 INFO:tasks.workunit.client.0.smithi110.stdout:9/512: readlink d1/d5/d20/d83/l96 0 2024-09-16T02:06:06.033 INFO:tasks.workunit.client.0.smithi110.stdout:9/513: chown d1/d1b/f1d 46 1 2024-09-16T02:06:06.042 INFO:tasks.workunit.client.0.smithi110.stdout:9/514: dwrite d1/dd/d6a/d6c/d6f/d79/de/f1c [0,4194304] 0 2024-09-16T02:06:06.045 INFO:tasks.workunit.client.0.smithi110.stdout:9/515: creat d1/dd/d6a/d6c/d6f/d79/de/d1f/fa8 x:0 0 0 2024-09-16T02:06:06.204 INFO:tasks.workunit.client.0.smithi110.stdout:6/673: sync 2024-09-16T02:06:06.204 INFO:tasks.workunit.client.0.smithi110.stdout:4/518: sync 2024-09-16T02:06:06.214 INFO:tasks.workunit.client.0.smithi110.stdout:4/519: rmdir d4/d8/d31/d80 39 2024-09-16T02:06:06.215 INFO:tasks.workunit.client.0.smithi110.stdout:6/674: fdatasync d0/d2/d5/d84/d16/f3b 0 2024-09-16T02:06:06.216 INFO:tasks.workunit.client.0.smithi110.stdout:4/520: creat d4/d8/d31/d5d/fa3 x:0 0 0 2024-09-16T02:06:06.305 INFO:tasks.workunit.client.0.smithi110.stdout:0/577: sync 2024-09-16T02:06:06.305 INFO:tasks.workunit.client.0.smithi110.stdout:3/517: sync 2024-09-16T02:06:06.305 INFO:tasks.workunit.client.0.smithi110.stdout:7/428: sync 2024-09-16T02:06:06.305 INFO:tasks.workunit.client.0.smithi110.stdout:5/474: sync 2024-09-16T02:06:06.305 INFO:tasks.workunit.client.0.smithi110.stdout:1/538: sync 2024-09-16T02:06:06.305 INFO:tasks.workunit.client.0.smithi110.stdout:8/428: sync 2024-09-16T02:06:06.307 INFO:tasks.workunit.client.0.smithi110.stdout:1/539: chown d0/d1/d2a/d32/d40/lb3 109971453 1 2024-09-16T02:06:06.308 INFO:tasks.workunit.client.0.smithi110.stdout:1/540: fdatasync d0/da/f36 0 2024-09-16T02:06:06.311 INFO:tasks.workunit.client.0.smithi110.stdout:3/518: creat d8/d48/d5b/d6a/d75/d8b/fbb x:0 0 0 2024-09-16T02:06:06.313 INFO:tasks.workunit.client.0.smithi110.stdout:8/429: rename d3/d12/d1a/d36/f72 to d3/d12/d1a/d36/d87/f93 0 2024-09-16T02:06:06.316 INFO:tasks.workunit.client.0.smithi110.stdout:4/521: symlink d4/d8/d31/d80/d90/la4 0 2024-09-16T02:06:06.317 INFO:tasks.workunit.client.0.smithi110.stdout:4/522: chown d4/d8/d17/d23/d35/f9b 80772 1 2024-09-16T02:06:06.323 INFO:tasks.workunit.client.0.smithi110.stdout:8/430: rename d3/d12/l6a to d3/d12/d1a/d36/d60/d83/l94 0 2024-09-16T02:06:06.325 INFO:tasks.workunit.client.0.smithi110.stdout:3/519: dwrite f7 [0,4194304] 0 2024-09-16T02:06:06.327 INFO:tasks.workunit.client.0.smithi110.stdout:4/523: mkdir d4/d8/d17/d23/d4c/da5 0 2024-09-16T02:06:06.337 INFO:tasks.workunit.client.0.smithi110.stdout:0/578: getdents d3/d6/d4b 0 2024-09-16T02:06:06.338 INFO:tasks.workunit.client.0.smithi110.stdout:0/579: chown d3/d6/d43/da7 107638 1 2024-09-16T02:06:06.340 INFO:tasks.workunit.client.0.smithi110.stdout:1/541: getdents d0/d1/d2a/d32/d6e 0 2024-09-16T02:06:06.341 INFO:tasks.workunit.client.0.smithi110.stdout:1/542: read - d0/d1/d4/d46/d7a/fb2 zero size 2024-09-16T02:06:06.342 INFO:tasks.workunit.client.0.smithi110.stdout:1/543: write d0/d1/f68 [3270242,112167] 0 2024-09-16T02:06:06.345 INFO:tasks.workunit.client.0.smithi110.stdout:3/520: dread d8/d48/d5b/d92/f8a [0,4194304] 0 2024-09-16T02:06:06.346 INFO:tasks.workunit.client.0.smithi110.stdout:3/521: chown d8/dc/d1b/d3a/d43/da5/f6c 6385 1 2024-09-16T02:06:06.350 INFO:tasks.workunit.client.0.smithi110.stdout:4/524: link d4/d8/d17/d23/d35/l40 d4/d8/d17/d23/d4c/d6d/d7f/la6 0 2024-09-16T02:06:06.352 INFO:tasks.workunit.client.0.smithi110.stdout:8/431: dread d3/d12/d1a/f40 [0,4194304] 0 2024-09-16T02:06:06.353 INFO:tasks.workunit.client.0.smithi110.stdout:0/580: getdents d3/d6/d43/da7 0 2024-09-16T02:06:06.355 INFO:tasks.workunit.client.0.smithi110.stdout:3/522: rename d8/dc to d8/dc/d1b/dbc 22 2024-09-16T02:06:06.357 INFO:tasks.workunit.client.0.smithi110.stdout:4/525: readlink d4/d8/d31/d80/d3b/l79 0 2024-09-16T02:06:06.358 INFO:tasks.workunit.client.0.smithi110.stdout:0/581: chown d3/d6/d43/d55/d59/f9f 736636563 1 2024-09-16T02:06:06.360 INFO:tasks.workunit.client.0.smithi110.stdout:3/523: rename d8/dc/d1b/d1c to d8/d29/dbd 0 2024-09-16T02:06:06.360 INFO:tasks.workunit.client.0.smithi110.stdout:0/582: read d3/d4/dc/f49 [2217494,30936] 0 2024-09-16T02:06:06.368 INFO:tasks.workunit.client.0.smithi110.stdout:1/544: getdents d0/d91 0 2024-09-16T02:06:06.369 INFO:tasks.workunit.client.0.smithi110.stdout:7/429: truncate f1 2193296 0 2024-09-16T02:06:06.376 INFO:tasks.workunit.client.0.smithi110.stdout:0/583: dread d3/d6/f39 [0,4194304] 0 2024-09-16T02:06:06.376 INFO:tasks.workunit.client.0.smithi110.stdout:7/430: dwrite d3/d15/d38/d4f/d10/d2c/f72 [0,4194304] 0 2024-09-16T02:06:06.379 INFO:tasks.workunit.client.0.smithi110.stdout:1/545: mknod d0/d1/d4/d46/d7a/d9b/cb6 0 2024-09-16T02:06:06.381 INFO:tasks.workunit.client.0.smithi110.stdout:7/431: dread d3/d15/d38/d4f/d2e/f59 [0,4194304] 0 2024-09-16T02:06:06.382 INFO:tasks.workunit.client.0.smithi110.stdout:1/546: fdatasync d0/d1/f3f 0 2024-09-16T02:06:06.384 INFO:tasks.workunit.client.0.smithi110.stdout:0/584: unlink d3/d4/dc/cad 0 2024-09-16T02:06:06.384 INFO:tasks.workunit.client.0.smithi110.stdout:1/547: stat d0/d1/d4/d46/d64/d79/l8e 0 2024-09-16T02:06:06.385 INFO:tasks.workunit.client.0.smithi110.stdout:7/432: mkdir d3/d15/d38/d4f/d10/d7d 0 2024-09-16T02:06:06.387 INFO:tasks.workunit.client.0.smithi110.stdout:0/585: fsync d3/d4/d41/f5f 0 2024-09-16T02:06:06.388 INFO:tasks.workunit.client.0.smithi110.stdout:1/548: creat d0/d1/d4/d46/d7a/d9b/fb7 x:0 0 0 2024-09-16T02:06:06.390 INFO:tasks.workunit.client.0.smithi110.stdout:7/433: mkdir d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e 0 2024-09-16T02:06:06.391 INFO:tasks.workunit.client.0.smithi110.stdout:0/586: mkdir d3/d4/dc/d70/d8b/db3 0 2024-09-16T02:06:06.392 INFO:tasks.workunit.client.0.smithi110.stdout:0/587: readlink d3/d6/d4b/l6a 0 2024-09-16T02:06:06.394 INFO:tasks.workunit.client.0.smithi110.stdout:7/434: mknod d3/d15/d38/d4f/d10/d2c/c7f 0 2024-09-16T02:06:06.399 INFO:tasks.workunit.client.0.smithi110.stdout:4/526: write d4/d8/d17/d23/d4c/d6d/d4f/f69 [602499,119698] 0 2024-09-16T02:06:06.402 INFO:tasks.workunit.client.0.smithi110.stdout:4/527: write d4/d8/d17/d23/f9e [869680,371] 0 2024-09-16T02:06:06.402 INFO:tasks.workunit.client.0.smithi110.stdout:7/435: dwrite d3/d15/d38/d4f/d10/d11/f28 [4194304,4194304] 0 2024-09-16T02:06:06.405 INFO:tasks.workunit.client.0.smithi110.stdout:3/524: truncate d8/d29/f42 395725 0 2024-09-16T02:06:06.408 INFO:tasks.workunit.client.0.smithi110.stdout:1/549: dread d0/d1/d2a/d32/f41 [0,4194304] 0 2024-09-16T02:06:06.408 INFO:tasks.workunit.client.0.smithi110.stdout:1/550: dread - d0/d25/f4a zero size 2024-09-16T02:06:06.409 INFO:tasks.workunit.client.0.smithi110.stdout:7/436: fsync d3/d15/d38/d4f/f22 0 2024-09-16T02:06:06.410 INFO:tasks.workunit.client.0.smithi110.stdout:4/528: write d4/d8/d17/d23/d4c/d6d/f99 [3329508,109180] 0 2024-09-16T02:06:06.413 INFO:tasks.workunit.client.0.smithi110.stdout:3/525: dread - d8/dc/d1b/d3a/d43/f67 zero size 2024-09-16T02:06:06.414 INFO:tasks.workunit.client.0.smithi110.stdout:3/526: read d8/d48/d5b/d92/f5a [215241,118468] 0 2024-09-16T02:06:06.417 INFO:tasks.workunit.client.0.smithi110.stdout:7/437: mkdir d3/d15/d3a/d80 0 2024-09-16T02:06:06.418 INFO:tasks.workunit.client.0.smithi110.stdout:4/529: rename d4/d8/d17/d23/d61/l6c to d4/d8/d31/d73/la7 0 2024-09-16T02:06:06.419 INFO:tasks.workunit.client.0.smithi110.stdout:4/530: read d4/d8/d17/d23/f74 [2648360,21224] 0 2024-09-16T02:06:06.420 INFO:tasks.workunit.client.0.smithi110.stdout:1/551: mknod d0/d1/d2a/d32/d9f/cb8 0 2024-09-16T02:06:06.421 INFO:tasks.workunit.client.0.smithi110.stdout:4/531: write d4/d8/d17/d23/d4c/f9f [1019556,47665] 0 2024-09-16T02:06:06.421 INFO:tasks.workunit.client.0.smithi110.stdout:3/527: creat d8/d29/fbe x:0 0 0 2024-09-16T02:06:06.422 INFO:tasks.workunit.client.0.smithi110.stdout:0/588: write d3/d4/dc/d14/f19 [69895,93312] 0 2024-09-16T02:06:06.422 INFO:tasks.workunit.client.0.smithi110.stdout:4/532: chown d4/d8/d17 4454097 1 2024-09-16T02:06:06.427 INFO:tasks.workunit.client.0.smithi110.stdout:1/552: truncate d0/d1/d4/d46/d64/f66 299919 0 2024-09-16T02:06:06.429 INFO:tasks.workunit.client.0.smithi110.stdout:3/528: unlink d8/d48/d5b/d6a/d75/d8b/fae 0 2024-09-16T02:06:06.433 INFO:tasks.workunit.client.0.smithi110.stdout:4/533: rename d4/d8/d31/d80/d18/f27 to d4/d8/d31/d80/d3b/fa8 0 2024-09-16T02:06:06.434 INFO:tasks.workunit.client.0.smithi110.stdout:4/534: readlink d4/d8/d31/d80/d18/l19 0 2024-09-16T02:06:06.434 INFO:tasks.workunit.client.0.smithi110.stdout:4/535: stat d4/d8/d17/d23/d4c/d6d/d7f/f8a 0 2024-09-16T02:06:06.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/553: creat d0/d1/d4/d46/d75/fb9 x:0 0 0 2024-09-16T02:06:06.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/554: stat d0/d1/d4/d46/d64 0 2024-09-16T02:06:06.439 INFO:tasks.workunit.client.0.smithi110.stdout:0/589: creat d3/d4/fb4 x:0 0 0 2024-09-16T02:06:06.440 INFO:tasks.workunit.client.0.smithi110.stdout:4/536: mkdir d4/d8/d17/d23/d4c/d6d/d4f/da9 0 2024-09-16T02:06:06.447 INFO:tasks.workunit.client.0.smithi110.stdout:0/590: dwrite d3/d4/fb4 [0,4194304] 0 2024-09-16T02:06:06.450 INFO:tasks.workunit.client.0.smithi110.stdout:0/591: write d3/d4/dc/f3e [1503140,90324] 0 2024-09-16T02:06:06.452 INFO:tasks.workunit.client.0.smithi110.stdout:0/592: read d3/d4/dc/d75/f83 [551151,37453] 0 2024-09-16T02:06:06.452 INFO:tasks.workunit.client.0.smithi110.stdout:4/537: unlink d4/l65 0 2024-09-16T02:06:06.452 INFO:tasks.workunit.client.0.smithi110.stdout:4/538: readlink d4/d8/d31/l3f 0 2024-09-16T02:06:06.456 INFO:tasks.workunit.client.0.smithi110.stdout:1/555: symlink d0/d1/d4/d46/lba 0 2024-09-16T02:06:06.463 INFO:tasks.workunit.client.0.smithi110.stdout:0/593: truncate d3/f1a 71046 0 2024-09-16T02:06:06.464 INFO:tasks.workunit.client.0.smithi110.stdout:4/539: mknod d4/d8/d31/d80/d3b/d55/caa 0 2024-09-16T02:06:06.465 INFO:tasks.workunit.client.0.smithi110.stdout:3/529: write d8/dc/d1b/f60 [715140,120099] 0 2024-09-16T02:06:06.468 INFO:tasks.workunit.client.0.smithi110.stdout:1/556: read d0/d1/d2a/d32/fa6 [8246830,122225] 0 2024-09-16T02:06:06.469 INFO:tasks.workunit.client.0.smithi110.stdout:0/594: rmdir d3/d4/d85/d93 39 2024-09-16T02:06:06.469 INFO:tasks.workunit.client.0.smithi110.stdout:1/557: chown d0/d1/d4 494 1 2024-09-16T02:06:06.471 INFO:tasks.workunit.client.0.smithi110.stdout:1/558: stat d0/d1/d2a/d32/d6e/f6f 0 2024-09-16T02:06:06.471 INFO:tasks.workunit.client.0.smithi110.stdout:3/530: dwrite d8/f1e [0,4194304] 0 2024-09-16T02:06:06.473 INFO:tasks.workunit.client.0.smithi110.stdout:4/540: truncate d4/d8/d17/d23/d4c/d6d/f64 1872318 0 2024-09-16T02:06:06.476 INFO:tasks.workunit.client.0.smithi110.stdout:4/541: truncate d4/d8/d17/d23/d35/f9b 182347 0 2024-09-16T02:06:06.480 INFO:tasks.workunit.client.0.smithi110.stdout:3/531: symlink d8/dc/d1b/d3a/lbf 0 2024-09-16T02:06:06.481 INFO:tasks.workunit.client.0.smithi110.stdout:4/542: mknod d4/d8/d31/d80/d18/cab 0 2024-09-16T02:06:06.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/559: dread d0/d1/f23 [0,4194304] 0 2024-09-16T02:06:06.487 INFO:tasks.workunit.client.0.smithi110.stdout:4/543: unlink d4/d8/d17/d23/d35/l8b 0 2024-09-16T02:06:06.487 INFO:tasks.workunit.client.0.smithi110.stdout:3/532: link d8/dc/d1b/d3a/c3f d8/dc/d1b/d36/d57/d64/cc0 0 2024-09-16T02:06:06.494 INFO:tasks.workunit.client.0.smithi110.stdout:3/533: dwrite d8/d29/dbd/fa4 [0,4194304] 0 2024-09-16T02:06:06.494 INFO:tasks.workunit.client.0.smithi110.stdout:3/534: chown d8/d48/d7c/d87 47041538 1 2024-09-16T02:06:06.495 INFO:tasks.workunit.client.0.smithi110.stdout:3/535: stat d8/dc/d1b/d36/f9c 0 2024-09-16T02:06:06.501 INFO:tasks.workunit.client.0.smithi110.stdout:3/536: rename d8/d48/d5b/f63 to d8/dc/d1b/d36/fc1 0 2024-09-16T02:06:06.503 INFO:tasks.workunit.client.0.smithi110.stdout:3/537: write d8/dc/f7e [859557,66698] 0 2024-09-16T02:06:06.516 INFO:tasks.workunit.client.0.smithi110.stdout:4/544: write d4/d8/d17/d23/d4c/d6d/f7e [32174,60059] 0 2024-09-16T02:06:06.524 INFO:tasks.workunit.client.0.smithi110.stdout:4/545: creat d4/fac x:0 0 0 2024-09-16T02:06:06.525 INFO:tasks.workunit.client.0.smithi110.stdout:4/546: readlink d4/d8/d31/d80/d18/l22 0 2024-09-16T02:06:06.535 INFO:tasks.workunit.client.0.smithi110.stdout:4/547: mkdir d4/d8/d17/d23/d4c/d6d/d4f/da9/dad 0 2024-09-16T02:06:06.536 INFO:tasks.workunit.client.0.smithi110.stdout:3/538: dwrite d8/d29/dbd/f38 [0,4194304] 0 2024-09-16T02:06:06.536 INFO:tasks.workunit.client.0.smithi110.stdout:4/548: readlink d4/d8/d31/l3f 0 2024-09-16T02:06:06.538 INFO:tasks.workunit.client.0.smithi110.stdout:4/549: fdatasync d4/d8/d17/d23/d4c/d6d/f62 0 2024-09-16T02:06:06.539 INFO:tasks.workunit.client.0.smithi110.stdout:3/539: dread - d8/f4d zero size 2024-09-16T02:06:06.546 INFO:tasks.workunit.client.0.smithi110.stdout:3/540: creat d8/d48/d7c/d87/da9/fc2 x:0 0 0 2024-09-16T02:06:06.547 INFO:tasks.workunit.client.0.smithi110.stdout:4/550: dread d4/d8/d31/d80/f24 [0,4194304] 0 2024-09-16T02:06:06.552 INFO:tasks.workunit.client.0.smithi110.stdout:3/541: getdents d8/d48 0 2024-09-16T02:06:06.552 INFO:tasks.workunit.client.0.smithi110.stdout:3/542: readlink d8/l86 0 2024-09-16T02:06:06.553 INFO:tasks.workunit.client.0.smithi110.stdout:4/551: link d4/fc d4/d8/d31/d6f/fae 0 2024-09-16T02:06:06.553 INFO:tasks.workunit.client.0.smithi110.stdout:3/543: fdatasync d8/dc/d1b/f60 0 2024-09-16T02:06:06.554 INFO:tasks.workunit.client.0.smithi110.stdout:4/552: chown d4/d8/d17/d23/d4c/d6d/d4f 62162 1 2024-09-16T02:06:06.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/544: chown d8/d29/d45/f68 184477 1 2024-09-16T02:06:06.555 INFO:tasks.workunit.client.0.smithi110.stdout:4/553: truncate d4/f15 4271073 0 2024-09-16T02:06:06.561 INFO:tasks.workunit.client.0.smithi110.stdout:3/545: mkdir d8/dc/d1b/d36/d57/d97/dc3 0 2024-09-16T02:06:06.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/546: chown d8/dc/d1b/d3a/d43/fa0 82839187 1 2024-09-16T02:06:06.562 INFO:tasks.workunit.client.0.smithi110.stdout:4/554: creat d4/d8/d31/d80/faf x:0 0 0 2024-09-16T02:06:06.562 INFO:tasks.workunit.client.0.smithi110.stdout:3/547: write d8/d48/d5b/d6a/d75/d8b/f8d [185280,36914] 0 2024-09-16T02:06:06.563 INFO:tasks.workunit.client.0.smithi110.stdout:3/548: symlink d8/d48/d5b/d6a/lc4 0 2024-09-16T02:06:06.571 INFO:tasks.workunit.client.0.smithi110.stdout:4/555: dread d4/f15 [0,4194304] 0 2024-09-16T02:06:06.576 INFO:tasks.workunit.client.0.smithi110.stdout:3/549: dwrite d8/dc/d1b/d36/f71 [4194304,4194304] 0 2024-09-16T02:06:06.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/550: fsync d8/dc/d1b/d3a/d43/f4e 0 2024-09-16T02:06:06.580 INFO:tasks.workunit.client.0.smithi110.stdout:4/556: dwrite d4/d8/f67 [0,4194304] 0 2024-09-16T02:06:06.585 INFO:tasks.workunit.client.0.smithi110.stdout:3/551: link d8/d29/l8c d8/dc/d1b/d36/d57/d97/dc3/lc5 0 2024-09-16T02:06:06.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/552: write d8/d48/f4f [1375340,51261] 0 2024-09-16T02:06:06.587 INFO:tasks.workunit.client.0.smithi110.stdout:4/557: dwrite d4/d8/d31/d80/d18/f4d [0,4194304] 0 2024-09-16T02:06:06.591 INFO:tasks.workunit.client.0.smithi110.stdout:3/553: rename d8/dc/d7f to d8/d29/dbd/dc6 0 2024-09-16T02:06:06.592 INFO:tasks.workunit.client.0.smithi110.stdout:4/558: symlink d4/d8/d17/d23/d4c/d6d/d4f/lb0 0 2024-09-16T02:06:06.593 INFO:tasks.workunit.client.0.smithi110.stdout:4/559: dread - d4/d8/d17/d23/d4c/d6d/d4f/fa2 zero size 2024-09-16T02:06:06.597 INFO:tasks.workunit.client.0.smithi110.stdout:2/625: sync 2024-09-16T02:06:06.597 INFO:tasks.workunit.client.0.smithi110.stdout:9/516: sync 2024-09-16T02:06:06.598 INFO:tasks.workunit.client.0.smithi110.stdout:4/560: dread d4/d8/f67 [0,4194304] 0 2024-09-16T02:06:06.599 INFO:tasks.workunit.client.0.smithi110.stdout:9/517: rename d1/dd to d1/dd/d6a/da9 22 2024-09-16T02:06:06.600 INFO:tasks.workunit.client.0.smithi110.stdout:2/626: mknod d0/db/d47/d48/da0/cda 0 2024-09-16T02:06:06.602 INFO:tasks.workunit.client.0.smithi110.stdout:9/518: mkdir d1/d1b/daa 0 2024-09-16T02:06:06.604 INFO:tasks.workunit.client.0.smithi110.stdout:2/627: mknod d0/db/d47/d48/da0/cdb 0 2024-09-16T02:06:06.608 INFO:tasks.workunit.client.0.smithi110.stdout:2/628: rename d0/db/d47/d48/dcd/d39/d7b to d0/d5f/dc0/ddc 0 2024-09-16T02:06:06.608 INFO:tasks.workunit.client.0.smithi110.stdout:3/554: write d8/dc/f11 [1150127,54948] 0 2024-09-16T02:06:06.610 INFO:tasks.workunit.client.0.smithi110.stdout:2/629: truncate d0/db/f2e 2086501 0 2024-09-16T02:06:06.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/555: rename d8/dc to d8/d48/d5b/d92/dc7 0 2024-09-16T02:06:06.619 INFO:tasks.workunit.client.0.smithi110.stdout:2/630: rename d0/da to d0/d5f/dc0/ddc/ddd 0 2024-09-16T02:06:06.623 INFO:tasks.workunit.client.0.smithi110.stdout:3/556: truncate d8/f5c 860893 0 2024-09-16T02:06:06.626 INFO:tasks.workunit.client.0.smithi110.stdout:2/631: dwrite d0/db/d33/f6c [0,4194304] 0 2024-09-16T02:06:06.628 INFO:tasks.workunit.client.0.smithi110.stdout:3/557: symlink d8/d48/d5b/d6a/lc8 0 2024-09-16T02:06:06.629 INFO:tasks.workunit.client.0.smithi110.stdout:3/558: chown d8/d29/f96 96903336 1 2024-09-16T02:06:06.632 INFO:tasks.workunit.client.0.smithi110.stdout:2/632: mknod d0/db/d47/d48/dcd/d41/db3/cde 0 2024-09-16T02:06:06.635 INFO:tasks.workunit.client.0.smithi110.stdout:2/633: mkdir d0/db/d47/d48/daa/ddf 0 2024-09-16T02:06:06.637 INFO:tasks.workunit.client.0.smithi110.stdout:9/519: dread d1/d1b/d23/f4c [0,4194304] 0 2024-09-16T02:06:06.639 INFO:tasks.workunit.client.0.smithi110.stdout:2/634: symlink d0/db/d47/d48/dcd/d41/db3/le0 0 2024-09-16T02:06:06.643 INFO:tasks.workunit.client.0.smithi110.stdout:9/520: dwrite d1/f3 [4194304,4194304] 0 2024-09-16T02:06:06.643 INFO:tasks.workunit.client.0.smithi110.stdout:2/635: mkdir d0/db/d47/d48/dcd/d41/db3/db8/de1 0 2024-09-16T02:06:06.643 INFO:tasks.workunit.client.0.smithi110.stdout:3/559: write d8/d48/d5b/d92/dc7/d1b/d3a/f50 [45667,70291] 0 2024-09-16T02:06:06.647 INFO:tasks.workunit.client.0.smithi110.stdout:2/636: mknod d0/d5f/dc0/ddc/ddd/d18/ce2 0 2024-09-16T02:06:06.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/637: read - d0/d5f/dc0/ddc/ddd/d18/d25/f8f zero size 2024-09-16T02:06:06.653 INFO:tasks.workunit.client.0.smithi110.stdout:2/638: mkdir d0/db/d47/d48/dcd/d41/db3/de3 0 2024-09-16T02:06:06.656 INFO:tasks.workunit.client.0.smithi110.stdout:2/639: rename d0/db/d47/da1/fc2 to d0/db/d47/d48/fe4 0 2024-09-16T02:06:06.663 INFO:tasks.workunit.client.0.smithi110.stdout:2/640: link d0/d5f/dc0/ddc/ddd/d18/dc/l9c d0/db/d47/d48/dcd/d41/db3/db8/de1/le5 0 2024-09-16T02:06:06.664 INFO:tasks.workunit.client.0.smithi110.stdout:9/521: dread d1/fc [0,4194304] 0 2024-09-16T02:06:06.665 INFO:tasks.workunit.client.0.smithi110.stdout:9/522: chown d1/d5/d20/f39 2773264 1 2024-09-16T02:06:06.665 INFO:tasks.workunit.client.0.smithi110.stdout:2/641: symlink d0/db/d47/d48/da0/le6 0 2024-09-16T02:06:06.667 INFO:tasks.workunit.client.0.smithi110.stdout:9/523: creat d1/d5/d20/d55/fab x:0 0 0 2024-09-16T02:06:06.668 INFO:tasks.workunit.client.0.smithi110.stdout:2/642: truncate d0/db/d47/d48/dcd/d58/fa6 931170 0 2024-09-16T02:06:06.670 INFO:tasks.workunit.client.0.smithi110.stdout:2/643: chown d0/db/d47/d48/c62 15460693 1 2024-09-16T02:06:06.670 INFO:tasks.workunit.client.0.smithi110.stdout:2/644: chown d0/d5f 506 1 2024-09-16T02:06:06.675 INFO:tasks.workunit.client.0.smithi110.stdout:2/645: dread d0/d5f/dc0/ddc/ddd/d18/dc/f1c [0,4194304] 0 2024-09-16T02:06:06.678 INFO:tasks.workunit.client.0.smithi110.stdout:2/646: chown d0/db/d47/d48/da0/cda 502 1 2024-09-16T02:06:06.679 INFO:tasks.workunit.client.0.smithi110.stdout:9/524: dwrite d1/dd/d6a/d6c/d6f/d79/de/f56 [4194304,4194304] 0 2024-09-16T02:06:06.684 INFO:tasks.workunit.client.0.smithi110.stdout:2/647: mkdir d0/d5f/dc0/ddc/ddd/d18/dc/de7 0 2024-09-16T02:06:06.687 INFO:tasks.workunit.client.0.smithi110.stdout:2/648: fsync d0/d5f/dc0/ddc/ddd/d18/d25/f89 0 2024-09-16T02:06:06.691 INFO:tasks.workunit.client.0.smithi110.stdout:9/525: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f76 [4194304,4194304] 0 2024-09-16T02:06:06.693 INFO:tasks.workunit.client.0.smithi110.stdout:2/649: mknod d0/db/d47/d48/dcd/d41/db3/db8/de1/ce8 0 2024-09-16T02:06:06.695 INFO:tasks.workunit.client.0.smithi110.stdout:9/526: symlink d1/dd/lac 0 2024-09-16T02:06:06.699 INFO:tasks.workunit.client.0.smithi110.stdout:2/650: unlink d0/d5f/dc0/ddc/ddd/d18/dc/l9c 0 2024-09-16T02:06:06.700 INFO:tasks.workunit.client.0.smithi110.stdout:9/527: rmdir d1/d1b/d23/d7c 39 2024-09-16T02:06:06.702 INFO:tasks.workunit.client.0.smithi110.stdout:9/528: write d1/dd/d6a/d6c/d6f/d79/de/f56 [4324863,32978] 0 2024-09-16T02:06:06.703 INFO:tasks.workunit.client.0.smithi110.stdout:2/651: mknod d0/db/d47/d48/dcd/d41/db3/db8/ce9 0 2024-09-16T02:06:06.703 INFO:tasks.workunit.client.0.smithi110.stdout:9/529: truncate d1/dd/f10 12635877 0 2024-09-16T02:06:06.706 INFO:tasks.workunit.client.0.smithi110.stdout:9/530: write d1/dd/d6a/d6c/d6f/d79/d26/f76 [2475761,19373] 0 2024-09-16T02:06:06.708 INFO:tasks.workunit.client.0.smithi110.stdout:2/652: unlink d0/db/d47/d48/dcd/d41/f44 0 2024-09-16T02:06:06.711 INFO:tasks.workunit.client.0.smithi110.stdout:9/531: creat d1/dd/d6a/d6c/d75/d86/fad x:0 0 0 2024-09-16T02:06:06.713 INFO:tasks.workunit.client.0.smithi110.stdout:2/653: mknod d0/db/d47/d48/dcd/d41/db3/db8/cea 0 2024-09-16T02:06:06.714 INFO:tasks.workunit.client.0.smithi110.stdout:9/532: mknod d1/dd/d6a/d6c/d6f/d79/de/cae 0 2024-09-16T02:06:06.714 INFO:tasks.workunit.client.0.smithi110.stdout:2/654: write d0/db/d47/d48/dcd/d58/fab [901259,45569] 0 2024-09-16T02:06:06.723 INFO:tasks.workunit.client.0.smithi110.stdout:2/655: dwrite d0/d5f/dc0/ddc/ddd/d18/dc/f7f [0,4194304] 0 2024-09-16T02:06:06.725 INFO:tasks.workunit.client.0.smithi110.stdout:2/656: read d0/d5f/dc0/ddc/ddd/f24 [93859,70559] 0 2024-09-16T02:06:06.725 INFO:tasks.workunit.client.0.smithi110.stdout:9/533: rename f0 to d1/d1b/faf 0 2024-09-16T02:06:06.740 INFO:tasks.workunit.client.0.smithi110.stdout:2/657: creat d0/db/d47/da1/feb x:0 0 0 2024-09-16T02:06:06.740 INFO:tasks.workunit.client.0.smithi110.stdout:2/658: chown d0/db/d47/da1/dad/dd5 124 1 2024-09-16T02:06:06.743 INFO:tasks.workunit.client.0.smithi110.stdout:9/534: symlink d1/dd/d6a/d6c/d9b/lb0 0 2024-09-16T02:06:06.744 INFO:tasks.workunit.client.0.smithi110.stdout:2/659: mkdir d0/db/d47/d48/dcd/d58/dec 0 2024-09-16T02:06:06.745 INFO:tasks.workunit.client.0.smithi110.stdout:9/535: mknod d1/dd/d6a/d6c/d75/d86/cb1 0 2024-09-16T02:06:06.748 INFO:tasks.workunit.client.0.smithi110.stdout:9/536: symlink d1/dd/d6a/d6c/d75/d8c/d38/d3d/lb2 0 2024-09-16T02:06:06.749 INFO:tasks.workunit.client.0.smithi110.stdout:2/660: dwrite d0/db/f27 [0,4194304] 0 2024-09-16T02:06:06.755 INFO:tasks.workunit.client.0.smithi110.stdout:2/661: rename d0/db/d47/d48/dcd/l65 to d0/db/d47/d48/daa/ddf/led 0 2024-09-16T02:06:06.763 INFO:tasks.workunit.client.0.smithi110.stdout:2/662: dwrite d0/db/d33/f6d [0,4194304] 0 2024-09-16T02:06:06.767 INFO:tasks.workunit.client.0.smithi110.stdout:9/537: dread d1/dd/d6a/d6c/d6f/d79/d26/f76 [0,4194304] 0 2024-09-16T02:06:06.770 INFO:tasks.workunit.client.0.smithi110.stdout:2/663: rmdir d0/db/d47/d48/dcd/d41/db3/db8/de1 39 2024-09-16T02:06:06.771 INFO:tasks.workunit.client.0.smithi110.stdout:2/664: chown d0/db/d47/lb4 360626 1 2024-09-16T02:06:06.772 INFO:tasks.workunit.client.0.smithi110.stdout:9/538: creat d1/dd/d6a/d6c/d6f/d79/d29/fb3 x:0 0 0 2024-09-16T02:06:06.773 INFO:tasks.workunit.client.0.smithi110.stdout:2/665: creat d0/d5f/dc0/ddc/ddd/d18/dc/fee x:0 0 0 2024-09-16T02:06:06.775 INFO:tasks.workunit.client.0.smithi110.stdout:9/539: mkdir d1/dd/d6a/d6c/d6f/d79/d29/db4 0 2024-09-16T02:06:06.777 INFO:tasks.workunit.client.0.smithi110.stdout:9/540: mknod d1/dd/d6a/d6c/d9b/cb5 0 2024-09-16T02:06:06.780 INFO:tasks.workunit.client.0.smithi110.stdout:9/541: write d1/dd/d6a/d6c/d6f/d79/d29/fb3 [833001,5248] 0 2024-09-16T02:06:06.780 INFO:tasks.workunit.client.0.smithi110.stdout:2/666: dwrite d0/db/d47/d48/dcd/d41/fae [0,4194304] 0 2024-09-16T02:06:06.782 INFO:tasks.workunit.client.0.smithi110.stdout:9/542: chown d1/dd/d6a/d6c/d6f/d79/f68 0 1 2024-09-16T02:06:06.783 INFO:tasks.workunit.client.0.smithi110.stdout:9/543: chown d1/dd/d6a/d6c/d75/d8c/f3a 395059 1 2024-09-16T02:06:06.790 INFO:tasks.workunit.client.0.smithi110.stdout:9/544: dwrite d1/dd/d6a/d6c/d6f/d79/f40 [0,4194304] 0 2024-09-16T02:06:06.792 INFO:tasks.workunit.client.0.smithi110.stdout:9/545: write d1/dd/d6a/d6c/d6f/d79/de/f3b [1443951,20915] 0 2024-09-16T02:06:06.796 INFO:tasks.workunit.client.0.smithi110.stdout:9/546: getdents d1/dd/d6a/d6c/d75 0 2024-09-16T02:06:06.800 INFO:tasks.workunit.client.0.smithi110.stdout:2/667: dwrite d0/db/d47/f50 [0,4194304] 0 2024-09-16T02:06:06.803 INFO:tasks.workunit.client.0.smithi110.stdout:2/668: fdatasync d0/db/d47/d48/dcd/d58/fa6 0 2024-09-16T02:06:06.806 INFO:tasks.workunit.client.0.smithi110.stdout:2/669: write d0/d5f/dc0/ddc/ddd/d18/fd2 [320005,78753] 0 2024-09-16T02:06:06.806 INFO:tasks.workunit.client.0.smithi110.stdout:9/547: dwrite d1/d1b/f6e [0,4194304] 0 2024-09-16T02:06:06.810 INFO:tasks.workunit.client.0.smithi110.stdout:2/670: creat d0/db/d47/d48/da0/fef x:0 0 0 2024-09-16T02:06:06.811 INFO:tasks.workunit.client.0.smithi110.stdout:9/548: dread d1/d1b/f6e [0,4194304] 0 2024-09-16T02:06:06.813 INFO:tasks.workunit.client.0.smithi110.stdout:2/671: mkdir d0/db/d47/d48/dcd/d41/db3/df0 0 2024-09-16T02:06:06.815 INFO:tasks.workunit.client.0.smithi110.stdout:9/549: creat d1/d5/fb6 x:0 0 0 2024-09-16T02:06:06.816 INFO:tasks.workunit.client.0.smithi110.stdout:9/550: chown d1/d5/d20 11 1 2024-09-16T02:06:06.818 INFO:tasks.workunit.client.0.smithi110.stdout:2/672: dread d0/db/d47/d48/dcd/d41/db3/db8/fc3 [0,4194304] 0 2024-09-16T02:06:06.819 INFO:tasks.workunit.client.0.smithi110.stdout:9/551: write d1/dd/d6a/d6c/d75/fa6 [272090,96642] 0 2024-09-16T02:06:06.827 INFO:tasks.workunit.client.0.smithi110.stdout:9/552: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e [4194304,4194304] 0 2024-09-16T02:06:06.832 INFO:tasks.workunit.client.0.smithi110.stdout:2/673: getdents d0/db/d47/d48/dcd/d39/d87 0 2024-09-16T02:06:06.833 INFO:tasks.workunit.client.0.smithi110.stdout:2/674: chown d0/db/d47/d48/dcd/d41/fb0 1207039207 1 2024-09-16T02:06:06.841 INFO:tasks.workunit.client.0.smithi110.stdout:2/675: rename d0/d5f/dc0/ddc/ddd/f26 to d0/d5f/ff1 0 2024-09-16T02:06:06.841 INFO:tasks.workunit.client.0.smithi110.stdout:9/553: write d1/f4f [645322,81221] 0 2024-09-16T02:06:06.841 INFO:tasks.workunit.client.0.smithi110.stdout:2/676: creat d0/db/d47/d48/da0/ff2 x:0 0 0 2024-09-16T02:06:06.852 INFO:tasks.workunit.client.0.smithi110.stdout:6/675: sync 2024-09-16T02:06:06.853 INFO:tasks.workunit.client.0.smithi110.stdout:9/554: dread d1/dd/d6a/d6c/d75/d8c/f3a [0,4194304] 0 2024-09-16T02:06:06.857 INFO:tasks.workunit.client.0.smithi110.stdout:2/677: dwrite d0/d5f/dc0/ddc/ddd/d18/dc/f2b [0,4194304] 0 2024-09-16T02:06:06.858 INFO:tasks.workunit.client.0.smithi110.stdout:2/678: fsync d0/d5f/dc0/ddc/ddd/d18/dc/fee 0 2024-09-16T02:06:06.859 INFO:tasks.workunit.client.0.smithi110.stdout:2/679: fsync d0/db/d33/f6c 0 2024-09-16T02:06:06.859 INFO:tasks.workunit.client.0.smithi110.stdout:9/555: symlink d1/dd/d6a/d6c/d6f/d79/d26/lb7 0 2024-09-16T02:06:06.860 INFO:tasks.workunit.client.0.smithi110.stdout:6/676: truncate d0/d2/d5/d84/f5d 4886939 0 2024-09-16T02:06:06.863 INFO:tasks.workunit.client.0.smithi110.stdout:9/556: rename d1/d5/d20/f39 to d1/dd/d6a/d6c/d6f/d79/de/d1f/fb8 0 2024-09-16T02:06:06.863 INFO:tasks.workunit.client.0.smithi110.stdout:6/677: rmdir d0/d2/d57 39 2024-09-16T02:06:06.866 INFO:tasks.workunit.client.0.smithi110.stdout:6/678: creat d0/d2/d18/d1d/fd4 x:0 0 0 2024-09-16T02:06:06.889 INFO:tasks.workunit.client.0.smithi110.stdout:9/557: dread d1/d5/f18 [4194304,4194304] 0 2024-09-16T02:06:06.909 INFO:tasks.workunit.client.0.smithi110.stdout:9/558: mknod d1/dd/d6a/cb9 0 2024-09-16T02:06:06.911 INFO:tasks.workunit.client.0.smithi110.stdout:9/559: chown d1/dd/d6a/d6c/d75/d8c/d38/d3d/c91 110 1 2024-09-16T02:06:06.913 INFO:tasks.workunit.client.0.smithi110.stdout:9/560: creat d1/dd/d6a/d6c/d6f/d79/d26/d5b/fba x:0 0 0 2024-09-16T02:06:06.918 INFO:tasks.workunit.client.0.smithi110.stdout:9/561: dwrite d1/f4f [0,4194304] 0 2024-09-16T02:06:06.922 INFO:tasks.workunit.client.0.smithi110.stdout:9/562: mknod d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/cbb 0 2024-09-16T02:06:06.926 INFO:tasks.workunit.client.0.smithi110.stdout:9/563: getdents d1/d5 0 2024-09-16T02:06:06.933 INFO:tasks.workunit.client.0.smithi110.stdout:9/564: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/fa8 [0,4194304] 0 2024-09-16T02:06:06.938 INFO:tasks.workunit.client.0.smithi110.stdout:9/565: dread d1/dd/d6a/d6c/d75/d8c/f41 [0,4194304] 0 2024-09-16T02:06:06.941 INFO:tasks.workunit.client.0.smithi110.stdout:9/566: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc 0 2024-09-16T02:06:06.942 INFO:tasks.workunit.client.0.smithi110.stdout:9/567: fdatasync d1/f3 0 2024-09-16T02:06:06.962 INFO:tasks.workunit.client.0.smithi110.stdout:9/568: dread d1/dd/d6a/d6c/d6f/d79/d26/f45 [0,4194304] 0 2024-09-16T02:06:06.964 INFO:tasks.workunit.client.0.smithi110.stdout:9/569: creat d1/dd/d6a/d6c/d75/d8c/fbd x:0 0 0 2024-09-16T02:06:06.965 INFO:tasks.workunit.client.0.smithi110.stdout:9/570: rmdir d1/dd/d6a/d6c 39 2024-09-16T02:06:06.968 INFO:tasks.workunit.client.0.smithi110.stdout:9/571: write d1/d1b/f22 [2751195,42565] 0 2024-09-16T02:06:06.970 INFO:tasks.workunit.client.0.smithi110.stdout:9/572: creat d1/d5/d20/fbe x:0 0 0 2024-09-16T02:06:06.977 INFO:tasks.workunit.client.0.smithi110.stdout:9/573: truncate d1/dd/f10 8956577 0 2024-09-16T02:06:06.977 INFO:tasks.workunit.client.0.smithi110.stdout:9/574: chown d1/dd/c7d 6893 1 2024-09-16T02:06:06.980 INFO:tasks.workunit.client.0.smithi110.stdout:9/575: creat d1/dd/d6a/d6c/d6f/d79/de/d1f/fbf x:0 0 0 2024-09-16T02:06:06.982 INFO:tasks.workunit.client.0.smithi110.stdout:9/576: write d1/dd/d6a/d6c/d75/d8c/f3a [2328898,103753] 0 2024-09-16T02:06:06.986 INFO:tasks.workunit.client.0.smithi110.stdout:9/577: creat d1/dd/d6a/d6c/d6f/d79/d26/fc0 x:0 0 0 2024-09-16T02:06:06.988 INFO:tasks.workunit.client.0.smithi110.stdout:9/578: mknod d1/d5/d20/d83/cc1 0 2024-09-16T02:06:06.989 INFO:tasks.workunit.client.0.smithi110.stdout:9/579: creat d1/dd/d6a/d6c/d75/d86/fc2 x:0 0 0 2024-09-16T02:06:06.992 INFO:tasks.workunit.client.0.smithi110.stdout:9/580: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/fc3 x:0 0 0 2024-09-16T02:06:06.994 INFO:tasks.workunit.client.0.smithi110.stdout:9/581: mkdir d1/d5/dc4 0 2024-09-16T02:06:06.995 INFO:tasks.workunit.client.0.smithi110.stdout:9/582: rmdir d1 39 2024-09-16T02:06:06.999 INFO:tasks.workunit.client.0.smithi110.stdout:9/583: truncate d1/d1b/d23/f4c 4336770 0 2024-09-16T02:06:07.000 INFO:tasks.workunit.client.0.smithi110.stdout:9/584: write d1/dd/d6a/f7a [1922585,105338] 0 2024-09-16T02:06:07.001 INFO:tasks.workunit.client.0.smithi110.stdout:9/585: stat d1/dd/d6a/d6c/d6f/d79/d26/l67 0 2024-09-16T02:06:07.004 INFO:tasks.workunit.client.0.smithi110.stdout:9/586: creat d1/dd/d6a/d6c/d6f/d79/de/d1f/fc5 x:0 0 0 2024-09-16T02:06:07.007 INFO:tasks.workunit.client.0.smithi110.stdout:9/587: chown d1/d5/fa4 6 1 2024-09-16T02:06:07.009 INFO:tasks.workunit.client.0.smithi110.stdout:9/588: getdents d1/d5/d20/d55/d82 0 2024-09-16T02:06:07.011 INFO:tasks.workunit.client.0.smithi110.stdout:9/589: getdents d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc 0 2024-09-16T02:06:07.012 INFO:tasks.workunit.client.0.smithi110.stdout:9/590: dread - d1/dd/d6a/d6c/d75/d86/fc2 zero size 2024-09-16T02:06:07.014 INFO:tasks.workunit.client.0.smithi110.stdout:9/591: creat d1/dd/d6a/fc6 x:0 0 0 2024-09-16T02:06:07.017 INFO:tasks.workunit.client.0.smithi110.stdout:9/592: creat d1/d1b/d23/fc7 x:0 0 0 2024-09-16T02:06:07.019 INFO:tasks.workunit.client.0.smithi110.stdout:9/593: creat d1/d1b/daa/fc8 x:0 0 0 2024-09-16T02:06:07.022 INFO:tasks.workunit.client.0.smithi110.stdout:9/594: creat d1/dd/d6a/d6c/d6f/fc9 x:0 0 0 2024-09-16T02:06:07.023 INFO:tasks.workunit.client.0.smithi110.stdout:9/595: fdatasync d1/d1b/faf 0 2024-09-16T02:06:07.027 INFO:tasks.workunit.client.0.smithi110.stdout:9/596: dread d1/dd/d6a/d6c/d75/d8c/f41 [0,4194304] 0 2024-09-16T02:06:07.029 INFO:tasks.workunit.client.0.smithi110.stdout:9/597: read d1/dd/d6a/d6c/d75/d8c/d38/d3d/f4e [2677205,18066] 0 2024-09-16T02:06:07.034 INFO:tasks.workunit.client.0.smithi110.stdout:9/598: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/fa8 [0,4194304] 0 2024-09-16T02:06:07.037 INFO:tasks.workunit.client.0.smithi110.stdout:9/599: fdatasync d1/dd/d6a/d6c/d6f/d79/f17 0 2024-09-16T02:06:07.039 INFO:tasks.workunit.client.0.smithi110.stdout:9/600: write d1/d5/d20/d55/fab [257597,95132] 0 2024-09-16T02:06:07.044 INFO:tasks.workunit.client.0.smithi110.stdout:9/601: rmdir d1/d1b/d23/d7c 39 2024-09-16T02:06:07.045 INFO:tasks.workunit.client.0.smithi110.stdout:5/475: sync 2024-09-16T02:06:07.046 INFO:tasks.workunit.client.0.smithi110.stdout:9/602: mknod d1/dd/d6a/d6c/d6f/d79/de/cca 0 2024-09-16T02:06:07.047 INFO:tasks.workunit.client.0.smithi110.stdout:9/603: read d1/f4f [591025,71080] 0 2024-09-16T02:06:07.048 INFO:tasks.workunit.client.0.smithi110.stdout:9/604: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/f4a 5 1 2024-09-16T02:06:07.055 INFO:tasks.workunit.client.0.smithi110.stdout:9/605: dread d1/d1b/d23/d7c/f81 [0,4194304] 0 2024-09-16T02:06:07.055 INFO:tasks.workunit.client.0.smithi110.stdout:5/476: getdents d5/d71 0 2024-09-16T02:06:07.063 INFO:tasks.workunit.client.0.smithi110.stdout:5/477: link d5/dd/df/d11/l41 d5/d36/l9b 0 2024-09-16T02:06:07.064 INFO:tasks.workunit.client.0.smithi110.stdout:5/478: chown d5/d36/l39 1 1 2024-09-16T02:06:07.064 INFO:tasks.workunit.client.0.smithi110.stdout:5/479: fdatasync d5/dd/f4c 0 2024-09-16T02:06:07.065 INFO:tasks.workunit.client.0.smithi110.stdout:5/480: write d5/dd/f2b [378882,3932] 0 2024-09-16T02:06:07.067 INFO:tasks.workunit.client.0.smithi110.stdout:5/481: mkdir d5/dd/df/d28/d9c 0 2024-09-16T02:06:07.068 INFO:tasks.workunit.client.0.smithi110.stdout:5/482: readlink d5/dd/l3e 0 2024-09-16T02:06:07.070 INFO:tasks.workunit.client.0.smithi110.stdout:5/483: creat d5/dd/df/d28/d6f/f9d x:0 0 0 2024-09-16T02:06:07.070 INFO:tasks.workunit.client.0.smithi110.stdout:5/484: fdatasync d5/dd/df/d11/f2f 0 2024-09-16T02:06:07.089 INFO:tasks.workunit.client.0.smithi110.stdout:5/485: dwrite d5/f13 [0,4194304] 0 2024-09-16T02:06:07.095 INFO:tasks.workunit.client.0.smithi110.stdout:5/486: creat d5/dd/df/f9e x:0 0 0 2024-09-16T02:06:07.096 INFO:tasks.workunit.client.0.smithi110.stdout:5/487: getdents d5/dd/d90 0 2024-09-16T02:06:07.097 INFO:tasks.workunit.client.0.smithi110.stdout:5/488: write d5/f1e [1107157,54401] 0 2024-09-16T02:06:07.098 INFO:tasks.workunit.client.0.smithi110.stdout:5/489: chown d5/dd/l3e 913 1 2024-09-16T02:06:07.101 INFO:tasks.workunit.client.0.smithi110.stdout:5/490: read d5/f1e [1939717,26213] 0 2024-09-16T02:06:07.104 INFO:tasks.workunit.client.0.smithi110.stdout:5/491: rename d5/dd/df/d11/d6d/d85 to d5/dd/df/d28/d77/d9f 0 2024-09-16T02:06:07.117 INFO:tasks.workunit.client.0.smithi110.stdout:5/492: write d5/dd/df/d11/f58 [175060,112333] 0 2024-09-16T02:06:07.132 INFO:tasks.workunit.client.0.smithi110.stdout:5/493: getdents d5/d36/d45/d47 0 2024-09-16T02:06:07.135 INFO:tasks.workunit.client.0.smithi110.stdout:5/494: rmdir d5/dd/df/d28 39 2024-09-16T02:06:07.138 INFO:tasks.workunit.client.0.smithi110.stdout:5/495: unlink d5/dd/df/d11/f3a 0 2024-09-16T02:06:07.140 INFO:tasks.workunit.client.0.smithi110.stdout:5/496: symlink d5/d36/la0 0 2024-09-16T02:06:07.143 INFO:tasks.workunit.client.0.smithi110.stdout:5/497: rename d5/f19 to d5/dd/df/d92/fa1 0 2024-09-16T02:06:07.148 INFO:tasks.workunit.client.0.smithi110.stdout:5/498: dwrite d5/d71/f81 [0,4194304] 0 2024-09-16T02:06:07.150 INFO:tasks.workunit.client.0.smithi110.stdout:5/499: creat d5/dd/df/d11/fa2 x:0 0 0 2024-09-16T02:06:07.152 INFO:tasks.workunit.client.0.smithi110.stdout:5/500: symlink d5/dd/df/d11/la3 0 2024-09-16T02:06:07.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:06 smithi165 ceph-mon[34621]: pgmap v27: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 108 MiB/s rd, 266 MiB/s wr, 535 op/s 2024-09-16T02:06:07.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:06 smithi110 ceph-mon[27634]: pgmap v27: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 108 MiB/s rd, 266 MiB/s wr, 535 op/s 2024-09-16T02:06:07.307 INFO:tasks.workunit.client.0.smithi110.stdout:5/501: rename d5/d36/d45/d47/f65 to d5/dd/df/d92/fa4 0 2024-09-16T02:06:07.338 INFO:tasks.workunit.client.0.smithi110.stdout:5/502: write d5/dd/df/d28/f93 [52198,95833] 0 2024-09-16T02:06:07.345 INFO:tasks.workunit.client.0.smithi110.stdout:5/503: rename d5/dd/df/d11/c8a to d5/dd/ca5 0 2024-09-16T02:06:07.348 INFO:tasks.workunit.client.0.smithi110.stdout:5/504: creat d5/dd/df/d28/d77/fa6 x:0 0 0 2024-09-16T02:06:07.349 INFO:tasks.workunit.client.0.smithi110.stdout:5/505: readlink d5/dd/l60 0 2024-09-16T02:06:07.386 INFO:tasks.workunit.client.0.smithi110.stdout:5/506: dwrite d5/dd/df/d11/d6d/f7b [0,4194304] 0 2024-09-16T02:06:07.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/507: rename d5/c8d to d5/d36/d3d/ca7 0 2024-09-16T02:06:07.392 INFO:tasks.workunit.client.0.smithi110.stdout:5/508: symlink d5/dd/d90/la8 0 2024-09-16T02:06:07.394 INFO:tasks.workunit.client.0.smithi110.stdout:5/509: mknod d5/ca9 0 2024-09-16T02:06:07.399 INFO:tasks.workunit.client.0.smithi110.stdout:5/510: write d5/d36/d45/d47/f57 [327542,40096] 0 2024-09-16T02:06:07.401 INFO:tasks.workunit.client.0.smithi110.stdout:5/511: truncate d5/dd/df/f38 916896 0 2024-09-16T02:06:07.403 INFO:tasks.workunit.client.0.smithi110.stdout:5/512: creat d5/dd/df/d28/d9c/faa x:0 0 0 2024-09-16T02:06:07.405 INFO:tasks.workunit.client.0.smithi110.stdout:5/513: mkdir d5/dd/df/d28/dab 0 2024-09-16T02:06:07.407 INFO:tasks.workunit.client.0.smithi110.stdout:5/514: mkdir d5/dd/df/d28/d6f/d8e/dac 0 2024-09-16T02:06:07.409 INFO:tasks.workunit.client.0.smithi110.stdout:5/515: unlink d5/dd/df/d92/fa4 0 2024-09-16T02:06:07.411 INFO:tasks.workunit.client.0.smithi110.stdout:5/516: write d5/dd/df/d11/f32 [1883845,92367] 0 2024-09-16T02:06:07.415 INFO:tasks.workunit.client.0.smithi110.stdout:5/517: getdents d5/dd/d90 0 2024-09-16T02:06:07.417 INFO:tasks.workunit.client.0.smithi110.stdout:5/518: symlink d5/dd/df/d92/lad 0 2024-09-16T02:06:07.431 INFO:tasks.workunit.client.0.smithi110.stdout:5/519: dwrite d5/dd/df/d92/fa1 [0,4194304] 0 2024-09-16T02:06:07.435 INFO:tasks.workunit.client.0.smithi110.stdout:5/520: link d5/d36/d45/d47/l5e d5/dd/df/d92/lae 0 2024-09-16T02:06:07.436 INFO:tasks.workunit.client.0.smithi110.stdout:8/432: sync 2024-09-16T02:06:07.438 INFO:tasks.workunit.client.0.smithi110.stdout:5/521: rename d5/d36/l39 to d5/dd/df/d28/laf 0 2024-09-16T02:06:07.440 INFO:tasks.workunit.client.0.smithi110.stdout:5/522: fsync d5/dd/df/f35 0 2024-09-16T02:06:07.441 INFO:tasks.workunit.client.0.smithi110.stdout:5/523: dread - d5/d36/d3d/f9a zero size 2024-09-16T02:06:07.456 INFO:tasks.workunit.client.0.smithi110.stdout:8/433: truncate d3/d2b/f1e 5914080 0 2024-09-16T02:06:07.463 INFO:tasks.workunit.client.0.smithi110.stdout:8/434: write d3/d12/d1a/f40 [1180852,50511] 0 2024-09-16T02:06:07.474 INFO:tasks.workunit.client.0.smithi110.stdout:8/435: dread d3/d31/f3e [0,4194304] 0 2024-09-16T02:06:07.476 INFO:tasks.workunit.client.0.smithi110.stdout:8/436: mknod d3/d12/d1a/d36/d60/c95 0 2024-09-16T02:06:07.478 INFO:tasks.workunit.client.0.smithi110.stdout:8/437: truncate d3/d12/f5c 579173 0 2024-09-16T02:06:07.521 INFO:tasks.workunit.client.0.smithi110.stdout:7/438: sync 2024-09-16T02:06:07.521 INFO:tasks.workunit.client.0.smithi110.stdout:0/595: sync 2024-09-16T02:06:07.536 INFO:tasks.workunit.client.0.smithi110.stdout:0/596: fdatasync d3/d6/d43/d55/fa4 0 2024-09-16T02:06:07.537 INFO:tasks.workunit.client.0.smithi110.stdout:8/438: link d3/c1b d3/c96 0 2024-09-16T02:06:07.543 INFO:tasks.workunit.client.0.smithi110.stdout:8/439: dread d3/d12/f5c [0,4194304] 0 2024-09-16T02:06:07.546 INFO:tasks.workunit.client.0.smithi110.stdout:0/597: truncate d3/d4/dc/f1c 965354 0 2024-09-16T02:06:07.554 INFO:tasks.workunit.client.0.smithi110.stdout:0/598: truncate d3/d4/dc/d10/f87 1183207 0 2024-09-16T02:06:07.554 INFO:tasks.workunit.client.0.smithi110.stdout:0/599: dread - d3/f82 zero size 2024-09-16T02:06:07.557 INFO:tasks.workunit.client.0.smithi110.stdout:0/600: unlink d3/d6/ff 0 2024-09-16T02:06:07.562 INFO:tasks.workunit.client.0.smithi110.stdout:0/601: creat d3/d4/d85/d93/da1/fb5 x:0 0 0 2024-09-16T02:06:07.565 INFO:tasks.workunit.client.0.smithi110.stdout:0/602: truncate d3/d4/dc/d14/d7e/d81/f97 386943 0 2024-09-16T02:06:07.568 INFO:tasks.workunit.client.0.smithi110.stdout:0/603: creat d3/d4/dc/d14/d7e/d81/d86/fb6 x:0 0 0 2024-09-16T02:06:07.573 INFO:tasks.workunit.client.0.smithi110.stdout:7/439: truncate d3/d15/d38/d4f/d10/d2c/f72 1422788 0 2024-09-16T02:06:07.574 INFO:tasks.workunit.client.0.smithi110.stdout:0/604: dwrite d3/d4/d85/d93/da1/fb5 [0,4194304] 0 2024-09-16T02:06:07.575 INFO:tasks.workunit.client.0.smithi110.stdout:8/440: write d3/d12/d1a/d36/d60/d62/d5f/f77 [5186437,74644] 0 2024-09-16T02:06:07.576 INFO:tasks.workunit.client.0.smithi110.stdout:0/605: dread - d3/d6/d43/d55/d59/f9c zero size 2024-09-16T02:06:07.577 INFO:tasks.workunit.client.0.smithi110.stdout:7/440: fsync d3/d15/d38/d4f/f18 0 2024-09-16T02:06:07.579 INFO:tasks.workunit.client.0.smithi110.stdout:7/441: dread - d3/d15/d38/d4f/d2e/f71 zero size 2024-09-16T02:06:07.580 INFO:tasks.workunit.client.0.smithi110.stdout:8/441: rmdir d3/d12/d1d 39 2024-09-16T02:06:07.582 INFO:tasks.workunit.client.0.smithi110.stdout:8/442: read d3/f3c [279690,70051] 0 2024-09-16T02:06:07.585 INFO:tasks.workunit.client.0.smithi110.stdout:7/442: dwrite d3/f32 [0,4194304] 0 2024-09-16T02:06:07.586 INFO:tasks.workunit.client.0.smithi110.stdout:7/443: fsync d3/d15/d38/d4f/fe 0 2024-09-16T02:06:07.595 INFO:tasks.workunit.client.0.smithi110.stdout:8/443: mknod d3/d12/d1a/d36/d60/d62/d5f/c97 0 2024-09-16T02:06:07.599 INFO:tasks.workunit.client.0.smithi110.stdout:8/444: unlink d3/d12/d1a/d36/d60/c95 0 2024-09-16T02:06:07.601 INFO:tasks.workunit.client.0.smithi110.stdout:0/606: getdents d3/d4/d85 0 2024-09-16T02:06:07.606 INFO:tasks.workunit.client.0.smithi110.stdout:0/607: creat d3/d4/dc/fb7 x:0 0 0 2024-09-16T02:06:07.607 INFO:tasks.workunit.client.0.smithi110.stdout:0/608: chown d3/d6/f39 5224680 1 2024-09-16T02:06:07.609 INFO:tasks.workunit.client.0.smithi110.stdout:0/609: dread - d3/d6/d43/d55/d59/f88 zero size 2024-09-16T02:06:07.612 INFO:tasks.workunit.client.0.smithi110.stdout:0/610: creat d3/d4/dc/fb8 x:0 0 0 2024-09-16T02:06:07.615 INFO:tasks.workunit.client.0.smithi110.stdout:0/611: rmdir d3/d4/dc/d70/d8b 39 2024-09-16T02:06:07.615 INFO:tasks.workunit.client.0.smithi110.stdout:8/445: dwrite d3/d12/d1a/d36/f4f [4194304,4194304] 0 2024-09-16T02:06:07.620 INFO:tasks.workunit.client.0.smithi110.stdout:0/612: mknod d3/d4/dc/d75/cb9 0 2024-09-16T02:06:07.622 INFO:tasks.workunit.client.0.smithi110.stdout:0/613: mknod d3/d4/dc/d10/cba 0 2024-09-16T02:06:07.626 INFO:tasks.workunit.client.0.smithi110.stdout:0/614: mkdir d3/d6/d43/d55/dbb 0 2024-09-16T02:06:07.628 INFO:tasks.workunit.client.0.smithi110.stdout:8/446: dread d3/d12/d1a/f5d [0,4194304] 0 2024-09-16T02:06:07.630 INFO:tasks.workunit.client.0.smithi110.stdout:8/447: mkdir d3/d12/d1a/d36/d60/d62/d5f/d98 0 2024-09-16T02:06:07.631 INFO:tasks.workunit.client.0.smithi110.stdout:0/615: truncate d3/d6/d43/d55/d59/f5c 2831886 0 2024-09-16T02:06:07.632 INFO:tasks.workunit.client.0.smithi110.stdout:0/616: dread - d3/d6/d43/d55/d59/f88 zero size 2024-09-16T02:06:07.633 INFO:tasks.workunit.client.0.smithi110.stdout:8/448: truncate d3/d2b/f4a 315838 0 2024-09-16T02:06:07.633 INFO:tasks.workunit.client.0.smithi110.stdout:0/617: chown d3/d6/d43/l47 1441359 1 2024-09-16T02:06:07.635 INFO:tasks.workunit.client.0.smithi110.stdout:8/449: creat d3/f99 x:0 0 0 2024-09-16T02:06:07.636 INFO:tasks.workunit.client.0.smithi110.stdout:0/618: creat d3/d4/dc/d14/d7e/d81/d89/fbc x:0 0 0 2024-09-16T02:06:07.638 INFO:tasks.workunit.client.0.smithi110.stdout:0/619: mkdir d3/d4/dc/d10/dbd 0 2024-09-16T02:06:07.642 INFO:tasks.workunit.client.0.smithi110.stdout:0/620: read - d3/d4/d6d/f79 zero size 2024-09-16T02:06:07.642 INFO:tasks.workunit.client.0.smithi110.stdout:0/621: fdatasync d3/d4/dc/d75/fae 0 2024-09-16T02:06:07.643 INFO:tasks.workunit.client.0.smithi110.stdout:8/450: write d3/d31/f3e [989353,10396] 0 2024-09-16T02:06:07.647 INFO:tasks.workunit.client.0.smithi110.stdout:8/451: readlink d3/d12/d1d/l2c 0 2024-09-16T02:06:07.652 INFO:tasks.workunit.client.0.smithi110.stdout:8/452: unlink d3/d12/d1a/l63 0 2024-09-16T02:06:07.656 INFO:tasks.workunit.client.0.smithi110.stdout:0/622: dwrite d3/d4/f27 [0,4194304] 0 2024-09-16T02:06:07.657 INFO:tasks.workunit.client.0.smithi110.stdout:8/453: rename d3/f3d to d3/d2b/d27/d45/d66/d6b/d8d/f9a 0 2024-09-16T02:06:07.666 INFO:tasks.workunit.client.0.smithi110.stdout:8/454: symlink d3/d2b/d27/d45/d66/l9b 0 2024-09-16T02:06:07.666 INFO:tasks.workunit.client.0.smithi110.stdout:8/455: stat d3/f9 0 2024-09-16T02:06:07.666 INFO:tasks.workunit.client.0.smithi110.stdout:0/623: dwrite d3/f17 [8388608,4194304] 0 2024-09-16T02:06:07.680 INFO:tasks.workunit.client.0.smithi110.stdout:0/624: write d3/d4/dc/f1c [660880,44515] 0 2024-09-16T02:06:07.683 INFO:tasks.workunit.client.0.smithi110.stdout:0/625: creat d3/d6/d43/da7/fbe x:0 0 0 2024-09-16T02:06:07.689 INFO:tasks.workunit.client.0.smithi110.stdout:8/456: dread d3/f44 [0,4194304] 0 2024-09-16T02:06:07.689 INFO:tasks.workunit.client.0.smithi110.stdout:0/626: dwrite d3/d4/d85/d93/da1/fb5 [4194304,4194304] 0 2024-09-16T02:06:07.693 INFO:tasks.workunit.client.0.smithi110.stdout:0/627: symlink d3/d4/d6d/lbf 0 2024-09-16T02:06:07.694 INFO:tasks.workunit.client.0.smithi110.stdout:8/457: write d3/d2b/f2e [3486959,6693] 0 2024-09-16T02:06:07.696 INFO:tasks.workunit.client.0.smithi110.stdout:0/628: write d3/d6/f39 [4235369,18634] 0 2024-09-16T02:06:07.697 INFO:tasks.workunit.client.0.smithi110.stdout:1/560: sync 2024-09-16T02:06:07.699 INFO:tasks.workunit.client.0.smithi110.stdout:0/629: unlink d3/d4/f9d 0 2024-09-16T02:06:07.701 INFO:tasks.workunit.client.0.smithi110.stdout:0/630: truncate d3/d6/d43/d55/d59/f9c 960161 0 2024-09-16T02:06:07.702 INFO:tasks.workunit.client.0.smithi110.stdout:0/631: write d3/d92/fa9 [402786,117001] 0 2024-09-16T02:06:07.709 INFO:tasks.workunit.client.0.smithi110.stdout:1/561: creat d0/d1/fbb x:0 0 0 2024-09-16T02:06:07.712 INFO:tasks.workunit.client.0.smithi110.stdout:8/458: dwrite d3/d2b/f1e [4194304,4194304] 0 2024-09-16T02:06:07.714 INFO:tasks.workunit.client.0.smithi110.stdout:1/562: mknod d0/d1/d4/d46/cbc 0 2024-09-16T02:06:07.714 INFO:tasks.workunit.client.0.smithi110.stdout:0/632: dwrite d3/d4/d85/fa2 [0,4194304] 0 2024-09-16T02:06:07.716 INFO:tasks.workunit.client.0.smithi110.stdout:8/459: dread - d3/d2b/d27/f4d zero size 2024-09-16T02:06:07.723 INFO:tasks.workunit.client.0.smithi110.stdout:8/460: link d3/d12/d1a/d36/d87/f91 d3/d2b/d27/d45/d66/d6b/d8d/f9c 0 2024-09-16T02:06:07.726 INFO:tasks.workunit.client.0.smithi110.stdout:0/633: dwrite d3/d4/d6d/faf [0,4194304] 0 2024-09-16T02:06:07.729 INFO:tasks.workunit.client.0.smithi110.stdout:8/461: dread d3/d12/d1a/f40 [0,4194304] 0 2024-09-16T02:06:07.730 INFO:tasks.workunit.client.0.smithi110.stdout:0/634: truncate d3/d6/d43/d55/f7d 29602 0 2024-09-16T02:06:07.731 INFO:tasks.workunit.client.0.smithi110.stdout:8/462: fsync d3/d12/f26 0 2024-09-16T02:06:07.731 INFO:tasks.workunit.client.0.smithi110.stdout:0/635: stat d3/d4/dc/d14/d7e 0 2024-09-16T02:06:07.733 INFO:tasks.workunit.client.0.smithi110.stdout:0/636: mknod d3/d6/d43/cc0 0 2024-09-16T02:06:07.735 INFO:tasks.workunit.client.0.smithi110.stdout:1/563: write d0/d25/f4a [942483,125423] 0 2024-09-16T02:06:07.741 INFO:tasks.workunit.client.0.smithi110.stdout:8/463: getdents d3/d12/d1a/d36/d87 0 2024-09-16T02:06:07.744 INFO:tasks.workunit.client.0.smithi110.stdout:1/564: dwrite d0/da/f17 [0,4194304] 0 2024-09-16T02:06:07.746 INFO:tasks.workunit.client.0.smithi110.stdout:8/464: creat d3/d2b/d65/f9d x:0 0 0 2024-09-16T02:06:07.749 INFO:tasks.workunit.client.0.smithi110.stdout:8/465: chown d3/d12/d8f/c79 0 1 2024-09-16T02:06:07.750 INFO:tasks.workunit.client.0.smithi110.stdout:8/466: stat d3/d12/d8f 0 2024-09-16T02:06:07.757 INFO:tasks.workunit.client.0.smithi110.stdout:1/565: link d0/d1/d4/laa d0/d25/d63/lbd 0 2024-09-16T02:06:07.760 INFO:tasks.workunit.client.0.smithi110.stdout:8/467: dwrite d3/d12/d1a/f40 [0,4194304] 0 2024-09-16T02:06:07.766 INFO:tasks.workunit.client.0.smithi110.stdout:8/468: rename d3/d2b/f80 to d3/d12/d1a/d36/d60/d62/d5f/f9e 0 2024-09-16T02:06:07.770 INFO:tasks.workunit.client.0.smithi110.stdout:8/469: creat d3/d31/f9f x:0 0 0 2024-09-16T02:06:07.773 INFO:tasks.workunit.client.0.smithi110.stdout:8/470: creat d3/d12/d1a/d36/d60/d62/fa0 x:0 0 0 2024-09-16T02:06:07.776 INFO:tasks.workunit.client.0.smithi110.stdout:8/471: stat d3/d12/d1a/d36/d60/d83/l94 0 2024-09-16T02:06:07.779 INFO:tasks.workunit.client.0.smithi110.stdout:1/566: dwrite d0/da/f29 [0,4194304] 0 2024-09-16T02:06:07.781 INFO:tasks.workunit.client.0.smithi110.stdout:8/472: mkdir d3/d12/d1a/d36/d60/da1 0 2024-09-16T02:06:07.784 INFO:tasks.workunit.client.0.smithi110.stdout:1/567: link d0/d1/d2a/f5d d0/da/d7c/fbe 0 2024-09-16T02:06:07.807 INFO:tasks.workunit.client.0.smithi110.stdout:1/568: dwrite d0/d1/d4/d46/d51/f7f [0,4194304] 0 2024-09-16T02:06:07.811 INFO:tasks.workunit.client.0.smithi110.stdout:1/569: mkdir d0/d1/d2a/d32/d40/dbf 0 2024-09-16T02:06:07.817 INFO:tasks.workunit.client.0.smithi110.stdout:1/570: link d0/d1/l3c d0/d1/d4/d46/d51/lc0 0 2024-09-16T02:06:07.819 INFO:tasks.workunit.client.0.smithi110.stdout:1/571: fdatasync d0/da/f5c 0 2024-09-16T02:06:07.832 INFO:tasks.workunit.client.0.smithi110.stdout:1/572: getdents d0/da 0 2024-09-16T02:06:07.837 INFO:tasks.workunit.client.0.smithi110.stdout:1/573: getdents d0/d1/d4/d46/d75 0 2024-09-16T02:06:07.851 INFO:tasks.workunit.client.0.smithi110.stdout:1/574: dread d0/d1/d2a/d32/f4f [0,4194304] 0 2024-09-16T02:06:07.853 INFO:tasks.workunit.client.0.smithi110.stdout:1/575: creat d0/d91/fc1 x:0 0 0 2024-09-16T02:06:07.856 INFO:tasks.workunit.client.0.smithi110.stdout:1/576: mkdir d0/d1/d4/dc2 0 2024-09-16T02:06:07.861 INFO:tasks.workunit.client.0.smithi110.stdout:1/577: unlink d0/da/le 0 2024-09-16T02:06:07.862 INFO:tasks.workunit.client.0.smithi110.stdout:1/578: stat d0/d1/fbb 0 2024-09-16T02:06:07.862 INFO:tasks.workunit.client.0.smithi110.stdout:1/579: chown d0/f47 677013 1 2024-09-16T02:06:07.863 INFO:tasks.workunit.client.0.smithi110.stdout:3/560: sync 2024-09-16T02:06:07.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/561: sync 2024-09-16T02:06:07.864 INFO:tasks.workunit.client.0.smithi110.stdout:1/580: unlink d0/da/c59 0 2024-09-16T02:06:07.865 INFO:tasks.workunit.client.0.smithi110.stdout:1/581: write d0/da/f17 [3132728,70819] 0 2024-09-16T02:06:07.866 INFO:tasks.workunit.client.0.smithi110.stdout:1/582: chown d0/d1/d2a/d32/d40/dbf 30222 1 2024-09-16T02:06:07.867 INFO:tasks.workunit.client.0.smithi110.stdout:4/562: symlink d4/d8/d31/d80/d90/lb1 0 2024-09-16T02:06:07.870 INFO:tasks.workunit.client.0.smithi110.stdout:1/583: creat d0/d1/d2a/d9a/fc3 x:0 0 0 2024-09-16T02:06:07.871 INFO:tasks.workunit.client.0.smithi110.stdout:1/584: dread - d0/d1/fa5 zero size 2024-09-16T02:06:07.871 INFO:tasks.workunit.client.0.smithi110.stdout:1/585: chown d0/d1/d4/f26 4 1 2024-09-16T02:06:07.873 INFO:tasks.workunit.client.0.smithi110.stdout:1/586: write d0/d1/d2a/f7e [3596476,100956] 0 2024-09-16T02:06:07.878 INFO:tasks.workunit.client.0.smithi110.stdout:4/563: mkdir d4/d8/d17/d23/d4c/da5/db2 0 2024-09-16T02:06:07.885 INFO:tasks.workunit.client.0.smithi110.stdout:1/587: dread d0/d1/f3f [0,4194304] 0 2024-09-16T02:06:07.886 INFO:tasks.workunit.client.0.smithi110.stdout:3/561: dwrite d8/d29/f42 [0,4194304] 0 2024-09-16T02:06:07.891 INFO:tasks.workunit.client.0.smithi110.stdout:4/564: write d4/f11 [1023248,34623] 0 2024-09-16T02:06:07.900 INFO:tasks.workunit.client.0.smithi110.stdout:4/565: dwrite d4/d8/d17/d23/d4c/d6d/f62 [0,4194304] 0 2024-09-16T02:06:07.902 INFO:tasks.workunit.client.0.smithi110.stdout:4/566: stat d4/d8/d17/d23/f74 0 2024-09-16T02:06:07.902 INFO:tasks.workunit.client.0.smithi110.stdout:3/562: dwrite d8/d48/d5b/d92/f5a [4194304,4194304] 0 2024-09-16T02:06:07.903 INFO:tasks.workunit.client.0.smithi110.stdout:4/567: dread - d4/d8/d31/d5d/fa3 zero size 2024-09-16T02:06:07.907 INFO:tasks.workunit.client.0.smithi110.stdout:3/563: rmdir d8/d48/d5b/d92/dc7/d1b/d3a/d43 39 2024-09-16T02:06:07.994 INFO:tasks.workunit.client.0.smithi110.stdout:1/588: rename d0/d1/d4/d46/d64 to d0/d1/db1/dc4 0 2024-09-16T02:06:08.140 INFO:tasks.workunit.client.0.smithi110.stdout:1/589: stat d0/d1/d4/d46/d51/c93 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:3/564: link d8/d48/d5b/d6a/lc8 d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/lc9 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:3/565: fdatasync d8/d48/f4f 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:3/566: symlink d8/d48/d5b/d92/dc7/d1b/lca 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:4/568: dwrite d4/d8/d31/d73/f7b [0,4194304] 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:1/590: dwrite d0/d1/d2a/d32/d40/f97 [0,4194304] 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:1/591: write d0/d1/d2a/f5d [556604,77202] 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:4/569: dwrite d4/d8/d17/d23/d4c/d6d/f64 [0,4194304] 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:1/592: read d0/d1/d2a/d32/f3a [955829,17655] 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:4/570: fsync d4/f14 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:1/593: truncate d0/d1/d2a/d32/f4f 4411058 0 2024-09-16T02:06:08.141 INFO:tasks.workunit.client.0.smithi110.stdout:4/571: link d4/d8/d31/d80/d18/l19 d4/d8/d31/d80/d18/lb3 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/594: rename d0/f47 to d0/d1/fc5 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:4/572: rename d4/d8/d31/d80/d3b to d4/db4 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:4/573: read d4/d8/d31/d6f/fae [649909,1017] 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/595: dwrite d0/d1/d2a/d32/d6e/f88 [0,4194304] 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:2/680: sync 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:6/679: sync 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/596: unlink d0/d1/d2a/f37 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:6/680: write d0/d2/d5/db8/fbf [360372,6902] 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:2/681: mkdir d0/db/d47/da1/dad/df3 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/597: chown d0/da/d8d/f9d 806 1 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:6/681: fdatasync d0/d2/d5/d84/f80 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:1/598: readlink d0/d1/d2a/d32/d40/l80 0 2024-09-16T02:06:08.142 INFO:tasks.workunit.client.0.smithi110.stdout:2/682: symlink d0/db/d47/d48/lf4 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:1/599: truncate d0/d1/f57 1844148 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:6/682: write d0/d2/d5/d84/d16/f72 [238875,30763] 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:4/574: dread d4/d8/d31/d80/d18/f57 [0,4194304] 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:2/683: creat d0/d5f/dc0/ddc/ddd/d18/dc/ff5 x:0 0 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:2/684: creat d0/db/d47/d48/dcd/d39/d87/ff6 x:0 0 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:6/683: getdents d0/d2 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:6/684: write d0/d29/fd3 [955568,128097] 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:4/575: write d4/d8/d31/d80/f24 [1357560,101654] 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:2/685: rmdir d0/db 39 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:4/576: rename d4/d8/d31/d80/d18/l2a to d4/d8/d31/d73/lb5 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:1/600: dread d0/d1/f57 [0,4194304] 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:4/577: symlink d4/d8/d31/d6f/lb6 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:6/685: dwrite d0/d29/d2a/d2d/fce [0,4194304] 0 2024-09-16T02:06:08.143 INFO:tasks.workunit.client.0.smithi110.stdout:4/578: creat d4/d8/d17/d23/d4c/d6d/d4f/fb7 x:0 0 0 2024-09-16T02:06:08.144 INFO:tasks.workunit.client.0.smithi110.stdout:2/686: mknod d0/db/d47/d48/dcd/d41/db3/db8/de1/cf7 0 2024-09-16T02:06:08.144 INFO:tasks.workunit.client.0.smithi110.stdout:2/687: chown d0/db/d47/d48/dcd/f4a 203 1 2024-09-16T02:06:08.144 INFO:tasks.workunit.client.0.smithi110.stdout:2/688: dwrite d0/db/d47/d48/dcd/f8a [0,4194304] 0 2024-09-16T02:06:08.145 INFO:tasks.workunit.client.0.smithi110.stdout:6/686: link d0/d2/d5/db8/d9c/ccb d0/d2/d5/d84/d62/cd5 0 2024-09-16T02:06:08.146 INFO:tasks.workunit.client.0.smithi110.stdout:2/689: dread - d0/d5f/dc0/ddc/ddd/d18/dc/fee zero size 2024-09-16T02:06:08.148 INFO:tasks.workunit.client.0.smithi110.stdout:2/690: fdatasync d0/d5f/dc0/ddc/ddd/f99 0 2024-09-16T02:06:08.151 INFO:tasks.workunit.client.0.smithi110.stdout:1/601: dwrite d0/d1/db1/dc4/f66 [0,4194304] 0 2024-09-16T02:06:08.151 INFO:tasks.workunit.client.0.smithi110.stdout:4/579: dread d4/d8/d17/d23/f4a [0,4194304] 0 2024-09-16T02:06:08.157 INFO:tasks.workunit.client.0.smithi110.stdout:6/687: dwrite d0/d29/f32 [0,4194304] 0 2024-09-16T02:06:08.157 INFO:tasks.workunit.client.0.smithi110.stdout:1/602: mknod d0/d1/d4/d46/d51/cc6 0 2024-09-16T02:06:08.158 INFO:tasks.workunit.client.0.smithi110.stdout:6/688: chown d0/d2/d5/db8/cb3 5100876 1 2024-09-16T02:06:08.159 INFO:tasks.workunit.client.0.smithi110.stdout:6/689: chown d0/d2/d57/d75/c7c 20113632 1 2024-09-16T02:06:08.163 INFO:tasks.workunit.client.0.smithi110.stdout:2/691: truncate d0/d5f/dc0/ddc/ddd/d18/dc/d9e/f67 1150248 0 2024-09-16T02:06:08.167 INFO:tasks.workunit.client.0.smithi110.stdout:2/692: symlink d0/d5f/dc0/ddc/ddd/d18/dc/d9e/lf8 0 2024-09-16T02:06:08.169 INFO:tasks.workunit.client.0.smithi110.stdout:2/693: dread - d0/db/d47/d48/dcd/d39/d87/ff6 zero size 2024-09-16T02:06:08.178 INFO:tasks.workunit.client.0.smithi110.stdout:6/690: write d0/d29/d2a/d2d/d98/fb6 [700757,90863] 0 2024-09-16T02:06:08.182 INFO:tasks.workunit.client.0.smithi110.stdout:6/691: mkdir d0/dd2/dd6 0 2024-09-16T02:06:08.184 INFO:tasks.workunit.client.0.smithi110.stdout:6/692: dread - d0/d29/fa1 zero size 2024-09-16T02:06:08.186 INFO:tasks.workunit.client.0.smithi110.stdout:6/693: write d0/d2/d5/f88 [726268,119023] 0 2024-09-16T02:06:08.187 INFO:tasks.workunit.client.0.smithi110.stdout:6/694: chown d0/d2/d5/db8/cb3 410988 1 2024-09-16T02:06:08.189 INFO:tasks.workunit.client.0.smithi110.stdout:2/694: dwrite d0/d5f/dc0/ddc/ddd/d18/f31 [0,4194304] 0 2024-09-16T02:06:08.192 INFO:tasks.workunit.client.0.smithi110.stdout:6/695: symlink d0/d29/dc1/ld7 0 2024-09-16T02:06:08.195 INFO:tasks.workunit.client.0.smithi110.stdout:4/580: dread d4/d8/d17/fa1 [0,4194304] 0 2024-09-16T02:06:08.200 INFO:tasks.workunit.client.0.smithi110.stdout:4/581: dread d4/d8/d31/d73/f7b [0,4194304] 0 2024-09-16T02:06:08.202 INFO:tasks.workunit.client.0.smithi110.stdout:4/582: dread - d4/d8/d31/d6f/d93/f96 zero size 2024-09-16T02:06:08.204 INFO:tasks.workunit.client.0.smithi110.stdout:6/696: dread d0/d2/f14 [0,4194304] 0 2024-09-16T02:06:08.206 INFO:tasks.workunit.client.0.smithi110.stdout:6/697: write d0/d29/d2a/d2d/d98/fc5 [3419501,49581] 0 2024-09-16T02:06:08.210 INFO:tasks.workunit.client.0.smithi110.stdout:4/583: creat d4/d8/d91/fb8 x:0 0 0 2024-09-16T02:06:08.217 INFO:tasks.workunit.client.0.smithi110.stdout:4/584: dwrite d4/d8/d17/d23/f37 [4194304,4194304] 0 2024-09-16T02:06:08.219 INFO:tasks.workunit.client.0.smithi110.stdout:4/585: readlink d4/d8/d31/d80/l68 0 2024-09-16T02:06:08.219 INFO:tasks.workunit.client.0.smithi110.stdout:2/695: dread d0/db/d47/da1/dad/fb6 [0,4194304] 0 2024-09-16T02:06:08.219 INFO:tasks.workunit.client.0.smithi110.stdout:4/586: truncate f3 4258196 0 2024-09-16T02:06:08.224 INFO:tasks.workunit.client.0.smithi110.stdout:2/696: mkdir d0/db/d47/d48/dcd/d41/db3/df9 0 2024-09-16T02:06:08.229 INFO:tasks.workunit.client.0.smithi110.stdout:2/697: unlink d0/db/d47/d48/cd6 0 2024-09-16T02:06:08.235 INFO:tasks.workunit.client.0.smithi110.stdout:2/698: dwrite d0/db/d47/d48/da0/ff2 [0,4194304] 0 2024-09-16T02:06:08.238 INFO:tasks.workunit.client.0.smithi110.stdout:6/698: write d0/d2/d18/f46 [804039,118179] 0 2024-09-16T02:06:08.242 INFO:tasks.workunit.client.0.smithi110.stdout:6/699: truncate d0/d2/f69 311763 0 2024-09-16T02:06:08.247 INFO:tasks.workunit.client.0.smithi110.stdout:2/699: rename d0/d5f/dc0/ddc/ddd/d18/d25 to d0/d5f/dc0/ddc/ddd/dfa 0 2024-09-16T02:06:08.248 INFO:tasks.workunit.client.0.smithi110.stdout:6/700: mkdir d0/d2/d5/db8/dd1/dd8 0 2024-09-16T02:06:08.253 INFO:tasks.workunit.client.0.smithi110.stdout:6/701: write d0/fc7 [192881,111393] 0 2024-09-16T02:06:08.255 INFO:tasks.workunit.client.0.smithi110.stdout:4/587: dwrite d4/db4/fa8 [4194304,4194304] 0 2024-09-16T02:06:08.259 INFO:tasks.workunit.client.0.smithi110.stdout:2/700: dread d0/d5f/dc0/ddc/ddd/d18/dc/f57 [0,4194304] 0 2024-09-16T02:06:08.259 INFO:tasks.workunit.client.0.smithi110.stdout:2/701: dread - d0/db/d47/d48/fe4 zero size 2024-09-16T02:06:08.263 INFO:tasks.workunit.client.0.smithi110.stdout:4/588: symlink d4/db4/lb9 0 2024-09-16T02:06:08.264 INFO:tasks.workunit.client.0.smithi110.stdout:4/589: write d4/d8/d17/d23/d4c/d6d/f7e [1123806,93848] 0 2024-09-16T02:06:08.265 INFO:tasks.workunit.client.0.smithi110.stdout:6/702: creat d0/d29/d2a/d2d/daa/fd9 x:0 0 0 2024-09-16T02:06:08.268 INFO:tasks.workunit.client.0.smithi110.stdout:6/703: stat d0/l9b 0 2024-09-16T02:06:08.269 INFO:tasks.workunit.client.0.smithi110.stdout:4/590: write d4/d8/d17/d23/d4c/d6d/d4f/f69 [442250,106926] 0 2024-09-16T02:06:08.270 INFO:tasks.workunit.client.0.smithi110.stdout:6/704: fsync d0/d2/d5/d1e/f40 0 2024-09-16T02:06:08.275 INFO:tasks.workunit.client.0.smithi110.stdout:6/705: chown d0/d2/d5/c70 1 1 2024-09-16T02:06:08.275 INFO:tasks.workunit.client.0.smithi110.stdout:4/591: getdents d4/d8/d31/d5d/d84 0 2024-09-16T02:06:08.276 INFO:tasks.workunit.client.0.smithi110.stdout:4/592: write d4/d8/d31/d80/d18/f94 [523321,14488] 0 2024-09-16T02:06:08.283 INFO:tasks.workunit.client.0.smithi110.stdout:2/702: dread d0/d5f/ff1 [0,4194304] 0 2024-09-16T02:06:08.284 INFO:tasks.workunit.client.0.smithi110.stdout:2/703: stat d0/db/d47/d48/dcd/f5a 0 2024-09-16T02:06:08.285 INFO:tasks.workunit.client.0.smithi110.stdout:4/593: getdents d4/d8/d17 0 2024-09-16T02:06:08.287 INFO:tasks.workunit.client.0.smithi110.stdout:2/704: stat d0/db/d47/da1/la3 0 2024-09-16T02:06:08.291 INFO:tasks.workunit.client.0.smithi110.stdout:4/594: symlink d4/d8/d17/d23/d4c/d6d/d3c/lba 0 2024-09-16T02:06:08.294 INFO:tasks.workunit.client.0.smithi110.stdout:2/705: creat d0/d5f/dc0/ddc/ddd/d18/dc/d9e/ffb x:0 0 0 2024-09-16T02:06:08.295 INFO:tasks.workunit.client.0.smithi110.stdout:6/706: dwrite d0/d2/d5/db8/f7e [0,4194304] 0 2024-09-16T02:06:08.302 INFO:tasks.workunit.client.0.smithi110.stdout:6/707: dwrite d0/d2/f42 [4194304,4194304] 0 2024-09-16T02:06:08.378 INFO:tasks.workunit.client.0.smithi110.stdout:2/706: creat d0/d5f/dc0/ddc/ddd/db5/ffc x:0 0 0 2024-09-16T02:06:08.386 INFO:tasks.workunit.client.0.smithi110.stdout:2/707: mkdir d0/d5f/dc0/ddc/ddd/d18/dc/dfd 0 2024-09-16T02:06:08.387 INFO:tasks.workunit.client.0.smithi110.stdout:4/595: getdents d4/d8/d17 0 2024-09-16T02:06:08.391 INFO:tasks.workunit.client.0.smithi110.stdout:6/708: getdents d0/d2/d5/d84/d16 0 2024-09-16T02:06:08.393 INFO:tasks.workunit.client.0.smithi110.stdout:6/709: chown d0/d29/d2a/d2f 21 1 2024-09-16T02:06:08.396 INFO:tasks.workunit.client.0.smithi110.stdout:4/596: dwrite d4/d8/d17/d23/d35/f9b [0,4194304] 0 2024-09-16T02:06:08.409 INFO:tasks.workunit.client.0.smithi110.stdout:2/708: dread d0/d5f/dc0/ddc/ddd/d18/dc/d9e/f7a [0,4194304] 0 2024-09-16T02:06:08.414 INFO:tasks.workunit.client.0.smithi110.stdout:2/709: write d0/d5f/dc0/ddc/ddd/d18/dc/f1c [2817551,114729] 0 2024-09-16T02:06:08.417 INFO:tasks.workunit.client.0.smithi110.stdout:6/710: dread d0/d29/d2a/d2f/f5f [0,4194304] 0 2024-09-16T02:06:08.420 INFO:tasks.workunit.client.0.smithi110.stdout:6/711: mknod d0/d2/d57/d75/cda 0 2024-09-16T02:06:08.420 INFO:tasks.workunit.client.0.smithi110.stdout:4/597: dread d4/f15 [0,4194304] 0 2024-09-16T02:06:08.422 INFO:tasks.workunit.client.0.smithi110.stdout:9/606: sync 2024-09-16T02:06:08.425 INFO:tasks.workunit.client.0.smithi110.stdout:6/712: symlink d0/d2/d5/d94/dba/ldb 0 2024-09-16T02:06:08.426 INFO:tasks.workunit.client.0.smithi110.stdout:6/713: fdatasync d0/d29/f53 0 2024-09-16T02:06:08.429 INFO:tasks.workunit.client.0.smithi110.stdout:9/607: dwrite d1/d1b/faf [0,4194304] 0 2024-09-16T02:06:08.430 INFO:tasks.workunit.client.0.smithi110.stdout:6/714: mknod d0/d2/d5/db8/d9c/cdc 0 2024-09-16T02:06:08.430 INFO:tasks.workunit.client.0.smithi110.stdout:9/608: readlink d1/d1b/l66 0 2024-09-16T02:06:08.438 INFO:tasks.workunit.client.0.smithi110.stdout:4/598: dread d4/d8/d17/d23/d4c/d6d/f3a [0,4194304] 0 2024-09-16T02:06:08.439 INFO:tasks.workunit.client.0.smithi110.stdout:9/609: rename d1/dd/d6a/d6c/d6f/d79/de/d1f/fb8 to d1/d2b/fcb 0 2024-09-16T02:06:08.441 INFO:tasks.workunit.client.0.smithi110.stdout:4/599: fsync d4/d8/d17/d23/f4a 0 2024-09-16T02:06:08.444 INFO:tasks.workunit.client.0.smithi110.stdout:9/610: mknod d1/d1b/ccc 0 2024-09-16T02:06:08.445 INFO:tasks.workunit.client.0.smithi110.stdout:4/600: fsync d4/d8/d31/d80/d18/f57 0 2024-09-16T02:06:08.451 INFO:tasks.workunit.client.0.smithi110.stdout:4/601: getdents d4/d8/d17/d23/d35 0 2024-09-16T02:06:08.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/602: creat d4/d8/d31/d80/d18/fbb x:0 0 0 2024-09-16T02:06:08.456 INFO:tasks.workunit.client.0.smithi110.stdout:9/611: dread d1/f3 [4194304,4194304] 0 2024-09-16T02:06:08.464 INFO:tasks.workunit.client.0.smithi110.stdout:9/612: symlink d1/dd/d6a/d6c/d6f/d79/de/d94/lcd 0 2024-09-16T02:06:08.467 INFO:tasks.workunit.client.0.smithi110.stdout:9/613: symlink d1/d2b/lce 0 2024-09-16T02:06:08.474 INFO:tasks.workunit.client.0.smithi110.stdout:9/614: dwrite d1/f52 [0,4194304] 0 2024-09-16T02:06:08.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/603: dread d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [4194304,4194304] 0 2024-09-16T02:06:08.483 INFO:tasks.workunit.client.0.smithi110.stdout:9/615: dwrite d1/dd/d6a/d6c/d6f/d79/d29/f97 [0,4194304] 0 2024-09-16T02:06:08.484 INFO:tasks.workunit.client.0.smithi110.stdout:4/604: link d4/d8/d31/d80/d18/f1f d4/d8/d31/d6f/fbc 0 2024-09-16T02:06:08.491 INFO:tasks.workunit.client.0.smithi110.stdout:9/616: symlink d1/dd/d6a/d6c/d6f/d79/de/d1f/lcf 0 2024-09-16T02:06:08.493 INFO:tasks.workunit.client.0.smithi110.stdout:9/617: fdatasync d1/f4f 0 2024-09-16T02:06:08.496 INFO:tasks.workunit.client.0.smithi110.stdout:9/618: mknod d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/cd0 0 2024-09-16T02:06:08.499 INFO:tasks.workunit.client.0.smithi110.stdout:9/619: mknod d1/dd/d6a/d6c/d6f/d79/de/d94/cd1 0 2024-09-16T02:06:08.507 INFO:tasks.workunit.client.0.smithi110.stdout:9/620: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/fbf [0,4194304] 0 2024-09-16T02:06:08.508 INFO:tasks.workunit.client.0.smithi110.stdout:9/621: rmdir d1/dd 39 2024-09-16T02:06:08.511 INFO:tasks.workunit.client.0.smithi110.stdout:9/622: fdatasync d1/dd/d6a/d6c/d6f/d79/d29/fb3 0 2024-09-16T02:06:08.525 INFO:tasks.workunit.client.0.smithi110.stdout:5/524: sync 2024-09-16T02:06:08.526 INFO:tasks.workunit.client.0.smithi110.stdout:5/525: fsync d5/f8c 0 2024-09-16T02:06:08.526 INFO:tasks.workunit.client.0.smithi110.stdout:9/623: dread d1/dd/d6a/d6c/d6f/d79/d26/f85 [4194304,4194304] 0 2024-09-16T02:06:08.527 INFO:tasks.workunit.client.0.smithi110.stdout:5/526: dread - d5/dd/df/d28/d9c/faa zero size 2024-09-16T02:06:08.530 INFO:tasks.workunit.client.0.smithi110.stdout:5/527: symlink d5/d71/d89/lb0 0 2024-09-16T02:06:08.531 INFO:tasks.workunit.client.0.smithi110.stdout:5/528: stat d5/dd/df/d28/d6f/d86 0 2024-09-16T02:06:08.532 INFO:tasks.workunit.client.0.smithi110.stdout:5/529: write d5/dd/df/d28/d77/fa6 [303711,8777] 0 2024-09-16T02:06:08.536 INFO:tasks.workunit.client.0.smithi110.stdout:5/530: unlink d5/dd/df/d11/f26 0 2024-09-16T02:06:08.539 INFO:tasks.workunit.client.0.smithi110.stdout:5/531: symlink d5/dd/df/d28/d6f/d86/lb1 0 2024-09-16T02:06:08.542 INFO:tasks.workunit.client.0.smithi110.stdout:5/532: dread d5/d36/d3d/f4f [4194304,4194304] 0 2024-09-16T02:06:08.543 INFO:tasks.workunit.client.0.smithi110.stdout:5/533: chown d5/l6c 4956125 1 2024-09-16T02:06:08.546 INFO:tasks.workunit.client.0.smithi110.stdout:2/710: write d0/d5f/dc0/ddc/ddd/f28 [3741059,114522] 0 2024-09-16T02:06:08.547 INFO:tasks.workunit.client.0.smithi110.stdout:2/711: readlink d0/d5f/dc0/ddc/ddd/lbf 0 2024-09-16T02:06:08.548 INFO:tasks.workunit.client.0.smithi110.stdout:2/712: dread - d0/d5f/dc0/ddc/ddd/dfa/f8f zero size 2024-09-16T02:06:08.553 INFO:tasks.workunit.client.0.smithi110.stdout:6/715: write d0/d2/d57/d75/f81 [3886000,85978] 0 2024-09-16T02:06:08.555 INFO:tasks.workunit.client.0.smithi110.stdout:6/716: creat d0/d2/d5/db8/fdd x:0 0 0 2024-09-16T02:06:08.561 INFO:tasks.workunit.client.0.smithi110.stdout:6/717: dwrite d0/d2/d5/f88 [0,4194304] 0 2024-09-16T02:06:08.574 INFO:tasks.workunit.client.0.smithi110.stdout:4/605: link d4/d8/d17/d23/f70 d4/d8/d31/d80/fbd 0 2024-09-16T02:06:08.580 INFO:tasks.workunit.client.0.smithi110.stdout:4/606: link d4/d8/d17/d23/l45 d4/d8/d17/d23/d4c/d6d/d4f/da9/lbe 0 2024-09-16T02:06:08.581 INFO:tasks.workunit.client.0.smithi110.stdout:4/607: read d4/d8/d17/d23/d4c/d6d/f62 [2207097,50821] 0 2024-09-16T02:06:08.601 INFO:tasks.workunit.client.0.smithi110.stdout:9/624: write d1/dd/f87 [413169,4949] 0 2024-09-16T02:06:08.606 INFO:tasks.workunit.client.0.smithi110.stdout:9/625: rmdir d1/d1b/daa 39 2024-09-16T02:06:08.607 INFO:tasks.workunit.client.0.smithi110.stdout:9/626: readlink d1/d5/d20/d83/l96 0 2024-09-16T02:06:08.610 INFO:tasks.workunit.client.0.smithi110.stdout:9/627: rmdir d1/d1b/d23 39 2024-09-16T02:06:08.612 INFO:tasks.workunit.client.0.smithi110.stdout:9/628: truncate d1/dd/d6a/d6c/d6f/f7e 577928 0 2024-09-16T02:06:08.616 INFO:tasks.workunit.client.0.smithi110.stdout:9/629: symlink d1/dd/d6a/d6c/d6f/d79/d29/db4/ld2 0 2024-09-16T02:06:08.618 INFO:tasks.workunit.client.0.smithi110.stdout:5/534: write d5/dd/f10 [2953045,24437] 0 2024-09-16T02:06:08.621 INFO:tasks.workunit.client.0.smithi110.stdout:2/713: write d0/db/d47/d48/dcd/f66 [2065557,49870] 0 2024-09-16T02:06:08.627 INFO:tasks.workunit.client.0.smithi110.stdout:9/630: dwrite d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/fc3 [0,4194304] 0 2024-09-16T02:06:08.627 INFO:tasks.workunit.client.0.smithi110.stdout:5/535: symlink d5/dd/d90/lb2 0 2024-09-16T02:06:08.632 INFO:tasks.workunit.client.0.smithi110.stdout:4/608: truncate d4/d8/d17/d23/d4c/d6d/f7e 1132913 0 2024-09-16T02:06:08.634 INFO:tasks.workunit.client.0.smithi110.stdout:9/631: creat d1/dd/d6a/d6c/d6f/d79/d29/db4/fd3 x:0 0 0 2024-09-16T02:06:08.634 INFO:tasks.workunit.client.0.smithi110.stdout:2/714: dwrite d0/db/d47/d48/dcd/d58/fa6 [0,4194304] 0 2024-09-16T02:06:08.636 INFO:tasks.workunit.client.0.smithi110.stdout:5/536: mknod d5/dd/df/d28/d6f/d86/cb3 0 2024-09-16T02:06:08.638 INFO:tasks.workunit.client.0.smithi110.stdout:2/715: creat d0/db/d47/d48/daa/ffe x:0 0 0 2024-09-16T02:06:08.640 INFO:tasks.workunit.client.0.smithi110.stdout:5/537: creat d5/dd/df/d92/fb4 x:0 0 0 2024-09-16T02:06:08.643 INFO:tasks.workunit.client.0.smithi110.stdout:5/538: read d5/f51 [341619,88967] 0 2024-09-16T02:06:08.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/716: mknod d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/cff 0 2024-09-16T02:06:08.650 INFO:tasks.workunit.client.0.smithi110.stdout:2/717: write d0/db/d47/d48/fc4 [61667,84300] 0 2024-09-16T02:06:08.651 INFO:tasks.workunit.client.0.smithi110.stdout:2/718: fsync d0/db/f83 0 2024-09-16T02:06:08.652 INFO:tasks.workunit.client.0.smithi110.stdout:2/719: chown d0/db/d47/lb4 92754 1 2024-09-16T02:06:08.653 INFO:tasks.workunit.client.0.smithi110.stdout:5/539: mkdir d5/d36/db5 0 2024-09-16T02:06:08.654 INFO:tasks.workunit.client.0.smithi110.stdout:5/540: write d5/f2c [264606,14082] 0 2024-09-16T02:06:08.656 INFO:tasks.workunit.client.0.smithi110.stdout:2/720: rmdir d0/d5f/dc0/ddc/ddd/d18 39 2024-09-16T02:06:08.660 INFO:tasks.workunit.client.0.smithi110.stdout:9/632: truncate d1/dd/d6a/d6c/d6f/f7e 299148 0 2024-09-16T02:06:08.662 INFO:tasks.workunit.client.0.smithi110.stdout:9/633: mkdir d1/dd/d6a/d6c/d75/d8c/d38/d3d/dd4 0 2024-09-16T02:06:08.665 INFO:tasks.workunit.client.0.smithi110.stdout:9/634: mknod d1/dd/d6a/d6c/d6f/d79/de/cd5 0 2024-09-16T02:06:08.666 INFO:tasks.workunit.client.0.smithi110.stdout:9/635: write d1/dd/d6a/d6c/d6f/d79/de/d1f/fc5 [804501,49357] 0 2024-09-16T02:06:08.668 INFO:tasks.workunit.client.0.smithi110.stdout:9/636: chown d1/d1b/f1d 0 1 2024-09-16T02:06:08.670 INFO:tasks.workunit.client.0.smithi110.stdout:5/541: truncate d5/dd/f12 3150327 0 2024-09-16T02:06:08.671 INFO:tasks.workunit.client.0.smithi110.stdout:5/542: dread - d5/d36/d3d/f9a zero size 2024-09-16T02:06:08.675 INFO:tasks.workunit.client.0.smithi110.stdout:9/637: dwrite d1/d2b/fcb [0,4194304] 0 2024-09-16T02:06:08.679 INFO:tasks.workunit.client.0.smithi110.stdout:9/638: mkdir d1/d1b/dd6 0 2024-09-16T02:06:08.680 INFO:tasks.workunit.client.0.smithi110.stdout:9/639: stat d1/dd/d6a/c9c 0 2024-09-16T02:06:08.682 INFO:tasks.workunit.client.0.smithi110.stdout:5/543: truncate d5/d36/d45/d47/f57 202309 0 2024-09-16T02:06:08.686 INFO:tasks.workunit.client.0.smithi110.stdout:9/640: creat d1/dd/d6a/fd7 x:0 0 0 2024-09-16T02:06:08.689 INFO:tasks.workunit.client.0.smithi110.stdout:9/641: creat d1/d5/d20/d55/d82/fd8 x:0 0 0 2024-09-16T02:06:08.691 INFO:tasks.workunit.client.0.smithi110.stdout:9/642: creat d1/dd/d6a/d6c/d6f/fd9 x:0 0 0 2024-09-16T02:06:08.694 INFO:tasks.workunit.client.0.smithi110.stdout:5/544: write d5/dd/f43 [4137929,45669] 0 2024-09-16T02:06:08.699 INFO:tasks.workunit.client.0.smithi110.stdout:5/545: dread d5/dd/df/f38 [0,4194304] 0 2024-09-16T02:06:08.700 INFO:tasks.workunit.client.0.smithi110.stdout:5/546: dread - d5/dd/df/d28/d6f/f9d zero size 2024-09-16T02:06:08.703 INFO:tasks.workunit.client.0.smithi110.stdout:5/547: unlink d5/dd/df/d28/c6a 0 2024-09-16T02:06:08.707 INFO:tasks.workunit.client.0.smithi110.stdout:5/548: getdents d5/dd/df/d92 0 2024-09-16T02:06:08.708 INFO:tasks.workunit.client.0.smithi110.stdout:9/643: dread d1/d1b/f6e [0,4194304] 0 2024-09-16T02:06:08.710 INFO:tasks.workunit.client.0.smithi110.stdout:5/549: creat d5/d71/d89/fb6 x:0 0 0 2024-09-16T02:06:08.711 INFO:tasks.workunit.client.0.smithi110.stdout:5/550: chown d5/d36/d3d/l4e 48 1 2024-09-16T02:06:08.711 INFO:tasks.workunit.client.0.smithi110.stdout:5/551: write f4 [2060870,118309] 0 2024-09-16T02:06:08.712 INFO:tasks.workunit.client.0.smithi110.stdout:5/552: chown d5/d36/f67 25 1 2024-09-16T02:06:08.713 INFO:tasks.workunit.client.0.smithi110.stdout:9/644: symlink d1/d5/d20/d55/d82/lda 0 2024-09-16T02:06:08.719 INFO:tasks.workunit.client.0.smithi110.stdout:5/553: chown d5/dd/df/d11/fa2 1326043 1 2024-09-16T02:06:08.720 INFO:tasks.workunit.client.0.smithi110.stdout:9/645: creat d1/dd/d6a/d6c/d6f/fdb x:0 0 0 2024-09-16T02:06:08.723 INFO:tasks.workunit.client.0.smithi110.stdout:5/554: mknod d5/dd/df/d28/cb7 0 2024-09-16T02:06:08.727 INFO:tasks.workunit.client.0.smithi110.stdout:5/555: read d5/f59 [206310,97531] 0 2024-09-16T02:06:08.728 INFO:tasks.workunit.client.0.smithi110.stdout:5/556: truncate d5/d36/d3d/f9a 90788 0 2024-09-16T02:06:08.737 INFO:tasks.workunit.client.0.smithi110.stdout:9/646: getdents d1/dd/d6a/d6c/d6f/d79 0 2024-09-16T02:06:08.740 INFO:tasks.workunit.client.0.smithi110.stdout:9/647: dread d1/f52 [0,4194304] 0 2024-09-16T02:06:08.741 INFO:tasks.workunit.client.0.smithi110.stdout:5/557: getdents d5/d71/d89 0 2024-09-16T02:06:08.743 INFO:tasks.workunit.client.0.smithi110.stdout:5/558: mknod d5/d36/d3d/cb8 0 2024-09-16T02:06:08.744 INFO:tasks.workunit.client.0.smithi110.stdout:9/648: rmdir d1/dd/d6a/d6c/d6f/d79/d26/d8e 39 2024-09-16T02:06:08.748 INFO:tasks.workunit.client.0.smithi110.stdout:5/559: creat d5/dd/df/d11/fb9 x:0 0 0 2024-09-16T02:06:08.748 INFO:tasks.workunit.client.0.smithi110.stdout:5/560: chown d5/d71/d89 19690047 1 2024-09-16T02:06:08.752 INFO:tasks.workunit.client.0.smithi110.stdout:9/649: link d1/d5/d20/c89 d1/d1b/d23/d7c/cdc 0 2024-09-16T02:06:08.753 INFO:tasks.workunit.client.0.smithi110.stdout:9/650: write d1/d5/d20/d55/d82/fd8 [187449,8822] 0 2024-09-16T02:06:08.754 INFO:tasks.workunit.client.0.smithi110.stdout:9/651: write d1/dd/d6a/fd7 [991931,47478] 0 2024-09-16T02:06:08.756 INFO:tasks.workunit.client.0.smithi110.stdout:5/561: write d5/f61 [89011,5181] 0 2024-09-16T02:06:08.757 INFO:tasks.workunit.client.0.smithi110.stdout:5/562: chown d5/dd 1342 1 2024-09-16T02:06:08.759 INFO:tasks.workunit.client.0.smithi110.stdout:5/563: symlink d5/dd/df/d28/lba 0 2024-09-16T02:06:08.759 INFO:tasks.workunit.client.0.smithi110.stdout:5/564: chown d5/f61 2577256 1 2024-09-16T02:06:08.760 INFO:tasks.workunit.client.0.smithi110.stdout:3/567: sync 2024-09-16T02:06:08.760 INFO:tasks.workunit.client.0.smithi110.stdout:1/603: sync 2024-09-16T02:06:08.760 INFO:tasks.workunit.client.0.smithi110.stdout:7/444: sync 2024-09-16T02:06:08.760 INFO:tasks.workunit.client.0.smithi110.stdout:0/637: sync 2024-09-16T02:06:08.761 INFO:tasks.workunit.client.0.smithi110.stdout:8/473: sync 2024-09-16T02:06:08.761 INFO:tasks.workunit.client.0.smithi110.stdout:5/565: write d5/dd/f4c [4645508,13328] 0 2024-09-16T02:06:08.763 INFO:tasks.workunit.client.0.smithi110.stdout:3/568: dread - d8/d48/d7c/d87/da9/fc2 zero size 2024-09-16T02:06:08.763 INFO:tasks.workunit.client.0.smithi110.stdout:0/638: chown d3/d6/d43/da7/fbe 109605 1 2024-09-16T02:06:08.764 INFO:tasks.workunit.client.0.smithi110.stdout:8/474: write d3/d12/d1d/f71 [3221675,97336] 0 2024-09-16T02:06:08.767 INFO:tasks.workunit.client.0.smithi110.stdout:9/652: truncate d1/dd/d6a/d6c/d6f/d79/d29/f97 2474409 0 2024-09-16T02:06:08.768 INFO:tasks.workunit.client.0.smithi110.stdout:7/445: mkdir d3/d15/d81 0 2024-09-16T02:06:08.771 INFO:tasks.workunit.client.0.smithi110.stdout:1/604: rename d0/d25/c27 to d0/d1/d2a/d32/d9f/cc7 0 2024-09-16T02:06:08.772 INFO:tasks.workunit.client.0.smithi110.stdout:7/446: rmdir d3/d15/d38/d4f/d10/d11/d73 39 2024-09-16T02:06:08.773 INFO:tasks.workunit.client.0.smithi110.stdout:1/605: chown d0/d1/db1/dc4/d79 49 1 2024-09-16T02:06:08.774 INFO:tasks.workunit.client.0.smithi110.stdout:9/653: dwrite d1/f3 [0,4194304] 0 2024-09-16T02:06:08.777 INFO:tasks.workunit.client.0.smithi110.stdout:1/606: read d0/d1/d4/d46/f5e [1780039,29260] 0 2024-09-16T02:06:08.778 INFO:tasks.workunit.client.0.smithi110.stdout:3/569: symlink d8/d48/d5b/d6a/d75/da8/lcb 0 2024-09-16T02:06:08.781 INFO:tasks.workunit.client.0.smithi110.stdout:8/475: dread d3/d12/d1a/d36/d87/f90 [4194304,4194304] 0 2024-09-16T02:06:08.782 INFO:tasks.workunit.client.0.smithi110.stdout:7/447: rename d3/d15/d38/d4f/f6e to d3/d15/d81/f82 0 2024-09-16T02:06:08.782 INFO:tasks.workunit.client.0.smithi110.stdout:8/476: stat d3/d2b/l6f 0 2024-09-16T02:06:08.786 INFO:tasks.workunit.client.0.smithi110.stdout:5/566: truncate d5/f13 3450813 0 2024-09-16T02:06:08.790 INFO:tasks.workunit.client.0.smithi110.stdout:1/607: dwrite d0/d1/d4/d46/d7a/fb2 [0,4194304] 0 2024-09-16T02:06:08.792 INFO:tasks.workunit.client.0.smithi110.stdout:3/570: rename d8/d48/d7c/d87/da9/fc2 to d8/d48/d7c/d87/da9/fcc 0 2024-09-16T02:06:08.795 INFO:tasks.workunit.client.0.smithi110.stdout:3/571: fsync d8/d48/f4f 0 2024-09-16T02:06:08.795 INFO:tasks.workunit.client.0.smithi110.stdout:9/654: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f76 [4194304,4194304] 0 2024-09-16T02:06:08.800 INFO:tasks.workunit.client.0.smithi110.stdout:7/448: creat d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 x:0 0 0 2024-09-16T02:06:08.801 INFO:tasks.workunit.client.0.smithi110.stdout:8/477: dread d3/d12/d1a/d36/d60/f64 [0,4194304] 0 2024-09-16T02:06:08.802 INFO:tasks.workunit.client.0.smithi110.stdout:5/567: creat d5/dd/df/d28/d6f/d86/fbb x:0 0 0 2024-09-16T02:06:08.804 INFO:tasks.workunit.client.0.smithi110.stdout:5/568: chown d5/dd/df/f35 708645 1 2024-09-16T02:06:08.806 INFO:tasks.workunit.client.0.smithi110.stdout:9/655: dwrite d1/dd/d6a/d6c/d75/d8c/f4d [0,4194304] 0 2024-09-16T02:06:08.806 INFO:tasks.workunit.client.0.smithi110.stdout:1/608: creat d0/da/fc8 x:0 0 0 2024-09-16T02:06:08.807 INFO:tasks.workunit.client.0.smithi110.stdout:1/609: chown d0/d1/d2a/l2d 4140478 1 2024-09-16T02:06:08.808 INFO:tasks.workunit.client.0.smithi110.stdout:5/569: truncate d5/dd/df/d28/f93 1146164 0 2024-09-16T02:06:08.813 INFO:tasks.workunit.client.0.smithi110.stdout:3/572: unlink d8/c20 0 2024-09-16T02:06:08.820 INFO:tasks.workunit.client.0.smithi110.stdout:1/610: creat d0/d1/d2a/d32/d6e/fc9 x:0 0 0 2024-09-16T02:06:08.821 INFO:tasks.workunit.client.0.smithi110.stdout:1/611: chown d0/d25/d63/f89 697 1 2024-09-16T02:06:08.823 INFO:tasks.workunit.client.0.smithi110.stdout:3/573: symlink d8/d48/d5b/d92/dc7/d1b/d36/d57/d64/lcd 0 2024-09-16T02:06:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:7/449: mknod d3/d7a/c84 0 2024-09-16T02:06:08.825 INFO:tasks.workunit.client.0.smithi110.stdout:8/478: link d3/d12/d1a/d36/f8b d3/d12/d1a/fa2 0 2024-09-16T02:06:08.827 INFO:tasks.workunit.client.0.smithi110.stdout:9/656: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd 0 2024-09-16T02:06:08.828 INFO:tasks.workunit.client.0.smithi110.stdout:1/612: unlink d0/d1/f68 0 2024-09-16T02:06:08.830 INFO:tasks.workunit.client.0.smithi110.stdout:5/570: write d5/dd/df/f38 [398274,110874] 0 2024-09-16T02:06:08.830 INFO:tasks.workunit.client.0.smithi110.stdout:1/613: chown d0/d1/d2a/d32/d6e/l8c 32420098 1 2024-09-16T02:06:08.831 INFO:tasks.workunit.client.0.smithi110.stdout:7/450: creat d3/d15/d38/d4f/d10/d2c/f85 x:0 0 0 2024-09-16T02:06:08.832 INFO:tasks.workunit.client.0.smithi110.stdout:8/479: rmdir d3/d2b/d27/d45/d86 39 2024-09-16T02:06:08.833 INFO:tasks.workunit.client.0.smithi110.stdout:9/657: creat d1/dd/d6a/d6c/d6f/fde x:0 0 0 2024-09-16T02:06:08.835 INFO:tasks.workunit.client.0.smithi110.stdout:1/614: readlink d0/d1/l74 0 2024-09-16T02:06:08.835 INFO:tasks.workunit.client.0.smithi110.stdout:9/658: write d1/dd/d6a/d6c/d6f/d79/d26/fc0 [418556,124817] 0 2024-09-16T02:06:08.846 INFO:tasks.workunit.client.0.smithi110.stdout:7/451: getdents d3/d7a 0 2024-09-16T02:06:08.849 INFO:tasks.workunit.client.0.smithi110.stdout:7/452: creat d3/d15/d38/d4f/d10/d2c/f86 x:0 0 0 2024-09-16T02:06:08.852 INFO:tasks.workunit.client.0.smithi110.stdout:1/615: write d0/d1/d2a/f78 [747499,45796] 0 2024-09-16T02:06:08.855 INFO:tasks.workunit.client.0.smithi110.stdout:7/453: rename d3/l54 to d3/d15/d38/l87 0 2024-09-16T02:06:08.857 INFO:tasks.workunit.client.0.smithi110.stdout:8/480: dwrite d3/d31/f50 [0,4194304] 0 2024-09-16T02:06:08.862 INFO:tasks.workunit.client.0.smithi110.stdout:9/659: dwrite d1/d5/d20/f74 [0,4194304] 0 2024-09-16T02:06:08.871 INFO:tasks.workunit.client.0.smithi110.stdout:8/481: symlink d3/d2b/d27/d45/d66/d6b/d8d/la3 0 2024-09-16T02:06:08.871 INFO:tasks.workunit.client.0.smithi110.stdout:8/482: read - d3/d31/f9f zero size 2024-09-16T02:06:08.872 INFO:tasks.workunit.client.0.smithi110.stdout:9/660: mkdir d1/dd/d6a/d6c/d6f/d79/de/ddf 0 2024-09-16T02:06:08.873 INFO:tasks.workunit.client.0.smithi110.stdout:7/454: truncate d3/f27 3861950 0 2024-09-16T02:06:08.873 INFO:tasks.workunit.client.0.smithi110.stdout:1/616: link d0/da/l2e d0/da/lca 0 2024-09-16T02:06:08.875 INFO:tasks.workunit.client.0.smithi110.stdout:1/617: readlink d0/d1/db1/dc4/lac 0 2024-09-16T02:06:08.876 INFO:tasks.workunit.client.0.smithi110.stdout:8/483: rename d3/c96 to d3/d2b/d27/ca4 0 2024-09-16T02:06:08.877 INFO:tasks.workunit.client.0.smithi110.stdout:9/661: symlink d1/d2b/le0 0 2024-09-16T02:06:08.880 INFO:tasks.workunit.client.0.smithi110.stdout:1/618: creat d0/d91/fcb x:0 0 0 2024-09-16T02:06:08.881 INFO:tasks.workunit.client.0.smithi110.stdout:7/455: mkdir d3/d15/d38/d4f/d10/d76/d88 0 2024-09-16T02:06:08.881 INFO:tasks.workunit.client.0.smithi110.stdout:1/619: chown d0/d1/d4/d46/d75/fb9 58 1 2024-09-16T02:06:08.883 INFO:tasks.workunit.client.0.smithi110.stdout:8/484: creat d3/d2b/d65/d7f/fa5 x:0 0 0 2024-09-16T02:06:08.885 INFO:tasks.workunit.client.0.smithi110.stdout:7/456: symlink d3/d15/d81/l89 0 2024-09-16T02:06:08.885 INFO:tasks.workunit.client.0.smithi110.stdout:1/620: creat d0/d1/d4/d46/d7a/fcc x:0 0 0 2024-09-16T02:06:08.887 INFO:tasks.workunit.client.0.smithi110.stdout:9/662: creat d1/d2b/fe1 x:0 0 0 2024-09-16T02:06:08.889 INFO:tasks.workunit.client.0.smithi110.stdout:7/457: mknod d3/d7a/c8a 0 2024-09-16T02:06:08.889 INFO:tasks.workunit.client.0.smithi110.stdout:1/621: creat d0/d1/db1/fcd x:0 0 0 2024-09-16T02:06:08.897 INFO:tasks.workunit.client.0.smithi110.stdout:7/458: creat d3/d15/d38/d4f/d2e/f8b x:0 0 0 2024-09-16T02:06:08.905 INFO:tasks.workunit.client.0.smithi110.stdout:1/622: dread d0/d1/f3f [0,4194304] 0 2024-09-16T02:06:08.915 INFO:tasks.workunit.client.0.smithi110.stdout:8/485: dwrite d3/f3c [0,4194304] 0 2024-09-16T02:06:08.918 INFO:tasks.workunit.client.0.smithi110.stdout:9/663: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/f4a [0,4194304] 0 2024-09-16T02:06:08.919 INFO:tasks.workunit.client.0.smithi110.stdout:9/664: chown d1/d5/d20/c8f 2 1 2024-09-16T02:06:08.935 INFO:tasks.workunit.client.0.smithi110.stdout:7/459: rmdir d3/d15/d38/d4f/d10/d11/d3e/d40 39 2024-09-16T02:06:08.936 INFO:tasks.workunit.client.0.smithi110.stdout:1/623: mknod d0/da/d7c/cce 0 2024-09-16T02:06:08.939 INFO:tasks.workunit.client.0.smithi110.stdout:8/486: mknod d3/d12/d8f/ca6 0 2024-09-16T02:06:08.940 INFO:tasks.workunit.client.0.smithi110.stdout:9/665: fsync d1/dd/d6a/d6c/d75/f7b 0 2024-09-16T02:06:08.943 INFO:tasks.workunit.client.0.smithi110.stdout:1/624: creat d0/da/fcf x:0 0 0 2024-09-16T02:06:08.944 INFO:tasks.workunit.client.0.smithi110.stdout:8/487: dread d3/d12/d1a/d36/d87/f90 [4194304,4194304] 0 2024-09-16T02:06:08.948 INFO:tasks.workunit.client.0.smithi110.stdout:1/625: mkdir d0/d1/db1/dd0 0 2024-09-16T02:06:08.951 INFO:tasks.workunit.client.0.smithi110.stdout:1/626: creat d0/d25/d63/fd1 x:0 0 0 2024-09-16T02:06:08.953 INFO:tasks.workunit.client.0.smithi110.stdout:1/627: creat d0/da/fd2 x:0 0 0 2024-09-16T02:06:08.956 INFO:tasks.workunit.client.0.smithi110.stdout:1/628: rename d0/d1/d2a/d32/d6e/fc9 to d0/d1/d2a/d32/d40/dbf/fd3 0 2024-09-16T02:06:08.965 INFO:tasks.workunit.client.0.smithi110.stdout:7/460: write f1 [2136358,62159] 0 2024-09-16T02:06:08.966 INFO:tasks.workunit.client.0.smithi110.stdout:9/666: write d1/dd/d6a/d6c/d6f/d79/d26/d8e/fa5 [4156932,101130] 0 2024-09-16T02:06:08.969 INFO:tasks.workunit.client.0.smithi110.stdout:7/461: write d3/d15/d38/d4f/fd [1744492,11741] 0 2024-09-16T02:06:08.969 INFO:tasks.workunit.client.0.smithi110.stdout:1/629: rmdir d0/d1/d2a/d32/d6e 39 2024-09-16T02:06:08.971 INFO:tasks.workunit.client.0.smithi110.stdout:9/667: mknod d1/d1b/ce2 0 2024-09-16T02:06:08.973 INFO:tasks.workunit.client.0.smithi110.stdout:8/488: dwrite d3/d2b/d27/f46 [0,4194304] 0 2024-09-16T02:06:08.976 INFO:tasks.workunit.client.0.smithi110.stdout:8/489: chown d3/d12/d1a/d36/d60/d62/d5f/d98 35521 1 2024-09-16T02:06:08.977 INFO:tasks.workunit.client.0.smithi110.stdout:1/630: dread d0/da/d8d/f99 [0,4194304] 0 2024-09-16T02:06:08.977 INFO:tasks.workunit.client.0.smithi110.stdout:9/668: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe3 x:0 0 0 2024-09-16T02:06:08.978 INFO:tasks.workunit.client.0.smithi110.stdout:7/462: getdents d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e 0 2024-09-16T02:06:08.979 INFO:tasks.workunit.client.0.smithi110.stdout:1/631: rmdir d0 39 2024-09-16T02:06:08.979 INFO:tasks.workunit.client.0.smithi110.stdout:9/669: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e 208631 1 2024-09-16T02:06:08.982 INFO:tasks.workunit.client.0.smithi110.stdout:9/670: chown d1/dd/d6a/d6c/d75 3 1 2024-09-16T02:06:08.982 INFO:tasks.workunit.client.0.smithi110.stdout:9/671: chown d1 92 1 2024-09-16T02:06:08.983 INFO:tasks.workunit.client.0.smithi110.stdout:1/632: fdatasync d0/d1/d2a/f5d 0 2024-09-16T02:06:08.983 INFO:tasks.workunit.client.0.smithi110.stdout:7/463: mknod d3/d15/d38/d4f/d10/c8c 0 2024-09-16T02:06:08.985 INFO:tasks.workunit.client.0.smithi110.stdout:8/490: dwrite d3/d12/d1a/d36/d60/d62/fa0 [0,4194304] 0 2024-09-16T02:06:08.986 INFO:tasks.workunit.client.0.smithi110.stdout:8/491: chown d3/f85 25 1 2024-09-16T02:06:08.987 INFO:tasks.workunit.client.0.smithi110.stdout:1/633: truncate d0/da/fc8 62431 0 2024-09-16T02:06:08.988 INFO:tasks.workunit.client.0.smithi110.stdout:9/672: chown d1/dd/d6a/d6c/d6f/f7e 748 1 2024-09-16T02:06:08.988 INFO:tasks.workunit.client.0.smithi110.stdout:7/464: fsync d3/d15/d38/d4f/d10/d11/f75 0 2024-09-16T02:06:08.989 INFO:tasks.workunit.client.0.smithi110.stdout:8/492: chown d3/d12/d1a/d36/c42 419 1 2024-09-16T02:06:08.989 INFO:tasks.workunit.client.0.smithi110.stdout:7/465: fdatasync d3/f19 0 2024-09-16T02:06:08.993 INFO:tasks.workunit.client.0.smithi110.stdout:1/634: symlink d0/d1/d2a/d32/ld4 0 2024-09-16T02:06:08.996 INFO:tasks.workunit.client.0.smithi110.stdout:7/466: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/f60 [0,4194304] 0 2024-09-16T02:06:09.002 INFO:tasks.workunit.client.0.smithi110.stdout:1/635: chown d0/d1/d2a/d32/d6e/f6f 3 1 2024-09-16T02:06:09.003 INFO:tasks.workunit.client.0.smithi110.stdout:9/673: getdents d1/d5 0 2024-09-16T02:06:09.004 INFO:tasks.workunit.client.0.smithi110.stdout:7/467: creat d3/d15/d38/f8d x:0 0 0 2024-09-16T02:06:09.006 INFO:tasks.workunit.client.0.smithi110.stdout:9/674: mknod d1/d1b/d23/d7c/ce4 0 2024-09-16T02:06:09.007 INFO:tasks.workunit.client.0.smithi110.stdout:1/636: creat d0/d1/db1/dd0/fd5 x:0 0 0 2024-09-16T02:06:09.007 INFO:tasks.workunit.client.0.smithi110.stdout:8/493: write d3/f44 [4314074,72080] 0 2024-09-16T02:06:09.009 INFO:tasks.workunit.client.0.smithi110.stdout:8/494: stat d3/d12/d1a/d36/d60/f81 0 2024-09-16T02:06:09.011 INFO:tasks.workunit.client.0.smithi110.stdout:7/468: rename d3/d15/d38/d4f/d10/d11/f2b to d3/d15/d38/d4f/d10/d11/d73/d7b/f8e 0 2024-09-16T02:06:09.016 INFO:tasks.workunit.client.0.smithi110.stdout:8/495: chown d3/d2b/d27/d45/d86/l89 1739499 1 2024-09-16T02:06:09.016 INFO:tasks.workunit.client.0.smithi110.stdout:8/496: chown d3/d2b/d27/d45/d66/d6b/d8d 2592 1 2024-09-16T02:06:09.017 INFO:tasks.workunit.client.0.smithi110.stdout:9/675: link d1/d2b/fcb d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe5 0 2024-09-16T02:06:09.023 INFO:tasks.workunit.client.0.smithi110.stdout:9/676: rmdir d1/dd 39 2024-09-16T02:06:09.025 INFO:tasks.workunit.client.0.smithi110.stdout:7/469: write d3/d15/d38/d4f/d10/d11/d3e/d40/f4b [5112113,80265] 0 2024-09-16T02:06:09.026 INFO:tasks.workunit.client.0.smithi110.stdout:1/637: dwrite d0/d1/f20 [0,4194304] 0 2024-09-16T02:06:09.026 INFO:tasks.workunit.client.0.smithi110.stdout:8/497: write d3/d31/f5a [800514,5078] 0 2024-09-16T02:06:09.027 INFO:tasks.workunit.client.0.smithi110.stdout:1/638: chown d0/d1/d4/f18 96 1 2024-09-16T02:06:09.031 INFO:tasks.workunit.client.0.smithi110.stdout:9/677: rmdir d1/dd/d6a/d6c 39 2024-09-16T02:06:09.034 INFO:tasks.workunit.client.0.smithi110.stdout:1/639: rename d0/d1/db1/dc4/c84 to d0/d1/d4/cd6 0 2024-09-16T02:06:09.035 INFO:tasks.workunit.client.0.smithi110.stdout:9/678: creat d1/d5/d20/d55/d82/fe6 x:0 0 0 2024-09-16T02:06:09.037 INFO:tasks.workunit.client.0.smithi110.stdout:9/679: readlink d1/d1b/l24 0 2024-09-16T02:06:09.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/498: dwrite d3/f9 [4194304,4194304] 0 2024-09-16T02:06:09.069 INFO:tasks.workunit.client.0.smithi110.stdout:1/640: rename d0/d91 to d0/d1/d4/d46/dd7 0 2024-09-16T02:06:09.069 INFO:tasks.workunit.client.0.smithi110.stdout:9/680: mkdir d1/dd/d6a/de7 0 2024-09-16T02:06:09.070 INFO:tasks.workunit.client.0.smithi110.stdout:1/641: fdatasync d0/d25/f42 0 2024-09-16T02:06:09.073 INFO:tasks.workunit.client.0.smithi110.stdout:8/499: getdents d3/d12/d1d 0 2024-09-16T02:06:09.075 INFO:tasks.workunit.client.0.smithi110.stdout:9/681: creat d1/dd/d6a/d6c/d6f/d79/de/d1f/fe8 x:0 0 0 2024-09-16T02:06:09.078 INFO:tasks.workunit.client.0.smithi110.stdout:1/642: dwrite d0/d1/fbb [0,4194304] 0 2024-09-16T02:06:09.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/682: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/fe9 x:0 0 0 2024-09-16T02:06:09.085 INFO:tasks.workunit.client.0.smithi110.stdout:9/683: chown d1/d1b/f1d 0 1 2024-09-16T02:06:09.087 INFO:tasks.workunit.client.0.smithi110.stdout:9/684: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/fea x:0 0 0 2024-09-16T02:06:09.088 INFO:tasks.workunit.client.0.smithi110.stdout:9/685: write d1/d5/fb6 [268015,68600] 0 2024-09-16T02:06:09.092 INFO:tasks.workunit.client.0.smithi110.stdout:9/686: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/feb x:0 0 0 2024-09-16T02:06:09.092 INFO:tasks.workunit.client.0.smithi110.stdout:8/500: dread d3/d12/d1a/d36/d87/f93 [0,4194304] 0 2024-09-16T02:06:09.094 INFO:tasks.workunit.client.0.smithi110.stdout:8/501: fsync d3/d12/d1a/d36/d60/d62/fa0 0 2024-09-16T02:06:09.095 INFO:tasks.workunit.client.0.smithi110.stdout:1/643: dwrite d0/da/f2c [0,4194304] 0 2024-09-16T02:06:09.096 INFO:tasks.workunit.client.0.smithi110.stdout:9/687: symlink d1/lec 0 2024-09-16T02:06:09.098 INFO:tasks.workunit.client.0.smithi110.stdout:8/502: fsync d3/d2b/f70 0 2024-09-16T02:06:09.102 INFO:tasks.workunit.client.0.smithi110.stdout:1/644: symlink d0/d1/ld8 0 2024-09-16T02:06:09.105 INFO:tasks.workunit.client.0.smithi110.stdout:8/503: rename d3/d12 to d3/d2b/d27/da7 0 2024-09-16T02:06:09.107 INFO:tasks.workunit.client.0.smithi110.stdout:9/688: mkdir d1/d1b/daa/ded 0 2024-09-16T02:06:09.109 INFO:tasks.workunit.client.0.smithi110.stdout:1/645: rmdir d0/d1/db1/dd0 39 2024-09-16T02:06:09.110 INFO:tasks.workunit.client.0.smithi110.stdout:8/504: dread d3/d2b/d27/da7/d1a/d36/d87/f93 [0,4194304] 0 2024-09-16T02:06:09.111 INFO:tasks.workunit.client.0.smithi110.stdout:8/505: stat d3/d2b/d27/da7/d8f/c79 0 2024-09-16T02:06:09.113 INFO:tasks.workunit.client.0.smithi110.stdout:9/689: symlink d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd/lee 0 2024-09-16T02:06:09.114 INFO:tasks.workunit.client.0.smithi110.stdout:8/506: mkdir d3/d2b/d27/da7/d1a/d36/d60/d62/d5f/da8 0 2024-09-16T02:06:09.115 INFO:tasks.workunit.client.0.smithi110.stdout:9/690: readlink d1/d1b/l8a 0 2024-09-16T02:06:09.116 INFO:tasks.workunit.client.0.smithi110.stdout:1/646: getdents d0/d1/d4/d46/dd7 0 2024-09-16T02:06:09.124 INFO:tasks.workunit.client.0.smithi110.stdout:9/691: truncate d1/d2b/f2d 2012958 0 2024-09-16T02:06:09.124 INFO:tasks.workunit.client.0.smithi110.stdout:1/647: dwrite d0/da/f29 [4194304,4194304] 0 2024-09-16T02:06:09.127 INFO:tasks.workunit.client.0.smithi110.stdout:8/507: dread d3/fe [0,4194304] 0 2024-09-16T02:06:09.128 INFO:tasks.workunit.client.0.smithi110.stdout:1/648: dread d0/d25/f42 [0,4194304] 0 2024-09-16T02:06:09.129 INFO:tasks.workunit.client.0.smithi110.stdout:9/692: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/def 0 2024-09-16T02:06:09.130 INFO:tasks.workunit.client.0.smithi110.stdout:1/649: fsync d0/d1/d2a/d32/d6e/f88 0 2024-09-16T02:06:09.139 INFO:tasks.workunit.client.0.smithi110.stdout:8/508: rename d3/d2b/d27/da7/d1a/d6c/c76 to d3/d2b/ca9 0 2024-09-16T02:06:09.140 INFO:tasks.workunit.client.0.smithi110.stdout:9/693: truncate d1/dd/f10 9678940 0 2024-09-16T02:06:09.144 INFO:tasks.workunit.client.0.smithi110.stdout:8/509: creat d3/d2b/d65/faa x:0 0 0 2024-09-16T02:06:09.145 INFO:tasks.workunit.client.0.smithi110.stdout:8/510: chown d3/d2b/d65/faa 96512 1 2024-09-16T02:06:09.146 INFO:tasks.workunit.client.0.smithi110.stdout:1/650: link d0/d1/d4/d46/c83 d0/d1/d2a/d32/d40/cd9 0 2024-09-16T02:06:09.147 INFO:tasks.workunit.client.0.smithi110.stdout:9/694: mkdir d1/d1b/df0 0 2024-09-16T02:06:09.149 INFO:tasks.workunit.client.0.smithi110.stdout:1/651: rmdir d0/d1/d2a/d32/d40/dbf 39 2024-09-16T02:06:09.150 INFO:tasks.workunit.client.0.smithi110.stdout:1/652: fsync d0/d1/d2a/d32/f4f 0 2024-09-16T02:06:09.153 INFO:tasks.workunit.client.0.smithi110.stdout:8/511: rename d3/d2b/d27/f2d to d3/d2b/d27/d45/d66/d6b/fab 0 2024-09-16T02:06:09.155 INFO:tasks.workunit.client.0.smithi110.stdout:9/695: symlink d1/d2b/lf1 0 2024-09-16T02:06:09.156 INFO:tasks.workunit.client.0.smithi110.stdout:1/653: truncate d0/d1/f53 2191224 0 2024-09-16T02:06:09.156 INFO:tasks.workunit.client.0.smithi110.stdout:1/654: readlink d0/d1/l30 0 2024-09-16T02:06:09.161 INFO:tasks.workunit.client.0.smithi110.stdout:1/655: unlink d0/da/lca 0 2024-09-16T02:06:09.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/696: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f85 [4194304,4194304] 0 2024-09-16T02:06:09.164 INFO:tasks.workunit.client.0.smithi110.stdout:9/697: fsync d1/dd/d6a/d6c/d75/d86/fad 0 2024-09-16T02:06:09.164 INFO:tasks.workunit.client.0.smithi110.stdout:1/656: readlink d0/la1 0 2024-09-16T02:06:09.170 INFO:tasks.workunit.client.0.smithi110.stdout:1/657: rename d0/d25/d63/c21 to d0/d1/db1/dc4/d79/cda 0 2024-09-16T02:06:09.172 INFO:tasks.workunit.client.0.smithi110.stdout:9/698: rename d1/dd/d6a/d6c/d6f/d79/d29/db4/fd3 to d1/dd/d6a/d6c/d6f/ff2 0 2024-09-16T02:06:09.174 INFO:tasks.workunit.client.0.smithi110.stdout:9/699: rename d1/dd/d6a/d6c/d75/d8c to d1/dd/d6a/d6c/d75/d8c/d38/d3d/dd4/df3 22 2024-09-16T02:06:09.175 INFO:tasks.workunit.client.0.smithi110.stdout:1/658: creat d0/d1/d4/dc2/fdb x:0 0 0 2024-09-16T02:06:09.176 INFO:tasks.workunit.client.0.smithi110.stdout:9/700: write d1/dd/d6a/d6c/d75/d86/fc2 [1035770,79842] 0 2024-09-16T02:06:09.177 INFO:tasks.workunit.client.0.smithi110.stdout:1/659: creat d0/d1/d4/d46/d51/fdc x:0 0 0 2024-09-16T02:06:09.178 INFO:tasks.workunit.client.0.smithi110.stdout:9/701: write d1/dd/d6a/d6c/d6f/d79/d26/d8e/fea [180373,38464] 0 2024-09-16T02:06:09.180 INFO:tasks.workunit.client.0.smithi110.stdout:9/702: chown d1/dd/d6a/d6c/d6f/fd9 49090 1 2024-09-16T02:06:09.183 INFO:tasks.workunit.client.0.smithi110.stdout:9/703: creat d1/dd/d6a/d6c/d75/d8c/d38/d3d/dd4/ff4 x:0 0 0 2024-09-16T02:06:09.185 INFO:tasks.workunit.client.0.smithi110.stdout:9/704: symlink d1/d1b/daa/lf5 0 2024-09-16T02:06:09.185 INFO:tasks.workunit.client.0.smithi110.stdout:9/705: chown d1/d5/d20/d83/cc1 104311396 1 2024-09-16T02:06:09.192 INFO:tasks.workunit.client.0.smithi110.stdout:1/660: dread d0/d25/f3b [0,4194304] 0 2024-09-16T02:06:09.197 INFO:tasks.workunit.client.0.smithi110.stdout:9/706: truncate d1/dd/d6a/d6c/d6f/d79/d26/f45 1573631 0 2024-09-16T02:06:09.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:08 smithi165 ceph-mon[34621]: pgmap v28: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 226 MiB/s wr, 476 op/s 2024-09-16T02:06:09.203 INFO:tasks.workunit.client.0.smithi110.stdout:1/661: dread d0/da/f17 [0,4194304] 0 2024-09-16T02:06:09.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:08 smithi110 ceph-mon[27634]: pgmap v28: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 226 MiB/s wr, 476 op/s 2024-09-16T02:06:09.207 INFO:tasks.workunit.client.0.smithi110.stdout:1/662: mknod d0/d1/db1/cdd 0 2024-09-16T02:06:09.207 INFO:tasks.workunit.client.0.smithi110.stdout:1/663: readlink d0/d1/l39 0 2024-09-16T02:06:09.208 INFO:tasks.workunit.client.0.smithi110.stdout:9/707: dread d1/dd/d6a/d6c/d6f/d79/f68 [0,4194304] 0 2024-09-16T02:06:09.209 INFO:tasks.workunit.client.0.smithi110.stdout:1/664: chown d0/d1/d2a/f7e 118316303 1 2024-09-16T02:06:09.209 INFO:tasks.workunit.client.0.smithi110.stdout:9/708: stat d1/dd/d6a/d6c/d6f/d79/de/d1f/l65 0 2024-09-16T02:06:09.211 INFO:tasks.workunit.client.0.smithi110.stdout:1/665: mknod d0/d1/cde 0 2024-09-16T02:06:09.212 INFO:tasks.workunit.client.0.smithi110.stdout:9/709: mknod d1/dd/d6a/d6c/d6f/d79/d26/d5b/cf6 0 2024-09-16T02:06:09.214 INFO:tasks.workunit.client.0.smithi110.stdout:9/710: read d1/dd/d6a/f7a [942508,72036] 0 2024-09-16T02:06:09.215 INFO:tasks.workunit.client.0.smithi110.stdout:9/711: write d1/d5/d20/d55/d82/fd8 [764937,86764] 0 2024-09-16T02:06:09.217 INFO:tasks.workunit.client.0.smithi110.stdout:9/712: readlink d1/dd/d6a/d6c/d6f/d79/l5a 0 2024-09-16T02:06:09.221 INFO:tasks.workunit.client.0.smithi110.stdout:9/713: unlink d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/feb 0 2024-09-16T02:06:09.223 INFO:tasks.workunit.client.0.smithi110.stdout:9/714: symlink d1/dd/d6a/d6c/d75/d8c/lf7 0 2024-09-16T02:06:09.225 INFO:tasks.workunit.client.0.smithi110.stdout:1/666: dread d0/d1/d4/d46/d51/f72 [0,4194304] 0 2024-09-16T02:06:09.226 INFO:tasks.workunit.client.0.smithi110.stdout:1/667: readlink d0/d1/d2a/l2d 0 2024-09-16T02:06:09.228 INFO:tasks.workunit.client.0.smithi110.stdout:9/715: dread d1/dd/d6a/fd7 [0,4194304] 0 2024-09-16T02:06:09.229 INFO:tasks.workunit.client.0.smithi110.stdout:9/716: readlink d1/dd/d6a/d6c/d6f/d79/d26/l64 0 2024-09-16T02:06:09.232 INFO:tasks.workunit.client.0.smithi110.stdout:9/717: mknod d1/dd/d6a/cf8 0 2024-09-16T02:06:09.235 INFO:tasks.workunit.client.0.smithi110.stdout:1/668: write d0/d1/d2a/d32/f67 [572091,46757] 0 2024-09-16T02:06:09.237 INFO:tasks.workunit.client.0.smithi110.stdout:1/669: chown d0/d1/l3c 183655655 1 2024-09-16T02:06:09.239 INFO:tasks.workunit.client.0.smithi110.stdout:1/670: rename d0/d1/d2a to d0/d1/d2a/ddf 22 2024-09-16T02:06:09.243 INFO:tasks.workunit.client.0.smithi110.stdout:9/718: dwrite d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe5 [0,4194304] 0 2024-09-16T02:06:09.244 INFO:tasks.workunit.client.0.smithi110.stdout:9/719: write d1/d1b/d23/f71 [3662139,58566] 0 2024-09-16T02:06:09.251 INFO:tasks.workunit.client.0.smithi110.stdout:1/671: dwrite d0/da/f92 [0,4194304] 0 2024-09-16T02:06:09.256 INFO:tasks.workunit.client.0.smithi110.stdout:1/672: write d0/da/d8d/f9d [53391,128424] 0 2024-09-16T02:06:09.257 INFO:tasks.workunit.client.0.smithi110.stdout:1/673: truncate d0/d1/d4/d46/dd7/fcb 1021035 0 2024-09-16T02:06:09.260 INFO:tasks.workunit.client.0.smithi110.stdout:9/720: dread d1/dd/f10 [0,4194304] 0 2024-09-16T02:06:09.261 INFO:tasks.workunit.client.0.smithi110.stdout:9/721: chown d1/dd/d6a/d6c/d75/d86/fad 0 1 2024-09-16T02:06:09.262 INFO:tasks.workunit.client.0.smithi110.stdout:9/722: chown d1/dd/d6a/d6c/d75/d86/fc2 14592230 1 2024-09-16T02:06:09.270 INFO:tasks.workunit.client.0.smithi110.stdout:9/723: dwrite d1/dd/d6a/d6c/d6f/ff2 [0,4194304] 0 2024-09-16T02:06:09.275 INFO:tasks.workunit.client.0.smithi110.stdout:1/674: truncate d0/d1/f23 3022122 0 2024-09-16T02:06:09.276 INFO:tasks.workunit.client.0.smithi110.stdout:1/675: fsync d0/da/d7c/f9e 0 2024-09-16T02:06:09.283 INFO:tasks.workunit.client.0.smithi110.stdout:1/676: symlink d0/d1/d2a/d32/le0 0 2024-09-16T02:06:09.288 INFO:tasks.workunit.client.0.smithi110.stdout:1/677: mknod d0/d1/d4/d46/dd7/ce1 0 2024-09-16T02:06:09.289 INFO:tasks.workunit.client.0.smithi110.stdout:1/678: fdatasync d0/d1/d4/d46/d51/f72 0 2024-09-16T02:06:09.297 INFO:tasks.workunit.client.0.smithi110.stdout:1/679: dwrite d0/d1/d4/dc2/fdb [0,4194304] 0 2024-09-16T02:06:09.309 INFO:tasks.workunit.client.0.smithi110.stdout:1/680: write d0/d25/d63/f6b [231211,130536] 0 2024-09-16T02:06:09.310 INFO:tasks.workunit.client.0.smithi110.stdout:1/681: stat d0/da/fd2 0 2024-09-16T02:06:09.311 INFO:tasks.workunit.client.0.smithi110.stdout:1/682: write d0/d1/db1/fcd [857966,22113] 0 2024-09-16T02:06:09.312 INFO:tasks.workunit.client.0.smithi110.stdout:1/683: chown d0/da/d7c/cce 185517728 1 2024-09-16T02:06:09.318 INFO:tasks.workunit.client.0.smithi110.stdout:1/684: dwrite d0/da/f17 [4194304,4194304] 0 2024-09-16T02:06:09.323 INFO:tasks.workunit.client.0.smithi110.stdout:1/685: stat d0/d1/d4/cd6 0 2024-09-16T02:06:09.331 INFO:tasks.workunit.client.0.smithi110.stdout:1/686: write d0/d1/d4/d46/d75/f86 [1000484,4546] 0 2024-09-16T02:06:09.332 INFO:tasks.workunit.client.0.smithi110.stdout:1/687: chown d0/d1/d2a/d32/f41 51053870 1 2024-09-16T02:06:09.341 INFO:tasks.workunit.client.0.smithi110.stdout:1/688: dread d0/da/d7c/fbe [0,4194304] 0 2024-09-16T02:06:09.342 INFO:tasks.workunit.client.0.smithi110.stdout:1/689: dread - d0/d1/fa5 zero size 2024-09-16T02:06:09.344 INFO:tasks.workunit.client.0.smithi110.stdout:1/690: rename d0/d1/f3f to d0/d1/d2a/d32/d6e/fe2 0 2024-09-16T02:06:09.347 INFO:tasks.workunit.client.0.smithi110.stdout:1/691: unlink d0/d1/fa5 0 2024-09-16T02:06:09.348 INFO:tasks.workunit.client.0.smithi110.stdout:1/692: symlink d0/d1/d2a/d9a/da2/le3 0 2024-09-16T02:06:09.350 INFO:tasks.workunit.client.0.smithi110.stdout:1/693: creat d0/d25/fe4 x:0 0 0 2024-09-16T02:06:09.355 INFO:tasks.workunit.client.0.smithi110.stdout:1/694: rename d0/d1/d4/dc2/fdb to d0/d1/db1/fe5 0 2024-09-16T02:06:09.358 INFO:tasks.workunit.client.0.smithi110.stdout:1/695: creat d0/d1/db1/dc4/d79/fe6 x:0 0 0 2024-09-16T02:06:09.362 INFO:tasks.workunit.client.0.smithi110.stdout:1/696: mknod d0/d1/d2a/d32/d40/ce7 0 2024-09-16T02:06:09.364 INFO:tasks.workunit.client.0.smithi110.stdout:1/697: fsync d0/d1/d2a/d32/f41 0 2024-09-16T02:06:09.370 INFO:tasks.workunit.client.0.smithi110.stdout:1/698: dwrite d0/d1/d4/f18 [4194304,4194304] 0 2024-09-16T02:06:09.374 INFO:tasks.workunit.client.0.smithi110.stdout:1/699: mkdir d0/d1/db1/dc4/de8 0 2024-09-16T02:06:09.380 INFO:tasks.workunit.client.0.smithi110.stdout:1/700: dwrite d0/d25/d63/f6b [0,4194304] 0 2024-09-16T02:06:09.382 INFO:tasks.workunit.client.0.smithi110.stdout:1/701: fdatasync d0/d1/d4/d46/d75/f86 0 2024-09-16T02:06:09.382 INFO:tasks.workunit.client.0.smithi110.stdout:1/702: chown d0/da/fd2 7139 1 2024-09-16T02:06:09.391 INFO:tasks.workunit.client.0.smithi110.stdout:1/703: dwrite d0/d1/d2a/d9a/da2/fb0 [0,4194304] 0 2024-09-16T02:06:09.392 INFO:tasks.workunit.client.0.smithi110.stdout:1/704: readlink d0/d1/d2a/d32/l35 0 2024-09-16T02:06:09.394 INFO:tasks.workunit.client.0.smithi110.stdout:1/705: unlink d0/da/l4e 0 2024-09-16T02:06:09.402 INFO:tasks.workunit.client.0.smithi110.stdout:1/706: dwrite d0/d1/d4/d46/d7a/fcc [0,4194304] 0 2024-09-16T02:06:09.409 INFO:tasks.workunit.client.0.smithi110.stdout:1/707: dwrite d0/d25/d63/fd1 [0,4194304] 0 2024-09-16T02:06:09.418 INFO:tasks.workunit.client.0.smithi110.stdout:1/708: symlink d0/d1/dab/le9 0 2024-09-16T02:06:09.434 INFO:tasks.workunit.client.0.smithi110.stdout:1/709: dread d0/d1/d2a/d32/f38 [0,4194304] 0 2024-09-16T02:06:09.435 INFO:tasks.workunit.client.0.smithi110.stdout:1/710: fsync d0/d1/f57 0 2024-09-16T02:06:09.437 INFO:tasks.workunit.client.0.smithi110.stdout:1/711: symlink d0/da/d8d/lea 0 2024-09-16T02:06:09.438 INFO:tasks.workunit.client.0.smithi110.stdout:1/712: creat d0/d1/db1/dc4/d79/feb x:0 0 0 2024-09-16T02:06:09.440 INFO:tasks.workunit.client.0.smithi110.stdout:1/713: mkdir d0/da/d7c/da8/dec 0 2024-09-16T02:06:09.445 INFO:tasks.workunit.client.0.smithi110.stdout:1/714: rename d0/d1/f53 to d0/d1/d2a/d32/d40/dbf/fed 0 2024-09-16T02:06:09.451 INFO:tasks.workunit.client.0.smithi110.stdout:1/715: dwrite d0/d1/db1/fe5 [0,4194304] 0 2024-09-16T02:06:09.456 INFO:tasks.workunit.client.0.smithi110.stdout:1/716: rename d0/d1/d4/d46/d51/fdc to d0/d1/d2a/d32/d40/fee 0 2024-09-16T02:06:09.458 INFO:tasks.workunit.client.0.smithi110.stdout:1/717: write d0/da/f29 [998985,24290] 0 2024-09-16T02:06:09.461 INFO:tasks.workunit.client.0.smithi110.stdout:1/718: dread d0/da/d7c/fbe [0,4194304] 0 2024-09-16T02:06:09.467 INFO:tasks.workunit.client.0.smithi110.stdout:1/719: creat d0/d1/d2a/d32/d40/fef x:0 0 0 2024-09-16T02:06:09.468 INFO:tasks.workunit.client.0.smithi110.stdout:1/720: write d0/d1/db1/dc4/f66 [2467105,57420] 0 2024-09-16T02:06:09.469 INFO:tasks.workunit.client.0.smithi110.stdout:1/721: stat d0/d1/d4/d46/d75/f86 0 2024-09-16T02:06:09.472 INFO:tasks.workunit.client.0.smithi110.stdout:1/722: mknod d0/d1/db1/dc4/d79/cf0 0 2024-09-16T02:06:09.479 INFO:tasks.workunit.client.0.smithi110.stdout:1/723: dwrite d0/d1/d4/d46/d75/fb9 [0,4194304] 0 2024-09-16T02:06:09.482 INFO:tasks.workunit.client.0.smithi110.stdout:1/724: rmdir d0/d1/d2a/d9a/da2 39 2024-09-16T02:06:09.483 INFO:tasks.workunit.client.0.smithi110.stdout:1/725: truncate d0/d1/d2a/d32/d6e/f88 4668082 0 2024-09-16T02:06:09.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/726: dread - d0/d1/d2a/d32/d40/dbf/fd3 zero size 2024-09-16T02:06:09.494 INFO:tasks.workunit.client.0.smithi110.stdout:1/727: write d0/f14 [2269879,29266] 0 2024-09-16T02:06:09.494 INFO:tasks.workunit.client.0.smithi110.stdout:1/728: readlink d0/d1/ld8 0 2024-09-16T02:06:09.502 INFO:tasks.workunit.client.0.smithi110.stdout:1/729: dwrite d0/d1/db1/dd0/fd5 [0,4194304] 0 2024-09-16T02:06:09.510 INFO:tasks.workunit.client.0.smithi110.stdout:1/730: dread d0/d25/f4a [0,4194304] 0 2024-09-16T02:06:09.512 INFO:tasks.workunit.client.0.smithi110.stdout:1/731: truncate d0/d1/d4/f24 1095362 0 2024-09-16T02:06:09.512 INFO:tasks.workunit.client.0.smithi110.stdout:1/732: chown d0/d1/d4/d46/f5e 43763 1 2024-09-16T02:06:09.513 INFO:tasks.workunit.client.0.smithi110.stdout:1/733: readlink d0/d1/d2a/l60 0 2024-09-16T02:06:09.513 INFO:tasks.workunit.client.0.smithi110.stdout:1/734: fdatasync d0/d1/d2a/d32/f67 0 2024-09-16T02:06:09.515 INFO:tasks.workunit.client.0.smithi110.stdout:1/735: rename d0 to d0/d1/d2a/d32/d40/df1 22 2024-09-16T02:06:09.525 INFO:tasks.workunit.client.0.smithi110.stdout:1/736: dread d0/d1/db1/dc4/f66 [0,4194304] 0 2024-09-16T02:06:09.531 INFO:tasks.workunit.client.0.smithi110.stdout:1/737: dwrite d0/da/f17 [8388608,4194304] 0 2024-09-16T02:06:09.536 INFO:tasks.workunit.client.0.smithi110.stdout:1/738: getdents d0/d1/dab 0 2024-09-16T02:06:09.540 INFO:tasks.workunit.client.0.smithi110.stdout:1/739: mkdir d0/d1/df2 0 2024-09-16T02:06:09.544 INFO:tasks.workunit.client.0.smithi110.stdout:1/740: link d0/d1/d4/d46/cbc d0/d1/d2a/d32/d40/cf3 0 2024-09-16T02:06:09.546 INFO:tasks.workunit.client.0.smithi110.stdout:1/741: dread d0/da/f81 [0,4194304] 0 2024-09-16T02:06:09.552 INFO:tasks.workunit.client.0.smithi110.stdout:1/742: dwrite d0/d25/f4a [0,4194304] 0 2024-09-16T02:06:09.560 INFO:tasks.workunit.client.0.smithi110.stdout:1/743: dwrite d0/d1/d4/d46/d75/fb9 [0,4194304] 0 2024-09-16T02:06:09.561 INFO:tasks.workunit.client.0.smithi110.stdout:1/744: fsync d0/d1/d4/d46/d7a/fb2 0 2024-09-16T02:06:09.563 INFO:tasks.workunit.client.0.smithi110.stdout:1/745: rmdir d0/d1/dab 39 2024-09-16T02:06:09.566 INFO:tasks.workunit.client.0.smithi110.stdout:1/746: unlink d0/d25/f3b 0 2024-09-16T02:06:09.566 INFO:tasks.workunit.client.0.smithi110.stdout:1/747: chown d0/d1/d2a/d32/d6e 6 1 2024-09-16T02:06:09.570 INFO:tasks.workunit.client.0.smithi110.stdout:1/748: rename d0/d1/d4/d46/dd7 to d0/d1/d4/d46/d7a/df4 0 2024-09-16T02:06:09.571 INFO:tasks.workunit.client.0.smithi110.stdout:1/749: truncate d0/d25/fe4 499808 0 2024-09-16T02:06:09.572 INFO:tasks.workunit.client.0.smithi110.stdout:1/750: stat d0/d1/d4/d46/d75 0 2024-09-16T02:06:09.987 INFO:tasks.workunit.client.0.smithi110.stdout:6/718: sync 2024-09-16T02:06:09.987 INFO:tasks.workunit.client.0.smithi110.stdout:4/609: sync 2024-09-16T02:06:09.992 INFO:tasks.workunit.client.0.smithi110.stdout:4/610: dread d4/d8/d17/d23/d4c/d6d/d3c/f81 [0,4194304] 0 2024-09-16T02:06:09.993 INFO:tasks.workunit.client.0.smithi110.stdout:6/719: getdents d0/d2/d57 0 2024-09-16T02:06:09.994 INFO:tasks.workunit.client.0.smithi110.stdout:6/720: fsync d0/d29/d2a/d2d/daa/fd9 0 2024-09-16T02:06:09.994 INFO:tasks.workunit.client.0.smithi110.stdout:4/611: chown d4/d8/d17/d23/d4c/d6d/f64 925763680 1 2024-09-16T02:06:10.193 INFO:tasks.workunit.client.0.smithi110.stdout:3/574: sync 2024-09-16T02:06:10.193 INFO:tasks.workunit.client.0.smithi110.stdout:2/721: sync 2024-09-16T02:06:10.193 INFO:tasks.workunit.client.0.smithi110.stdout:0/639: sync 2024-09-16T02:06:10.196 INFO:tasks.workunit.client.0.smithi110.stdout:0/640: dread d3/d92/fa9 [0,4194304] 0 2024-09-16T02:06:10.199 INFO:tasks.workunit.client.0.smithi110.stdout:2/722: dwrite d0/db/d47/d48/dcd/f66 [4194304,4194304] 0 2024-09-16T02:06:10.324 INFO:tasks.workunit.client.0.smithi110.stdout:7/470: sync 2024-09-16T02:06:10.325 INFO:tasks.workunit.client.0.smithi110.stdout:9/724: sync 2024-09-16T02:06:10.325 INFO:tasks.workunit.client.0.smithi110.stdout:5/571: sync 2024-09-16T02:06:10.325 INFO:tasks.workunit.client.0.smithi110.stdout:8/512: sync 2024-09-16T02:06:10.325 INFO:tasks.workunit.client.0.smithi110.stdout:1/751: sync 2024-09-16T02:06:10.327 INFO:tasks.workunit.client.0.smithi110.stdout:5/572: write d5/dd/df/d92/fa1 [3120129,29712] 0 2024-09-16T02:06:10.330 INFO:tasks.workunit.client.0.smithi110.stdout:0/641: creat d3/d92/d9a/fc1 x:0 0 0 2024-09-16T02:06:10.333 INFO:tasks.workunit.client.0.smithi110.stdout:7/471: truncate d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 790341 0 2024-09-16T02:06:10.336 INFO:tasks.workunit.client.0.smithi110.stdout:2/723: write d0/d5f/dc0/ddc/ddd/d18/dc/fee [695517,68777] 0 2024-09-16T02:06:10.337 INFO:tasks.workunit.client.0.smithi110.stdout:9/725: dwrite d1/dd/d6a/d6c/d75/d8c/d38/d3d/dd4/ff4 [0,4194304] 0 2024-09-16T02:06:10.339 INFO:tasks.workunit.client.0.smithi110.stdout:5/573: dwrite d5/dd/f10 [4194304,4194304] 0 2024-09-16T02:06:10.341 INFO:tasks.workunit.client.0.smithi110.stdout:9/726: dread - d1/dd/d6a/d6c/d75/d86/fad zero size 2024-09-16T02:06:10.342 INFO:tasks.workunit.client.0.smithi110.stdout:9/727: write d1/d1b/d23/fc7 [607065,98073] 0 2024-09-16T02:06:10.345 INFO:tasks.workunit.client.0.smithi110.stdout:9/728: chown d1/dd/d6a/d6c/d6f/d79/de/l37 182277711 1 2024-09-16T02:06:10.345 INFO:tasks.workunit.client.0.smithi110.stdout:8/513: creat d3/d2b/d27/da7/d1a/d36/d60/fac x:0 0 0 2024-09-16T02:06:10.345 INFO:tasks.workunit.client.0.smithi110.stdout:9/729: write d1/f3 [895499,101407] 0 2024-09-16T02:06:10.352 INFO:tasks.workunit.client.0.smithi110.stdout:7/472: fsync d3/d15/d38/d4f/d10/f6d 0 2024-09-16T02:06:10.354 INFO:tasks.workunit.client.0.smithi110.stdout:2/724: rmdir d0/db/d47/d48/dcd/d39/d87 39 2024-09-16T02:06:10.355 INFO:tasks.workunit.client.0.smithi110.stdout:2/725: read - d0/db/d47/d48/fd0 zero size 2024-09-16T02:06:10.356 INFO:tasks.workunit.client.0.smithi110.stdout:5/574: fdatasync d5/f7f 0 2024-09-16T02:06:10.357 INFO:tasks.workunit.client.0.smithi110.stdout:5/575: readlink d5/d36/d3d/l4e 0 2024-09-16T02:06:10.361 INFO:tasks.workunit.client.0.smithi110.stdout:0/642: symlink d3/d4/dc/lc2 0 2024-09-16T02:06:10.370 INFO:tasks.workunit.client.0.smithi110.stdout:8/514: write d3/d2b/d27/da7/f88 [653437,2807] 0 2024-09-16T02:06:10.371 INFO:tasks.workunit.client.0.smithi110.stdout:8/515: readlink d3/d2b/d27/d45/d66/d6b/d8d/la3 0 2024-09-16T02:06:10.373 INFO:tasks.workunit.client.0.smithi110.stdout:1/752: link d0/d1/cde d0/d1/cf5 0 2024-09-16T02:06:10.375 INFO:tasks.workunit.client.0.smithi110.stdout:0/643: symlink d3/d4/dc/d10/lc3 0 2024-09-16T02:06:10.376 INFO:tasks.workunit.client.0.smithi110.stdout:7/473: mkdir d3/d15/d38/d4f/d10/d11/d8f 0 2024-09-16T02:06:10.377 INFO:tasks.workunit.client.0.smithi110.stdout:0/644: chown d3/d6/d4b/l7c 38707697 1 2024-09-16T02:06:10.379 INFO:tasks.workunit.client.0.smithi110.stdout:1/753: dread d0/d1/db1/fe5 [0,4194304] 0 2024-09-16T02:06:10.380 INFO:tasks.workunit.client.0.smithi110.stdout:1/754: dread - d0/da/fcf zero size 2024-09-16T02:06:10.381 INFO:tasks.workunit.client.0.smithi110.stdout:9/730: rename d1/f52 to d1/ff9 0 2024-09-16T02:06:10.382 INFO:tasks.workunit.client.0.smithi110.stdout:5/576: dwrite d5/d36/d45/f56 [4194304,4194304] 0 2024-09-16T02:06:10.382 INFO:tasks.workunit.client.0.smithi110.stdout:8/516: symlink d3/d2b/d27/da7/d1a/d6c/lad 0 2024-09-16T02:06:10.385 INFO:tasks.workunit.client.0.smithi110.stdout:1/755: write d0/d1/d4/d46/d7a/fb2 [181999,104983] 0 2024-09-16T02:06:10.385 INFO:tasks.workunit.client.0.smithi110.stdout:2/726: truncate d0/db/d47/d48/dcd/d41/fae 3795447 0 2024-09-16T02:06:10.388 INFO:tasks.workunit.client.0.smithi110.stdout:0/645: write d3/f82 [658869,47854] 0 2024-09-16T02:06:10.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/577: rmdir d5/d36/d45/d47 39 2024-09-16T02:06:10.389 INFO:tasks.workunit.client.0.smithi110.stdout:0/646: write d3/d6/d43/d55/fa4 [69824,10372] 0 2024-09-16T02:06:10.395 INFO:tasks.workunit.client.0.smithi110.stdout:9/731: rename d1/dd/d6a/d6c/d6f/d79/de/d1f/fa8 to d1/d5/dc4/ffa 0 2024-09-16T02:06:10.396 INFO:tasks.workunit.client.0.smithi110.stdout:6/721: sync 2024-09-16T02:06:10.396 INFO:tasks.workunit.client.0.smithi110.stdout:9/732: write d1/dd/d6a/d6c/d6f/fc9 [873468,79014] 0 2024-09-16T02:06:10.402 INFO:tasks.workunit.client.0.smithi110.stdout:8/517: rename d3/d31/f3e to d3/d2b/d27/da7/d1a/d36/d60/d62/d5f/da8/fae 0 2024-09-16T02:06:10.404 INFO:tasks.workunit.client.0.smithi110.stdout:8/518: write d3/d2b/d65/d7f/fa5 [557595,10017] 0 2024-09-16T02:06:10.408 INFO:tasks.workunit.client.0.smithi110.stdout:6/722: mkdir d0/d2/d5/d94/dba/dde 0 2024-09-16T02:06:10.417 INFO:tasks.workunit.client.0.smithi110.stdout:5/578: truncate f4 2534071 0 2024-09-16T02:06:10.417 INFO:tasks.workunit.client.0.smithi110.stdout:9/733: dread d1/dd/d6a/d6c/d6f/d79/f40 [0,4194304] 0 2024-09-16T02:06:10.421 INFO:tasks.workunit.client.0.smithi110.stdout:0/647: truncate d3/d4/dc/f1c 378329 0 2024-09-16T02:06:10.425 INFO:tasks.workunit.client.0.smithi110.stdout:1/756: rename d0/d1/db1 to d0/da/d8d/df6 0 2024-09-16T02:06:10.425 INFO:tasks.workunit.client.0.smithi110.stdout:8/519: mknod d3/d2b/caf 0 2024-09-16T02:06:10.426 INFO:tasks.workunit.client.0.smithi110.stdout:8/520: chown d3/d2b/d27/f67 165 1 2024-09-16T02:06:10.430 INFO:tasks.workunit.client.0.smithi110.stdout:7/474: rename d3/f27 to d3/f90 0 2024-09-16T02:06:10.436 INFO:tasks.workunit.client.0.smithi110.stdout:5/579: mkdir d5/dd/df/d28/d6f/d8e/dbc 0 2024-09-16T02:06:10.440 INFO:tasks.workunit.client.0.smithi110.stdout:2/727: rename d0/d5f/da9 to d0/db/d47/d48/dcd/d58/dec/d100 0 2024-09-16T02:06:10.443 INFO:tasks.workunit.client.0.smithi110.stdout:8/521: creat d3/d2b/d27/d45/d66/d6b/fb0 x:0 0 0 2024-09-16T02:06:10.449 INFO:tasks.workunit.client.0.smithi110.stdout:9/734: rename d1/d1b/f6e to d1/dd/d6a/de7/ffb 0 2024-09-16T02:06:10.449 INFO:tasks.workunit.client.0.smithi110.stdout:8/522: dwrite d3/d2b/d65/d7f/fa5 [0,4194304] 0 2024-09-16T02:06:10.450 INFO:tasks.workunit.client.0.smithi110.stdout:1/757: mkdir d0/d1/d4/d46/df7 0 2024-09-16T02:06:10.454 INFO:tasks.workunit.client.0.smithi110.stdout:6/723: creat d0/d29/d2a/d2d/fdf x:0 0 0 2024-09-16T02:06:10.455 INFO:tasks.workunit.client.0.smithi110.stdout:6/724: read d0/d2/d5/d1e/f44 [2347860,23299] 0 2024-09-16T02:06:10.457 INFO:tasks.workunit.client.0.smithi110.stdout:0/648: link d3/d6/d43/l47 d3/d6/d43/lc4 0 2024-09-16T02:06:10.462 INFO:tasks.workunit.client.0.smithi110.stdout:0/649: dwrite d3/d6/f21 [0,4194304] 0 2024-09-16T02:06:10.463 INFO:tasks.workunit.client.0.smithi110.stdout:1/758: unlink d0/d25/d63/fd1 0 2024-09-16T02:06:10.471 INFO:tasks.workunit.client.0.smithi110.stdout:7/475: dwrite d3/d15/d38/f6a [0,4194304] 0 2024-09-16T02:06:10.474 INFO:tasks.workunit.client.0.smithi110.stdout:6/725: dread d0/d2/f69 [0,4194304] 0 2024-09-16T02:06:10.480 INFO:tasks.workunit.client.0.smithi110.stdout:8/523: creat d3/d2b/d27/da7/d1a/d36/d60/d62/d5f/d98/fb1 x:0 0 0 2024-09-16T02:06:10.481 INFO:tasks.workunit.client.0.smithi110.stdout:8/524: readlink d3/d2b/d27/d45/d66/d6b/d8d/la3 0 2024-09-16T02:06:10.483 INFO:tasks.workunit.client.0.smithi110.stdout:7/476: creat d3/d7a/f91 x:0 0 0 2024-09-16T02:06:10.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/759: dread d0/d1/d4/d46/d7a/fb2 [0,4194304] 0 2024-09-16T02:06:10.485 INFO:tasks.workunit.client.0.smithi110.stdout:5/580: rename d5/d36/d45/c78 to d5/dd/df/d11/cbd 0 2024-09-16T02:06:10.487 INFO:tasks.workunit.client.0.smithi110.stdout:9/735: dwrite d1/dd/d6a/d6c/d6f/d79/f5c [0,4194304] 0 2024-09-16T02:06:10.487 INFO:tasks.workunit.client.0.smithi110.stdout:6/726: rmdir d0/d2/d57/d75 39 2024-09-16T02:06:10.492 INFO:tasks.workunit.client.0.smithi110.stdout:8/525: creat d3/d2b/d27/da7/d1a/d36/d60/fb2 x:0 0 0 2024-09-16T02:06:10.493 INFO:tasks.workunit.client.0.smithi110.stdout:8/526: dread - d3/d2b/d27/da7/d1a/fa2 zero size 2024-09-16T02:06:10.503 INFO:tasks.workunit.client.0.smithi110.stdout:8/527: creat d3/d2b/d27/da7/d1a/d36/d87/fb3 x:0 0 0 2024-09-16T02:06:10.505 INFO:tasks.workunit.client.0.smithi110.stdout:7/477: unlink d3/d15/d38/d4f/d10/c6f 0 2024-09-16T02:06:10.506 INFO:tasks.workunit.client.0.smithi110.stdout:9/736: symlink d1/d1b/d23/lfc 0 2024-09-16T02:06:10.509 INFO:tasks.workunit.client.0.smithi110.stdout:6/727: rename d0/d2/f6a to d0/d2/d57/d75/fe0 0 2024-09-16T02:06:10.513 INFO:tasks.workunit.client.0.smithi110.stdout:0/650: getdents d3/d4/d6d 0 2024-09-16T02:06:10.513 INFO:tasks.workunit.client.0.smithi110.stdout:5/581: creat d5/dd/fbe x:0 0 0 2024-09-16T02:06:10.515 INFO:tasks.workunit.client.0.smithi110.stdout:5/582: dread - d5/d71/d89/fb6 zero size 2024-09-16T02:06:10.518 INFO:tasks.workunit.client.0.smithi110.stdout:6/728: dwrite d0/d29/f53 [0,4194304] 0 2024-09-16T02:06:10.518 INFO:tasks.workunit.client.0.smithi110.stdout:0/651: dwrite d3/d4/dc/d14/f19 [0,4194304] 0 2024-09-16T02:06:10.523 INFO:tasks.workunit.client.0.smithi110.stdout:7/478: link d3/f9 d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f92 0 2024-09-16T02:06:10.530 INFO:tasks.workunit.client.0.smithi110.stdout:6/729: fdatasync d0/d2/d5/d84/d16/f13 0 2024-09-16T02:06:10.533 INFO:tasks.workunit.client.0.smithi110.stdout:0/652: creat d3/d4/dc/d75/fc5 x:0 0 0 2024-09-16T02:06:10.536 INFO:tasks.workunit.client.0.smithi110.stdout:5/583: symlink d5/lbf 0 2024-09-16T02:06:10.536 INFO:tasks.workunit.client.0.smithi110.stdout:5/584: dread - d5/d71/d89/fb6 zero size 2024-09-16T02:06:10.537 INFO:tasks.workunit.client.0.smithi110.stdout:5/585: fdatasync d5/dd/df/d11/fa2 0 2024-09-16T02:06:10.537 INFO:tasks.workunit.client.0.smithi110.stdout:9/737: link d1/dd/d6a/d6c/d75/d8c/d38/c62 d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/cfd 0 2024-09-16T02:06:10.544 INFO:tasks.workunit.client.0.smithi110.stdout:1/760: getdents d0/d1/d2a/d32/d40/dbf 0 2024-09-16T02:06:10.544 INFO:tasks.workunit.client.0.smithi110.stdout:1/761: chown d0/d25/d63/f19 2 1 2024-09-16T02:06:10.551 INFO:tasks.workunit.client.0.smithi110.stdout:1/762: dwrite d0/d1/f20 [0,4194304] 0 2024-09-16T02:06:10.552 INFO:tasks.workunit.client.0.smithi110.stdout:1/763: stat d0/d1/l30 0 2024-09-16T02:06:10.553 INFO:tasks.workunit.client.0.smithi110.stdout:1/764: stat d0/da 0 2024-09-16T02:06:10.553 INFO:tasks.workunit.client.0.smithi110.stdout:7/479: link d3/f8 d3/d15/d38/d4f/d10/d11/d73/f93 0 2024-09-16T02:06:10.555 INFO:tasks.workunit.client.0.smithi110.stdout:5/586: chown d5/dd/f12 19785 1 2024-09-16T02:06:10.557 INFO:tasks.workunit.client.0.smithi110.stdout:3/575: sync 2024-09-16T02:06:10.557 INFO:tasks.workunit.client.0.smithi110.stdout:4/612: sync 2024-09-16T02:06:10.557 INFO:tasks.workunit.client.0.smithi110.stdout:8/528: write d3/d2b/d27/d45/d66/d6b/fab [1749774,11119] 0 2024-09-16T02:06:10.558 INFO:tasks.workunit.client.0.smithi110.stdout:5/587: write d5/dd/df/d28/d6f/d86/fbb [602863,26617] 0 2024-09-16T02:06:10.561 INFO:tasks.workunit.client.0.smithi110.stdout:8/529: write d3/d2b/d27/da7/d1a/f40 [4579822,17229] 0 2024-09-16T02:06:10.562 INFO:tasks.workunit.client.0.smithi110.stdout:5/588: read d5/dd/df/f38 [558730,61676] 0 2024-09-16T02:06:10.567 INFO:tasks.workunit.client.0.smithi110.stdout:9/738: read d1/dd/d6a/d6c/d75/d8c/d38/d3d/f4e [134590,105974] 0 2024-09-16T02:06:10.569 INFO:tasks.workunit.client.0.smithi110.stdout:7/480: read d3/f9 [7919833,117836] 0 2024-09-16T02:06:10.571 INFO:tasks.workunit.client.0.smithi110.stdout:7/481: stat d3/d15/d38/d4f/d10/d11/f75 0 2024-09-16T02:06:10.573 INFO:tasks.workunit.client.0.smithi110.stdout:5/589: read d5/dd/df/d28/f75 [3978589,4293] 0 2024-09-16T02:06:10.574 INFO:tasks.workunit.client.0.smithi110.stdout:0/653: mknod d3/d4/dc/cc6 0 2024-09-16T02:06:10.577 INFO:tasks.workunit.client.0.smithi110.stdout:1/765: rename d0/d1/d4/d46/d7a/d9b/cb6 to d0/d1/d4/d46/df7/cf8 0 2024-09-16T02:06:10.578 INFO:tasks.workunit.client.0.smithi110.stdout:1/766: stat d0/d1/d2a/l60 0 2024-09-16T02:06:10.578 INFO:tasks.workunit.client.0.smithi110.stdout:0/654: write d3/d4/dc/d14/d7e/d81/fa3 [4992612,45280] 0 2024-09-16T02:06:10.581 INFO:tasks.workunit.client.0.smithi110.stdout:0/655: dread d3/d6/d43/d55/d59/f9c [0,4194304] 0 2024-09-16T02:06:10.581 INFO:tasks.workunit.client.0.smithi110.stdout:3/576: creat d8/d48/d5b/d6a/d75/d88/dac/fce x:0 0 0 2024-09-16T02:06:10.583 INFO:tasks.workunit.client.0.smithi110.stdout:3/577: write d8/d48/d5b/d92/dc7/d1b/d36/f9c [300727,125603] 0 2024-09-16T02:06:10.585 INFO:tasks.workunit.client.0.smithi110.stdout:7/482: creat d3/d15/d38/d4f/d10/f94 x:0 0 0 2024-09-16T02:06:10.586 INFO:tasks.workunit.client.0.smithi110.stdout:9/739: creat d1/dd/d6a/d6c/d6f/d79/de/d94/ffe x:0 0 0 2024-09-16T02:06:10.587 INFO:tasks.workunit.client.0.smithi110.stdout:9/740: chown d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd 156435 1 2024-09-16T02:06:10.587 INFO:tasks.workunit.client.0.smithi110.stdout:6/730: write d0/d2/d57/d75/f90 [4684520,1418] 0 2024-09-16T02:06:10.588 INFO:tasks.workunit.client.0.smithi110.stdout:4/613: mkdir d4/d8/d31/d80/dbf 0 2024-09-16T02:06:10.589 INFO:tasks.workunit.client.0.smithi110.stdout:4/614: fsync d4/d8/d17/d23/f82 0 2024-09-16T02:06:10.593 INFO:tasks.workunit.client.0.smithi110.stdout:1/767: creat d0/d1/d2a/d32/d40/dbf/ff9 x:0 0 0 2024-09-16T02:06:10.594 INFO:tasks.workunit.client.0.smithi110.stdout:6/731: dread d0/d2/d5/d84/d16/f72 [0,4194304] 0 2024-09-16T02:06:10.596 INFO:tasks.workunit.client.0.smithi110.stdout:0/656: unlink d3/d4/f4a 0 2024-09-16T02:06:10.627 INFO:tasks.workunit.client.0.smithi110.stdout:8/530: symlink d3/d2b/d27/d45/lb4 0 2024-09-16T02:06:10.627 INFO:tasks.workunit.client.0.smithi110.stdout:5/590: symlink d5/lc0 0 2024-09-16T02:06:10.632 INFO:tasks.workunit.client.0.smithi110.stdout:8/531: dwrite d3/d2b/d27/da7/d1a/d36/d60/fb2 [0,4194304] 0 2024-09-16T02:06:10.666 INFO:tasks.workunit.client.0.smithi110.stdout:2/728: sync 2024-09-16T02:06:10.668 INFO:tasks.workunit.client.0.smithi110.stdout:9/741: rename d1/d5/c34 to d1/d1b/d23/d7c/cff 0 2024-09-16T02:06:10.673 INFO:tasks.workunit.client.0.smithi110.stdout:4/615: symlink d4/db4/lc0 0 2024-09-16T02:06:10.675 INFO:tasks.workunit.client.0.smithi110.stdout:7/483: dread d3/f90 [0,4194304] 0 2024-09-16T02:06:10.675 INFO:tasks.workunit.client.0.smithi110.stdout:7/484: chown d3/f19 2 1 2024-09-16T02:06:10.685 INFO:tasks.workunit.client.0.smithi110.stdout:2/729: write d0/d5f/ff1 [3811110,44207] 0 2024-09-16T02:06:10.687 INFO:tasks.workunit.client.0.smithi110.stdout:4/616: dread d4/db4/fa8 [4194304,4194304] 0 2024-09-16T02:06:10.688 INFO:tasks.workunit.client.0.smithi110.stdout:4/617: readlink d4/d8/d31/l3f 0 2024-09-16T02:06:10.689 INFO:tasks.workunit.client.0.smithi110.stdout:6/732: creat d0/d2/d5/d94/dba/dde/fe1 x:0 0 0 2024-09-16T02:06:10.690 INFO:tasks.workunit.client.0.smithi110.stdout:0/657: symlink d3/d4/dc/lc7 0 2024-09-16T02:06:10.691 INFO:tasks.workunit.client.0.smithi110.stdout:7/485: creat d3/d15/d81/f95 x:0 0 0 2024-09-16T02:06:10.692 INFO:tasks.workunit.client.0.smithi110.stdout:7/486: chown d3/d15/l1f 29 1 2024-09-16T02:06:10.693 INFO:tasks.workunit.client.0.smithi110.stdout:3/578: rmdir d8/d29/d45/dab 0 2024-09-16T02:06:10.694 INFO:tasks.workunit.client.0.smithi110.stdout:8/532: mkdir d3/d2b/d27/da7/d1a/d36/d60/da1/db5 0 2024-09-16T02:06:10.702 INFO:tasks.workunit.client.0.smithi110.stdout:7/487: unlink d3/d15/d38/d4f/d2e/f8b 0 2024-09-16T02:06:10.704 INFO:tasks.workunit.client.0.smithi110.stdout:3/579: fdatasync d8/d48/d5b/d92/dc7/f84 0 2024-09-16T02:06:10.708 INFO:tasks.workunit.client.0.smithi110.stdout:8/533: unlink d3/d2b/d27/d45/d66/d6b/c8e 0 2024-09-16T02:06:10.708 INFO:tasks.workunit.client.0.smithi110.stdout:2/730: write d0/db/d47/d48/dcd/f4a [1954527,7739] 0 2024-09-16T02:06:10.709 INFO:tasks.workunit.client.0.smithi110.stdout:6/733: write d0/d2/d5/d84/d62/fa6 [913139,60045] 0 2024-09-16T02:06:10.711 INFO:tasks.workunit.client.0.smithi110.stdout:9/742: dread d1/d5/f18 [0,4194304] 0 2024-09-16T02:06:10.711 INFO:tasks.workunit.client.0.smithi110.stdout:0/658: creat d3/d4/dc/d10/dbd/fc8 x:0 0 0 2024-09-16T02:06:10.713 INFO:tasks.workunit.client.0.smithi110.stdout:0/659: dread - d3/d4/d6d/f79 zero size 2024-09-16T02:06:10.713 INFO:tasks.workunit.client.0.smithi110.stdout:5/591: rename d5/dd/df/d11/d6d/l70 to d5/dd/lc1 0 2024-09-16T02:06:10.715 INFO:tasks.workunit.client.0.smithi110.stdout:7/488: truncate d3/f26 164845 0 2024-09-16T02:06:10.716 INFO:tasks.workunit.client.0.smithi110.stdout:6/734: truncate d0/d2/d5/d94/dba/dde/fe1 73438 0 2024-09-16T02:06:10.718 INFO:tasks.workunit.client.0.smithi110.stdout:2/731: rmdir d0/d5f/dc0/ddc/ddd 39 2024-09-16T02:06:10.720 INFO:tasks.workunit.client.0.smithi110.stdout:8/534: dwrite d3/d2b/d27/da7/d1a/d36/d87/fb3 [0,4194304] 0 2024-09-16T02:06:10.722 INFO:tasks.workunit.client.0.smithi110.stdout:8/535: chown d3/d2b/d27/d3a 173 1 2024-09-16T02:06:10.723 INFO:tasks.workunit.client.0.smithi110.stdout:5/592: rmdir d5/dd 39 2024-09-16T02:06:10.724 INFO:tasks.workunit.client.0.smithi110.stdout:0/660: dwrite d3/d4/dc/d14/d7e/d81/fa3 [0,4194304] 0 2024-09-16T02:06:10.724 INFO:tasks.workunit.client.0.smithi110.stdout:9/743: creat d1/dd/d6a/d6c/d6f/d79/de/d94/f100 x:0 0 0 2024-09-16T02:06:10.725 INFO:tasks.workunit.client.0.smithi110.stdout:9/744: chown d1/d5/dc4/ffa 0 1 2024-09-16T02:06:10.726 INFO:tasks.workunit.client.0.smithi110.stdout:9/745: dread - d1/dd/d6a/d6c/d6f/fde zero size 2024-09-16T02:06:10.731 INFO:tasks.workunit.client.0.smithi110.stdout:3/580: write d8/f56 [500958,9549] 0 2024-09-16T02:06:10.734 INFO:tasks.workunit.client.0.smithi110.stdout:2/732: creat d0/db/d47/d48/daa/f101 x:0 0 0 2024-09-16T02:06:10.737 INFO:tasks.workunit.client.0.smithi110.stdout:8/536: rmdir d3/d2b/d27/da7/d1a/d36/d60/d83 39 2024-09-16T02:06:10.739 INFO:tasks.workunit.client.0.smithi110.stdout:9/746: dwrite d1/dd/d6a/d6c/d75/fa6 [0,4194304] 0 2024-09-16T02:06:10.742 INFO:tasks.workunit.client.0.smithi110.stdout:7/489: dwrite d3/d15/d38/d4f/d10/d11/d73/d7b/f8e [0,4194304] 0 2024-09-16T02:06:10.746 INFO:tasks.workunit.client.0.smithi110.stdout:9/747: chown d1/dd/d6a/d6c/d9b/lb0 33487909 1 2024-09-16T02:06:10.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/490: chown d3/d15/d38/d4f/d2e/l5d 388015 1 2024-09-16T02:06:10.748 INFO:tasks.workunit.client.0.smithi110.stdout:0/661: symlink d3/d4/dc/d70/lc9 0 2024-09-16T02:06:10.750 INFO:tasks.workunit.client.0.smithi110.stdout:0/662: truncate d3/d4/dc/fb8 708361 0 2024-09-16T02:06:10.752 INFO:tasks.workunit.client.0.smithi110.stdout:8/537: rename d3/d2b/d27/d45/d66/l9b to d3/d2b/d27/da7/d1a/d36/d60/d62/lb6 0 2024-09-16T02:06:10.757 INFO:tasks.workunit.client.0.smithi110.stdout:9/748: getdents d1/dd/d6a/d6c/d6f/d79/d26/d8e/def 0 2024-09-16T02:06:10.760 INFO:tasks.workunit.client.0.smithi110.stdout:2/733: rename d0/d5f/dc0/ddc/ddd/d18/f31 to d0/db/d47/d48/dcd/d58/f102 0 2024-09-16T02:06:10.761 INFO:tasks.workunit.client.0.smithi110.stdout:7/491: creat d3/d15/d38/d4f/d10/d11/d8f/f96 x:0 0 0 2024-09-16T02:06:10.762 INFO:tasks.workunit.client.0.smithi110.stdout:5/593: creat d5/dd/df/d11/fc2 x:0 0 0 2024-09-16T02:06:10.767 INFO:tasks.workunit.client.0.smithi110.stdout:0/663: write d3/d6/d43/d55/f6f [1764255,123935] 0 2024-09-16T02:06:10.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/664: truncate d3/d92/fa9 1374687 0 2024-09-16T02:06:10.769 INFO:tasks.workunit.client.0.smithi110.stdout:9/749: creat d1/dd/d6a/d6c/d75/d86/f101 x:0 0 0 2024-09-16T02:06:10.773 INFO:tasks.workunit.client.0.smithi110.stdout:8/538: dread d3/f3c [0,4194304] 0 2024-09-16T02:06:10.776 INFO:tasks.workunit.client.0.smithi110.stdout:2/734: dread - d0/db/d47/d48/dcd/d41/f7e zero size 2024-09-16T02:06:10.776 INFO:tasks.workunit.client.0.smithi110.stdout:5/594: dread d5/dd/df/f35 [0,4194304] 0 2024-09-16T02:06:10.778 INFO:tasks.workunit.client.0.smithi110.stdout:0/665: dwrite d3/d6/d43/d55/fa4 [0,4194304] 0 2024-09-16T02:06:10.783 INFO:tasks.workunit.client.0.smithi110.stdout:3/581: link d8/d48/d5b/d92/f49 d8/d48/d5b/d92/dc7/fcf 0 2024-09-16T02:06:10.788 INFO:tasks.workunit.client.0.smithi110.stdout:0/666: dwrite d3/d6/d43/d55/f6f [0,4194304] 0 2024-09-16T02:06:10.791 INFO:tasks.workunit.client.0.smithi110.stdout:7/492: dwrite d3/d15/d38/d4f/d10/d11/f68 [0,4194304] 0 2024-09-16T02:06:10.793 INFO:tasks.workunit.client.0.smithi110.stdout:3/582: mknod d8/d29/d45/cd0 0 2024-09-16T02:06:10.793 INFO:tasks.workunit.client.0.smithi110.stdout:9/750: write d1/dd/d6a/d6c/d6f/d79/f68 [2281645,109982] 0 2024-09-16T02:06:10.794 INFO:tasks.workunit.client.0.smithi110.stdout:3/583: fsync d8/d29/fbe 0 2024-09-16T02:06:10.798 INFO:tasks.workunit.client.0.smithi110.stdout:7/493: creat d3/d7a/f97 x:0 0 0 2024-09-16T02:06:10.800 INFO:tasks.workunit.client.0.smithi110.stdout:8/539: rename d3/d2b/d27/da7/d1a/l28 to d3/d2b/d27/d45/lb7 0 2024-09-16T02:06:10.802 INFO:tasks.workunit.client.0.smithi110.stdout:8/540: stat d3/d2b/d27/da7/d1d/l4e 0 2024-09-16T02:06:10.808 INFO:tasks.workunit.client.0.smithi110.stdout:8/541: read d3/d2b/d27/da7/d1a/d36/d87/f93 [372380,70523] 0 2024-09-16T02:06:10.810 INFO:tasks.workunit.client.0.smithi110.stdout:2/735: rename d0/d5f/dc0/ddc/ddd/d18/dc/d9e/ffb to d0/db/d47/d48/dcd/d58/dec/d100/f103 0 2024-09-16T02:06:10.810 INFO:tasks.workunit.client.0.smithi110.stdout:8/542: write d3/d2b/d65/faa [939319,76345] 0 2024-09-16T02:06:10.811 INFO:tasks.workunit.client.0.smithi110.stdout:8/543: chown d3/d2b/d27/da7 6 1 2024-09-16T02:06:10.812 INFO:tasks.workunit.client.0.smithi110.stdout:3/584: creat d8/fd1 x:0 0 0 2024-09-16T02:06:10.813 INFO:tasks.workunit.client.0.smithi110.stdout:7/494: creat d3/d15/d38/d4f/d10/d11/d3e/f98 x:0 0 0 2024-09-16T02:06:10.815 INFO:tasks.workunit.client.0.smithi110.stdout:2/736: mkdir d0/d5f/dc0/ddc/ddd/dfa/d104 0 2024-09-16T02:06:10.815 INFO:tasks.workunit.client.0.smithi110.stdout:3/585: mknod d8/d48/d5b/d92/dc7/d1b/d36/cd2 0 2024-09-16T02:06:10.817 INFO:tasks.workunit.client.0.smithi110.stdout:2/737: stat d0/db/d47/d48/dcd/d41/db3/db8 0 2024-09-16T02:06:10.817 INFO:tasks.workunit.client.0.smithi110.stdout:8/544: mknod d3/cb8 0 2024-09-16T02:06:10.841 INFO:tasks.workunit.client.0.smithi110.stdout:7/495: creat d3/d15/d38/d4f/d10/d11/d3e/d40/f99 x:0 0 0 2024-09-16T02:06:10.844 INFO:tasks.workunit.client.0.smithi110.stdout:0/667: dread d3/d6/d4b/f4d [0,4194304] 0 2024-09-16T02:06:10.852 INFO:tasks.workunit.client.0.smithi110.stdout:9/751: dread d1/dd/f58 [4194304,4194304] 0 2024-09-16T02:06:10.853 INFO:tasks.workunit.client.0.smithi110.stdout:0/668: symlink d3/d4/d85/d93/lca 0 2024-09-16T02:06:10.854 INFO:tasks.workunit.client.0.smithi110.stdout:9/752: write d1/dd/d6a/d6c/d6f/fde [106827,65395] 0 2024-09-16T02:06:10.855 INFO:tasks.workunit.client.0.smithi110.stdout:2/738: rename d0/db/d47/d48/dcd to d0/db/d105 0 2024-09-16T02:06:10.858 INFO:tasks.workunit.client.0.smithi110.stdout:3/586: getdents d8/d48/d5b/d92/dc7/d1b/d36/d57 0 2024-09-16T02:06:10.860 INFO:tasks.workunit.client.0.smithi110.stdout:0/669: dwrite d3/d4/dc/d14/d7e/d81/d89/fb0 [0,4194304] 0 2024-09-16T02:06:10.863 INFO:tasks.workunit.client.0.smithi110.stdout:3/587: mkdir d8/d29/dbd/dc6/dd3 0 2024-09-16T02:06:10.864 INFO:tasks.workunit.client.0.smithi110.stdout:8/545: getdents d3/d2b/d27/da7/d1a/d36/d60/d62/d5f 0 2024-09-16T02:06:10.866 INFO:tasks.workunit.client.0.smithi110.stdout:9/753: creat d1/d5/d20/d83/f102 x:0 0 0 2024-09-16T02:06:10.867 INFO:tasks.workunit.client.0.smithi110.stdout:9/754: fsync d1/d1b/faf 0 2024-09-16T02:06:10.869 INFO:tasks.workunit.client.0.smithi110.stdout:0/670: creat d3/d4/dc/d14/d7e/d81/d89/fcb x:0 0 0 2024-09-16T02:06:10.870 INFO:tasks.workunit.client.0.smithi110.stdout:3/588: creat d8/d29/fd4 x:0 0 0 2024-09-16T02:06:10.876 INFO:tasks.workunit.client.0.smithi110.stdout:7/496: write d3/d15/d38/d4f/d10/d11/f5f [743116,22248] 0 2024-09-16T02:06:10.876 INFO:tasks.workunit.client.0.smithi110.stdout:9/755: mkdir d1/dd/d6a/d6c/d6f/d79/de/d1f/d103 0 2024-09-16T02:06:10.884 INFO:tasks.workunit.client.0.smithi110.stdout:2/739: getdents d0/db/d105/d58 0 2024-09-16T02:06:10.886 INFO:tasks.workunit.client.0.smithi110.stdout:9/756: creat d1/dd/f104 x:0 0 0 2024-09-16T02:06:10.888 INFO:tasks.workunit.client.0.smithi110.stdout:7/497: dread d3/f32 [0,4194304] 0 2024-09-16T02:06:10.888 INFO:tasks.workunit.client.0.smithi110.stdout:8/546: dread d3/d2b/d27/d45/d66/d6b/d8d/f9a [0,4194304] 0 2024-09-16T02:06:10.889 INFO:tasks.workunit.client.0.smithi110.stdout:3/589: write d8/d48/d5b/d92/dc7/d1b/f24 [2645031,21139] 0 2024-09-16T02:06:10.890 INFO:tasks.workunit.client.0.smithi110.stdout:7/498: fsync d3/d15/d38/d4f/d10/d11/d3e/d40/f60 0 2024-09-16T02:06:10.892 INFO:tasks.workunit.client.0.smithi110.stdout:0/671: creat d3/d4/dc/d14/fcc x:0 0 0 2024-09-16T02:06:10.894 INFO:tasks.workunit.client.0.smithi110.stdout:0/672: readlink d3/l3d 0 2024-09-16T02:06:10.896 INFO:tasks.workunit.client.0.smithi110.stdout:8/547: dread d3/d2b/d65/d7f/fa5 [0,4194304] 0 2024-09-16T02:06:10.899 INFO:tasks.workunit.client.0.smithi110.stdout:2/740: dwrite d0/d5f/f97 [0,4194304] 0 2024-09-16T02:06:10.905 INFO:tasks.workunit.client.0.smithi110.stdout:9/757: creat d1/d1b/d23/f105 x:0 0 0 2024-09-16T02:06:10.905 INFO:tasks.workunit.client.0.smithi110.stdout:7/499: rename d3/d15/d38/d4f/d10/d11/d3e/d40/c6b to d3/d7a/c9a 0 2024-09-16T02:06:10.910 INFO:tasks.workunit.client.0.smithi110.stdout:7/500: write d3/d15/d38/d4f/d10/d11/d73/d7b/f8e [3830757,117547] 0 2024-09-16T02:06:10.912 INFO:tasks.workunit.client.0.smithi110.stdout:9/758: read d1/dd/d6a/d6c/d6f/d79/d26/f76 [7934560,46241] 0 2024-09-16T02:06:10.912 INFO:tasks.workunit.client.0.smithi110.stdout:3/590: dwrite d8/d48/d5b/d92/dc7/fcf [4194304,4194304] 0 2024-09-16T02:06:10.913 INFO:tasks.workunit.client.0.smithi110.stdout:3/591: fdatasync f2 0 2024-09-16T02:06:10.914 INFO:tasks.workunit.client.0.smithi110.stdout:9/759: write d1/f4f [3820095,87116] 0 2024-09-16T02:06:10.930 INFO:tasks.workunit.client.0.smithi110.stdout:2/741: dread - d0/d5f/dc0/ddc/ddd/f7c zero size 2024-09-16T02:06:10.930 INFO:tasks.workunit.client.0.smithi110.stdout:2/742: readlink d0/d5f/dc0/ddc/ddd/db5/lbc 0 2024-09-16T02:06:10.936 INFO:tasks.workunit.client.0.smithi110.stdout:3/592: mknod d8/d29/cd5 0 2024-09-16T02:06:10.937 INFO:tasks.workunit.client.0.smithi110.stdout:9/760: write d1/dd/d6a/d6c/d75/d8c/f3a [1061270,8525] 0 2024-09-16T02:06:10.940 INFO:tasks.workunit.client.0.smithi110.stdout:8/548: creat d3/fb9 x:0 0 0 2024-09-16T02:06:10.942 INFO:tasks.workunit.client.0.smithi110.stdout:0/673: rename d3/d4/d41/f7f to d3/d4/d6d/fcd 0 2024-09-16T02:06:10.944 INFO:tasks.workunit.client.0.smithi110.stdout:0/674: write d3/d6/f39 [1331120,24199] 0 2024-09-16T02:06:10.944 INFO:tasks.workunit.client.0.smithi110.stdout:2/743: fsync d0/db/d105/d41/f4b 0 2024-09-16T02:06:10.945 INFO:tasks.workunit.client.0.smithi110.stdout:0/675: chown d3/d4/d41/c96 367778743 1 2024-09-16T02:06:10.946 INFO:tasks.workunit.client.0.smithi110.stdout:9/761: dread d1/d2b/f2d [0,4194304] 0 2024-09-16T02:06:10.954 INFO:tasks.workunit.client.0.smithi110.stdout:2/744: dwrite d0/d5f/dc0/ddc/ddd/dfa/f89 [0,4194304] 0 2024-09-16T02:06:10.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:10 smithi110 ceph-mon[27634]: pgmap v29: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 279 MiB/s wr, 621 op/s 2024-09-16T02:06:10.962 INFO:tasks.workunit.client.0.smithi110.stdout:9/762: dread d1/d5/dc4/ffa [0,4194304] 0 2024-09-16T02:06:10.967 INFO:tasks.workunit.client.0.smithi110.stdout:3/593: rmdir d8/d48/d5b/d92/dc7/d1b/d3a/d43/d80 0 2024-09-16T02:06:10.967 INFO:tasks.workunit.client.0.smithi110.stdout:8/549: dread d3/d2b/d27/da7/d1a/d36/d60/d62/f73 [0,4194304] 0 2024-09-16T02:06:10.968 INFO:tasks.workunit.client.0.smithi110.stdout:2/745: symlink d0/db/d47/da1/dad/dd5/l106 0 2024-09-16T02:06:10.977 INFO:tasks.workunit.client.0.smithi110.stdout:2/746: getdents d0/db/d47/d48 0 2024-09-16T02:06:10.978 INFO:tasks.workunit.client.0.smithi110.stdout:8/550: getdents d3/d2b/d27/da7/d1a/d36/d60/d62 0 2024-09-16T02:06:10.980 INFO:tasks.workunit.client.0.smithi110.stdout:8/551: mknod d3/d2b/d65/cba 0 2024-09-16T02:06:10.980 INFO:tasks.workunit.client.0.smithi110.stdout:7/501: write d3/d15/d38/d4f/d10/f3d [938040,100126] 0 2024-09-16T02:06:10.983 INFO:tasks.workunit.client.0.smithi110.stdout:2/747: rename d0/d5f/dc0/ddc/ddd/dfa/d3b/c8e to d0/d5f/dc0/ddc/ddd/db5/c107 0 2024-09-16T02:06:10.985 INFO:tasks.workunit.client.0.smithi110.stdout:7/502: truncate d3/f8 1019153 0 2024-09-16T02:06:10.988 INFO:tasks.workunit.client.0.smithi110.stdout:7/503: write d3/d15/d38/d4f/d10/d2c/f86 [748978,126808] 0 2024-09-16T02:06:10.992 INFO:tasks.workunit.client.0.smithi110.stdout:8/552: dread d3/fe [0,4194304] 0 2024-09-16T02:06:10.993 INFO:tasks.workunit.client.0.smithi110.stdout:7/504: dread d3/f90 [0,4194304] 0 2024-09-16T02:06:10.994 INFO:tasks.workunit.client.0.smithi110.stdout:8/553: symlink d3/d31/lbb 0 2024-09-16T02:06:10.998 INFO:tasks.workunit.client.0.smithi110.stdout:7/505: mkdir d3/d15/d38/d4f/d10/d11/d8f/d9b 0 2024-09-16T02:06:11.003 INFO:tasks.workunit.client.0.smithi110.stdout:3/594: dwrite d8/d29/dbd/f26 [0,4194304] 0 2024-09-16T02:06:11.003 INFO:tasks.workunit.client.0.smithi110.stdout:7/506: symlink d3/d15/d3a/l9c 0 2024-09-16T02:06:11.004 INFO:tasks.workunit.client.0.smithi110.stdout:3/595: fsync d8/d29/dbd/f38 0 2024-09-16T02:06:11.013 INFO:tasks.workunit.client.0.smithi110.stdout:8/554: write d3/d2b/d27/da7/d1a/d36/d60/d62/f73 [3256595,87929] 0 2024-09-16T02:06:11.015 INFO:tasks.workunit.client.0.smithi110.stdout:2/748: dwrite d0/db/d105/d41/fae [4194304,4194304] 0 2024-09-16T02:06:11.017 INFO:tasks.workunit.client.0.smithi110.stdout:8/555: write d3/d2b/d27/da7/d1d/f1f [2002945,264] 0 2024-09-16T02:06:11.020 INFO:tasks.workunit.client.0.smithi110.stdout:3/596: rename d8/d48/d5b/d92/dc7/d1b/d36/d57/d64/cc0 to d8/d29/dbd/cd6 0 2024-09-16T02:06:11.028 INFO:tasks.workunit.client.0.smithi110.stdout:8/556: dwrite d3/d2b/d27/d45/d66/d6b/fab [0,4194304] 0 2024-09-16T02:06:11.031 INFO:tasks.workunit.client.0.smithi110.stdout:8/557: dread - d3/d2b/d27/da7/d1a/d36/f8a zero size 2024-09-16T02:06:11.033 INFO:tasks.workunit.client.0.smithi110.stdout:7/507: dread d3/f13 [0,4194304] 0 2024-09-16T02:06:11.036 INFO:tasks.workunit.client.0.smithi110.stdout:3/597: rename d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/lc5 to d8/ld7 0 2024-09-16T02:06:11.043 INFO:tasks.workunit.client.0.smithi110.stdout:8/558: rename d3/d2b/d27/da7/f88 to d3/d2b/d27/da7/d1a/d36/d60/d62/d5f/fbc 0 2024-09-16T02:06:11.044 INFO:tasks.workunit.client.0.smithi110.stdout:8/559: fdatasync d3/d2b/f70 0 2024-09-16T02:06:11.044 INFO:tasks.workunit.client.0.smithi110.stdout:3/598: mkdir d8/d48/d5b/d92/dd8 0 2024-09-16T02:06:11.048 INFO:tasks.workunit.client.0.smithi110.stdout:7/508: creat d3/d15/d3a/d80/f9d x:0 0 0 2024-09-16T02:06:11.050 INFO:tasks.workunit.client.0.smithi110.stdout:2/749: dread d0/d5f/dc0/ddc/ddd/db5/fc7 [0,4194304] 0 2024-09-16T02:06:11.057 INFO:tasks.workunit.client.0.smithi110.stdout:8/560: rename d3/d2b/d27/da7/d1a/d36/d60/d62/d5f to d3/d2b/d27/da7/d1a/d36/d60/da1/dbd 0 2024-09-16T02:06:11.062 INFO:tasks.workunit.client.0.smithi110.stdout:8/561: rmdir d3/d2b/d27/da7/d1a/d6c 39 2024-09-16T02:06:11.064 INFO:tasks.workunit.client.0.smithi110.stdout:3/599: link d8/d48/d5b/d92/dc7/d1b/d36/l44 d8/d48/d5b/d92/dc7/d1b/d36/ld9 0 2024-09-16T02:06:11.064 INFO:tasks.workunit.client.0.smithi110.stdout:7/509: dwrite d3/d15/d38/d4f/d10/d11/f2d [0,4194304] 0 2024-09-16T02:06:11.066 INFO:tasks.workunit.client.0.smithi110.stdout:2/750: write d0/db/d47/d48/daa/fbd [377504,69265] 0 2024-09-16T02:06:11.067 INFO:tasks.workunit.client.0.smithi110.stdout:8/562: creat d3/d2b/d65/fbe x:0 0 0 2024-09-16T02:06:11.068 INFO:tasks.workunit.client.0.smithi110.stdout:8/563: fsync d3/d2b/f2e 0 2024-09-16T02:06:11.069 INFO:tasks.workunit.client.0.smithi110.stdout:3/600: dread - d8/d48/d5b/d92/dc7/d1b/d36/d83/fad zero size 2024-09-16T02:06:11.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.066+0000 7f5066299640 1 -- 172.21.15.110:0/3110752856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060103e30 msgr2=0x7f50601042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.066+0000 7f5066299640 1 --2- 172.21.15.110:0/3110752856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060103e30 0x7f50601042a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5048004810 tx=0x7f5048009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.067+0000 7f5066299640 1 -- 172.21.15.110:0/3110752856 shutdown_connections 2024-09-16T02:06:11.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.067+0000 7f5066299640 1 --2- 172.21.15.110:0/3110752856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060103e30 0x7f50601042a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.067+0000 7f5066299640 1 --2- 172.21.15.110:0/3110752856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060102b60 0x7f5060102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.067+0000 7f5066299640 1 -- 172.21.15.110:0/3110752856 >> 172.21.15.110:0/3110752856 conn(0x7f5060066450 msgr2=0x7f5060066870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:11.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.067+0000 7f5066299640 1 -- 172.21.15.110:0/3110752856 shutdown_connections 2024-09-16T02:06:11.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.067+0000 7f5066299640 1 -- 172.21.15.110:0/3110752856 wait complete. 2024-09-16T02:06:11.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.068+0000 7f5066299640 1 Processor -- start 2024-09-16T02:06:11.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.069+0000 7f5066299640 1 -- start start 2024-09-16T02:06:11.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5066299640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060102b60 0x7f5060113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5066299640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 0x7f5060113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5066299640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50601141a0 con 0x7f5060103e30 2024-09-16T02:06:11.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5066299640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50601149c0 con 0x7f5060102b60 2024-09-16T02:06:11.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5057fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 0x7f5060113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5057fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 0x7f5060113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51032/0 (socket says 172.21.15.110:51032) 2024-09-16T02:06:11.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.070+0000 7f5057fff640 1 -- 172.21.15.110:0/1632482366 learned_addr learned my addr 172.21.15.110:0/1632482366 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:11.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.071+0000 7f505ffff640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060102b60 0x7f5060113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.074 INFO:tasks.workunit.client.0.smithi110.stdout:3/601: stat d8/d48/d5b/d92/dc7/cd 0 2024-09-16T02:06:11.074 INFO:tasks.workunit.client.0.smithi110.stdout:7/510: creat d3/d62/d65/f9e x:0 0 0 2024-09-16T02:06:11.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.071+0000 7f5057fff640 1 -- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060102b60 msgr2=0x7f5060113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.071+0000 7f5057fff640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060102b60 0x7f5060113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.071+0000 7f5057fff640 1 -- 172.21.15.110:0/1632482366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048005040 con 0x7f5060103e30 2024-09-16T02:06:11.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.071+0000 7f5057fff640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 0x7f5060113b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5048003080 tx=0x7f5048009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:11.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.072+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5048038070 con 0x7f5060103e30 2024-09-16T02:06:11.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.072+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5060114bf0 con 0x7f5060103e30 2024-09-16T02:06:11.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.073+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060115190 con 0x7f5060103e30 2024-09-16T02:06:11.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.073+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5048009700 con 0x7f5060103e30 2024-09-16T02:06:11.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.073+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504803c630 con 0x7f5060103e30 2024-09-16T02:06:11.077 INFO:tasks.workunit.client.0.smithi110.stdout:2/751: read d0/db/f36 [5855407,40560] 0 2024-09-16T02:06:11.078 INFO:tasks.workunit.client.0.smithi110.stdout:8/564: dwrite d3/d31/f5a [0,4194304] 0 2024-09-16T02:06:11.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.076+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f5048030020 con 0x7f5060103e30 2024-09-16T02:06:11.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.076+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5060075a50 con 0x7f5060103e30 2024-09-16T02:06:11.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.077+0000 7f505d7fa640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f504c06e6e0 0x7f504c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.077+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f50480ada70 con 0x7f5060103e30 2024-09-16T02:06:11.080 INFO:tasks.workunit.client.0.smithi110.stdout:2/752: chown d0/db/d47/d48/c4c 112 1 2024-09-16T02:06:11.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.078+0000 7f505ffff640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f504c06e6e0 0x7f504c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.080+0000 7f505ffff640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f504c06e6e0 0x7f504c070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5050004a70 tx=0x7f505000b040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.086+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5048077580 con 0x7f5060103e30 2024-09-16T02:06:11.089 INFO:tasks.workunit.client.0.smithi110.stdout:2/753: rename d0/db/d47/d48/cc6 to d0/d5f/dc0/ddc/ddd/dfa/c108 0 2024-09-16T02:06:11.091 INFO:tasks.workunit.client.0.smithi110.stdout:7/511: write d3/f14 [4194813,21887] 0 2024-09-16T02:06:11.093 INFO:tasks.workunit.client.0.smithi110.stdout:7/512: readlink d3/d15/d38/d4f/d10/d2c/l77 0 2024-09-16T02:06:11.093 INFO:tasks.workunit.client.0.smithi110.stdout:3/602: write d8/f5c [420267,52647] 0 2024-09-16T02:06:11.098 INFO:tasks.workunit.client.0.smithi110.stdout:7/513: truncate d3/d15/d38/d4f/d2e/f71 954644 0 2024-09-16T02:06:11.101 INFO:tasks.workunit.client.0.smithi110.stdout:2/754: dwrite d0/d5f/dc0/ddc/ddd/d18/dc/ff5 [0,4194304] 0 2024-09-16T02:06:11.104 INFO:tasks.workunit.client.0.smithi110.stdout:2/755: readlink d0/d5f/dc0/ddc/ddd/d18/dc/d9e/lf8 0 2024-09-16T02:06:11.104 INFO:tasks.workunit.client.0.smithi110.stdout:7/514: mknod d3/d15/d38/d4f/d2e/c9f 0 2024-09-16T02:06:11.108 INFO:tasks.workunit.client.0.smithi110.stdout:8/565: dread d3/d2b/d27/da7/d1a/f40 [0,4194304] 0 2024-09-16T02:06:11.109 INFO:tasks.workunit.client.0.smithi110.stdout:8/566: chown d3/fb9 95936 1 2024-09-16T02:06:11.110 INFO:tasks.workunit.client.0.smithi110.stdout:7/515: mknod d3/ca0 0 2024-09-16T02:06:11.111 INFO:tasks.workunit.client.0.smithi110.stdout:7/516: fsync d3/f14 0 2024-09-16T02:06:11.112 INFO:tasks.workunit.client.0.smithi110.stdout:2/756: symlink d0/db/d105/d39/l109 0 2024-09-16T02:06:11.113 INFO:tasks.workunit.client.0.smithi110.stdout:3/603: link d8/d48/d5b/d92/dc7/d1b/d3a/c3f d8/d48/d5b/cda 0 2024-09-16T02:06:11.114 INFO:tasks.workunit.client.0.smithi110.stdout:2/757: chown d0/d5f/dc0/ddc/ddd/d18/dc/d9e/c52 79297959 1 2024-09-16T02:06:11.115 INFO:tasks.workunit.client.0.smithi110.stdout:8/567: symlink d3/d2b/d27/da7/d1a/d36/d87/lbf 0 2024-09-16T02:06:11.117 INFO:tasks.workunit.client.0.smithi110.stdout:3/604: mknod d8/d48/d5b/d92/dc7/d1b/d3a/d43/cdb 0 2024-09-16T02:06:11.119 INFO:tasks.workunit.client.0.smithi110.stdout:7/517: mknod d3/d15/d38/d4f/ca1 0 2024-09-16T02:06:11.120 INFO:tasks.workunit.client.0.smithi110.stdout:3/605: creat d8/d29/dbd/fdc x:0 0 0 2024-09-16T02:06:11.124 INFO:tasks.workunit.client.0.smithi110.stdout:3/606: rename d8/f22 to d8/d29/fdd 0 2024-09-16T02:06:11.125 INFO:tasks.workunit.client.0.smithi110.stdout:8/568: creat d3/d2b/d27/d45/fc0 x:0 0 0 2024-09-16T02:06:11.126 INFO:tasks.workunit.client.0.smithi110.stdout:2/758: write d0/db/d47/d48/f95 [534515,83173] 0 2024-09-16T02:06:11.127 INFO:tasks.workunit.client.0.smithi110.stdout:7/518: mkdir d3/d15/d38/d4f/d10/d7d/da2 0 2024-09-16T02:06:11.130 INFO:tasks.workunit.client.0.smithi110.stdout:7/519: fsync d3/d15/d38/d4f/f18 0 2024-09-16T02:06:11.131 INFO:tasks.workunit.client.0.smithi110.stdout:2/759: creat d0/d5f/dc0/ddc/ddd/d18/dc/d9e/f10a x:0 0 0 2024-09-16T02:06:11.131 INFO:tasks.workunit.client.0.smithi110.stdout:7/520: chown d3/d15/d38/d4f/d10/d2c/c57 919 1 2024-09-16T02:06:11.135 INFO:tasks.workunit.client.0.smithi110.stdout:2/760: mkdir d0/db/d47/da1/dad/d10b 0 2024-09-16T02:06:11.139 INFO:tasks.workunit.client.0.smithi110.stdout:7/521: fsync d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f92 0 2024-09-16T02:06:11.143 INFO:tasks.workunit.client.0.smithi110.stdout:2/761: dwrite d0/db/d47/d48/daa/fbd [0,4194304] 0 2024-09-16T02:06:11.144 INFO:tasks.workunit.client.0.smithi110.stdout:2/762: fsync d0/d5f/dc0/ddc/ddd/d18/dc/fee 0 2024-09-16T02:06:11.147 INFO:tasks.workunit.client.0.smithi110.stdout:8/569: link d3/d2b/d27/da7/d1d/c84 d3/d2b/d27/d45/d66/d6b/cc1 0 2024-09-16T02:06:11.152 INFO:tasks.workunit.client.0.smithi110.stdout:8/570: creat d3/d31/fc2 x:0 0 0 2024-09-16T02:06:11.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/522: creat d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/fa3 x:0 0 0 2024-09-16T02:06:11.155 INFO:tasks.workunit.client.0.smithi110.stdout:7/523: write d3/d15/d38/d4f/d10/d11/d3e/f98 [960726,50803] 0 2024-09-16T02:06:11.157 INFO:tasks.workunit.client.0.smithi110.stdout:7/524: chown d3/d15/d38/d4f/d10/d2c/f86 702 1 2024-09-16T02:06:11.160 INFO:tasks.workunit.client.0.smithi110.stdout:2/763: write d0/db/f36 [7034408,78265] 0 2024-09-16T02:06:11.163 INFO:tasks.workunit.client.0.smithi110.stdout:2/764: write d0/d5f/dc0/ddc/ddd/dfa/d3b/f53 [1680455,87287] 0 2024-09-16T02:06:11.166 INFO:tasks.workunit.client.0.smithi110.stdout:2/765: chown d0/d5f/dc0/ddc/ddd/db5/c107 2058929964 1 2024-09-16T02:06:11.166 INFO:tasks.workunit.client.0.smithi110.stdout:8/571: dread d3/d31/f50 [0,4194304] 0 2024-09-16T02:06:11.167 INFO:tasks.workunit.client.0.smithi110.stdout:2/766: dread - d0/db/d105/d41/f4f zero size 2024-09-16T02:06:11.168 INFO:tasks.workunit.client.0.smithi110.stdout:8/572: write d3/f44 [2291898,76058] 0 2024-09-16T02:06:11.168 INFO:tasks.workunit.client.0.smithi110.stdout:8/573: dread - d3/d31/f9f zero size 2024-09-16T02:06:11.171 INFO:tasks.workunit.client.0.smithi110.stdout:8/574: truncate d3/d2b/d27/da7/d1d/f1f 9417163 0 2024-09-16T02:06:11.178 INFO:tasks.workunit.client.0.smithi110.stdout:2/767: getdents d0/d5f/dc0 0 2024-09-16T02:06:11.180 INFO:tasks.workunit.client.0.smithi110.stdout:2/768: fdatasync d0/db/d105/d41/f85 0 2024-09-16T02:06:11.185 INFO:tasks.workunit.client.0.smithi110.stdout:8/575: dread d3/d2b/f52 [0,4194304] 0 2024-09-16T02:06:11.186 INFO:tasks.workunit.client.0.smithi110.stdout:2/769: unlink d0/d5f/dc0/ddc/ddd/d18/dc/l69 0 2024-09-16T02:06:11.189 INFO:tasks.workunit.client.0.smithi110.stdout:2/770: mknod d0/db/d105/d58/dec/d100/c10c 0 2024-09-16T02:06:11.190 INFO:tasks.workunit.client.0.smithi110.stdout:2/771: readlink d0/d5f/dc0/ddc/ddd/d18/dc/d9e/la5 0 2024-09-16T02:06:11.195 INFO:tasks.workunit.client.0.smithi110.stdout:8/576: link d3/d2b/d27/d45/d66/d6b/d8d/f9c d3/d2b/d27/da7/d1a/d36/d60/d62/fc3 0 2024-09-16T02:06:11.196 INFO:tasks.workunit.client.0.smithi110.stdout:2/772: stat d0/db/d105/d39/d87/c91 0 2024-09-16T02:06:11.198 INFO:tasks.workunit.client.0.smithi110.stdout:8/577: read d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/f77 [3099948,106202] 0 2024-09-16T02:06:11.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:10 smithi165 ceph-mon[34621]: pgmap v29: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 116 MiB/s rd, 279 MiB/s wr, 621 op/s 2024-09-16T02:06:11.203 INFO:tasks.workunit.client.0.smithi110.stdout:8/578: mknod d3/d2b/d27/da7/d1a/d36/d60/cc4 0 2024-09-16T02:06:11.206 INFO:tasks.workunit.client.0.smithi110.stdout:8/579: rename d3/d2b/d27/da7/d1a/d36/d60/d62/f73 to d3/d2b/d27/da7/d1a/d36/d60/d62/fc5 0 2024-09-16T02:06:11.207 INFO:tasks.workunit.client.0.smithi110.stdout:2/773: truncate d0/db/d105/f66 5971532 0 2024-09-16T02:06:11.211 INFO:tasks.workunit.client.0.smithi110.stdout:8/580: write d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/f9e [734868,13128] 0 2024-09-16T02:06:11.214 INFO:tasks.workunit.client.0.smithi110.stdout:8/581: readlink d3/d2b/d27/da7/l20 0 2024-09-16T02:06:11.218 INFO:tasks.workunit.client.0.smithi110.stdout:8/582: mkdir d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/dc6 0 2024-09-16T02:06:11.226 INFO:tasks.workunit.client.0.smithi110.stdout:2/774: dwrite d0/d5f/dc0/ddc/ddd/f7c [0,4194304] 0 2024-09-16T02:06:11.230 INFO:tasks.workunit.client.0.smithi110.stdout:8/583: truncate d3/d2b/d27/f47 2045675 0 2024-09-16T02:06:11.232 INFO:tasks.workunit.client.0.smithi110.stdout:8/584: write d3/d2b/d27/da7/d1a/d36/d60/f64 [1127004,88866] 0 2024-09-16T02:06:11.235 INFO:tasks.workunit.client.0.smithi110.stdout:8/585: chown d3/d2b/d27/l29 18 1 2024-09-16T02:06:11.237 INFO:tasks.workunit.client.0.smithi110.stdout:8/586: unlink d3/c1b 0 2024-09-16T02:06:11.238 INFO:tasks.workunit.client.0.smithi110.stdout:8/587: write d3/d2b/d27/d45/fc0 [375217,98163] 0 2024-09-16T02:06:11.239 INFO:tasks.workunit.client.0.smithi110.stdout:8/588: truncate d3/f85 141115 0 2024-09-16T02:06:11.240 INFO:tasks.workunit.client.0.smithi110.stdout:8/589: write d3/d2b/f2e [2813493,80954] 0 2024-09-16T02:06:11.253 INFO:tasks.workunit.client.0.smithi110.stdout:2/775: dwrite d0/d5f/dc0/ddc/ddd/f2c [0,4194304] 0 2024-09-16T02:06:11.257 INFO:tasks.workunit.client.0.smithi110.stdout:8/590: dread d3/d2b/f58 [0,4194304] 0 2024-09-16T02:06:11.257 INFO:tasks.workunit.client.0.smithi110.stdout:2/776: symlink d0/d5f/dc0/ddc/ddd/dfa/l10d 0 2024-09-16T02:06:11.258 INFO:tasks.workunit.client.0.smithi110.stdout:8/591: chown d3/d31/f50 3511 1 2024-09-16T02:06:11.258 INFO:tasks.workunit.client.0.smithi110.stdout:2/777: chown d0/db/d47/d48/lc9 1 1 2024-09-16T02:06:11.261 INFO:tasks.workunit.client.0.smithi110.stdout:8/592: mkdir d3/d2b/d27/da7/dc7 0 2024-09-16T02:06:11.261 INFO:tasks.workunit.client.0.smithi110.stdout:8/593: fdatasync d3/d31/fc2 0 2024-09-16T02:06:11.263 INFO:tasks.workunit.client.0.smithi110.stdout:8/594: rename d3/d2b/d27/da7/d1a/d36/d60 to d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/dc6/dc8 22 2024-09-16T02:06:11.265 INFO:tasks.workunit.client.0.smithi110.stdout:8/595: symlink d3/d2b/d27/d45/lc9 0 2024-09-16T02:06:11.267 INFO:tasks.workunit.client.0.smithi110.stdout:8/596: symlink d3/d2b/d27/da7/d1a/d36/lca 0 2024-09-16T02:06:11.282 INFO:tasks.workunit.client.0.smithi110.stdout:8/597: dwrite d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/f69 [0,4194304] 0 2024-09-16T02:06:11.285 INFO:tasks.workunit.client.0.smithi110.stdout:8/598: creat d3/d2b/d27/d3a/fcb x:0 0 0 2024-09-16T02:06:11.286 INFO:tasks.workunit.client.0.smithi110.stdout:8/599: write d3/f9 [7540037,93976] 0 2024-09-16T02:06:11.287 INFO:tasks.workunit.client.0.smithi110.stdout:8/600: write d3/d2b/d65/fbe [224046,29366] 0 2024-09-16T02:06:11.300 INFO:tasks.workunit.client.0.smithi110.stdout:8/601: dwrite d3/d2b/d27/da7/d1a/d36/f8b [0,4194304] 0 2024-09-16T02:06:11.301 INFO:tasks.workunit.client.0.smithi110.stdout:8/602: fsync d3/d2b/d65/faa 0 2024-09-16T02:06:11.307 INFO:tasks.workunit.client.0.smithi110.stdout:8/603: dread - d3/d2b/d27/d45/d66/d6b/d8d/f9c zero size 2024-09-16T02:06:11.321 INFO:tasks.workunit.client.0.smithi110.stdout:8/604: write d3/d2b/d27/da7/d1a/d36/f8a [280871,100771] 0 2024-09-16T02:06:11.323 INFO:tasks.workunit.client.0.smithi110.stdout:8/605: rmdir d3/d2b/d27/da7 39 2024-09-16T02:06:11.325 INFO:tasks.workunit.client.0.smithi110.stdout:8/606: symlink d3/d2b/lcc 0 2024-09-16T02:06:11.330 INFO:tasks.workunit.client.0.smithi110.stdout:8/607: rename d3/d2b/d27/d45/lc9 to d3/d2b/d27/d45/d66/d6b/d8d/lcd 0 2024-09-16T02:06:11.334 INFO:tasks.workunit.client.0.smithi110.stdout:8/608: fdatasync d3/d2b/d27/da7/d1a/d36/d60/f81 0 2024-09-16T02:06:11.339 INFO:tasks.workunit.client.0.smithi110.stdout:8/609: mkdir d3/d2b/d27/d45/dce 0 2024-09-16T02:06:11.339 INFO:tasks.workunit.client.0.smithi110.stdout:8/610: write d3/d31/fc2 [821471,129090] 0 2024-09-16T02:06:11.341 INFO:tasks.workunit.client.0.smithi110.stdout:8/611: write d3/d2b/f1e [4065133,42389] 0 2024-09-16T02:06:11.345 INFO:tasks.workunit.client.0.smithi110.stdout:8/612: creat d3/d2b/d27/da7/fcf x:0 0 0 2024-09-16T02:06:11.347 INFO:tasks.workunit.client.0.smithi110.stdout:8/613: write d3/d31/f50 [3304265,122146] 0 2024-09-16T02:06:11.354 INFO:tasks.workunit.client.0.smithi110.stdout:8/614: dwrite d3/d2b/d27/da7/d1a/d36/d60/fb2 [0,4194304] 0 2024-09-16T02:06:11.359 INFO:tasks.workunit.client.0.smithi110.stdout:8/615: dread d3/d31/f50 [0,4194304] 0 2024-09-16T02:06:11.374 INFO:tasks.workunit.client.0.smithi110.stdout:8/616: dread d3/d2b/d27/da7/d1a/d36/f4f [0,4194304] 0 2024-09-16T02:06:11.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.389+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50601154a0 con 0x7f504c06e6e0 2024-09-16T02:06:11.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.391+0000 7f505d7fa640 1 -- 172.21.15.110:0/1632482366 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f50601154a0 con 0x7f504c06e6e0 2024-09-16T02:06:11.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f504c06e6e0 msgr2=0x7f504c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f504c06e6e0 0x7f504c070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5050004a70 tx=0x7f505000b040 comp rx=0 tx=0).stop 2024-09-16T02:06:11.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 msgr2=0x7f5060113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 0x7f5060113b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5048003080 tx=0x7f5048009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 shutdown_connections 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f504c06e6e0 0x7f504c070b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5060103e30 0x7f5060113b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 --2- 172.21.15.110:0/1632482366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5060102b60 0x7f5060113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 >> 172.21.15.110:0/1632482366 conn(0x7f5060066450 msgr2=0x7f5060074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 shutdown_connections 2024-09-16T02:06:11.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.393+0000 7f5066299640 1 -- 172.21.15.110:0/1632482366 wait complete. 2024-09-16T02:06:11.403 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:06:11.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.472+0000 7f9c76066640 1 -- 172.21.15.110:0/2295077610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c700ff6a0 msgr2=0x7f9c70101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.472+0000 7f9c76066640 1 --2- 172.21.15.110:0/2295077610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c700ff6a0 0x7f9c70101a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9c600048d0 tx=0x7f9c60009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 -- 172.21.15.110:0/2295077610 shutdown_connections 2024-09-16T02:06:11.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 --2- 172.21.15.110:0/2295077610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c700ff6a0 0x7f9c70101a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 --2- 172.21.15.110:0/2295077610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c70066790 0x7f9c700ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 -- 172.21.15.110:0/2295077610 >> 172.21.15.110:0/2295077610 conn(0x7f9c700f6c10 msgr2=0x7f9c700f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:11.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 -- 172.21.15.110:0/2295077610 shutdown_connections 2024-09-16T02:06:11.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 -- 172.21.15.110:0/2295077610 wait complete. 2024-09-16T02:06:11.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 Processor -- start 2024-09-16T02:06:11.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.473+0000 7f9c76066640 1 -- start start 2024-09-16T02:06:11.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c76066640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 0x7f9c7010d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c76066640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c700ff6a0 0x7f9c7010d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c76066640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7010e4d0 con 0x7f9c70066790 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c76066640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7010e640 con 0x7f9c700ff6a0 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 0x7f9c7010d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 0x7f9c7010d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51060/0 (socket says 172.21.15.110:51060) 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 -- 172.21.15.110:0/929913858 learned_addr learned my addr 172.21.15.110:0/929913858 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6effd640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c700ff6a0 0x7f9c7010d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 -- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c700ff6a0 msgr2=0x7f9c7010d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c700ff6a0 0x7f9c7010d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 -- 172.21.15.110:0/929913858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60005040 con 0x7f9c70066790 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c6f7fe640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 0x7f9c7010d120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400b580 tx=0x7f9c640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c6400f570 con 0x7f9c70066790 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7010e920 con 0x7f9c70066790 2024-09-16T02:06:11.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c6400fb70 con 0x7f9c70066790 2024-09-16T02:06:11.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c64010d40 con 0x7f9c70066790 2024-09-16T02:06:11.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.474+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7010ee40 con 0x7f9c70066790 2024-09-16T02:06:11.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.475+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c70105800 con 0x7f9c70066790 2024-09-16T02:06:11.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.476+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f9c6400fce0 con 0x7f9c70066790 2024-09-16T02:06:11.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.476+0000 7f9c57fff640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f9c5806e6e0 0x7f9c58070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.477+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f9c6408dcc0 con 0x7f9c70066790 2024-09-16T02:06:11.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.477+0000 7f9c6effd640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f9c5806e6e0 0x7f9c58070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.477+0000 7f9c6effd640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f9c5806e6e0 0x7f9c58070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c60007ac0 tx=0x7f9c60035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:11.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.481+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9c64057720 con 0x7f9c70066790 2024-09-16T02:06:11.493 INFO:tasks.workunit.client.0.smithi110.stdout:4/618: sync 2024-09-16T02:06:11.493 INFO:tasks.workunit.client.0.smithi110.stdout:1/768: sync 2024-09-16T02:06:11.553 INFO:tasks.workunit.client.0.smithi110.stdout:4/619: dwrite d4/d8/d31/d80/d18/f1f [0,4194304] 0 2024-09-16T02:06:11.553 INFO:tasks.workunit.client.0.smithi110.stdout:1/769: truncate d0/d25/f4a 358397 0 2024-09-16T02:06:11.563 INFO:tasks.workunit.client.0.smithi110.stdout:1/770: dwrite d0/d1/d4/d46/d7a/fb2 [0,4194304] 0 2024-09-16T02:06:11.564 INFO:tasks.workunit.client.0.smithi110.stdout:1/771: write d0/d1/d2a/f7e [468106,92969] 0 2024-09-16T02:06:11.567 INFO:tasks.workunit.client.0.smithi110.stdout:1/772: dread - d0/d1/d4/d46/d7a/df4/fa9 zero size 2024-09-16T02:06:11.574 INFO:tasks.workunit.client.0.smithi110.stdout:1/773: unlink d0/d1/d2a/d32/f3a 0 2024-09-16T02:06:11.578 INFO:tasks.workunit.client.0.smithi110.stdout:1/774: creat d0/da/d8d/df6/dc4/d79/ffa x:0 0 0 2024-09-16T02:06:11.580 INFO:tasks.workunit.client.0.smithi110.stdout:4/620: dwrite d4/f86 [0,4194304] 0 2024-09-16T02:06:11.589 INFO:tasks.workunit.client.0.smithi110.stdout:4/621: symlink d4/d8/d17/d6b/d98/lc1 0 2024-09-16T02:06:11.590 INFO:tasks.workunit.client.0.smithi110.stdout:1/775: creat d0/d1/d2a/d9a/ffb x:0 0 0 2024-09-16T02:06:11.591 INFO:tasks.workunit.client.0.smithi110.stdout:1/776: fdatasync d0/d1/d4/d46/d7a/fb2 0 2024-09-16T02:06:11.593 INFO:tasks.workunit.client.0.smithi110.stdout:4/622: mknod d4/d8/d31/d80/d90/cc2 0 2024-09-16T02:06:11.596 INFO:tasks.workunit.client.0.smithi110.stdout:1/777: fdatasync d0/d25/d63/f89 0 2024-09-16T02:06:11.598 INFO:tasks.workunit.client.0.smithi110.stdout:1/778: fdatasync d0/da/d8d/df6/dc4/d79/fe6 0 2024-09-16T02:06:11.604 INFO:tasks.workunit.client.0.smithi110.stdout:4/623: dread d4/d8/d17/d23/d4c/d6d/d4f/f58 [0,4194304] 0 2024-09-16T02:06:11.605 INFO:tasks.workunit.client.0.smithi110.stdout:4/624: chown d4/d8/d31/d80/f24 803167468 1 2024-09-16T02:06:11.607 INFO:tasks.workunit.client.0.smithi110.stdout:4/625: mknod d4/d8/d17/d23/d4c/d6d/d7f/cc3 0 2024-09-16T02:06:11.611 INFO:tasks.workunit.client.0.smithi110.stdout:4/626: mkdir d4/d8/d17/d23/d4c/da5/db2/dc4 0 2024-09-16T02:06:11.614 INFO:tasks.workunit.client.0.smithi110.stdout:4/627: dread d4/d8/d17/d23/f9e [0,4194304] 0 2024-09-16T02:06:11.615 INFO:tasks.workunit.client.0.smithi110.stdout:4/628: write d4/d8/d17/d23/d4c/f9f [1506071,94728] 0 2024-09-16T02:06:11.618 INFO:tasks.workunit.client.0.smithi110.stdout:4/629: mkdir d4/d8/d31/d6f/d93/dc5 0 2024-09-16T02:06:11.653 INFO:tasks.workunit.client.0.smithi110.stdout:6/735: sync 2024-09-16T02:06:11.698 INFO:tasks.workunit.client.0.smithi110.stdout:6/736: write d0/d2/fc0 [609813,24667] 0 2024-09-16T02:06:11.703 INFO:tasks.workunit.client.0.smithi110.stdout:6/737: symlink d0/d2/d5/d84/le2 0 2024-09-16T02:06:11.707 INFO:tasks.workunit.client.0.smithi110.stdout:6/738: getdents d0/dd2 0 2024-09-16T02:06:11.712 INFO:tasks.workunit.client.0.smithi110.stdout:6/739: write d0/d29/d2a/d2d/d8b/faf [165144,23556] 0 2024-09-16T02:06:11.714 INFO:tasks.workunit.client.0.smithi110.stdout:6/740: truncate d0/d29/d2a/d2d/d98/fc5 4531061 0 2024-09-16T02:06:11.716 INFO:tasks.workunit.client.0.smithi110.stdout:6/741: creat d0/d29/dc1/fe3 x:0 0 0 2024-09-16T02:06:11.720 INFO:tasks.workunit.client.0.smithi110.stdout:6/742: dread d0/d2/d57/d7a/f9a [0,4194304] 0 2024-09-16T02:06:11.721 INFO:tasks.workunit.client.0.smithi110.stdout:6/743: chown d0/d2/d5/d84/d16/c76 175695 1 2024-09-16T02:06:11.728 INFO:tasks.workunit.client.0.smithi110.stdout:6/744: dwrite d0/d2/d5/db8/f7e [0,4194304] 0 2024-09-16T02:06:11.741 INFO:tasks.workunit.client.0.smithi110.stdout:6/745: dread d0/d2/f8d [0,4194304] 0 2024-09-16T02:06:11.747 INFO:tasks.workunit.client.0.smithi110.stdout:6/746: link d0/d2/d5/d94/dba/ldb d0/d2/d5/db8/dd1/dd8/le4 0 2024-09-16T02:06:11.749 INFO:tasks.workunit.client.0.smithi110.stdout:6/747: creat d0/d2/d5/db8/fe5 x:0 0 0 2024-09-16T02:06:11.751 INFO:tasks.workunit.client.0.smithi110.stdout:6/748: creat d0/d2/d5/d84/fe6 x:0 0 0 2024-09-16T02:06:11.752 INFO:tasks.workunit.client.0.smithi110.stdout:6/749: mkdir d0/d2/d57/d75/de7 0 2024-09-16T02:06:11.753 INFO:tasks.workunit.client.0.smithi110.stdout:6/750: creat d0/d2/d5/d55/fe8 x:0 0 0 2024-09-16T02:06:11.763 INFO:tasks.workunit.client.0.smithi110.stdout:6/751: write d0/d2/f3a [2841268,103808] 0 2024-09-16T02:06:11.769 INFO:tasks.workunit.client.0.smithi110.stdout:6/752: dread d0/d29/d2a/d2f/f99 [0,4194304] 0 2024-09-16T02:06:11.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.769+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c7010f060 con 0x7f9c5806e6e0 2024-09-16T02:06:11.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.770+0000 7f9c57fff640 1 -- 172.21.15.110:0/929913858 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f9c7010f060 con 0x7f9c5806e6e0 2024-09-16T02:06:11.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f9c5806e6e0 msgr2=0x7f9c58070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f9c5806e6e0 0x7f9c58070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c60007ac0 tx=0x7f9c60035040 comp rx=0 tx=0).stop 2024-09-16T02:06:11.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 msgr2=0x7f9c7010d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 0x7f9c7010d120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400b580 tx=0x7f9c640091a0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 shutdown_connections 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f9c5806e6e0 0x7f9c58070b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c700ff6a0 0x7f9c7010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 --2- 172.21.15.110:0/929913858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c70066790 0x7f9c7010d120 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.773+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 >> 172.21.15.110:0/929913858 conn(0x7f9c700f6c10 msgr2=0x7f9c700f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.774+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 shutdown_connections 2024-09-16T02:06:11.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.774+0000 7f9c76066640 1 -- 172.21.15.110:0/929913858 wait complete. 2024-09-16T02:06:11.779 INFO:tasks.workunit.client.0.smithi110.stdout:6/753: dwrite d0/d29/d2a/fa5 [0,4194304] 0 2024-09-16T02:06:11.783 INFO:tasks.workunit.client.0.smithi110.stdout:6/754: dread d0/d29/d2a/fa5 [0,4194304] 0 2024-09-16T02:06:11.788 INFO:tasks.workunit.client.0.smithi110.stdout:6/755: rename d0/d2/d5/d1e/d48/dbe to d0/d29/dc1/de9 0 2024-09-16T02:06:11.789 INFO:tasks.workunit.client.0.smithi110.stdout:6/756: mknod d0/d2/cea 0 2024-09-16T02:06:11.791 INFO:tasks.workunit.client.0.smithi110.stdout:6/757: write d0/d2/d57/d75/fe0 [8833209,32017] 0 2024-09-16T02:06:11.795 INFO:tasks.workunit.client.0.smithi110.stdout:6/758: mkdir d0/d29/d2a/d2d/deb 0 2024-09-16T02:06:11.797 INFO:tasks.workunit.client.0.smithi110.stdout:6/759: truncate d0/d2/f25 3258085 0 2024-09-16T02:06:11.798 INFO:tasks.workunit.client.0.smithi110.stdout:6/760: chown d0/d2/d5/d84/le2 7476681 1 2024-09-16T02:06:11.799 INFO:tasks.workunit.client.0.smithi110.stdout:6/761: truncate d0/d2/d5/db8/fdd 280252 0 2024-09-16T02:06:11.810 INFO:tasks.workunit.client.0.smithi110.stdout:6/762: truncate d0/d29/d2a/d2f/f5f 2090420 0 2024-09-16T02:06:11.811 INFO:tasks.workunit.client.0.smithi110.stdout:6/763: write d0/d2/d57/d75/f81 [564955,13725] 0 2024-09-16T02:06:11.814 INFO:tasks.workunit.client.0.smithi110.stdout:6/764: mknod d0/dd2/cec 0 2024-09-16T02:06:11.817 INFO:tasks.workunit.client.0.smithi110.stdout:6/765: mkdir d0/d2/d57/d75/ded 0 2024-09-16T02:06:11.818 INFO:tasks.workunit.client.0.smithi110.stdout:6/766: read - d0/d29/d2a/d2d/daa/fd9 zero size 2024-09-16T02:06:11.819 INFO:tasks.workunit.client.0.smithi110.stdout:6/767: truncate d0/d2/d5/d84/fe6 59933 0 2024-09-16T02:06:11.822 INFO:tasks.workunit.client.0.smithi110.stdout:6/768: dread d0/d2/f69 [0,4194304] 0 2024-09-16T02:06:11.824 INFO:tasks.workunit.client.0.smithi110.stdout:6/769: truncate d0/d2/d5/d84/f80 836068 0 2024-09-16T02:06:11.825 INFO:tasks.workunit.client.0.smithi110.stdout:6/770: write d0/d2/d18/f46 [1035379,27896] 0 2024-09-16T02:06:11.827 INFO:tasks.workunit.client.0.smithi110.stdout:6/771: symlink d0/dd2/lee 0 2024-09-16T02:06:11.830 INFO:tasks.workunit.client.0.smithi110.stdout:6/772: symlink d0/d2/d5/db8/dd1/dd8/lef 0 2024-09-16T02:06:11.835 INFO:tasks.workunit.client.0.smithi110.stdout:6/773: rename d0/d29/d2a/d2d/d98 to d0/d2/d57/d75/df0 0 2024-09-16T02:06:11.838 INFO:tasks.workunit.client.0.smithi110.stdout:6/774: unlink d0/d2/d5/db8/dd1/dd8/le4 0 2024-09-16T02:06:11.841 INFO:tasks.workunit.client.0.smithi110.stdout:6/775: symlink d0/d29/d2a/d2f/lf1 0 2024-09-16T02:06:11.842 INFO:tasks.workunit.client.0.smithi110.stdout:6/776: unlink d0/d2/d18/f59 0 2024-09-16T02:06:11.857 INFO:tasks.workunit.client.0.smithi110.stdout:6/777: dwrite d0/d2/d5/d84/f5d [4194304,4194304] 0 2024-09-16T02:06:11.857 INFO:tasks.workunit.client.0.smithi110.stdout:6/778: dread - d0/d29/fa1 zero size 2024-09-16T02:06:11.861 INFO:tasks.workunit.client.0.smithi110.stdout:6/779: rename d0/d2/d5/db8/cb3 to d0/d2/d18/cf2 0 2024-09-16T02:06:11.864 INFO:tasks.workunit.client.0.smithi110.stdout:6/780: mknod d0/d29/d2a/d2d/cf3 0 2024-09-16T02:06:11.867 INFO:tasks.workunit.client.0.smithi110.stdout:6/781: creat d0/d2/ff4 x:0 0 0 2024-09-16T02:06:11.869 INFO:tasks.workunit.client.0.smithi110.stdout:6/782: truncate d0/d2/d18/d1d/fd4 576923 0 2024-09-16T02:06:11.878 INFO:tasks.workunit.client.0.smithi110.stdout:6/783: dwrite d0/d2/d5/d1e/f40 [4194304,4194304] 0 2024-09-16T02:06:11.880 INFO:tasks.workunit.client.0.smithi110.stdout:5/595: sync 2024-09-16T02:06:11.883 INFO:tasks.workunit.client.0.smithi110.stdout:5/596: write d5/dd/df/d11/f2f [4355314,80454] 0 2024-09-16T02:06:11.886 INFO:tasks.workunit.client.0.smithi110.stdout:6/784: dread d0/d29/fd3 [0,4194304] 0 2024-09-16T02:06:11.887 INFO:tasks.workunit.client.0.smithi110.stdout:6/785: chown d0/d29/fd3 1604195 1 2024-09-16T02:06:11.888 INFO:tasks.workunit.client.0.smithi110.stdout:5/597: mkdir d5/dd/df/d28/d9c/dc3 0 2024-09-16T02:06:11.888 INFO:tasks.workunit.client.0.smithi110.stdout:5/598: readlink d5/lc0 0 2024-09-16T02:06:11.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.886+0000 7ffb8b65d640 1 -- 172.21.15.110:0/3775166628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840ffa40 msgr2=0x7ffb840ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.886+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/3775166628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840ffa40 0x7ffb840ffeb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffb740048d0 tx=0x7ffb74009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.887+0000 7ffb8b65d640 1 -- 172.21.15.110:0/3775166628 shutdown_connections 2024-09-16T02:06:11.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.887+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/3775166628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840ffa40 0x7ffb840ffeb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.887+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/3775166628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840fe770 0x7ffb840feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.887+0000 7ffb8b65d640 1 -- 172.21.15.110:0/3775166628 >> 172.21.15.110:0/3775166628 conn(0x7ffb840fa060 msgr2=0x7ffb840fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:11.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.887+0000 7ffb8b65d640 1 -- 172.21.15.110:0/3775166628 shutdown_connections 2024-09-16T02:06:11.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.887+0000 7ffb8b65d640 1 -- 172.21.15.110:0/3775166628 wait complete. 2024-09-16T02:06:11.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb8b65d640 1 Processor -- start 2024-09-16T02:06:11.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb8b65d640 1 -- start start 2024-09-16T02:06:11.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb8b65d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 0x7ffb84071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb8b65d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840ffa40 0x7ffb84072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb8b65d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84072a20 con 0x7ffb840fe770 2024-09-16T02:06:11.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb8b65d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840732e0 con 0x7ffb840ffa40 2024-09-16T02:06:11.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb893f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 0x7ffb84071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb893f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 0x7ffb84071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51084/0 (socket says 172.21.15.110:51084) 2024-09-16T02:06:11.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb893f9640 1 -- 172.21.15.110:0/383681802 learned_addr learned my addr 172.21.15.110:0/383681802 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:11.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb88bf8640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840ffa40 0x7ffb84072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb893f9640 1 -- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840ffa40 msgr2=0x7ffb84072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:11.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb893f9640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840ffa40 0x7ffb84072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:11.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.888+0000 7ffb893f9640 1 -- 172.21.15.110:0/383681802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74005040 con 0x7ffb840fe770 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb88bf8640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840ffa40 0x7ffb84072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb893f9640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 0x7ffb84071ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb80002a50 tx=0x7ffb80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb80007c30 con 0x7ffb840fe770 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb840735c0 con 0x7ffb840fe770 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb8000f040 con 0x7ffb840fe770 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb8000da90 con 0x7ffb840fe770 2024-09-16T02:06:11.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.889+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb84073b60 con 0x7ffb840fe770 2024-09-16T02:06:11.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.891+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb840fdbd0 con 0x7ffb840fe770 2024-09-16T02:06:11.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.892+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ffb8000dcd0 con 0x7ffb840fe770 2024-09-16T02:06:11.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.892+0000 7ffb79ffb640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ffb7006e6e0 0x7ffb70070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:11.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.892+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ffb8008d6d0 con 0x7ffb840fe770 2024-09-16T02:06:11.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.893+0000 7ffb88bf8640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ffb7006e6e0 0x7ffb70070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:11.897 INFO:tasks.workunit.client.0.smithi110.stdout:5/599: rename d5/f16 to d5/dd/df/d11/d6d/fc4 0 2024-09-16T02:06:11.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.893+0000 7ffb88bf8640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ffb7006e6e0 0x7ffb70070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007ac0 tx=0x7ffb74035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:11.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:11.900+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ffb8004f670 con 0x7ffb840fe770 2024-09-16T02:06:11.903 INFO:tasks.workunit.client.0.smithi110.stdout:5/600: write d5/dd/df/d11/d6d/f73 [1519003,86581] 0 2024-09-16T02:06:11.903 INFO:tasks.workunit.client.0.smithi110.stdout:6/786: dwrite d0/d2/d57/f95 [0,4194304] 0 2024-09-16T02:06:11.911 INFO:tasks.workunit.client.0.smithi110.stdout:5/601: stat d5/dd/df/d11/la3 0 2024-09-16T02:06:11.922 INFO:tasks.workunit.client.0.smithi110.stdout:5/602: dread d5/dd/f43 [0,4194304] 0 2024-09-16T02:06:11.936 INFO:tasks.workunit.client.0.smithi110.stdout:6/787: mkdir d0/d2/d57/d75/de7/df5 0 2024-09-16T02:06:11.938 INFO:tasks.workunit.client.0.smithi110.stdout:5/603: readlink d5/dd/df/d28/laf 0 2024-09-16T02:06:11.940 INFO:tasks.workunit.client.0.smithi110.stdout:5/604: truncate d5/dd/f17 2342613 0 2024-09-16T02:06:11.943 INFO:tasks.workunit.client.0.smithi110.stdout:6/788: creat d0/d2/d5/db8/ff6 x:0 0 0 2024-09-16T02:06:11.944 INFO:tasks.workunit.client.0.smithi110.stdout:6/789: chown d0/d2/d5/d84/d16 0 1 2024-09-16T02:06:11.945 INFO:tasks.workunit.client.0.smithi110.stdout:6/790: chown d0/d2/d5/d84/d16/c76 39 1 2024-09-16T02:06:11.950 INFO:tasks.workunit.client.0.smithi110.stdout:6/791: dwrite d0/d2/d57/f95 [0,4194304] 0 2024-09-16T02:06:11.952 INFO:tasks.workunit.client.0.smithi110.stdout:6/792: stat d0/d2/d5/d84/d16/l56 0 2024-09-16T02:06:11.953 INFO:tasks.workunit.client.0.smithi110.stdout:6/793: mknod d0/d29/d2a/d2f/cf7 0 2024-09-16T02:06:11.954 INFO:tasks.workunit.client.0.smithi110.stdout:6/794: chown d0/d29/d2a/lc2 177432 1 2024-09-16T02:06:11.960 INFO:tasks.workunit.client.0.smithi110.stdout:6/795: dwrite d0/d2/d18/f46 [0,4194304] 0 2024-09-16T02:06:11.963 INFO:tasks.workunit.client.0.smithi110.stdout:5/605: write d5/f7f [311435,58799] 0 2024-09-16T02:06:11.968 INFO:tasks.workunit.client.0.smithi110.stdout:5/606: mkdir d5/dd/df/d28/d6f/d8e/dac/dc5 0 2024-09-16T02:06:11.975 INFO:tasks.workunit.client.0.smithi110.stdout:5/607: dwrite d5/f8c [4194304,4194304] 0 2024-09-16T02:06:11.978 INFO:tasks.workunit.client.0.smithi110.stdout:5/608: chown d5/dd/d90/la8 384 1 2024-09-16T02:06:11.979 INFO:tasks.workunit.client.0.smithi110.stdout:5/609: readlink d5/l18 0 2024-09-16T02:06:11.980 INFO:tasks.workunit.client.0.smithi110.stdout:6/796: dwrite d0/d2/d57/d75/df0/f9d [0,4194304] 0 2024-09-16T02:06:11.981 INFO:tasks.workunit.client.0.smithi110.stdout:6/797: chown d0/d29/f32 57493803 1 2024-09-16T02:06:11.984 INFO:tasks.workunit.client.0.smithi110.stdout:5/610: creat d5/dd/df/d28/d9c/fc6 x:0 0 0 2024-09-16T02:06:11.985 INFO:tasks.workunit.client.0.smithi110.stdout:6/798: rename d0/d2/d5/d84/d16/f72 to d0/d2/d18/ff8 0 2024-09-16T02:06:11.986 INFO:tasks.workunit.client.0.smithi110.stdout:5/611: write d5/f1e [3564774,121286] 0 2024-09-16T02:06:11.988 INFO:tasks.workunit.client.0.smithi110.stdout:6/799: mkdir d0/d2/d5/db8/dd1/df9 0 2024-09-16T02:06:11.990 INFO:tasks.workunit.client.0.smithi110.stdout:5/612: mknod d5/cc7 0 2024-09-16T02:06:11.994 INFO:tasks.workunit.client.0.smithi110.stdout:5/613: dread d5/dd/f43 [0,4194304] 0 2024-09-16T02:06:12.006 INFO:tasks.workunit.client.0.smithi110.stdout:5/614: dread f0 [0,4194304] 0 2024-09-16T02:06:12.007 INFO:tasks.workunit.client.0.smithi110.stdout:5/615: readlink d5/l69 0 2024-09-16T02:06:12.010 INFO:tasks.workunit.client.0.smithi110.stdout:5/616: fsync d5/dd/df/d28/d9c/fc6 0 2024-09-16T02:06:12.012 INFO:tasks.workunit.client.0.smithi110.stdout:5/617: dread d5/d36/d3d/f9a [0,4194304] 0 2024-09-16T02:06:12.015 INFO:tasks.workunit.client.0.smithi110.stdout:5/618: unlink d5/dd/df/d28/d6f/d86/c99 0 2024-09-16T02:06:12.025 INFO:tasks.workunit.client.0.smithi110.stdout:5/619: write d5/dd/df/d11/d6d/fc4 [933431,40861] 0 2024-09-16T02:06:12.027 INFO:tasks.workunit.client.0.smithi110.stdout:5/620: creat d5/dd/df/d11/d6d/fc8 x:0 0 0 2024-09-16T02:06:12.040 INFO:tasks.workunit.client.0.smithi110.stdout:5/621: dwrite d5/dd/df/f38 [0,4194304] 0 2024-09-16T02:06:12.045 INFO:tasks.workunit.client.0.smithi110.stdout:5/622: creat d5/d36/fc9 x:0 0 0 2024-09-16T02:06:12.052 INFO:tasks.workunit.client.0.smithi110.stdout:5/623: dwrite d5/dd/df/f35 [4194304,4194304] 0 2024-09-16T02:06:12.059 INFO:tasks.workunit.client.0.smithi110.stdout:5/624: dwrite d5/dd/f10 [0,4194304] 0 2024-09-16T02:06:12.066 INFO:tasks.workunit.client.0.smithi110.stdout:5/625: creat d5/dd/df/d28/d6f/d8e/dbc/fca x:0 0 0 2024-09-16T02:06:12.081 INFO:tasks.workunit.client.0.smithi110.stdout:5/626: dwrite d5/d36/d3d/f9a [0,4194304] 0 2024-09-16T02:06:12.082 INFO:tasks.workunit.client.0.smithi110.stdout:5/627: write d5/dd/df/d28/d6f/f9d [995928,74229] 0 2024-09-16T02:06:12.086 INFO:tasks.workunit.client.0.smithi110.stdout:5/628: rmdir d5/dd/df/d11/d6d 39 2024-09-16T02:06:12.088 INFO:tasks.workunit.client.0.smithi110.stdout:5/629: read d5/f7f [663363,103171] 0 2024-09-16T02:06:12.094 INFO:tasks.workunit.client.0.smithi110.stdout:5/630: dread d5/dd/df/d11/f58 [0,4194304] 0 2024-09-16T02:06:12.095 INFO:tasks.workunit.client.0.smithi110.stdout:5/631: dread - d5/dd/df/d28/d9c/fc6 zero size 2024-09-16T02:06:12.101 INFO:tasks.workunit.client.0.smithi110.stdout:5/632: dwrite d5/dd/df/f9e [0,4194304] 0 2024-09-16T02:06:12.110 INFO:tasks.workunit.client.0.smithi110.stdout:5/633: dwrite d5/d36/fc9 [0,4194304] 0 2024-09-16T02:06:12.120 INFO:tasks.workunit.client.0.smithi110.stdout:5/634: rename d5/dd/f17 to d5/dd/df/d28/d6f/fcb 0 2024-09-16T02:06:12.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/635: write d5/dd/df/d28/d9c/fc6 [675639,120998] 0 2024-09-16T02:06:12.123 INFO:tasks.workunit.client.0.smithi110.stdout:5/636: fdatasync d5/d71/d89/fb6 0 2024-09-16T02:06:12.124 INFO:tasks.workunit.client.0.smithi110.stdout:5/637: chown d5/d36/d3d/c48 68 1 2024-09-16T02:06:12.125 INFO:tasks.workunit.client.0.smithi110.stdout:5/638: fdatasync d5/dd/df/d11/f58 0 2024-09-16T02:06:12.140 INFO:tasks.workunit.client.0.smithi110.stdout:5/639: dread d5/dd/df/d11/d6d/f7b [0,4194304] 0 2024-09-16T02:06:12.142 INFO:tasks.workunit.client.0.smithi110.stdout:5/640: fdatasync d5/dd/df/d28/d6f/d86/f97 0 2024-09-16T02:06:12.145 INFO:tasks.workunit.client.0.smithi110.stdout:5/641: mknod d5/dd/d90/ccc 0 2024-09-16T02:06:12.154 INFO:tasks.workunit.client.0.smithi110.stdout:5/642: write d5/f51 [5174180,126367] 0 2024-09-16T02:06:12.155 INFO:tasks.workunit.client.0.smithi110.stdout:5/643: stat d5/d36/d3d/c4d 0 2024-09-16T02:06:12.157 INFO:tasks.workunit.client.0.smithi110.stdout:5/644: dread d5/f61 [0,4194304] 0 2024-09-16T02:06:12.161 INFO:tasks.workunit.client.0.smithi110.stdout:5/645: dread d5/dd/f10 [0,4194304] 0 2024-09-16T02:06:12.173 INFO:tasks.workunit.client.0.smithi110.stdout:5/646: dread d5/dd/df/d28/d6f/d86/f97 [0,4194304] 0 2024-09-16T02:06:12.174 INFO:tasks.workunit.client.0.smithi110.stdout:5/647: chown d5/dd/df/d11/d6d/f7b 7 1 2024-09-16T02:06:12.184 INFO:tasks.workunit.client.0.smithi110.stdout:5/648: dwrite d5/dd/df/d28/d6f/d86/f97 [0,4194304] 0 2024-09-16T02:06:12.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.195+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb84073e40 con 0x7ffb7006e6e0 2024-09-16T02:06:12.197 INFO:tasks.workunit.client.0.smithi110.stdout:5/649: dwrite d5/dd/f12 [0,4194304] 0 2024-09-16T02:06:12.201 INFO:tasks.workunit.client.0.smithi110.stdout:5/650: creat d5/dd/fcd x:0 0 0 2024-09-16T02:06:12.203 INFO:tasks.workunit.client.0.smithi110.stdout:5/651: symlink d5/lce 0 2024-09-16T02:06:12.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.206+0000 7ffb79ffb640 1 -- 172.21.15.110:0/383681802 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffb84073e40 con 0x7ffb7006e6e0 2024-09-16T02:06:12.208 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:06:12.208 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (6m) 39s ago 8m 24.4M - 0.25.0 c8568f914cd2 d98e35b955ee 2024-09-16T02:06:12.208 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (8m) 39s ago 8m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:06:12.208 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (7m) 43s ago 7m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:06:12.208 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (6m) 39s ago 7m 89.2M - 9.4.7 954c08fa6188 02b51104ba52 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (2m) 39s ago 2m 138M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (2m) 39s ago 2m 149M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (2m) 43s ago 2m 14.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (2m) 43s ago 2m 11.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:9283,8765,8443 running (9m) 39s ago 9m 207M - 17.2.7-1633-g6d025bc2 33ed8dba3996 093819b4fc7f 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (65s) 43s ago 7m 482M - 19.1.1-326-g8921c8ef f1455bd0219c 059ca54552a6 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (9m) 39s ago 9m 49.0M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (7m) 43s ago 7m 38.1M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 starting - - - - 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (7m) 43s ago 7m 16.9M - 1.5.0 0da6a335fe13 60a3c227d383 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (6m) 39s ago 6m 78.4M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:06:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (6m) 39s ago 6m 79.0M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:06:12.210 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (5m) 39s ago 5m 71.6M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:06:12.210 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (5m) 43s ago 5m 79.4M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:06:12.210 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (4m) 43s ago 4m 72.5M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:06:12.210 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (4m) 43s ago 4m 76.1M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:06:12.210 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (6m) 39s ago 7m 64.5M - 2.43.0 a07b618ecd1d 63397dfd0974 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ffb7006e6e0 msgr2=0x7ffb70070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ffb7006e6e0 0x7ffb70070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007ac0 tx=0x7ffb74035040 comp rx=0 tx=0).stop 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 msgr2=0x7ffb84071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 0x7ffb84071ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb80002a50 tx=0x7ffb80004600 comp rx=0 tx=0).stop 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 shutdown_connections 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ffb7006e6e0 0x7ffb70070b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb840ffa40 0x7ffb84072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 --2- 172.21.15.110:0/383681802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb840fe770 0x7ffb84071ee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 >> 172.21.15.110:0/383681802 conn(0x7ffb840fa060 msgr2=0x7ffb840fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:12.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 shutdown_connections 2024-09-16T02:06:12.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.209+0000 7ffb8b65d640 1 -- 172.21.15.110:0/383681802 wait complete. 2024-09-16T02:06:12.221 INFO:tasks.workunit.client.0.smithi110.stdout:5/652: write d5/d71/d89/f94 [935635,130287] 0 2024-09-16T02:06:12.224 INFO:tasks.workunit.client.0.smithi110.stdout:5/653: unlink d5/dd/df/d28/d6f/d86/f97 0 2024-09-16T02:06:12.240 INFO:tasks.workunit.client.0.smithi110.stdout:5/654: dwrite d5/d36/f67 [4194304,4194304] 0 2024-09-16T02:06:12.243 INFO:tasks.workunit.client.0.smithi110.stdout:5/655: creat d5/dd/df/d28/d77/fcf x:0 0 0 2024-09-16T02:06:12.267 INFO:tasks.workunit.client.0.smithi110.stdout:5/656: dread d5/d36/d3d/f79 [0,4194304] 0 2024-09-16T02:06:12.268 INFO:tasks.workunit.client.0.smithi110.stdout:5/657: write d5/dd/df/f38 [1677704,82394] 0 2024-09-16T02:06:12.272 INFO:tasks.workunit.client.0.smithi110.stdout:5/658: creat d5/dd/df/d28/dab/fd0 x:0 0 0 2024-09-16T02:06:12.274 INFO:tasks.workunit.client.0.smithi110.stdout:5/659: mknod d5/dd/df/d28/d6f/cd1 0 2024-09-16T02:06:12.275 INFO:tasks.workunit.client.0.smithi110.stdout:5/660: write d5/dd/df/d11/d6d/fc8 [550079,17868] 0 2024-09-16T02:06:12.277 INFO:tasks.workunit.client.0.smithi110.stdout:5/661: dread - d5/dd/df/d28/d6f/d8e/dbc/fca zero size 2024-09-16T02:06:12.279 INFO:tasks.workunit.client.0.smithi110.stdout:5/662: creat d5/dd/df/d28/d77/d9f/fd2 x:0 0 0 2024-09-16T02:06:12.279 INFO:tasks.workunit.client.0.smithi110.stdout:5/663: chown d5/c66 2104 1 2024-09-16T02:06:12.281 INFO:tasks.workunit.client.0.smithi110.stdout:5/664: creat d5/dd/df/d28/d9c/fd3 x:0 0 0 2024-09-16T02:06:12.288 INFO:tasks.workunit.client.0.smithi110.stdout:5/665: dwrite d5/dd/df/d28/d77/fa6 [0,4194304] 0 2024-09-16T02:06:12.292 INFO:tasks.workunit.client.0.smithi110.stdout:5/666: mknod d5/dd/df/d11/d6d/cd4 0 2024-09-16T02:06:12.293 INFO:tasks.workunit.client.0.smithi110.stdout:5/667: write d5/dd/df/d11/fc2 [587914,131027] 0 2024-09-16T02:06:12.295 INFO:tasks.workunit.client.0.smithi110.stdout:5/668: write d5/dd/df/d11/f58 [775855,123626] 0 2024-09-16T02:06:12.297 INFO:tasks.workunit.client.0.smithi110.stdout:5/669: mkdir d5/d36/dd5 0 2024-09-16T02:06:12.298 INFO:tasks.workunit.client.0.smithi110.stdout:5/670: chown d5/l24 63524945 1 2024-09-16T02:06:12.304 INFO:tasks.workunit.client.0.smithi110.stdout:5/671: dwrite d5/dd/f12 [0,4194304] 0 2024-09-16T02:06:12.306 INFO:tasks.workunit.client.0.smithi110.stdout:5/672: readlink d5/dd/df/d11/l41 0 2024-09-16T02:06:12.309 INFO:tasks.workunit.client.0.smithi110.stdout:5/673: mkdir d5/dd/df/d28/d6f/d8e/dd6 0 2024-09-16T02:06:12.319 INFO:tasks.workunit.client.0.smithi110.stdout:5/674: link d5/dd/df/d92/lad d5/dd/df/d92/ld7 0 2024-09-16T02:06:12.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 -- 172.21.15.110:0/820296773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fb3e0 msgr2=0x7fd8080fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 --2- 172.21.15.110:0/820296773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fb3e0 0x7fd8080fb7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd804004810 tx=0x7fd804009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 -- 172.21.15.110:0/820296773 shutdown_connections 2024-09-16T02:06:12.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 --2- 172.21.15.110:0/820296773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fc6b0 0x7fd8080fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 --2- 172.21.15.110:0/820296773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fb3e0 0x7fd8080fb7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 -- 172.21.15.110:0/820296773 >> 172.21.15.110:0/820296773 conn(0x7fd8080f6b80 msgr2=0x7fd8080f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 -- 172.21.15.110:0/820296773 shutdown_connections 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.321+0000 7fd810563640 1 -- 172.21.15.110:0/820296773 wait complete. 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd810563640 1 Processor -- start 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd810563640 1 -- start start 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd810563640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fb3e0 0x7fd80810abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd810563640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fc6b0 0x7fd80810b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd810563640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80810b730 con 0x7fd8080fb3e0 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd810563640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808111250 con 0x7fd8080fc6b0 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80e2ff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fb3e0 0x7fd80810abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80dafe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fc6b0 0x7fd80810b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:12.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80e2ff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fb3e0 0x7fd80810abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51110/0 (socket says 172.21.15.110:51110) 2024-09-16T02:06:12.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80e2ff640 1 -- 172.21.15.110:0/1985518504 learned_addr learned my addr 172.21.15.110:0/1985518504 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:12.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80dafe640 1 -- 172.21.15.110:0/1985518504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fb3e0 msgr2=0x7fd80810abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80dafe640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fb3e0 0x7fd80810abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.322+0000 7fd80dafe640 1 -- 172.21.15.110:0/1985518504 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804005040 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.323+0000 7fd80dafe640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fc6b0 0x7fd80810b130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e930 tx=0x7fd7f800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.323+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f8007c30 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.323+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7f800f040 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.323+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f800c9c0 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.323+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8081114d0 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.323+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8081119f0 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.324+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8081045f0 con 0x7fd8080fc6b0 2024-09-16T02:06:12.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.325+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd7f800cb20 con 0x7fd8080fc6b0 2024-09-16T02:06:12.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.326+0000 7fd7feffd640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fd7f406e6f0 0x7fd7f4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:12.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.326+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd7f808d930 con 0x7fd8080fc6b0 2024-09-16T02:06:12.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.326+0000 7fd80e2ff640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fd7f406e6f0 0x7fd7f4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:12.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.327+0000 7fd80e2ff640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fd7f406e6f0 0x7fd7f4070ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd80810a9a0 tx=0x7fd804035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:12.329 INFO:tasks.workunit.client.0.smithi110.stdout:5/675: mknod d5/dd/df/d28/d6f/d8e/dd6/cd8 0 2024-09-16T02:06:12.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.331+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd7f8050670 con 0x7fd8080fc6b0 2024-09-16T02:06:12.338 INFO:tasks.workunit.client.0.smithi110.stdout:5/676: dwrite d5/f13 [0,4194304] 0 2024-09-16T02:06:12.340 INFO:tasks.workunit.client.0.smithi110.stdout:5/677: mknod d5/dd/df/d28/d6f/d8e/dbc/cd9 0 2024-09-16T02:06:12.342 INFO:tasks.workunit.client.0.smithi110.stdout:5/678: creat d5/d36/dd5/fda x:0 0 0 2024-09-16T02:06:12.349 INFO:tasks.workunit.client.0.smithi110.stdout:5/679: truncate d5/f7f 682463 0 2024-09-16T02:06:12.356 INFO:tasks.workunit.client.0.smithi110.stdout:5/680: dwrite d5/dd/df/d11/f58 [0,4194304] 0 2024-09-16T02:06:12.358 INFO:tasks.workunit.client.0.smithi110.stdout:5/681: truncate d5/f6 5187021 0 2024-09-16T02:06:12.359 INFO:tasks.workunit.client.0.smithi110.stdout:5/682: mknod d5/dd/d90/cdb 0 2024-09-16T02:06:12.360 INFO:tasks.workunit.client.0.smithi110.stdout:5/683: chown d5/f1e 154557 1 2024-09-16T02:06:12.362 INFO:tasks.workunit.client.0.smithi110.stdout:5/684: unlink d5/dd/df/d28/c3c 0 2024-09-16T02:06:12.369 INFO:tasks.workunit.client.0.smithi110.stdout:5/685: dwrite d5/dd/df/d11/fb9 [0,4194304] 0 2024-09-16T02:06:12.372 INFO:tasks.workunit.client.0.smithi110.stdout:5/686: mknod d5/dd/df/d28/dab/cdc 0 2024-09-16T02:06:12.373 INFO:tasks.workunit.client.0.smithi110.stdout:5/687: fdatasync d5/dd/df/d28/d77/fa6 0 2024-09-16T02:06:12.379 INFO:tasks.workunit.client.0.smithi110.stdout:5/688: rename d5/dd/df/d28/f30 to d5/dd/df/d11/d6d/fdd 0 2024-09-16T02:06:12.397 INFO:tasks.workunit.client.0.smithi110.stdout:5/689: truncate d5/f7f 481266 0 2024-09-16T02:06:12.401 INFO:tasks.workunit.client.0.smithi110.stdout:5/690: dread d5/d36/fc9 [0,4194304] 0 2024-09-16T02:06:12.401 INFO:tasks.workunit.client.0.smithi110.stdout:5/691: stat d5/lce 0 2024-09-16T02:06:12.404 INFO:tasks.workunit.client.0.smithi110.stdout:5/692: rmdir d5/dd/df/d28/d6f/d8e/dac 39 2024-09-16T02:06:12.405 INFO:tasks.workunit.client.0.smithi110.stdout:5/693: chown d5/dd/df/d28/d6f/d86 112 1 2024-09-16T02:06:12.407 INFO:tasks.workunit.client.0.smithi110.stdout:5/694: mkdir d5/dd/df/d28/d6f/d86/dde 0 2024-09-16T02:06:12.409 INFO:tasks.workunit.client.0.smithi110.stdout:5/695: creat d5/d36/db5/fdf x:0 0 0 2024-09-16T02:06:12.424 INFO:tasks.workunit.client.0.smithi110.stdout:5/696: dwrite d5/f7f [0,4194304] 0 2024-09-16T02:06:12.429 INFO:tasks.workunit.client.0.smithi110.stdout:5/697: creat d5/dd/fe0 x:0 0 0 2024-09-16T02:06:12.434 INFO:tasks.workunit.client.0.smithi110.stdout:5/698: rmdir d5/dd/df/d28/d6f/d86/dde 0 2024-09-16T02:06:12.436 INFO:tasks.workunit.client.0.smithi110.stdout:5/699: creat d5/dd/df/d28/d77/d9f/fe1 x:0 0 0 2024-09-16T02:06:12.441 INFO:tasks.workunit.client.0.smithi110.stdout:5/700: getdents d5/dd/df/d28/d6f/d8e/dbc 0 2024-09-16T02:06:12.444 INFO:tasks.workunit.client.0.smithi110.stdout:5/701: dread f4 [0,4194304] 0 2024-09-16T02:06:12.447 INFO:tasks.workunit.client.0.smithi110.stdout:5/702: write d5/dd/df/d11/f50 [1292799,118871] 0 2024-09-16T02:06:12.449 INFO:tasks.workunit.client.0.smithi110.stdout:5/703: mknod d5/d36/d45/ce2 0 2024-09-16T02:06:12.455 INFO:tasks.workunit.client.0.smithi110.stdout:5/704: dwrite d5/dd/df/d11/fa2 [0,4194304] 0 2024-09-16T02:06:12.457 INFO:tasks.workunit.client.0.smithi110.stdout:5/705: write d5/f2c [477159,126761] 0 2024-09-16T02:06:12.459 INFO:tasks.workunit.client.0.smithi110.stdout:5/706: mknod d5/dd/df/ce3 0 2024-09-16T02:06:12.463 INFO:tasks.workunit.client.0.smithi110.stdout:5/707: creat d5/d36/d45/d47/fe4 x:0 0 0 2024-09-16T02:06:12.464 INFO:tasks.workunit.client.0.smithi110.stdout:5/708: chown d5/l9 3043 1 2024-09-16T02:06:12.465 INFO:tasks.workunit.client.0.smithi110.stdout:3/607: sync 2024-09-16T02:06:12.468 INFO:tasks.workunit.client.0.smithi110.stdout:3/608: creat d8/d29/dbd/fde x:0 0 0 2024-09-16T02:06:12.468 INFO:tasks.workunit.client.0.smithi110.stdout:5/709: mkdir d5/d71/d8f/de5 0 2024-09-16T02:06:12.470 INFO:tasks.workunit.client.0.smithi110.stdout:5/710: write d5/dd/df/d11/d6d/fc8 [1499611,87759] 0 2024-09-16T02:06:12.475 INFO:tasks.workunit.client.0.smithi110.stdout:3/609: dwrite d8/d48/d5b/d92/dc7/d1b/d36/f9c [0,4194304] 0 2024-09-16T02:06:12.480 INFO:tasks.workunit.client.0.smithi110.stdout:3/610: fdatasync d8/d48/d5b/d92/dc7/f2b 0 2024-09-16T02:06:12.481 INFO:tasks.workunit.client.0.smithi110.stdout:5/711: link d5/d36/d45/d47/f88 d5/d71/d89/fe6 0 2024-09-16T02:06:12.481 INFO:tasks.workunit.client.0.smithi110.stdout:5/712: stat d5/dd/c34 0 2024-09-16T02:06:12.485 INFO:tasks.workunit.client.0.smithi110.stdout:5/713: mkdir d5/de7 0 2024-09-16T02:06:12.487 INFO:tasks.workunit.client.0.smithi110.stdout:3/611: truncate d8/d48/d5b/d92/dc7/d1b/d36/f71 3314803 0 2024-09-16T02:06:12.490 INFO:tasks.workunit.client.0.smithi110.stdout:5/714: symlink d5/dd/le8 0 2024-09-16T02:06:12.494 INFO:tasks.workunit.client.0.smithi110.stdout:3/612: rename d8/d48/d5b/d92/dc7/d1b/d3a/d43/f4e to d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/fdf 0 2024-09-16T02:06:12.495 INFO:tasks.workunit.client.0.smithi110.stdout:5/715: stat d5/d71/d89/fe6 0 2024-09-16T02:06:12.498 INFO:tasks.workunit.client.0.smithi110.stdout:5/716: mkdir d5/dd/df/d28/d77/de9 0 2024-09-16T02:06:12.499 INFO:tasks.workunit.client.0.smithi110.stdout:3/613: mknod d8/d48/d5b/d92/dc7/ce0 0 2024-09-16T02:06:12.501 INFO:tasks.workunit.client.0.smithi110.stdout:0/676: sync 2024-09-16T02:06:12.501 INFO:tasks.workunit.client.0.smithi110.stdout:0/677: dread - d3/d4/dc/d14/d7e/d81/d89/fcb zero size 2024-09-16T02:06:12.550 INFO:tasks.workunit.client.0.smithi110.stdout:9/763: sync 2024-09-16T02:06:12.551 INFO:tasks.workunit.client.0.smithi110.stdout:5/717: fdatasync d5/dd/df/d11/d6d/f74 0 2024-09-16T02:06:12.552 INFO:tasks.workunit.client.0.smithi110.stdout:9/764: readlink d1/dd/d6a/d6c/d6f/d79/de/d1f/lcf 0 2024-09-16T02:06:12.557 INFO:tasks.workunit.client.0.smithi110.stdout:3/614: truncate d8/d48/d5b/d6a/fb6 384443 0 2024-09-16T02:06:12.560 INFO:tasks.workunit.client.0.smithi110.stdout:5/718: dwrite d5/d36/d45/f56 [0,4194304] 0 2024-09-16T02:06:12.561 INFO:tasks.workunit.client.0.smithi110.stdout:5/719: fdatasync d5/d36/f67 0 2024-09-16T02:06:12.575 INFO:tasks.workunit.client.0.smithi110.stdout:5/720: write d5/dd/df/d11/f32 [609801,22915] 0 2024-09-16T02:06:12.579 INFO:tasks.workunit.client.0.smithi110.stdout:9/765: creat d1/dd/d6a/d6c/d6f/d79/de/d1f/d103/f106 x:0 0 0 2024-09-16T02:06:12.585 INFO:tasks.workunit.client.0.smithi110.stdout:0/678: dwrite d3/d4/dc/d10/f35 [0,4194304] 0 2024-09-16T02:06:12.587 INFO:tasks.workunit.client.0.smithi110.stdout:9/766: dwrite d1/d2b/fe1 [0,4194304] 0 2024-09-16T02:06:12.590 INFO:tasks.workunit.client.0.smithi110.stdout:9/767: chown d1/dd/d6a/d6c/d6f/d79/d29/c5d 0 1 2024-09-16T02:06:12.595 INFO:tasks.workunit.client.0.smithi110.stdout:5/721: dread d5/dd/df/d11/f2f [0,4194304] 0 2024-09-16T02:06:12.597 INFO:tasks.workunit.client.0.smithi110.stdout:9/768: mknod d1/d5/dc4/c107 0 2024-09-16T02:06:12.598 INFO:tasks.workunit.client.0.smithi110.stdout:0/679: creat d3/d6/d43/da7/fce x:0 0 0 2024-09-16T02:06:12.600 INFO:tasks.workunit.client.0.smithi110.stdout:5/722: dread - d5/dd/df/d28/d9c/fd3 zero size 2024-09-16T02:06:12.600 INFO:tasks.workunit.client.0.smithi110.stdout:3/615: dwrite d8/f79 [0,4194304] 0 2024-09-16T02:06:12.605 INFO:tasks.workunit.client.0.smithi110.stdout:3/616: write d8/d29/dbd/fde [25444,21149] 0 2024-09-16T02:06:12.612 INFO:tasks.workunit.client.0.smithi110.stdout:5/723: dwrite d5/d36/d3d/f9a [0,4194304] 0 2024-09-16T02:06:12.614 INFO:tasks.workunit.client.0.smithi110.stdout:0/680: symlink d3/d4/d85/d98/lcf 0 2024-09-16T02:06:12.619 INFO:tasks.workunit.client.0.smithi110.stdout:5/724: read d5/f6 [2033837,45407] 0 2024-09-16T02:06:12.621 INFO:tasks.workunit.client.0.smithi110.stdout:5/725: fsync d5/dd/df/d28/d77/fcf 0 2024-09-16T02:06:12.622 INFO:tasks.workunit.client.0.smithi110.stdout:3/617: unlink d8/d48/d5b/d92/dc7/d1b/d3a/d43/l61 0 2024-09-16T02:06:12.624 INFO:tasks.workunit.client.0.smithi110.stdout:0/681: mknod d3/d4/dc/d14/d7e/d81/cd0 0 2024-09-16T02:06:12.626 INFO:tasks.workunit.client.0.smithi110.stdout:0/682: dread - d3/d6/d43/d55/d59/f88 zero size 2024-09-16T02:06:12.630 INFO:tasks.workunit.client.0.smithi110.stdout:3/618: write d8/d48/d5b/d92/dc7/d1b/d36/fc1 [2899165,11782] 0 2024-09-16T02:06:12.643 INFO:tasks.workunit.client.0.smithi110.stdout:0/683: link d3/d4/dc/d10/lc3 d3/d4/dc/d14/ld1 0 2024-09-16T02:06:12.645 INFO:tasks.workunit.client.0.smithi110.stdout:3/619: getdents d8/d48/d4b 0 2024-09-16T02:06:12.647 INFO:tasks.workunit.client.0.smithi110.stdout:0/684: mknod d3/d4/dc/d14/d7e/d81/cd2 0 2024-09-16T02:06:12.652 INFO:tasks.workunit.client.0.smithi110.stdout:9/769: write d1/dd/d6a/d6c/d75/d8c/d38/d3d/f4e [5401545,94406] 0 2024-09-16T02:06:12.660 INFO:tasks.workunit.client.0.smithi110.stdout:5/726: dwrite d5/f6 [0,4194304] 0 2024-09-16T02:06:12.662 INFO:tasks.workunit.client.0.smithi110.stdout:3/620: dread d8/f1e [0,4194304] 0 2024-09-16T02:06:12.667 INFO:tasks.workunit.client.0.smithi110.stdout:9/770: dread d1/d1b/f1d [0,4194304] 0 2024-09-16T02:06:12.668 INFO:tasks.workunit.client.0.smithi110.stdout:5/727: dwrite d5/f6 [0,4194304] 0 2024-09-16T02:06:12.670 INFO:tasks.workunit.client.0.smithi110.stdout:9/771: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/l65 37270 1 2024-09-16T02:06:12.672 INFO:tasks.workunit.client.0.smithi110.stdout:5/728: symlink d5/dd/df/d92/lea 0 2024-09-16T02:06:12.677 INFO:tasks.workunit.client.0.smithi110.stdout:3/621: write d8/d48/d5b/d92/dc7/f7e [2414848,115543] 0 2024-09-16T02:06:12.679 INFO:tasks.workunit.client.0.smithi110.stdout:3/622: truncate d8/fd1 809210 0 2024-09-16T02:06:12.685 INFO:tasks.workunit.client.0.smithi110.stdout:3/623: mknod d8/d48/d5b/ce1 0 2024-09-16T02:06:12.687 INFO:tasks.workunit.client.0.smithi110.stdout:3/624: read d8/d48/d5b/d92/f8a [3823,92165] 0 2024-09-16T02:06:12.688 INFO:tasks.workunit.client.0.smithi110.stdout:3/625: chown d8/d29 17163 1 2024-09-16T02:06:12.689 INFO:tasks.workunit.client.0.smithi110.stdout:5/729: dwrite f0 [0,4194304] 0 2024-09-16T02:06:12.695 INFO:tasks.workunit.client.0.smithi110.stdout:5/730: getdents d5/dd/df/d28/d6f/d8e 0 2024-09-16T02:06:12.697 INFO:tasks.workunit.client.0.smithi110.stdout:5/731: unlink d5/f1e 0 2024-09-16T02:06:12.701 INFO:tasks.workunit.client.0.smithi110.stdout:5/732: truncate d5/d36/f64 448406 0 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.699+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd808103f30 con 0x7fd8080fc6b0 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.700+0000 7fd7feffd640 1 -- 172.21.15.110:0/1985518504 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fd7f8057330 con 0x7fd8080fc6b0 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:06:12.702 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 1, 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 13, 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:06:12.703 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:06:12.704 INFO:tasks.workunit.client.0.smithi110.stdout:5/733: chown d5/dd/df/d28/d6f/fcb 45904 1 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.702+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fd7f406e6f0 msgr2=0x7fd7f4070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fd7f406e6f0 0x7fd7f4070ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd80810a9a0 tx=0x7fd804035040 comp rx=0 tx=0).stop 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fc6b0 msgr2=0x7fd80810b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fc6b0 0x7fd80810b130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e930 tx=0x7fd7f800b040 comp rx=0 tx=0).stop 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 shutdown_connections 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fd7f406e6f0 0x7fd7f4070ba0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8080fc6b0 0x7fd80810b130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 --2- 172.21.15.110:0/1985518504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8080fb3e0 0x7fd80810abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 >> 172.21.15.110:0/1985518504 conn(0x7fd8080f6b80 msgr2=0x7fd8080f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:12.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 shutdown_connections 2024-09-16T02:06:12.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.703+0000 7fd810563640 1 -- 172.21.15.110:0/1985518504 wait complete. 2024-09-16T02:06:12.707 INFO:tasks.workunit.client.0.smithi110.stdout:5/734: link d5/dd/f12 d5/d36/d45/d47/feb 0 2024-09-16T02:06:12.708 INFO:tasks.workunit.client.0.smithi110.stdout:9/772: dread d1/d5/f18 [4194304,4194304] 0 2024-09-16T02:06:12.710 INFO:tasks.workunit.client.0.smithi110.stdout:5/735: creat d5/dd/df/d28/fec x:0 0 0 2024-09-16T02:06:12.712 INFO:tasks.workunit.client.0.smithi110.stdout:9/773: rename d1/dd/d6a/d6c/d6f/d79/d26/f85 to d1/dd/d6a/d6c/d6f/d79/d26/d8e/f108 0 2024-09-16T02:06:12.714 INFO:tasks.workunit.client.0.smithi110.stdout:9/774: stat d1/d5/fa4 0 2024-09-16T02:06:12.715 INFO:tasks.workunit.client.0.smithi110.stdout:9/775: chown d1/d2b/fe1 833027 1 2024-09-16T02:06:12.716 INFO:tasks.workunit.client.0.smithi110.stdout:5/736: link d5/dd/df/c31 d5/dd/ced 0 2024-09-16T02:06:12.716 INFO:tasks.workunit.client.0.smithi110.stdout:9/776: dread - d1/dd/d6a/d6c/d75/d86/fad zero size 2024-09-16T02:06:12.717 INFO:tasks.workunit.client.0.smithi110.stdout:5/737: readlink d5/d36/d3d/l5a 0 2024-09-16T02:06:12.717 INFO:tasks.workunit.client.0.smithi110.stdout:9/777: readlink d1/dd/d6a/d6c/d6f/d79/l5a 0 2024-09-16T02:06:12.722 INFO:tasks.workunit.client.0.smithi110.stdout:5/738: mknod d5/dd/df/d11/cee 0 2024-09-16T02:06:12.728 INFO:tasks.workunit.client.0.smithi110.stdout:5/739: rename d5/l7e to d5/dd/df/d28/d6f/d8e/dac/dc5/lef 0 2024-09-16T02:06:12.728 INFO:tasks.workunit.client.0.smithi110.stdout:5/740: readlink d5/dd/d90/lb2 0 2024-09-16T02:06:12.730 INFO:tasks.workunit.client.0.smithi110.stdout:5/741: symlink d5/dd/df/d11/d6d/lf0 0 2024-09-16T02:06:12.734 INFO:tasks.workunit.client.0.smithi110.stdout:5/742: symlink d5/dd/df/d28/d77/lf1 0 2024-09-16T02:06:12.740 INFO:tasks.workunit.client.0.smithi110.stdout:5/743: dwrite d5/d36/dd5/fda [0,4194304] 0 2024-09-16T02:06:12.742 INFO:tasks.workunit.client.0.smithi110.stdout:5/744: write d5/f51 [1784394,111570] 0 2024-09-16T02:06:12.742 INFO:tasks.workunit.client.0.smithi110.stdout:9/778: write d1/dd/d6a/f7a [753714,81798] 0 2024-09-16T02:06:12.746 INFO:tasks.workunit.client.0.smithi110.stdout:5/745: chown d5/d36/d45/d47/l5e 21 1 2024-09-16T02:06:12.750 INFO:tasks.workunit.client.0.smithi110.stdout:9/779: rmdir d1/dd/d6a/d6c/d6f/d79/d26/d8e 39 2024-09-16T02:06:12.751 INFO:tasks.workunit.client.0.smithi110.stdout:5/746: dread d5/dd/df/d28/d77/fa6 [0,4194304] 0 2024-09-16T02:06:12.754 INFO:tasks.workunit.client.0.smithi110.stdout:9/780: unlink d1/dd/d6a/d6c/d75/d8c/d38/d3d/lb2 0 2024-09-16T02:06:12.757 INFO:tasks.workunit.client.0.smithi110.stdout:5/747: rmdir d5/dd/df/d28/d77 39 2024-09-16T02:06:12.760 INFO:tasks.workunit.client.0.smithi110.stdout:5/748: creat d5/dd/df/d28/d6f/d8e/dac/ff2 x:0 0 0 2024-09-16T02:06:12.762 INFO:tasks.workunit.client.0.smithi110.stdout:5/749: write d5/dd/df/d11/fa2 [2002492,79331] 0 2024-09-16T02:06:12.765 INFO:tasks.workunit.client.0.smithi110.stdout:5/750: chown d5/d36/f67 22 1 2024-09-16T02:06:12.765 INFO:tasks.workunit.client.0.smithi110.stdout:9/781: write d1/dd/f58 [5015219,63011] 0 2024-09-16T02:06:12.765 INFO:tasks.workunit.client.0.smithi110.stdout:5/751: write d5/dd/df/d11/fc2 [773283,57487] 0 2024-09-16T02:06:12.769 INFO:tasks.workunit.client.0.smithi110.stdout:9/782: mkdir d1/d1b/daa/d109 0 2024-09-16T02:06:12.769 INFO:tasks.workunit.client.0.smithi110.stdout:5/752: dread d5/dd/df/d11/d6d/f74 [0,4194304] 0 2024-09-16T02:06:12.771 INFO:tasks.workunit.client.0.smithi110.stdout:5/753: chown d5/d36/d3d/cb8 577594 1 2024-09-16T02:06:12.771 INFO:tasks.workunit.client.0.smithi110.stdout:5/754: write d5/f6 [4979710,76336] 0 2024-09-16T02:06:12.781 INFO:tasks.workunit.client.0.smithi110.stdout:5/755: dwrite d5/dd/f2b [0,4194304] 0 2024-09-16T02:06:12.782 INFO:tasks.workunit.client.0.smithi110.stdout:9/783: dread d1/dd/d6a/d6c/d6f/ff2 [0,4194304] 0 2024-09-16T02:06:12.785 INFO:tasks.workunit.client.0.smithi110.stdout:5/756: read - d5/dd/df/d28/d6f/d8e/dbc/fca zero size 2024-09-16T02:06:12.786 INFO:tasks.workunit.client.0.smithi110.stdout:5/757: fdatasync d5/d36/f67 0 2024-09-16T02:06:12.786 INFO:tasks.workunit.client.0.smithi110.stdout:9/784: read d1/dd/d6a/d6c/d6f/d79/d29/fb3 [740235,69758] 0 2024-09-16T02:06:12.792 INFO:tasks.workunit.client.0.smithi110.stdout:5/758: dwrite d5/d36/f67 [0,4194304] 0 2024-09-16T02:06:12.793 INFO:tasks.workunit.client.0.smithi110.stdout:5/759: fsync d5/dd/fcd 0 2024-09-16T02:06:12.796 INFO:tasks.workunit.client.0.smithi110.stdout:5/760: fsync d5/dd/df/d28/f6b 0 2024-09-16T02:06:12.797 INFO:tasks.workunit.client.0.smithi110.stdout:5/761: truncate d5/d36/f67 9063870 0 2024-09-16T02:06:12.798 INFO:tasks.workunit.client.0.smithi110.stdout:5/762: chown d5/dd 7672 1 2024-09-16T02:06:12.801 INFO:tasks.workunit.client.0.smithi110.stdout:5/763: symlink d5/d71/lf3 0 2024-09-16T02:06:12.804 INFO:tasks.workunit.client.0.smithi110.stdout:5/764: rmdir d5/dd/df/d28/d6f/d8e/dac/dc5 39 2024-09-16T02:06:12.810 INFO:tasks.workunit.client.0.smithi110.stdout:5/765: dwrite d5/dd/df/d11/f32 [0,4194304] 0 2024-09-16T02:06:12.814 INFO:tasks.workunit.client.0.smithi110.stdout:5/766: rmdir d5/d71/d89 39 2024-09-16T02:06:12.818 INFO:tasks.workunit.client.0.smithi110.stdout:5/767: creat d5/dd/df/d28/ff4 x:0 0 0 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.823+0000 7f580e238640 1 -- 172.21.15.110:0/4232530622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fe4c0 msgr2=0x7f58080fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.823+0000 7f580e238640 1 --2- 172.21.15.110:0/4232530622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fe4c0 0x7f58080fa620 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0048d0 tx=0x7f57fc009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.823+0000 7f580e238640 1 -- 172.21.15.110:0/4232530622 shutdown_connections 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.823+0000 7f580e238640 1 --2- 172.21.15.110:0/4232530622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fe4c0 0x7f58080fa620 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.824+0000 7f580e238640 1 --2- 172.21.15.110:0/4232530622 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58080fdb70 0x7f58080fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.824+0000 7f580e238640 1 -- 172.21.15.110:0/4232530622 >> 172.21.15.110:0/4232530622 conn(0x7f58080f6390 msgr2=0x7f58080f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.824+0000 7f580e238640 1 -- 172.21.15.110:0/4232530622 shutdown_connections 2024-09-16T02:06:12.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.824+0000 7f580e238640 1 -- 172.21.15.110:0/4232530622 wait complete. 2024-09-16T02:06:12.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.824+0000 7f580e238640 1 Processor -- start 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.824+0000 7f580e238640 1 -- start start 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f580e238640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 0x7f580810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f580e238640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58080fe4c0 0x7f580810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f580e238640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580810dc30 con 0x7f58080fdb70 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f580e238640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580810e450 con 0x7f58080fe4c0 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 0x7f580810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 0x7f580810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51118/0 (socket says 172.21.15.110:51118) 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 -- 172.21.15.110:0/2297460534 learned_addr learned my addr 172.21.15.110:0/2297460534 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:12.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f5806ffd640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58080fe4c0 0x7f580810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:12.829 INFO:tasks.workunit.client.0.smithi110.stdout:5/768: link d5/dd/df/d11/c46 d5/dd/df/d28/d6f/cf5 0 2024-09-16T02:06:12.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 -- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58080fe4c0 msgr2=0x7f580810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58080fe4c0 0x7f580810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 -- 172.21.15.110:0/2297460534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc005040 con 0x7f58080fdb70 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.825+0000 7f58077fe640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 0x7f580810d0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57f800eb70 tx=0x7f57f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.826+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57f8007c30 con 0x7f58080fdb70 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.826+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580810e680 con 0x7f58080fdb70 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.826+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580810ec20 con 0x7f58080fdb70 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.826+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f57f800f040 con 0x7f58080fdb70 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.826+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57f8009420 con 0x7f58080fdb70 2024-09-16T02:06:12.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.827+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58080fa010 con 0x7f58080fdb70 2024-09-16T02:06:12.831 INFO:tasks.workunit.client.0.smithi110.stdout:5/769: mkdir d5/dd/d90/df6 0 2024-09-16T02:06:12.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.828+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f57f8009660 con 0x7f58080fdb70 2024-09-16T02:06:12.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.829+0000 7f57effff640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f57f006e6e0 0x7f57f0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:12.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.829+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f57f808dce0 con 0x7f58080fdb70 2024-09-16T02:06:12.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.829+0000 7f5806ffd640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f57f006e6e0 0x7f57f0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:12.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.829+0000 7f5806ffd640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f57f006e6e0 0x7f57f0070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f580810ce50 tx=0x7f57fc035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:12.833 INFO:tasks.workunit.client.0.smithi110.stdout:5/770: rename d5/dd/le8 to d5/dd/df/d28/lf7 0 2024-09-16T02:06:12.834 INFO:tasks.workunit.client.0.smithi110.stdout:5/771: creat d5/d36/dd5/ff8 x:0 0 0 2024-09-16T02:06:12.835 INFO:tasks.workunit.client.0.smithi110.stdout:5/772: chown d5/dd/df/d28/dab 1764 1 2024-09-16T02:06:12.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:12.833+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f57f8057700 con 0x7f58080fdb70 2024-09-16T02:06:12.838 INFO:tasks.workunit.client.0.smithi110.stdout:5/773: creat d5/ff9 x:0 0 0 2024-09-16T02:06:12.839 INFO:tasks.workunit.client.0.smithi110.stdout:5/774: write d5/dd/df/d11/fa2 [2346982,67562] 0 2024-09-16T02:06:12.955 INFO:tasks.workunit.client.0.smithi110.stdout:5/775: dwrite d5/d36/d3d/f79 [0,4194304] 0 2024-09-16T02:06:12.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:12 smithi110 ceph-mon[27634]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:12.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:12 smithi110 ceph-mon[27634]: pgmap v30: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 70 MiB/s rd, 159 MiB/s wr, 384 op/s 2024-09-16T02:06:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:12 smithi110 ceph-mon[27634]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:12 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1985518504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:06:12.958 INFO:tasks.workunit.client.0.smithi110.stdout:7/525: sync 2024-09-16T02:06:12.970 INFO:tasks.workunit.client.0.smithi110.stdout:5/776: dread d5/dd/df/f35 [0,4194304] 0 2024-09-16T02:06:12.982 INFO:tasks.workunit.client.0.smithi110.stdout:7/526: symlink d3/d15/d38/d4f/d10/d11/d73/d7b/la4 0 2024-09-16T02:06:12.984 INFO:tasks.workunit.client.0.smithi110.stdout:5/777: write d5/dd/df/d28/d77/fcf [215332,83796] 0 2024-09-16T02:06:12.985 INFO:tasks.workunit.client.0.smithi110.stdout:5/778: read - d5/dd/df/d28/dab/fd0 zero size 2024-09-16T02:06:12.987 INFO:tasks.workunit.client.0.smithi110.stdout:5/779: mknod d5/d71/cfa 0 2024-09-16T02:06:12.989 INFO:tasks.workunit.client.0.smithi110.stdout:5/780: creat d5/d71/d8f/ffb x:0 0 0 2024-09-16T02:06:12.989 INFO:tasks.workunit.client.0.smithi110.stdout:5/781: chown d5/dd/df/d28/dab/cdc 2033540 1 2024-09-16T02:06:12.992 INFO:tasks.workunit.client.0.smithi110.stdout:5/782: unlink d5/dd/df/d11/c46 0 2024-09-16T02:06:12.994 INFO:tasks.workunit.client.0.smithi110.stdout:5/783: mkdir d5/dd/df/d28/d77/de9/dfc 0 2024-09-16T02:06:12.998 INFO:tasks.workunit.client.0.smithi110.stdout:5/784: rename d5/d36/la0 to d5/dd/lfd 0 2024-09-16T02:06:13.001 INFO:tasks.workunit.client.0.smithi110.stdout:5/785: rename d5/dd/df/d28/fec to d5/d36/d45/ffe 0 2024-09-16T02:06:13.002 INFO:tasks.workunit.client.0.smithi110.stdout:5/786: chown d5/d71/f81 5612859 1 2024-09-16T02:06:13.004 INFO:tasks.workunit.client.0.smithi110.stdout:5/787: mkdir d5/d36/d3d/dff 0 2024-09-16T02:06:13.009 INFO:tasks.workunit.client.0.smithi110.stdout:5/788: creat d5/dd/df/d28/d77/de9/dfc/f100 x:0 0 0 2024-09-16T02:06:13.011 INFO:tasks.workunit.client.0.smithi110.stdout:5/789: mknod d5/d36/d45/d47/c101 0 2024-09-16T02:06:13.017 INFO:tasks.workunit.client.0.smithi110.stdout:5/790: dwrite d5/dd/df/d11/f58 [0,4194304] 0 2024-09-16T02:06:13.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.090+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f580810efa0 con 0x7f57f006e6e0 2024-09-16T02:06:13.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.091+0000 7f57effff640 1 -- 172.21.15.110:0/2297460534 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f580810efa0 con 0x7f57f006e6e0 2024-09-16T02:06:13.093 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:06:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [], 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "1/2 daemons upgraded", 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "", 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:06:13.094 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:06:13.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f57f006e6e0 msgr2=0x7f57f0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f57f006e6e0 0x7f57f0070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f580810ce50 tx=0x7f57fc035040 comp rx=0 tx=0).stop 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 msgr2=0x7f580810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 0x7f580810d0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57f800eb70 tx=0x7f57f800b040 comp rx=0 tx=0).stop 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 shutdown_connections 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f57f006e6e0 0x7f57f0070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58080fe4c0 0x7f580810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 --2- 172.21.15.110:0/2297460534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58080fdb70 0x7f580810d0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 >> 172.21.15.110:0/2297460534 conn(0x7f58080f6390 msgr2=0x7f58080f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 shutdown_connections 2024-09-16T02:06:13.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:13.093+0000 7f580e238640 1 -- 172.21.15.110:0/2297460534 wait complete. 2024-09-16T02:06:13.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:12 smithi165 ceph-mon[34621]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:13.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:12 smithi165 ceph-mon[34621]: pgmap v30: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 70 MiB/s rd, 159 MiB/s wr, 384 op/s 2024-09-16T02:06:13.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:12 smithi165 ceph-mon[34621]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:13.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:12 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1985518504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:06:13.203 INFO:tasks.workunit.client.0.smithi110.stdout:2/778: sync 2024-09-16T02:06:13.230 INFO:tasks.workunit.client.0.smithi110.stdout:2/779: rename d0/db/d105/d41/f7e to d0/db/d105/d41/db3/df0/f10e 0 2024-09-16T02:06:13.231 INFO:tasks.workunit.client.0.smithi110.stdout:2/780: readlink d0/d5f/dc0/ddc/ddd/d18/dc/l5b 0 2024-09-16T02:06:13.272 INFO:tasks.workunit.client.0.smithi110.stdout:2/781: truncate d0/d5f/dc0/ddc/ddd/d18/dc/f57 89056 0 2024-09-16T02:06:13.273 INFO:tasks.workunit.client.0.smithi110.stdout:2/782: readlink d0/l9 0 2024-09-16T02:06:13.275 INFO:tasks.workunit.client.0.smithi110.stdout:2/783: dread - d0/fc5 zero size 2024-09-16T02:06:13.276 INFO:tasks.workunit.client.0.smithi110.stdout:2/784: stat d0/db/d105/d41/db3/db8 0 2024-09-16T02:06:13.293 INFO:tasks.workunit.client.0.smithi110.stdout:2/785: write d0/db/d105/d41/f4f [271100,36245] 0 2024-09-16T02:06:13.439 INFO:tasks.workunit.client.0.smithi110.stdout:2/786: unlink d0/d5f/dc0/ld4 0 2024-09-16T02:06:13.440 INFO:tasks.workunit.client.0.smithi110.stdout:2/787: mkdir d0/d5f/dc0/d10f 0 2024-09-16T02:06:13.442 INFO:tasks.workunit.client.0.smithi110.stdout:2/788: readlink d0/d5f/dc0/ddc/ddd/d18/dc/l5b 0 2024-09-16T02:06:13.443 INFO:tasks.workunit.client.0.smithi110.stdout:2/789: rmdir d0/db/d105/d41/db3/db8 39 2024-09-16T02:06:13.443 INFO:tasks.workunit.client.0.smithi110.stdout:2/790: chown d0/db/d105 99659 1 2024-09-16T02:06:13.449 INFO:tasks.workunit.client.0.smithi110.stdout:2/791: dwrite d0/db/d105/d58/fa6 [0,4194304] 0 2024-09-16T02:06:13.452 INFO:tasks.workunit.client.0.smithi110.stdout:2/792: symlink d0/db/d105/d41/db3/l110 0 2024-09-16T02:06:13.453 INFO:tasks.workunit.client.0.smithi110.stdout:2/793: fdatasync d0/db/d47/d48/da0/ff2 0 2024-09-16T02:06:13.453 INFO:tasks.workunit.client.0.smithi110.stdout:2/794: readlink d0/d5f/dc0/ddc/ddd/l72 0 2024-09-16T02:06:13.459 INFO:tasks.workunit.client.0.smithi110.stdout:2/795: dread d0/db/d105/f8c [0,4194304] 0 2024-09-16T02:06:13.513 INFO:tasks.workunit.client.0.smithi110.stdout:2/796: rename d0/db/d47/f8b to d0/db/d105/d41/f111 0 2024-09-16T02:06:13.516 INFO:tasks.workunit.client.0.smithi110.stdout:2/797: symlink d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/l112 0 2024-09-16T02:06:13.518 INFO:tasks.workunit.client.0.smithi110.stdout:2/798: fdatasync d0/db/d105/d39/f86 0 2024-09-16T02:06:13.524 INFO:tasks.workunit.client.0.smithi110.stdout:2/799: dwrite d0/d5f/dc0/ddc/ddd/dfa/d3b/f53 [0,4194304] 0 2024-09-16T02:06:13.527 INFO:tasks.workunit.client.0.smithi110.stdout:2/800: mkdir d0/d5f/dc0/d10f/d113 0 2024-09-16T02:06:13.530 INFO:tasks.workunit.client.0.smithi110.stdout:2/801: unlink d0/db/d105/d58/fa6 0 2024-09-16T02:06:13.531 INFO:tasks.workunit.client.0.smithi110.stdout:2/802: chown d0/db/d33/c6f 885 1 2024-09-16T02:06:13.532 INFO:tasks.workunit.client.0.smithi110.stdout:2/803: dread - d0/db/d47/d48/fe4 zero size 2024-09-16T02:06:13.532 INFO:tasks.workunit.client.0.smithi110.stdout:2/804: chown d0/db/d47/cba 496 1 2024-09-16T02:06:13.534 INFO:tasks.workunit.client.0.smithi110.stdout:2/805: symlink d0/d5f/dc0/ddc/ddd/d18/dc/dfd/l114 0 2024-09-16T02:06:13.535 INFO:tasks.workunit.client.0.smithi110.stdout:2/806: dread - d0/fc5 zero size 2024-09-16T02:06:13.535 INFO:tasks.workunit.client.0.smithi110.stdout:2/807: chown d0/db/d33/c6f 71495 1 2024-09-16T02:06:13.536 INFO:tasks.workunit.client.0.smithi110.stdout:2/808: dread - d0/db/d105/d41/f85 zero size 2024-09-16T02:06:13.541 INFO:tasks.workunit.client.0.smithi110.stdout:2/809: link d0/d5f/dc0/ddc/ddd/d18/dc/d9e/lf8 d0/l115 0 2024-09-16T02:06:13.547 INFO:tasks.workunit.client.0.smithi110.stdout:2/810: dwrite d0/db/d105/f8a [0,4194304] 0 2024-09-16T02:06:13.550 INFO:tasks.workunit.client.0.smithi110.stdout:2/811: creat d0/d5f/dc0/ddc/ddd/f116 x:0 0 0 2024-09-16T02:06:13.552 INFO:tasks.workunit.client.0.smithi110.stdout:2/812: mknod d0/db/d47/da1/dad/c117 0 2024-09-16T02:06:13.573 INFO:tasks.workunit.client.0.smithi110.stdout:2/813: dwrite d0/d5f/dc0/ddc/ddd/d18/dc/f1f [4194304,4194304] 0 2024-09-16T02:06:13.575 INFO:tasks.workunit.client.0.smithi110.stdout:2/814: symlink d0/db/d105/d58/dec/l118 0 2024-09-16T02:06:13.581 INFO:tasks.workunit.client.0.smithi110.stdout:2/815: dread d0/d5f/dc0/ddc/ddd/d18/dc/f1f [4194304,4194304] 0 2024-09-16T02:06:13.586 INFO:tasks.workunit.client.0.smithi110.stdout:2/816: dread - d0/db/d105/d41/db3/df0/f10e zero size 2024-09-16T02:06:13.591 INFO:tasks.workunit.client.0.smithi110.stdout:2/817: creat d0/db/d105/d39/d87/f119 x:0 0 0 2024-09-16T02:06:13.591 INFO:tasks.workunit.client.0.smithi110.stdout:2/818: chown d0/d5f 2 1 2024-09-16T02:06:13.620 INFO:tasks.workunit.client.0.smithi110.stdout:2/819: dwrite d0/db/d47/d48/da0/fef [0,4194304] 0 2024-09-16T02:06:13.630 INFO:tasks.workunit.client.0.smithi110.stdout:2/820: creat d0/db/d105/d41/db3/db8/f11a x:0 0 0 2024-09-16T02:06:13.662 INFO:tasks.workunit.client.0.smithi110.stdout:2/821: dread d0/d5f/dc0/ddc/ddd/f2c [0,4194304] 0 2024-09-16T02:06:13.664 INFO:tasks.workunit.client.0.smithi110.stdout:2/822: mkdir d0/db/d105/d39/d87/d11b 0 2024-09-16T02:06:13.666 INFO:tasks.workunit.client.0.smithi110.stdout:2/823: creat d0/d5f/f11c x:0 0 0 2024-09-16T02:06:13.669 INFO:tasks.workunit.client.0.smithi110.stdout:2/824: chown d0/db/d105/d41/db3/db8/de1/le5 2581 1 2024-09-16T02:06:13.669 INFO:tasks.workunit.client.0.smithi110.stdout:2/825: dread - d0/d5f/dc0/ddc/ddd/f99 zero size 2024-09-16T02:06:13.671 INFO:tasks.workunit.client.0.smithi110.stdout:2/826: symlink d0/db/d105/d58/dec/l11d 0 2024-09-16T02:06:13.676 INFO:tasks.workunit.client.0.smithi110.stdout:2/827: rename d0/d5f/ff1 to d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/f11e 0 2024-09-16T02:06:13.678 INFO:tasks.workunit.client.0.smithi110.stdout:2/828: unlink d0/db/d47/c56 0 2024-09-16T02:06:13.705 INFO:tasks.workunit.client.0.smithi110.stdout:2/829: dread d0/db/d47/f60 [0,4194304] 0 2024-09-16T02:06:13.706 INFO:tasks.workunit.client.0.smithi110.stdout:2/830: chown d0/db/d105/d41/db3/db8/ce9 333685 1 2024-09-16T02:06:13.710 INFO:tasks.workunit.client.0.smithi110.stdout:2/831: link d0/db/d105/d58/l59 d0/l11f 0 2024-09-16T02:06:13.711 INFO:tasks.workunit.client.0.smithi110.stdout:2/832: stat d0/db/d47/d48/daa/f101 0 2024-09-16T02:06:13.717 INFO:tasks.workunit.client.0.smithi110.stdout:2/833: dwrite d0/db/d105/d41/db3/db8/f11a [0,4194304] 0 2024-09-16T02:06:13.718 INFO:tasks.workunit.client.0.smithi110.stdout:2/834: dread - d0/db/d47/d48/daa/ffe zero size 2024-09-16T02:06:13.723 INFO:tasks.workunit.client.0.smithi110.stdout:2/835: write d0/db/d105/f8c [272820,121430] 0 2024-09-16T02:06:13.730 INFO:tasks.workunit.client.0.smithi110.stdout:2/836: dwrite d0/d5f/dc0/ddc/ddd/dfa/f8f [0,4194304] 0 2024-09-16T02:06:13.733 INFO:tasks.workunit.client.0.smithi110.stdout:2/837: fdatasync d0/d5f/dc0/ddc/ddd/d18/dc/d9e/f67 0 2024-09-16T02:06:13.735 INFO:tasks.workunit.client.0.smithi110.stdout:2/838: fdatasync d0/db/d47/d48/daa/fbd 0 2024-09-16T02:06:13.738 INFO:tasks.workunit.client.0.smithi110.stdout:2/839: mkdir d0/db/d105/d39/d87/d120 0 2024-09-16T02:06:13.744 INFO:tasks.workunit.client.0.smithi110.stdout:2/840: write d0/d5f/dc0/ddc/ddd/d18/fd2 [610342,15799] 0 2024-09-16T02:06:13.745 INFO:tasks.workunit.client.0.smithi110.stdout:2/841: rmdir d0/db/d33 39 2024-09-16T02:06:13.754 INFO:tasks.workunit.client.0.smithi110.stdout:2/842: dread d0/db/d47/f50 [0,4194304] 0 2024-09-16T02:06:13.757 INFO:tasks.workunit.client.0.smithi110.stdout:2/843: creat d0/db/d105/d39/d87/d120/f121 x:0 0 0 2024-09-16T02:06:13.760 INFO:tasks.workunit.client.0.smithi110.stdout:2/844: creat d0/d5f/dc0/ddc/ddd/d18/f122 x:0 0 0 2024-09-16T02:06:13.765 INFO:tasks.workunit.client.0.smithi110.stdout:2/845: link d0/c14 d0/db/d105/d41/db3/db8/de1/c123 0 2024-09-16T02:06:13.766 INFO:tasks.workunit.client.0.smithi110.stdout:2/846: chown d0/db/d105/d58/dec 18 1 2024-09-16T02:06:13.769 INFO:tasks.workunit.client.0.smithi110.stdout:2/847: creat d0/db/d105/d41/db3/db8/de1/f124 x:0 0 0 2024-09-16T02:06:13.770 INFO:tasks.workunit.client.0.smithi110.stdout:2/848: readlink d0/db/d105/d41/db3/lca 0 2024-09-16T02:06:13.772 INFO:tasks.workunit.client.0.smithi110.stdout:2/849: mkdir d0/d5f/dc0/ddc/ddd/d18/dc/dfd/d125 0 2024-09-16T02:06:13.775 INFO:tasks.workunit.client.0.smithi110.stdout:2/850: mkdir d0/db/d105/d41/db3/d126 0 2024-09-16T02:06:13.775 INFO:tasks.workunit.client.0.smithi110.stdout:2/851: dread - d0/db/d105/d39/f86 zero size 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:0/685: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:7/527: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:4/630: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:6/800: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:1/779: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:9/785: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:3/626: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:5/791: sync 2024-09-16T02:06:13.811 INFO:tasks.workunit.client.0.smithi110.stdout:8/617: sync 2024-09-16T02:06:13.812 INFO:tasks.workunit.client.0.smithi110.stdout:6/801: stat d0/d29/la7 0 2024-09-16T02:06:13.813 INFO:tasks.workunit.client.0.smithi110.stdout:0/686: dread - d3/d6/d43/da7/fce zero size 2024-09-16T02:06:13.815 INFO:tasks.workunit.client.0.smithi110.stdout:8/618: creat d3/d31/fd0 x:0 0 0 2024-09-16T02:06:13.815 INFO:tasks.workunit.client.0.smithi110.stdout:6/802: chown d0/d2/d57/d75/df0/fb6 330 1 2024-09-16T02:06:13.817 INFO:tasks.workunit.client.0.smithi110.stdout:1/780: fdatasync d0/d1/d4/f26 0 2024-09-16T02:06:13.818 INFO:tasks.workunit.client.0.smithi110.stdout:9/786: mkdir d1/dd/d6a/d6c/d6f/d79/de/d94/d10a 0 2024-09-16T02:06:13.818 INFO:tasks.workunit.client.0.smithi110.stdout:6/803: write d0/d2/d5/db8/fdd [671190,125889] 0 2024-09-16T02:06:13.821 INFO:tasks.workunit.client.0.smithi110.stdout:5/792: dread - d5/dd/df/d28/d6f/d8e/dac/ff2 zero size 2024-09-16T02:06:13.823 INFO:tasks.workunit.client.0.smithi110.stdout:8/619: unlink d3/d31/f49 0 2024-09-16T02:06:13.824 INFO:tasks.workunit.client.0.smithi110.stdout:8/620: stat d3/d31/l92 0 2024-09-16T02:06:13.826 INFO:tasks.workunit.client.0.smithi110.stdout:0/687: creat d3/d4/dc/d14/d7e/d81/fd3 x:0 0 0 2024-09-16T02:06:13.827 INFO:tasks.workunit.client.0.smithi110.stdout:4/631: dread d4/d8/d31/d6f/fae [0,4194304] 0 2024-09-16T02:06:13.828 INFO:tasks.workunit.client.0.smithi110.stdout:6/804: dwrite d0/d29/d2a/d2d/fdf [0,4194304] 0 2024-09-16T02:06:13.829 INFO:tasks.workunit.client.0.smithi110.stdout:0/688: write d3/d4/dc/d10/f35 [4412913,119784] 0 2024-09-16T02:06:13.831 INFO:tasks.workunit.client.0.smithi110.stdout:7/528: rename d3/d15/d38/d4f/d10/d11/d3e/d40/f60 to d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/fa5 0 2024-09-16T02:06:13.833 INFO:tasks.workunit.client.0.smithi110.stdout:9/787: mknod d1/d5/d20/d55/d82/c10b 0 2024-09-16T02:06:13.833 INFO:tasks.workunit.client.0.smithi110.stdout:3/627: creat d8/d48/d5b/d6a/fe2 x:0 0 0 2024-09-16T02:06:13.837 INFO:tasks.workunit.client.0.smithi110.stdout:7/529: dread d3/d15/d38/d4f/f22 [0,4194304] 0 2024-09-16T02:06:13.844 INFO:tasks.workunit.client.0.smithi110.stdout:6/805: truncate d0/d2/d5/d84/d16/f3b 2146429 0 2024-09-16T02:06:13.846 INFO:tasks.workunit.client.0.smithi110.stdout:9/788: readlink d1/d5/l28 0 2024-09-16T02:06:13.847 INFO:tasks.workunit.client.0.smithi110.stdout:9/789: fdatasync d1/d1b/faf 0 2024-09-16T02:06:13.848 INFO:tasks.workunit.client.0.smithi110.stdout:3/628: unlink d8/d48/d5b/d92/dc7/d1b/f2c 0 2024-09-16T02:06:13.849 INFO:tasks.workunit.client.0.smithi110.stdout:4/632: dread d4/d8/d31/d80/d18/f4d [0,4194304] 0 2024-09-16T02:06:13.850 INFO:tasks.workunit.client.0.smithi110.stdout:5/793: symlink d5/d71/d89/l102 0 2024-09-16T02:06:13.851 INFO:tasks.workunit.client.0.smithi110.stdout:1/781: truncate d0/da/f5c 2002106 0 2024-09-16T02:06:13.853 INFO:tasks.workunit.client.0.smithi110.stdout:7/530: fsync d3/d15/d38/d4f/d10/f29 0 2024-09-16T02:06:13.854 INFO:tasks.workunit.client.0.smithi110.stdout:0/689: fsync d3/d6/d43/d55/d59/f5c 0 2024-09-16T02:06:13.855 INFO:tasks.workunit.client.0.smithi110.stdout:1/782: write d0/d25/fe4 [384771,15287] 0 2024-09-16T02:06:13.855 INFO:tasks.workunit.client.0.smithi110.stdout:8/621: dwrite d3/d2b/d27/f4d [0,4194304] 0 2024-09-16T02:06:13.858 INFO:tasks.workunit.client.0.smithi110.stdout:7/531: chown d3/d15/d38/d4f/d2e/f4c 0 1 2024-09-16T02:06:13.860 INFO:tasks.workunit.client.0.smithi110.stdout:7/532: chown d3/d15/d38/d4f/d10/f3d 3 1 2024-09-16T02:06:13.863 INFO:tasks.workunit.client.0.smithi110.stdout:3/629: readlink d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/lc9 0 2024-09-16T02:06:13.865 INFO:tasks.workunit.client.0.smithi110.stdout:4/633: mkdir d4/d8/d17/d23/d4c/d6d/dc6 0 2024-09-16T02:06:13.869 INFO:tasks.workunit.client.0.smithi110.stdout:6/806: mknod d0/d2/d57/cfa 0 2024-09-16T02:06:13.870 INFO:tasks.workunit.client.0.smithi110.stdout:0/690: mkdir d3/d92/d9a/dd4 0 2024-09-16T02:06:13.872 INFO:tasks.workunit.client.0.smithi110.stdout:9/790: mknod d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd/c10c 0 2024-09-16T02:06:13.873 INFO:tasks.workunit.client.0.smithi110.stdout:9/791: write d1/dd/d6a/d6c/d6f/d79/d26/d8e/fa5 [521649,4874] 0 2024-09-16T02:06:13.882 INFO:tasks.workunit.client.0.smithi110.stdout:5/794: symlink d5/dd/d90/df6/l103 0 2024-09-16T02:06:13.886 INFO:tasks.workunit.client.0.smithi110.stdout:0/691: unlink d3/d4/dc/d14/c2d 0 2024-09-16T02:06:13.887 INFO:tasks.workunit.client.0.smithi110.stdout:0/692: readlink d3/d4/d6d/l8a 0 2024-09-16T02:06:13.887 INFO:tasks.workunit.client.0.smithi110.stdout:8/622: symlink d3/d2b/d27/da7/ld1 0 2024-09-16T02:06:13.891 INFO:tasks.workunit.client.0.smithi110.stdout:7/533: dwrite d3/d15/d38/d4f/d10/d11/d3e/f42 [0,4194304] 0 2024-09-16T02:06:13.892 INFO:tasks.workunit.client.0.smithi110.stdout:7/534: chown d3/lf 437 1 2024-09-16T02:06:13.896 INFO:tasks.workunit.client.0.smithi110.stdout:3/630: mkdir d8/d48/d5b/d92/de3 0 2024-09-16T02:06:13.899 INFO:tasks.workunit.client.0.smithi110.stdout:5/795: creat d5/dd/df/d28/d77/de9/f104 x:0 0 0 2024-09-16T02:06:13.900 INFO:tasks.workunit.client.0.smithi110.stdout:6/807: mknod d0/d2/d5/d1e/cfb 0 2024-09-16T02:06:13.901 INFO:tasks.workunit.client.0.smithi110.stdout:6/808: readlink d0/d2/l1b 0 2024-09-16T02:06:13.905 INFO:tasks.workunit.client.0.smithi110.stdout:8/623: creat d3/d2b/d27/da7/d1a/d36/d60/da1/fd2 x:0 0 0 2024-09-16T02:06:13.906 INFO:tasks.workunit.client.0.smithi110.stdout:1/783: creat d0/d1/dab/dad/ffc x:0 0 0 2024-09-16T02:06:13.909 INFO:tasks.workunit.client.0.smithi110.stdout:7/535: rmdir d3/d15 39 2024-09-16T02:06:13.912 INFO:tasks.workunit.client.0.smithi110.stdout:4/634: creat d4/d8/fc7 x:0 0 0 2024-09-16T02:06:13.912 INFO:tasks.workunit.client.0.smithi110.stdout:1/784: dwrite d0/da/d7c/fb5 [4194304,4194304] 0 2024-09-16T02:06:13.920 INFO:tasks.workunit.client.0.smithi110.stdout:6/809: chown d0/d2/d5/d1e/c27 255483 1 2024-09-16T02:06:13.922 INFO:tasks.workunit.client.0.smithi110.stdout:8/624: truncate d3/d2b/d27/da7/f26 1766594 0 2024-09-16T02:06:13.929 INFO:tasks.workunit.client.0.smithi110.stdout:4/635: read d4/d8/d17/d23/d4c/d6d/f7e [803701,129373] 0 2024-09-16T02:06:13.930 INFO:tasks.workunit.client.0.smithi110.stdout:3/631: dwrite d8/d48/d5b/d6a/d75/d8b/fbb [0,4194304] 0 2024-09-16T02:06:13.933 INFO:tasks.workunit.client.0.smithi110.stdout:8/625: mkdir d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/dc6/dd3 0 2024-09-16T02:06:13.934 INFO:tasks.workunit.client.0.smithi110.stdout:6/810: link d0/d2/d57/d75/df0/fa8 d0/d2/d57/d75/de7/df5/ffc 0 2024-09-16T02:06:13.935 INFO:tasks.workunit.client.0.smithi110.stdout:0/693: dwrite d3/d4/dc/f1c [0,4194304] 0 2024-09-16T02:06:13.936 INFO:tasks.workunit.client.0.smithi110.stdout:4/636: creat d4/d8/d91/fc8 x:0 0 0 2024-09-16T02:06:13.937 INFO:tasks.workunit.client.0.smithi110.stdout:8/626: write d3/d31/fc2 [89651,67974] 0 2024-09-16T02:06:13.937 INFO:tasks.workunit.client.0.smithi110.stdout:1/785: dread d0/d1/d2a/f34 [0,4194304] 0 2024-09-16T02:06:13.940 INFO:tasks.workunit.client.0.smithi110.stdout:5/796: truncate d5/dd/df/d11/f50 1303089 0 2024-09-16T02:06:13.945 INFO:tasks.workunit.client.0.smithi110.stdout:1/786: read d0/d25/fe4 [458339,114955] 0 2024-09-16T02:06:13.946 INFO:tasks.workunit.client.0.smithi110.stdout:5/797: truncate d5/dd/fe0 992452 0 2024-09-16T02:06:13.950 INFO:tasks.workunit.client.0.smithi110.stdout:5/798: dread - d5/dd/df/d28/dab/fd0 zero size 2024-09-16T02:06:13.951 INFO:tasks.workunit.client.0.smithi110.stdout:3/632: rename d8/d48/d5b/d92/dc7/cd to d8/d48/d5b/d92/dc7/d1b/d36/d57/d64/ce4 0 2024-09-16T02:06:13.957 INFO:tasks.workunit.client.0.smithi110.stdout:4/637: symlink d4/d8/d17/d23/lc9 0 2024-09-16T02:06:13.957 INFO:tasks.workunit.client.0.smithi110.stdout:8/627: dwrite d3/d2b/f4a [0,4194304] 0 2024-09-16T02:06:13.958 INFO:tasks.workunit.client.0.smithi110.stdout:6/811: dread d0/f10 [0,4194304] 0 2024-09-16T02:06:13.960 INFO:tasks.workunit.client.0.smithi110.stdout:0/694: truncate d3/d4/dc/d14/d7e/d81/d89/f9b 1417424 0 2024-09-16T02:06:13.960 INFO:tasks.workunit.client.0.smithi110.stdout:7/536: dwrite d3/d15/d38/f3b [0,4194304] 0 2024-09-16T02:06:13.961 INFO:tasks.workunit.client.0.smithi110.stdout:1/787: mkdir d0/d1/d2a/d32/d40/dbf/dfd 0 2024-09-16T02:06:13.962 INFO:tasks.workunit.client.0.smithi110.stdout:0/695: dread - d3/d4/dc/d14/fcc zero size 2024-09-16T02:06:13.963 INFO:tasks.workunit.client.0.smithi110.stdout:0/696: readlink d3/d6/l77 0 2024-09-16T02:06:14.004 INFO:tasks.workunit.client.0.smithi110.stdout:8/628: write d3/d2b/d65/d7f/fa5 [3835428,100343] 0 2024-09-16T02:06:14.004 INFO:tasks.workunit.client.0.smithi110.stdout:1/788: dread - d0/d1/d2a/d32/d6e/f6f zero size 2024-09-16T02:06:14.005 INFO:tasks.workunit.client.0.smithi110.stdout:7/537: mkdir d3/d15/d81/da6 0 2024-09-16T02:06:14.007 INFO:tasks.workunit.client.0.smithi110.stdout:0/697: symlink d3/d4/dc/d14/d7e/d81/d86/ld5 0 2024-09-16T02:06:14.008 INFO:tasks.workunit.client.0.smithi110.stdout:0/698: readlink d3/d6/d43/d55/d59/l7a 0 2024-09-16T02:06:14.009 INFO:tasks.workunit.client.0.smithi110.stdout:5/799: creat d5/dd/df/d28/d6f/d86/f105 x:0 0 0 2024-09-16T02:06:14.012 INFO:tasks.workunit.client.0.smithi110.stdout:1/789: readlink d0/d1/d2a/d32/l62 0 2024-09-16T02:06:14.014 INFO:tasks.workunit.client.0.smithi110.stdout:5/800: unlink d5/dd/df/d11/fc2 0 2024-09-16T02:06:14.018 INFO:tasks.workunit.client.0.smithi110.stdout:5/801: mkdir d5/dd/d90/df6/d106 0 2024-09-16T02:06:14.020 INFO:tasks.workunit.client.0.smithi110.stdout:1/790: creat d0/d1/d2a/ffe x:0 0 0 2024-09-16T02:06:14.021 INFO:tasks.workunit.client.0.smithi110.stdout:5/802: creat d5/dd/df/d28/dab/f107 x:0 0 0 2024-09-16T02:06:14.023 INFO:tasks.workunit.client.0.smithi110.stdout:1/791: rename d0/d1/d4/c73 to d0/d1/d4/d46/d7a/d9b/cff 0 2024-09-16T02:06:14.026 INFO:tasks.workunit.client.0.smithi110.stdout:1/792: mkdir d0/d1/d2a/d9a/d100 0 2024-09-16T02:06:14.029 INFO:tasks.workunit.client.0.smithi110.stdout:1/793: unlink d0/da/f36 0 2024-09-16T02:06:14.031 INFO:tasks.workunit.client.0.smithi110.stdout:1/794: symlink d0/d25/l101 0 2024-09-16T02:06:14.034 INFO:tasks.workunit.client.0.smithi110.stdout:1/795: mknod d0/d1/d2a/c102 0 2024-09-16T02:06:14.041 INFO:tasks.workunit.client.0.smithi110.stdout:1/796: rename d0/d1/d4/l7b to d0/da/d8d/df6/l103 0 2024-09-16T02:06:14.044 INFO:tasks.workunit.client.0.smithi110.stdout:8/629: write d3/d2b/d27/da7/f5c [294952,38473] 0 2024-09-16T02:06:14.044 INFO:tasks.workunit.client.0.smithi110.stdout:0/699: write d3/d4/f11 [112580,80516] 0 2024-09-16T02:06:14.045 INFO:tasks.workunit.client.0.smithi110.stdout:4/638: dwrite d4/f11 [0,4194304] 0 2024-09-16T02:06:14.051 INFO:tasks.workunit.client.0.smithi110.stdout:3/633: dwrite d8/d48/d5b/d92/dc7/d1b/d36/f37 [0,4194304] 0 2024-09-16T02:06:14.054 INFO:tasks.workunit.client.0.smithi110.stdout:6/812: dwrite d0/f10 [0,4194304] 0 2024-09-16T02:06:14.054 INFO:tasks.workunit.client.0.smithi110.stdout:4/639: read d4/fc [424323,130755] 0 2024-09-16T02:06:14.055 INFO:tasks.workunit.client.0.smithi110.stdout:1/797: unlink d0/d1/d4/d46/d51/f9c 0 2024-09-16T02:06:14.058 INFO:tasks.workunit.client.0.smithi110.stdout:8/630: rmdir d3/d2b/d27/da7/d1a/d36/d60/d62 39 2024-09-16T02:06:14.059 INFO:tasks.workunit.client.0.smithi110.stdout:0/700: rename d3/d4/c54 to d3/d4/d85/d93/cd6 0 2024-09-16T02:06:14.062 INFO:tasks.workunit.client.0.smithi110.stdout:4/640: read - d4/fac zero size 2024-09-16T02:06:14.062 INFO:tasks.workunit.client.0.smithi110.stdout:7/538: dwrite d3/f8 [0,4194304] 0 2024-09-16T02:06:14.063 INFO:tasks.workunit.client.0.smithi110.stdout:1/798: dread - d0/d1/d2a/d32/d40/dbf/ff9 zero size 2024-09-16T02:06:14.065 INFO:tasks.workunit.client.0.smithi110.stdout:3/634: read f4 [910199,83695] 0 2024-09-16T02:06:14.066 INFO:tasks.workunit.client.0.smithi110.stdout:5/803: write d5/dd/df/d11/f50 [358188,64046] 0 2024-09-16T02:06:14.068 INFO:tasks.workunit.client.0.smithi110.stdout:1/799: stat d0/d1/d2a/d32/d9f 0 2024-09-16T02:06:14.069 INFO:tasks.workunit.client.0.smithi110.stdout:1/800: readlink d0/la1 0 2024-09-16T02:06:14.072 INFO:tasks.workunit.client.0.smithi110.stdout:7/539: creat d3/d15/d81/fa7 x:0 0 0 2024-09-16T02:06:14.073 INFO:tasks.workunit.client.0.smithi110.stdout:6/813: creat d0/d2/d5/db8/ffd x:0 0 0 2024-09-16T02:06:14.074 INFO:tasks.workunit.client.0.smithi110.stdout:7/540: write d3/d15/d38/d4f/d10/d11/d8f/f96 [1037550,95924] 0 2024-09-16T02:06:14.101 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:13 smithi165 ceph-mon[34621]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:14.127 INFO:tasks.workunit.client.0.smithi110.stdout:3/635: creat d8/d48/d5b/d6a/fe5 x:0 0 0 2024-09-16T02:06:14.127 INFO:tasks.workunit.client.0.smithi110.stdout:5/804: mkdir d5/dd/d90/d108 0 2024-09-16T02:06:14.128 INFO:tasks.workunit.client.0.smithi110.stdout:1/801: symlink d0/da/l104 0 2024-09-16T02:06:14.128 INFO:tasks.workunit.client.0.smithi110.stdout:6/814: mknod d0/d2/d57/da0/cfe 0 2024-09-16T02:06:14.128 INFO:tasks.workunit.client.0.smithi110.stdout:3/636: chown d8/l33 79458 1 2024-09-16T02:06:14.129 INFO:tasks.workunit.client.0.smithi110.stdout:8/631: write d3/d2b/d27/da7/d1a/d36/d87/f91 [914492,40233] 0 2024-09-16T02:06:14.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/637: chown d8/d29/f42 916 1 2024-09-16T02:06:14.157 INFO:tasks.workunit.client.0.smithi110.stdout:0/701: link d3/d4/dc/d10/f3c d3/d6/d43/da7/fd7 0 2024-09-16T02:06:14.157 INFO:tasks.workunit.client.0.smithi110.stdout:4/641: write d4/d8/d17/d23/f70 [454343,127102] 0 2024-09-16T02:06:14.157 INFO:tasks.workunit.client.0.smithi110.stdout:7/541: truncate d3/f9 7381193 0 2024-09-16T02:06:14.158 INFO:tasks.workunit.client.0.smithi110.stdout:1/802: creat d0/d1/d4/d46/d7a/d9b/f105 x:0 0 0 2024-09-16T02:06:14.158 INFO:tasks.workunit.client.0.smithi110.stdout:8/632: chown d3/d2b/d27/da7/d1a/d36/c8c 97154931 1 2024-09-16T02:06:14.159 INFO:tasks.workunit.client.0.smithi110.stdout:5/805: write d5/dd/df/d92/fb4 [147768,102069] 0 2024-09-16T02:06:14.160 INFO:tasks.workunit.client.0.smithi110.stdout:7/542: chown d3/l47 74751 1 2024-09-16T02:06:14.160 INFO:tasks.workunit.client.0.smithi110.stdout:1/803: stat d0/d25/d63 0 2024-09-16T02:06:14.160 INFO:tasks.workunit.client.0.smithi110.stdout:6/815: symlink d0/d29/d2a/d2d/d8b/lff 0 2024-09-16T02:06:14.163 INFO:tasks.workunit.client.0.smithi110.stdout:1/804: readlink d0/da/l2e 0 2024-09-16T02:06:14.165 INFO:tasks.workunit.client.0.smithi110.stdout:5/806: mknod d5/dd/df/d28/d77/d9f/c109 0 2024-09-16T02:06:14.166 INFO:tasks.workunit.client.0.smithi110.stdout:3/638: dread f2 [0,4194304] 0 2024-09-16T02:06:14.168 INFO:tasks.workunit.client.0.smithi110.stdout:7/543: unlink d3/d15/d38/d4f/d10/f3d 0 2024-09-16T02:06:14.173 INFO:tasks.workunit.client.0.smithi110.stdout:3/639: dwrite d8/d48/d5b/d6a/fe2 [0,4194304] 0 2024-09-16T02:06:14.175 INFO:tasks.workunit.client.0.smithi110.stdout:8/633: dread d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/f9e [0,4194304] 0 2024-09-16T02:06:14.176 INFO:tasks.workunit.client.0.smithi110.stdout:5/807: rmdir d5/d36/db5 39 2024-09-16T02:06:14.176 INFO:tasks.workunit.client.0.smithi110.stdout:4/642: write d4/d8/d31/d80/faf [436749,32535] 0 2024-09-16T02:06:14.177 INFO:tasks.workunit.client.0.smithi110.stdout:7/544: fsync d3/d15/d38/d4f/d10/f29 0 2024-09-16T02:06:14.180 INFO:tasks.workunit.client.0.smithi110.stdout:7/545: readlink d3/d15/d38/d4f/d2e/l5d 0 2024-09-16T02:06:14.181 INFO:tasks.workunit.client.0.smithi110.stdout:8/634: dread - d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/d98/fb1 zero size 2024-09-16T02:06:14.183 INFO:tasks.workunit.client.0.smithi110.stdout:3/640: unlink d8/d48/d5b/d6a/d75/d8b/f8d 0 2024-09-16T02:06:14.184 INFO:tasks.workunit.client.0.smithi110.stdout:7/546: chown d3/d15/d38/d4f/d10/d7d/da2 115 1 2024-09-16T02:06:14.184 INFO:tasks.workunit.client.0.smithi110.stdout:6/816: dwrite d0/d29/fa1 [0,4194304] 0 2024-09-16T02:06:14.187 INFO:tasks.workunit.client.0.smithi110.stdout:8/635: read d3/d2b/f1e [2255999,103206] 0 2024-09-16T02:06:14.189 INFO:tasks.workunit.client.0.smithi110.stdout:1/805: rename d0/d1/fbb to d0/d1/d4/d46/f106 0 2024-09-16T02:06:14.194 INFO:tasks.workunit.client.0.smithi110.stdout:7/547: symlink d3/d7a/la8 0 2024-09-16T02:06:14.196 INFO:tasks.workunit.client.0.smithi110.stdout:3/641: mkdir d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/de6 0 2024-09-16T02:06:14.198 INFO:tasks.workunit.client.0.smithi110.stdout:4/643: dwrite d4/d8/d17/d23/d35/f42 [0,4194304] 0 2024-09-16T02:06:14.200 INFO:tasks.workunit.client.0.smithi110.stdout:5/808: rename d5/l18 to d5/d36/d45/d47/l10a 0 2024-09-16T02:06:14.202 INFO:tasks.workunit.client.0.smithi110.stdout:5/809: write d5/dd/df/f38 [2581206,4266] 0 2024-09-16T02:06:14.202 INFO:tasks.workunit.client.0.smithi110.stdout:6/817: mknod d0/c100 0 2024-09-16T02:06:14.206 INFO:tasks.workunit.client.0.smithi110.stdout:1/806: rename d0/d1/dab/dad to d0/d1/df2/d107 0 2024-09-16T02:06:14.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:13 smithi110 ceph-mon[27634]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:14.207 INFO:tasks.workunit.client.0.smithi110.stdout:8/636: write d3/f2a [4975564,82243] 0 2024-09-16T02:06:14.209 INFO:tasks.workunit.client.0.smithi110.stdout:7/548: mknod d3/d15/d38/d4f/ca9 0 2024-09-16T02:06:14.213 INFO:tasks.workunit.client.0.smithi110.stdout:1/807: creat d0/d1/d2a/d32/d9f/f108 x:0 0 0 2024-09-16T02:06:14.216 INFO:tasks.workunit.client.0.smithi110.stdout:7/549: dwrite d3/d7a/f97 [0,4194304] 0 2024-09-16T02:06:14.216 INFO:tasks.workunit.client.0.smithi110.stdout:6/818: mknod d0/d2/d57/d75/de7/df5/c101 0 2024-09-16T02:06:14.223 INFO:tasks.workunit.client.0.smithi110.stdout:3/642: rename d8/d29/d45/f59 to d8/d48/d5b/d92/dc7/fe7 0 2024-09-16T02:06:14.225 INFO:tasks.workunit.client.0.smithi110.stdout:6/819: dwrite d0/d29/f53 [0,4194304] 0 2024-09-16T02:06:14.227 INFO:tasks.workunit.client.0.smithi110.stdout:8/637: creat d3/d2b/d27/da7/d1a/fd4 x:0 0 0 2024-09-16T02:06:14.232 INFO:tasks.workunit.client.0.smithi110.stdout:1/808: write d0/d25/d63/f19 [8145912,65546] 0 2024-09-16T02:06:14.234 INFO:tasks.workunit.client.0.smithi110.stdout:6/820: creat d0/d2/d5/db8/dd1/f102 x:0 0 0 2024-09-16T02:06:14.235 INFO:tasks.workunit.client.0.smithi110.stdout:6/821: write d0/d29/f53 [1652348,91478] 0 2024-09-16T02:06:14.236 INFO:tasks.workunit.client.0.smithi110.stdout:8/638: mknod d3/cd5 0 2024-09-16T02:06:14.236 INFO:tasks.workunit.client.0.smithi110.stdout:6/822: dread - d0/d29/dc1/fe3 zero size 2024-09-16T02:06:14.239 INFO:tasks.workunit.client.0.smithi110.stdout:3/643: link d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/lc9 d8/d48/d4b/le8 0 2024-09-16T02:06:14.240 INFO:tasks.workunit.client.0.smithi110.stdout:5/810: dread d5/dd/f4c [0,4194304] 0 2024-09-16T02:06:14.241 INFO:tasks.workunit.client.0.smithi110.stdout:5/811: stat d5/dd/d90 0 2024-09-16T02:06:14.242 INFO:tasks.workunit.client.0.smithi110.stdout:7/550: write d3/f26 [561613,99866] 0 2024-09-16T02:06:14.245 INFO:tasks.workunit.client.0.smithi110.stdout:1/809: creat d0/d1/f109 x:0 0 0 2024-09-16T02:06:14.245 INFO:tasks.workunit.client.0.smithi110.stdout:3/644: mknod d8/d48/d5b/d6a/d75/ce9 0 2024-09-16T02:06:14.246 INFO:tasks.workunit.client.0.smithi110.stdout:1/810: write d0/d1/d2a/d32/d6e/f88 [3277176,62509] 0 2024-09-16T02:06:14.246 INFO:tasks.workunit.client.0.smithi110.stdout:3/645: stat d8/d48/d7c/l94 0 2024-09-16T02:06:14.247 INFO:tasks.workunit.client.0.smithi110.stdout:3/646: chown d8/d29/dbd/fa4 38193538 1 2024-09-16T02:06:14.249 INFO:tasks.workunit.client.0.smithi110.stdout:6/823: rename d0/d2/d57/l8a to d0/d2/d57/d7a/l103 0 2024-09-16T02:06:14.253 INFO:tasks.workunit.client.0.smithi110.stdout:1/811: dwrite d0/d1/d4/d46/d7a/df4/fcb [0,4194304] 0 2024-09-16T02:06:14.255 INFO:tasks.workunit.client.0.smithi110.stdout:1/812: dread - d0/d1/d2a/d32/d40/dbf/ff9 zero size 2024-09-16T02:06:14.261 INFO:tasks.workunit.client.0.smithi110.stdout:3/647: mknod d8/d48/d5b/d92/dc7/d1b/d36/cea 0 2024-09-16T02:06:14.268 INFO:tasks.workunit.client.0.smithi110.stdout:5/812: dwrite d5/d36/d45/d47/f88 [0,4194304] 0 2024-09-16T02:06:14.269 INFO:tasks.workunit.client.0.smithi110.stdout:8/639: truncate d3/d2b/f4a 417617 0 2024-09-16T02:06:14.271 INFO:tasks.workunit.client.0.smithi110.stdout:8/640: write d3/d31/fd0 [678285,92613] 0 2024-09-16T02:06:14.272 INFO:tasks.workunit.client.0.smithi110.stdout:1/813: creat d0/da/d8d/df6/dc4/de8/f10a x:0 0 0 2024-09-16T02:06:14.274 INFO:tasks.workunit.client.0.smithi110.stdout:8/641: dread - d3/d2b/d27/d3a/fcb zero size 2024-09-16T02:06:14.278 INFO:tasks.workunit.client.0.smithi110.stdout:5/813: dwrite d5/d36/d45/f56 [0,4194304] 0 2024-09-16T02:06:14.278 INFO:tasks.workunit.client.0.smithi110.stdout:7/551: link d3/d62/c67 d3/caa 0 2024-09-16T02:06:14.279 INFO:tasks.workunit.client.0.smithi110.stdout:6/824: write d0/d2/d5/f4e [2074637,66751] 0 2024-09-16T02:06:14.284 INFO:tasks.workunit.client.0.smithi110.stdout:3/648: link d8/d29/dbd/f7a d8/d48/d5b/d6a/d75/feb 0 2024-09-16T02:06:14.287 INFO:tasks.workunit.client.0.smithi110.stdout:5/814: unlink d5/dd/df/d28/d77/d9f/fd2 0 2024-09-16T02:06:14.290 INFO:tasks.workunit.client.0.smithi110.stdout:3/649: chown d8/d48/d5b/d92/f49 153377549 1 2024-09-16T02:06:14.292 INFO:tasks.workunit.client.0.smithi110.stdout:6/825: dwrite d0/d2/d57/d75/df0/f9d [0,4194304] 0 2024-09-16T02:06:14.296 INFO:tasks.workunit.client.0.smithi110.stdout:7/552: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 [0,4194304] 0 2024-09-16T02:06:14.297 INFO:tasks.workunit.client.0.smithi110.stdout:1/814: creat d0/d1/f10b x:0 0 0 2024-09-16T02:06:14.300 INFO:tasks.workunit.client.0.smithi110.stdout:8/642: creat d3/d2b/d27/da7/d1a/fd6 x:0 0 0 2024-09-16T02:06:14.301 INFO:tasks.workunit.client.0.smithi110.stdout:5/815: symlink d5/dd/df/d28/l10b 0 2024-09-16T02:06:14.303 INFO:tasks.workunit.client.0.smithi110.stdout:3/650: creat d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/fec x:0 0 0 2024-09-16T02:06:14.306 INFO:tasks.workunit.client.0.smithi110.stdout:7/553: creat d3/d15/d38/d4f/d10/d7d/fab x:0 0 0 2024-09-16T02:06:14.308 INFO:tasks.workunit.client.0.smithi110.stdout:3/651: write d8/d48/d5b/d92/dc7/d1b/d36/fc1 [3151990,59948] 0 2024-09-16T02:06:14.314 INFO:tasks.workunit.client.0.smithi110.stdout:8/643: rename d3/d2b/ca9 to d3/d2b/d27/da7/d1a/d36/d87/cd7 0 2024-09-16T02:06:14.315 INFO:tasks.workunit.client.0.smithi110.stdout:7/554: dread d3/d15/d38/d4f/d10/d11/f5f [0,4194304] 0 2024-09-16T02:06:14.318 INFO:tasks.workunit.client.0.smithi110.stdout:8/644: write d3/d2b/d27/f46 [2344388,111927] 0 2024-09-16T02:06:14.318 INFO:tasks.workunit.client.0.smithi110.stdout:7/555: stat d3/d15/d38/d4f/d2e/l5d 0 2024-09-16T02:06:14.318 INFO:tasks.workunit.client.0.smithi110.stdout:6/826: dwrite d0/d2/d18/f46 [4194304,4194304] 0 2024-09-16T02:06:14.320 INFO:tasks.workunit.client.0.smithi110.stdout:3/652: truncate d8/d48/d7c/d87/fb3 112489 0 2024-09-16T02:06:14.322 INFO:tasks.workunit.client.0.smithi110.stdout:8/645: stat d3/d2b/d27/da7/d1a/d36/d87/f93 0 2024-09-16T02:06:14.327 INFO:tasks.workunit.client.0.smithi110.stdout:5/816: truncate d5/dd/df/d28/f75 4905591 0 2024-09-16T02:06:14.330 INFO:tasks.workunit.client.0.smithi110.stdout:1/815: getdents d0/d1/d2a/d32 0 2024-09-16T02:06:14.331 INFO:tasks.workunit.client.0.smithi110.stdout:6/827: fsync d0/d2/d5/db8/fbf 0 2024-09-16T02:06:14.332 INFO:tasks.workunit.client.0.smithi110.stdout:1/816: read d0/da/f29 [6927084,69239] 0 2024-09-16T02:06:14.333 INFO:tasks.workunit.client.0.smithi110.stdout:3/653: read - d8/d48/d5b/d6a/d75/d88/dac/fb0 zero size 2024-09-16T02:06:14.343 INFO:tasks.workunit.client.0.smithi110.stdout:8/646: symlink d3/d2b/d27/da7/d1a/d36/d60/d83/ld8 0 2024-09-16T02:06:14.343 INFO:tasks.workunit.client.0.smithi110.stdout:5/817: write d5/dd/df/f35 [6190586,32936] 0 2024-09-16T02:06:14.345 INFO:tasks.workunit.client.0.smithi110.stdout:6/828: dread d0/d2/d5/f52 [0,4194304] 0 2024-09-16T02:06:14.345 INFO:tasks.workunit.client.0.smithi110.stdout:1/817: rename d0/d25/d63/f89 to d0/da/f10c 0 2024-09-16T02:06:14.347 INFO:tasks.workunit.client.0.smithi110.stdout:3/654: read - d8/d48/d5b/d92/dc7/f46 zero size 2024-09-16T02:06:14.349 INFO:tasks.workunit.client.0.smithi110.stdout:5/818: chown d5/d36/db5/fdf 4 1 2024-09-16T02:06:14.351 INFO:tasks.workunit.client.0.smithi110.stdout:8/647: mkdir d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/dd9 0 2024-09-16T02:06:14.353 INFO:tasks.workunit.client.0.smithi110.stdout:7/556: dread d3/d15/d38/d4f/d10/f39 [0,4194304] 0 2024-09-16T02:06:14.353 INFO:tasks.workunit.client.0.smithi110.stdout:1/818: rmdir d0/da/d8d/df6/dc4/d79 39 2024-09-16T02:06:14.354 INFO:tasks.workunit.client.0.smithi110.stdout:8/648: dread d3/d2b/d65/fbe [0,4194304] 0 2024-09-16T02:06:14.356 INFO:tasks.workunit.client.0.smithi110.stdout:3/655: creat d8/d48/d5b/d92/fed x:0 0 0 2024-09-16T02:06:14.357 INFO:tasks.workunit.client.0.smithi110.stdout:6/829: mknod d0/d29/dd0/c104 0 2024-09-16T02:06:14.361 INFO:tasks.workunit.client.0.smithi110.stdout:8/649: dwrite d3/d31/fc2 [0,4194304] 0 2024-09-16T02:06:14.364 INFO:tasks.workunit.client.0.smithi110.stdout:5/819: chown d5/dd/df/d28/f75 21 1 2024-09-16T02:06:14.368 INFO:tasks.workunit.client.0.smithi110.stdout:7/557: dwrite d3/d15/d81/f82 [0,4194304] 0 2024-09-16T02:06:14.374 INFO:tasks.workunit.client.0.smithi110.stdout:8/650: mknod d3/d2b/d27/d45/d66/d6b/cda 0 2024-09-16T02:06:14.376 INFO:tasks.workunit.client.0.smithi110.stdout:1/819: mkdir d0/da/d8d/df6/d10d 0 2024-09-16T02:06:14.377 INFO:tasks.workunit.client.0.smithi110.stdout:1/820: chown d0/d1/d2a/d32/d40/dbf/ff9 56231 1 2024-09-16T02:06:14.378 INFO:tasks.workunit.client.0.smithi110.stdout:3/656: write d8/d48/d5b/d92/dc7/d1b/fb1 [383284,104410] 0 2024-09-16T02:06:14.379 INFO:tasks.workunit.client.0.smithi110.stdout:5/820: readlink d5/dd/df/d11/l15 0 2024-09-16T02:06:14.383 INFO:tasks.workunit.client.0.smithi110.stdout:8/651: mkdir d3/d2b/d27/d3a/ddb 0 2024-09-16T02:06:14.384 INFO:tasks.workunit.client.0.smithi110.stdout:3/657: symlink d8/d48/lee 0 2024-09-16T02:06:14.385 INFO:tasks.workunit.client.0.smithi110.stdout:5/821: dread d5/dd/f2b [0,4194304] 0 2024-09-16T02:06:14.385 INFO:tasks.workunit.client.0.smithi110.stdout:1/821: unlink d0/d1/d4/d46/d7a/df4/ce1 0 2024-09-16T02:06:14.387 INFO:tasks.workunit.client.0.smithi110.stdout:1/822: stat d0/da/d8d/df6/dc4/de8/f10a 0 2024-09-16T02:06:14.387 INFO:tasks.workunit.client.0.smithi110.stdout:3/658: chown d8/d29/d45/c4a 67787 1 2024-09-16T02:06:14.388 INFO:tasks.workunit.client.0.smithi110.stdout:5/822: fsync d5/dd/f4c 0 2024-09-16T02:06:14.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/823: chown d5/dd/f2b 768123 1 2024-09-16T02:06:14.389 INFO:tasks.workunit.client.0.smithi110.stdout:5/824: chown d5/l62 1 1 2024-09-16T02:06:14.392 INFO:tasks.workunit.client.0.smithi110.stdout:1/823: symlink d0/d1/d2a/d32/d40/dbf/l10e 0 2024-09-16T02:06:14.396 INFO:tasks.workunit.client.0.smithi110.stdout:3/659: mkdir d8/d48/d5b/d6a/def 0 2024-09-16T02:06:14.397 INFO:tasks.workunit.client.0.smithi110.stdout:7/558: dwrite d3/f90 [0,4194304] 0 2024-09-16T02:06:14.399 INFO:tasks.workunit.client.0.smithi110.stdout:7/559: stat d3/d15/d38/d4f/d2e/f71 0 2024-09-16T02:06:14.403 INFO:tasks.workunit.client.0.smithi110.stdout:1/824: rename d0/d1/d2a to d0/d1/df2/d10f 0 2024-09-16T02:06:14.404 INFO:tasks.workunit.client.0.smithi110.stdout:7/560: creat d3/d7a/fac x:0 0 0 2024-09-16T02:06:14.406 INFO:tasks.workunit.client.0.smithi110.stdout:3/660: write d8/d29/fdd [863263,35518] 0 2024-09-16T02:06:14.408 INFO:tasks.workunit.client.0.smithi110.stdout:8/652: dwrite d3/f85 [0,4194304] 0 2024-09-16T02:06:14.409 INFO:tasks.workunit.client.0.smithi110.stdout:8/653: chown d3/d2b/d27/d45 859536390 1 2024-09-16T02:06:14.411 INFO:tasks.workunit.client.0.smithi110.stdout:3/661: chown d8/d48/d5b/d6a/d75/d88/c91 257548530 1 2024-09-16T02:06:14.412 INFO:tasks.workunit.client.0.smithi110.stdout:3/662: chown d8/d48/c89 19 1 2024-09-16T02:06:14.412 INFO:tasks.workunit.client.0.smithi110.stdout:3/663: chown d8/c14 101 1 2024-09-16T02:06:14.413 INFO:tasks.workunit.client.0.smithi110.stdout:3/664: chown d8/d48/f8e 58492381 1 2024-09-16T02:06:14.414 INFO:tasks.workunit.client.0.smithi110.stdout:3/665: write f2 [3903274,130766] 0 2024-09-16T02:06:14.416 INFO:tasks.workunit.client.0.smithi110.stdout:3/666: write d8/d48/d5b/d92/dc7/d1b/d36/fc1 [4571885,128753] 0 2024-09-16T02:06:14.417 INFO:tasks.workunit.client.0.smithi110.stdout:7/561: rename d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/fa5 to d3/d15/d38/d4f/d10/d11/d8f/fad 0 2024-09-16T02:06:14.418 INFO:tasks.workunit.client.0.smithi110.stdout:7/562: stat d3/d7a/f97 0 2024-09-16T02:06:14.419 INFO:tasks.workunit.client.0.smithi110.stdout:7/563: write d3/d15/d38/d4f/d10/d11/d3e/d40/f99 [107512,40296] 0 2024-09-16T02:06:14.424 INFO:tasks.workunit.client.0.smithi110.stdout:8/654: rename d3/d2b/d27/da7/d1a/d36/d87 to d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/ddc 0 2024-09-16T02:06:14.425 INFO:tasks.workunit.client.0.smithi110.stdout:1/825: getdents d0/da/d7c/da8 0 2024-09-16T02:06:14.426 INFO:tasks.workunit.client.0.smithi110.stdout:7/564: fdatasync d3/d15/d38/d4f/d10/f6d 0 2024-09-16T02:06:14.427 INFO:tasks.workunit.client.0.smithi110.stdout:7/565: dread - d3/d7a/f91 zero size 2024-09-16T02:06:14.427 INFO:tasks.workunit.client.0.smithi110.stdout:8/655: creat d3/d2b/d27/d45/d66/fdd x:0 0 0 2024-09-16T02:06:14.432 INFO:tasks.workunit.client.0.smithi110.stdout:7/566: dread - d3/d15/d38/d4f/d10/d2c/f85 zero size 2024-09-16T02:06:14.433 INFO:tasks.workunit.client.0.smithi110.stdout:8/656: mkdir d3/d2b/d27/d45/dce/dde 0 2024-09-16T02:06:14.433 INFO:tasks.workunit.client.0.smithi110.stdout:3/667: dread d8/f2a [4194304,4194304] 0 2024-09-16T02:06:14.434 INFO:tasks.workunit.client.0.smithi110.stdout:3/668: chown f2 22263 1 2024-09-16T02:06:14.435 INFO:tasks.workunit.client.0.smithi110.stdout:7/567: truncate d3/d15/d38/d4f/d10/d11/d73/f93 4616014 0 2024-09-16T02:06:14.436 INFO:tasks.workunit.client.0.smithi110.stdout:7/568: write d3/d15/d38/d4f/fd [975566,48875] 0 2024-09-16T02:06:14.437 INFO:tasks.workunit.client.0.smithi110.stdout:3/669: mknod d8/d29/dbd/dc6/cf0 0 2024-09-16T02:06:14.440 INFO:tasks.workunit.client.0.smithi110.stdout:8/657: symlink d3/d2b/d27/d45/dce/dde/ldf 0 2024-09-16T02:06:14.442 INFO:tasks.workunit.client.0.smithi110.stdout:7/569: truncate d3/d15/d38/d4f/d10/d11/d73/d7b/f8e 4712859 0 2024-09-16T02:06:14.443 INFO:tasks.workunit.client.0.smithi110.stdout:1/826: dwrite d0/d25/fe4 [0,4194304] 0 2024-09-16T02:06:14.444 INFO:tasks.workunit.client.0.smithi110.stdout:7/570: readlink d3/d15/d38/d4f/d10/l25 0 2024-09-16T02:06:14.446 INFO:tasks.workunit.client.0.smithi110.stdout:8/658: creat d3/d2b/d27/d45/dce/dde/fe0 x:0 0 0 2024-09-16T02:06:14.448 INFO:tasks.workunit.client.0.smithi110.stdout:8/659: truncate d3/d2b/d27/da7/f5c 796356 0 2024-09-16T02:06:14.449 INFO:tasks.workunit.client.0.smithi110.stdout:1/827: mknod d0/da/d7c/c110 0 2024-09-16T02:06:14.452 INFO:tasks.workunit.client.0.smithi110.stdout:3/670: creat d8/d48/d5b/ff1 x:0 0 0 2024-09-16T02:06:14.455 INFO:tasks.workunit.client.0.smithi110.stdout:8/660: rename d3/d2b/d27/d45/d66/d6b/d8d/la3 to d3/d2b/d27/da7/dc7/le1 0 2024-09-16T02:06:14.457 INFO:tasks.workunit.client.0.smithi110.stdout:1/828: dwrite d0/da/d8d/df6/fcd [0,4194304] 0 2024-09-16T02:06:14.458 INFO:tasks.workunit.client.0.smithi110.stdout:8/661: write d3/d2b/d27/da7/d1a/fd4 [774838,101798] 0 2024-09-16T02:06:14.460 INFO:tasks.workunit.client.0.smithi110.stdout:1/829: write d0/da/d8d/df6/fcd [3014594,96156] 0 2024-09-16T02:06:14.460 INFO:tasks.workunit.client.0.smithi110.stdout:3/671: creat d8/d48/d5b/d6a/def/ff2 x:0 0 0 2024-09-16T02:06:14.461 INFO:tasks.workunit.client.0.smithi110.stdout:1/830: chown d0/da/d8d/df6/d10d 161 1 2024-09-16T02:06:14.461 INFO:tasks.workunit.client.0.smithi110.stdout:3/672: chown d8/d48/d5b/d92/dc7/fcf 0 1 2024-09-16T02:06:14.462 INFO:tasks.workunit.client.0.smithi110.stdout:8/662: creat d3/d2b/d65/fe2 x:0 0 0 2024-09-16T02:06:14.463 INFO:tasks.workunit.client.0.smithi110.stdout:8/663: chown d3/lc 3 1 2024-09-16T02:06:14.466 INFO:tasks.workunit.client.0.smithi110.stdout:3/673: fsync d8/d48/d5b/d92/dc7/f2b 0 2024-09-16T02:06:14.468 INFO:tasks.workunit.client.0.smithi110.stdout:1/831: dread d0/d25/f42 [0,4194304] 0 2024-09-16T02:06:14.469 INFO:tasks.workunit.client.0.smithi110.stdout:3/674: readlink d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5/l65 0 2024-09-16T02:06:14.470 INFO:tasks.workunit.client.0.smithi110.stdout:7/571: link d3/d15/d38/l69 d3/d15/d38/d4f/d10/d11/lae 0 2024-09-16T02:06:14.471 INFO:tasks.workunit.client.0.smithi110.stdout:8/664: dwrite d3/d2b/d27/da7/d1a/d36/d60/fb2 [0,4194304] 0 2024-09-16T02:06:14.473 INFO:tasks.workunit.client.0.smithi110.stdout:7/572: write d3/f26 [487238,73868] 0 2024-09-16T02:06:14.476 INFO:tasks.workunit.client.0.smithi110.stdout:1/832: creat d0/d25/d63/f111 x:0 0 0 2024-09-16T02:06:14.481 INFO:tasks.workunit.client.0.smithi110.stdout:3/675: creat d8/d48/d5b/d6a/d75/d8b/ff3 x:0 0 0 2024-09-16T02:06:14.482 INFO:tasks.workunit.client.0.smithi110.stdout:3/676: write d8/f79 [1946729,58450] 0 2024-09-16T02:06:14.482 INFO:tasks.workunit.client.0.smithi110.stdout:7/573: mknod d3/d15/d38/d4f/d10/d11/d73/d7b/caf 0 2024-09-16T02:06:14.485 INFO:tasks.workunit.client.0.smithi110.stdout:8/665: symlink d3/d2b/d27/le3 0 2024-09-16T02:06:14.485 INFO:tasks.workunit.client.0.smithi110.stdout:7/574: chown d3/d15/d38/d4f/d2e/f4c 685774875 1 2024-09-16T02:06:14.486 INFO:tasks.workunit.client.0.smithi110.stdout:1/833: mknod d0/da/d8d/df6/dc4/c112 0 2024-09-16T02:06:14.490 INFO:tasks.workunit.client.0.smithi110.stdout:7/575: dread d3/f90 [0,4194304] 0 2024-09-16T02:06:14.490 INFO:tasks.workunit.client.0.smithi110.stdout:8/666: mknod d3/d2b/d27/d45/d66/d6b/d8d/ce4 0 2024-09-16T02:06:14.491 INFO:tasks.workunit.client.0.smithi110.stdout:7/576: fdatasync d3/d15/d38/d4f/d10/d11/d3e/f42 0 2024-09-16T02:06:14.492 INFO:tasks.workunit.client.0.smithi110.stdout:8/667: write d3/d2b/d27/da7/d1a/d36/f8b [4879037,124646] 0 2024-09-16T02:06:14.493 INFO:tasks.workunit.client.0.smithi110.stdout:1/834: read d0/d1/f23 [1404811,13023] 0 2024-09-16T02:06:14.498 INFO:tasks.workunit.client.0.smithi110.stdout:7/577: mknod d3/d15/d44/cb0 0 2024-09-16T02:06:14.500 INFO:tasks.workunit.client.0.smithi110.stdout:8/668: fdatasync d3/d2b/d27/da7/d1a/d36/d60/f81 0 2024-09-16T02:06:14.501 INFO:tasks.workunit.client.0.smithi110.stdout:3/677: link d8/d48/d5b/d92/dc7/d1b/d36/la3 d8/d29/dbd/dc6/lf4 0 2024-09-16T02:06:14.505 INFO:tasks.workunit.client.0.smithi110.stdout:1/835: mknod d0/da/d7c/da8/dec/c113 0 2024-09-16T02:06:14.506 INFO:tasks.workunit.client.0.smithi110.stdout:8/669: unlink d3/d2b/d27/da7/d1d/f71 0 2024-09-16T02:06:14.507 INFO:tasks.workunit.client.0.smithi110.stdout:3/678: fsync d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5/f6c 0 2024-09-16T02:06:14.507 INFO:tasks.workunit.client.0.smithi110.stdout:7/578: symlink d3/d15/d38/lb1 0 2024-09-16T02:06:14.511 INFO:tasks.workunit.client.0.smithi110.stdout:7/579: dread d3/f26 [0,4194304] 0 2024-09-16T02:06:14.517 INFO:tasks.workunit.client.0.smithi110.stdout:8/670: creat d3/d2b/d27/da7/d1a/d36/d60/da1/db5/fe5 x:0 0 0 2024-09-16T02:06:14.517 INFO:tasks.workunit.client.0.smithi110.stdout:7/580: mknod d3/d62/d65/cb2 0 2024-09-16T02:06:14.518 INFO:tasks.workunit.client.0.smithi110.stdout:1/836: dwrite d0/da/f29 [4194304,4194304] 0 2024-09-16T02:06:14.519 INFO:tasks.workunit.client.0.smithi110.stdout:8/671: chown d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/c97 15586 1 2024-09-16T02:06:14.520 INFO:tasks.workunit.client.0.smithi110.stdout:3/679: creat d8/ff5 x:0 0 0 2024-09-16T02:06:14.524 INFO:tasks.workunit.client.0.smithi110.stdout:8/672: symlink d3/d2b/d27/da7/d8f/le6 0 2024-09-16T02:06:14.525 INFO:tasks.workunit.client.0.smithi110.stdout:3/680: mknod d8/d48/d5b/d6a/d75/da8/cf6 0 2024-09-16T02:06:14.527 INFO:tasks.workunit.client.0.smithi110.stdout:3/681: chown d8/f79 41 1 2024-09-16T02:06:14.527 INFO:tasks.workunit.client.0.smithi110.stdout:1/837: rename d0/d1/l39 to d0/d1/d4/d46/l114 0 2024-09-16T02:06:14.531 INFO:tasks.workunit.client.0.smithi110.stdout:8/673: rename d3/d2b/d27/d45/d66/d6b/d8d/f9c to d3/d2b/d27/d45/fe7 0 2024-09-16T02:06:14.531 INFO:tasks.workunit.client.0.smithi110.stdout:3/682: creat d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/ff7 x:0 0 0 2024-09-16T02:06:14.533 INFO:tasks.workunit.client.0.smithi110.stdout:3/683: fsync d8/d29/dbd/f38 0 2024-09-16T02:06:14.533 INFO:tasks.workunit.client.0.smithi110.stdout:1/838: creat d0/d1/df2/d10f/d9a/da2/f115 x:0 0 0 2024-09-16T02:06:14.535 INFO:tasks.workunit.client.0.smithi110.stdout:8/674: symlink d3/d2b/d27/d45/d86/le8 0 2024-09-16T02:06:14.538 INFO:tasks.workunit.client.0.smithi110.stdout:1/839: creat d0/da/d8d/df6/dc4/d79/f116 x:0 0 0 2024-09-16T02:06:14.539 INFO:tasks.workunit.client.0.smithi110.stdout:1/840: chown d0/da/d8d/df6/d10d 573 1 2024-09-16T02:06:14.540 INFO:tasks.workunit.client.0.smithi110.stdout:7/581: write d3/d15/d38/d4f/d10/f29 [140977,128892] 0 2024-09-16T02:06:14.542 INFO:tasks.workunit.client.0.smithi110.stdout:1/841: read d0/d1/d4/d46/d7a/fcc [1619244,45794] 0 2024-09-16T02:06:14.544 INFO:tasks.workunit.client.0.smithi110.stdout:8/675: rename d3/d2b/d27/da7/d1d to d3/d2b/d27/da7/d1a/de9 0 2024-09-16T02:06:14.544 INFO:tasks.workunit.client.0.smithi110.stdout:3/684: dread d8/d29/dbd/f26 [0,4194304] 0 2024-09-16T02:06:14.548 INFO:tasks.workunit.client.0.smithi110.stdout:1/842: fsync d0/da/f81 0 2024-09-16T02:06:14.549 INFO:tasks.workunit.client.0.smithi110.stdout:3/685: unlink d8/d48/d4b/ca6 0 2024-09-16T02:06:14.554 INFO:tasks.workunit.client.0.smithi110.stdout:3/686: fdatasync d8/d48/f4f 0 2024-09-16T02:06:14.555 INFO:tasks.workunit.client.0.smithi110.stdout:1/843: symlink d0/da/d8d/df6/l117 0 2024-09-16T02:06:14.678 INFO:tasks.workunit.client.0.smithi110.stdout:3/687: creat d8/d48/d5b/d6a/ff8 x:0 0 0 2024-09-16T02:06:14.685 INFO:tasks.workunit.client.0.smithi110.stdout:1/844: rename d0/d1/df2/d10f/d32/d40/dbf/l10e to d0/da/d7c/da8/l118 0 2024-09-16T02:06:14.708 INFO:tasks.workunit.client.0.smithi110.stdout:1/845: dread d0/da/d8d/df6/fe5 [0,4194304] 0 2024-09-16T02:06:14.710 INFO:tasks.workunit.client.0.smithi110.stdout:1/846: write d0/d1/df2/d10f/d32/f33 [934651,76639] 0 2024-09-16T02:06:14.713 INFO:tasks.workunit.client.0.smithi110.stdout:1/847: mknod d0/da/d7c/da8/dec/c119 0 2024-09-16T02:06:14.715 INFO:tasks.workunit.client.0.smithi110.stdout:1/848: unlink d0/d1/df2/d10f/d32/d6e/l71 0 2024-09-16T02:06:14.717 INFO:tasks.workunit.client.0.smithi110.stdout:1/849: chown d0/d25/d63/lbd 0 1 2024-09-16T02:06:14.722 INFO:tasks.workunit.client.0.smithi110.stdout:1/850: dwrite d0/d1/df2/d10f/d32/fa6 [0,4194304] 0 2024-09-16T02:06:14.726 INFO:tasks.workunit.client.0.smithi110.stdout:1/851: symlink d0/d1/d4/d46/d7a/d9b/l11a 0 2024-09-16T02:06:14.731 INFO:tasks.workunit.client.0.smithi110.stdout:1/852: link d0/d1/d4/l3 d0/d1/df2/d10f/d9a/da2/l11b 0 2024-09-16T02:06:14.732 INFO:tasks.workunit.client.0.smithi110.stdout:1/853: fdatasync d0/d1/df2/d10f/d9a/ffb 0 2024-09-16T02:06:14.746 INFO:tasks.workunit.client.0.smithi110.stdout:1/854: dread d0/d1/df2/d10f/d32/f41 [0,4194304] 0 2024-09-16T02:06:14.747 INFO:tasks.workunit.client.0.smithi110.stdout:1/855: truncate d0/d1/f10b 92795 0 2024-09-16T02:06:14.749 INFO:tasks.workunit.client.0.smithi110.stdout:1/856: mknod d0/da/d8d/df6/dd0/c11c 0 2024-09-16T02:06:14.751 INFO:tasks.workunit.client.0.smithi110.stdout:1/857: symlink d0/d1/df2/d10f/d32/d40/dbf/dfd/l11d 0 2024-09-16T02:06:14.752 INFO:tasks.workunit.client.0.smithi110.stdout:1/858: mkdir d0/da/d7c/d11e 0 2024-09-16T02:06:14.753 INFO:tasks.workunit.client.0.smithi110.stdout:1/859: fsync d0/d1/d4/f18 0 2024-09-16T02:06:14.756 INFO:tasks.workunit.client.0.smithi110.stdout:1/860: creat d0/d1/f11f x:0 0 0 2024-09-16T02:06:14.758 INFO:tasks.workunit.client.0.smithi110.stdout:1/861: symlink d0/d1/d4/d46/df7/l120 0 2024-09-16T02:06:14.758 INFO:tasks.workunit.client.0.smithi110.stdout:1/862: dread - d0/d1/df2/d10f/d32/d6e/f6f zero size 2024-09-16T02:06:14.760 INFO:tasks.workunit.client.0.smithi110.stdout:1/863: fsync d0/da/fd2 0 2024-09-16T02:06:14.761 INFO:tasks.workunit.client.0.smithi110.stdout:1/864: creat d0/d1/d4/d46/d7a/d9b/f121 x:0 0 0 2024-09-16T02:06:14.763 INFO:tasks.workunit.client.0.smithi110.stdout:1/865: symlink d0/d1/dab/l122 0 2024-09-16T02:06:14.764 INFO:tasks.workunit.client.0.smithi110.stdout:1/866: mknod d0/d1/df2/d10f/d32/c123 0 2024-09-16T02:06:14.766 INFO:tasks.workunit.client.0.smithi110.stdout:1/867: creat d0/d1/dab/f124 x:0 0 0 2024-09-16T02:06:14.767 INFO:tasks.workunit.client.0.smithi110.stdout:1/868: symlink d0/d1/dab/l125 0 2024-09-16T02:06:15.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:14 smithi165 ceph-mon[34621]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:15.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:14 smithi165 ceph-mon[34621]: pgmap v31: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 74 MiB/s rd, 170 MiB/s wr, 399 op/s 2024-09-16T02:06:15.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:14 smithi110 ceph-mon[27634]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:15.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:14 smithi110 ceph-mon[27634]: pgmap v31: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 74 MiB/s rd, 170 MiB/s wr, 399 op/s 2024-09-16T02:06:15.334 INFO:tasks.workunit.client.0.smithi110.stdout:2/852: sync 2024-09-16T02:06:15.337 INFO:tasks.workunit.client.0.smithi110.stdout:2/853: creat d0/db/d105/d41/db3/db8/f127 x:0 0 0 2024-09-16T02:06:15.339 INFO:tasks.workunit.client.0.smithi110.stdout:2/854: mkdir d0/d5f/dc0/d10f/d128 0 2024-09-16T02:06:15.341 INFO:tasks.workunit.client.0.smithi110.stdout:2/855: mknod d0/db/d105/d41/c129 0 2024-09-16T02:06:15.347 INFO:tasks.workunit.client.0.smithi110.stdout:2/856: dwrite d0/db/d105/d39/d87/f119 [0,4194304] 0 2024-09-16T02:06:15.348 INFO:tasks.workunit.client.0.smithi110.stdout:2/857: dread - d0/db/d105/d41/db3/df0/f10e zero size 2024-09-16T02:06:15.358 INFO:tasks.workunit.client.0.smithi110.stdout:2/858: dwrite d0/d5f/dc0/ddc/ddd/d18/f98 [0,4194304] 0 2024-09-16T02:06:15.359 INFO:tasks.workunit.client.0.smithi110.stdout:2/859: write d0/d5f/f97 [2974091,73047] 0 2024-09-16T02:06:15.361 INFO:tasks.workunit.client.0.smithi110.stdout:2/860: chown d0/db/d105/d41/db3/df0/f10e 2886 1 2024-09-16T02:06:15.366 INFO:tasks.workunit.client.0.smithi110.stdout:2/861: write d0/fc5 [172002,996] 0 2024-09-16T02:06:15.367 INFO:tasks.workunit.client.0.smithi110.stdout:2/862: rmdir d0/db/d105/d41/db3/df0 39 2024-09-16T02:06:15.371 INFO:tasks.workunit.client.0.smithi110.stdout:2/863: rename d0/d5f/dc0/ddc/ddd/l81 to d0/db/d105/d41/db3/d126/l12a 0 2024-09-16T02:06:15.375 INFO:tasks.workunit.client.0.smithi110.stdout:2/864: rename d0/d5f/dc0/ddc/ddd/dfa/d3b/cd7 to d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/c12b 0 2024-09-16T02:06:15.378 INFO:tasks.workunit.client.0.smithi110.stdout:2/865: creat d0/d5f/dc0/ddc/ddd/dfa/f12c x:0 0 0 2024-09-16T02:06:15.379 INFO:tasks.workunit.client.0.smithi110.stdout:2/866: dread - d0/d5f/dc0/ddc/ddd/d18/f122 zero size 2024-09-16T02:06:15.381 INFO:tasks.workunit.client.0.smithi110.stdout:2/867: read d0/db/d33/f8d [285351,62457] 0 2024-09-16T02:06:15.382 INFO:tasks.workunit.client.0.smithi110.stdout:2/868: fdatasync d0/d5f/dc0/ddc/ddd/d18/dc/fee 0 2024-09-16T02:06:15.384 INFO:tasks.workunit.client.0.smithi110.stdout:8/676: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:4/644: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:7/582: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:0/702: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:5/825: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:9/792: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:1/869: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:6/830: sync 2024-09-16T02:06:15.385 INFO:tasks.workunit.client.0.smithi110.stdout:3/688: sync 2024-09-16T02:06:15.388 INFO:tasks.workunit.client.0.smithi110.stdout:2/869: dread - d0/d5f/dc0/ddc/ddd/db5/ffc zero size 2024-09-16T02:06:15.391 INFO:tasks.workunit.client.0.smithi110.stdout:3/689: stat d8/d48/d5b/d92/dc7/d1b/f24 0 2024-09-16T02:06:15.392 INFO:tasks.workunit.client.0.smithi110.stdout:0/703: creat d3/d4/dc/d75/fd8 x:0 0 0 2024-09-16T02:06:15.394 INFO:tasks.workunit.client.0.smithi110.stdout:9/793: fdatasync d1/d5/d20/d55/fab 0 2024-09-16T02:06:15.397 INFO:tasks.workunit.client.0.smithi110.stdout:8/677: mknod d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/cea 0 2024-09-16T02:06:15.400 INFO:tasks.workunit.client.0.smithi110.stdout:4/645: rename d4/d8/d31/d80/d90/la4 to d4/d8/d17/d23/d4c/d6d/dc6/lca 0 2024-09-16T02:06:15.403 INFO:tasks.workunit.client.0.smithi110.stdout:8/678: stat d3/d2b/d27/da7/d8f 0 2024-09-16T02:06:15.406 INFO:tasks.workunit.client.0.smithi110.stdout:8/679: readlink d3/lc 0 2024-09-16T02:06:15.411 INFO:tasks.workunit.client.0.smithi110.stdout:6/831: dwrite d0/d29/dc1/fe3 [0,4194304] 0 2024-09-16T02:06:15.419 INFO:tasks.workunit.client.0.smithi110.stdout:5/826: dwrite d5/d71/d89/fe6 [4194304,4194304] 0 2024-09-16T02:06:15.419 INFO:tasks.workunit.client.0.smithi110.stdout:3/690: mknod d8/d29/d45/cf9 0 2024-09-16T02:06:15.422 INFO:tasks.workunit.client.0.smithi110.stdout:6/832: dread d0/f10 [0,4194304] 0 2024-09-16T02:06:15.428 INFO:tasks.workunit.client.0.smithi110.stdout:9/794: creat d1/dd/d6a/d6c/d9b/f10d x:0 0 0 2024-09-16T02:06:15.429 INFO:tasks.workunit.client.0.smithi110.stdout:2/870: write d0/db/d33/f6c [751222,81229] 0 2024-09-16T02:06:15.435 INFO:tasks.workunit.client.0.smithi110.stdout:4/646: truncate d4/d8/d31/d80/d18/f94 1182992 0 2024-09-16T02:06:15.441 INFO:tasks.workunit.client.0.smithi110.stdout:5/827: mkdir d5/dd/df/d28/d6f/d8e/dd6/d10c 0 2024-09-16T02:06:15.443 INFO:tasks.workunit.client.0.smithi110.stdout:3/691: creat d8/d29/dbd/dc6/ffa x:0 0 0 2024-09-16T02:06:15.445 INFO:tasks.workunit.client.0.smithi110.stdout:1/870: dwrite d0/d1/d4/d46/d7a/d9b/fb7 [0,4194304] 0 2024-09-16T02:06:15.445 INFO:tasks.workunit.client.0.smithi110.stdout:0/704: dwrite d3/d4/dc/d75/f83 [0,4194304] 0 2024-09-16T02:06:15.446 INFO:tasks.workunit.client.0.smithi110.stdout:6/833: write d0/d29/d2a/fa5 [3197914,5127] 0 2024-09-16T02:06:15.450 INFO:tasks.workunit.client.0.smithi110.stdout:7/583: write d3/d15/d38/d4f/d10/d11/d3e/d40/f4a [1173858,67497] 0 2024-09-16T02:06:15.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/647: creat d4/d8/d17/d23/d4c/d6d/fcb x:0 0 0 2024-09-16T02:06:15.458 INFO:tasks.workunit.client.0.smithi110.stdout:5/828: creat d5/d36/d3d/f10d x:0 0 0 2024-09-16T02:06:15.460 INFO:tasks.workunit.client.0.smithi110.stdout:5/829: write d5/dd/df/d11/d6d/fc4 [1704984,119850] 0 2024-09-16T02:06:15.462 INFO:tasks.workunit.client.0.smithi110.stdout:6/834: dread d0/d2/d5/db8/f7e [0,4194304] 0 2024-09-16T02:06:15.463 INFO:tasks.workunit.client.0.smithi110.stdout:7/584: symlink d3/d62/d65/lb3 0 2024-09-16T02:06:15.463 INFO:tasks.workunit.client.0.smithi110.stdout:6/835: write d0/d2/f3a [3617349,112506] 0 2024-09-16T02:06:15.464 INFO:tasks.workunit.client.0.smithi110.stdout:7/585: dread - d3/d15/d81/f95 zero size 2024-09-16T02:06:15.464 INFO:tasks.workunit.client.0.smithi110.stdout:3/692: symlink d8/d29/dbd/dc6/dd3/lfb 0 2024-09-16T02:06:15.466 INFO:tasks.workunit.client.0.smithi110.stdout:2/871: rmdir d0/db/d105/d41/db3/de3 0 2024-09-16T02:06:15.467 INFO:tasks.workunit.client.0.smithi110.stdout:2/872: stat d0/d5f/dc0/ddc/ddd/dfa/d104 0 2024-09-16T02:06:15.475 INFO:tasks.workunit.client.0.smithi110.stdout:8/680: truncate d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/ddc/fb3 3598713 0 2024-09-16T02:06:15.477 INFO:tasks.workunit.client.0.smithi110.stdout:6/836: unlink d0/d29/d2a/fa5 0 2024-09-16T02:06:15.481 INFO:tasks.workunit.client.0.smithi110.stdout:7/586: rename f1 to d3/d15/d38/d4f/d10/d11/d73/d7b/fb4 0 2024-09-16T02:06:15.482 INFO:tasks.workunit.client.0.smithi110.stdout:3/693: dwrite d8/d48/d5b/f76 [0,4194304] 0 2024-09-16T02:06:15.482 INFO:tasks.workunit.client.0.smithi110.stdout:5/830: truncate d5/dd/df/d11/f91 448420 0 2024-09-16T02:06:15.484 INFO:tasks.workunit.client.0.smithi110.stdout:5/831: chown d5/dd/df/d28/d6f/d86/fbb 0 1 2024-09-16T02:06:15.485 INFO:tasks.workunit.client.0.smithi110.stdout:9/795: getdents d1/dd/d6a/d6c/d75/d8c 0 2024-09-16T02:06:15.486 INFO:tasks.workunit.client.0.smithi110.stdout:4/648: creat d4/d8/d17/d23/d4c/d6d/d3c/fcc x:0 0 0 2024-09-16T02:06:15.486 INFO:tasks.workunit.client.0.smithi110.stdout:1/871: write d0/da/f10c [424138,38823] 0 2024-09-16T02:06:15.487 INFO:tasks.workunit.client.0.smithi110.stdout:4/649: fsync d4/f11 0 2024-09-16T02:06:15.487 INFO:tasks.workunit.client.0.smithi110.stdout:9/796: readlink d1/dd/d6a/d6c/d6f/d79/de/l5e 0 2024-09-16T02:06:15.488 INFO:tasks.workunit.client.0.smithi110.stdout:0/705: getdents d3/d92/d9a 0 2024-09-16T02:06:15.490 INFO:tasks.workunit.client.0.smithi110.stdout:6/837: creat d0/d2/d57/d75/df0/f105 x:0 0 0 2024-09-16T02:06:15.493 INFO:tasks.workunit.client.0.smithi110.stdout:2/873: rename d0/db/d105/d39/d87/d11b to d0/db/d47/d48/da0/d12d 0 2024-09-16T02:06:15.498 INFO:tasks.workunit.client.0.smithi110.stdout:5/832: readlink d5/d36/d45/d47/l10a 0 2024-09-16T02:06:15.499 INFO:tasks.workunit.client.0.smithi110.stdout:5/833: dread - d5/ff9 zero size 2024-09-16T02:06:15.502 INFO:tasks.workunit.client.0.smithi110.stdout:2/874: dwrite d0/db/d105/f8a [0,4194304] 0 2024-09-16T02:06:15.503 INFO:tasks.workunit.client.0.smithi110.stdout:7/587: dwrite d3/d15/d38/d4f/d10/d11/f5f [0,4194304] 0 2024-09-16T02:06:15.505 INFO:tasks.workunit.client.0.smithi110.stdout:2/875: chown d0/d5f/dc0/d10f/d128 863 1 2024-09-16T02:06:15.506 INFO:tasks.workunit.client.0.smithi110.stdout:7/588: chown d3/d15/d38/d4f/d10/d11/d73/d7b/c7c 3321426 1 2024-09-16T02:06:15.506 INFO:tasks.workunit.client.0.smithi110.stdout:0/706: dread - d3/d4/dc/d75/fae zero size 2024-09-16T02:06:15.510 INFO:tasks.workunit.client.0.smithi110.stdout:1/872: write d0/d1/d4/d46/d51/f72 [4842328,104478] 0 2024-09-16T02:06:15.515 INFO:tasks.workunit.client.0.smithi110.stdout:9/797: symlink d1/d1b/daa/d109/l10e 0 2024-09-16T02:06:15.515 INFO:tasks.workunit.client.0.smithi110.stdout:7/589: dread d3/d15/d38/d4f/d10/d11/f3f [0,4194304] 0 2024-09-16T02:06:15.516 INFO:tasks.workunit.client.0.smithi110.stdout:2/876: read - d0/d5f/dc0/ddc/ddd/d18/fa2 zero size 2024-09-16T02:06:15.518 INFO:tasks.workunit.client.0.smithi110.stdout:0/707: read - d3/d4/dc/fb7 zero size 2024-09-16T02:06:15.522 INFO:tasks.workunit.client.0.smithi110.stdout:1/873: creat d0/d1/d4/d46/d7a/f126 x:0 0 0 2024-09-16T02:06:15.523 INFO:tasks.workunit.client.0.smithi110.stdout:0/708: dread - d3/d4/d6d/f79 zero size 2024-09-16T02:06:15.523 INFO:tasks.workunit.client.0.smithi110.stdout:4/650: dwrite d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [8388608,4194304] 0 2024-09-16T02:06:15.525 INFO:tasks.workunit.client.0.smithi110.stdout:5/834: link d5/dd/df/d28/ff4 d5/d36/db5/f10e 0 2024-09-16T02:06:15.525 INFO:tasks.workunit.client.0.smithi110.stdout:6/838: dwrite d0/d2/d5/db8/f7e [0,4194304] 0 2024-09-16T02:06:15.526 INFO:tasks.workunit.client.0.smithi110.stdout:0/709: dread - d3/d4/d6d/f79 zero size 2024-09-16T02:06:15.526 INFO:tasks.workunit.client.0.smithi110.stdout:7/590: write d3/f90 [3955071,113072] 0 2024-09-16T02:06:15.530 INFO:tasks.workunit.client.0.smithi110.stdout:9/798: truncate d1/dd/d6a/d6c/d6f/d79/d26/d8e/fa5 4324623 0 2024-09-16T02:06:15.530 INFO:tasks.workunit.client.0.smithi110.stdout:4/651: rmdir d4/d8/d31/d6f/d93 39 2024-09-16T02:06:15.533 INFO:tasks.workunit.client.0.smithi110.stdout:1/874: chown d0/d1/df2/d10f/d32/d40/dbf/fd3 173131 1 2024-09-16T02:06:15.533 INFO:tasks.workunit.client.0.smithi110.stdout:0/710: fdatasync d3/d4/dc/d14/d7e/d81/d89/fcb 0 2024-09-16T02:06:15.535 INFO:tasks.workunit.client.0.smithi110.stdout:7/591: mkdir d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/db5 0 2024-09-16T02:06:15.540 INFO:tasks.workunit.client.0.smithi110.stdout:4/652: rename d4/d8/d31/d80/d18/f29 to d4/db4/fcd 0 2024-09-16T02:06:15.540 INFO:tasks.workunit.client.0.smithi110.stdout:2/877: write d0/db/d105/d41/fb0 [384187,57352] 0 2024-09-16T02:06:15.541 INFO:tasks.workunit.client.0.smithi110.stdout:2/878: chown d0/db/d105/f4a 13 1 2024-09-16T02:06:15.542 INFO:tasks.workunit.client.0.smithi110.stdout:0/711: mknod d3/d4/dc/d14/d7e/d81/d86/cd9 0 2024-09-16T02:06:15.545 INFO:tasks.workunit.client.0.smithi110.stdout:1/875: mknod d0/d1/df2/d10f/d32/d40/c127 0 2024-09-16T02:06:15.548 INFO:tasks.workunit.client.0.smithi110.stdout:1/876: symlink d0/da/d7c/l128 0 2024-09-16T02:06:15.549 INFO:tasks.workunit.client.0.smithi110.stdout:9/799: link d1/d1b/d23/lfc d1/d1b/daa/l10f 0 2024-09-16T02:06:15.553 INFO:tasks.workunit.client.0.smithi110.stdout:4/653: dwrite d4/d8/d17/d23/f9e [0,4194304] 0 2024-09-16T02:06:15.555 INFO:tasks.workunit.client.0.smithi110.stdout:1/877: mknod d0/da/d8d/df6/dd0/c129 0 2024-09-16T02:06:15.557 INFO:tasks.workunit.client.0.smithi110.stdout:7/592: write d3/f26 [1505852,50243] 0 2024-09-16T02:06:15.558 INFO:tasks.workunit.client.0.smithi110.stdout:9/800: creat d1/dd/d6a/d6c/d6f/d79/de/f110 x:0 0 0 2024-09-16T02:06:15.558 INFO:tasks.workunit.client.0.smithi110.stdout:5/835: dread d5/dd/f12 [0,4194304] 0 2024-09-16T02:06:15.560 INFO:tasks.workunit.client.0.smithi110.stdout:1/878: truncate d0/d1/d4/d46/d7a/fcc 5012222 0 2024-09-16T02:06:15.563 INFO:tasks.workunit.client.0.smithi110.stdout:9/801: read d1/dd/d6a/d6c/d75/d8c/f4d [1374997,53323] 0 2024-09-16T02:06:15.564 INFO:tasks.workunit.client.0.smithi110.stdout:0/712: write d3/d6/d43/d55/d59/fa6 [3020105,18032] 0 2024-09-16T02:06:15.565 INFO:tasks.workunit.client.0.smithi110.stdout:4/654: creat d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fce x:0 0 0 2024-09-16T02:06:15.569 INFO:tasks.workunit.client.0.smithi110.stdout:5/836: mknod d5/dd/df/d11/d6d/c10f 0 2024-09-16T02:06:15.571 INFO:tasks.workunit.client.0.smithi110.stdout:7/593: dwrite d3/d15/d38/d4f/d10/d11/d3e/f42 [0,4194304] 0 2024-09-16T02:06:15.573 INFO:tasks.workunit.client.0.smithi110.stdout:1/879: dwrite d0/d25/d63/f111 [0,4194304] 0 2024-09-16T02:06:15.576 INFO:tasks.workunit.client.0.smithi110.stdout:7/594: chown d3/d15/d38/d4f/d10/d11/d8f/d9b 1369982 1 2024-09-16T02:06:15.579 INFO:tasks.workunit.client.0.smithi110.stdout:7/595: truncate d3/d15/d38/d4f/d10/f29 2393551 0 2024-09-16T02:06:15.580 INFO:tasks.workunit.client.0.smithi110.stdout:7/596: fsync d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 0 2024-09-16T02:06:15.583 INFO:tasks.workunit.client.0.smithi110.stdout:9/802: creat d1/d5/d20/d83/f111 x:0 0 0 2024-09-16T02:06:15.584 INFO:tasks.workunit.client.0.smithi110.stdout:0/713: mkdir d3/d6/d43/da7/dda 0 2024-09-16T02:06:15.589 INFO:tasks.workunit.client.0.smithi110.stdout:5/837: creat d5/dd/df/d11/d6d/f110 x:0 0 0 2024-09-16T02:06:15.590 INFO:tasks.workunit.client.0.smithi110.stdout:4/655: dread d4/d8/d31/d80/d18/f94 [0,4194304] 0 2024-09-16T02:06:15.591 INFO:tasks.workunit.client.0.smithi110.stdout:4/656: readlink d4/d8/d31/d6f/lb6 0 2024-09-16T02:06:15.594 INFO:tasks.workunit.client.0.smithi110.stdout:7/597: read - d3/d15/d38/f8d zero size 2024-09-16T02:06:15.598 INFO:tasks.workunit.client.0.smithi110.stdout:5/838: fsync d5/dd/df/d28/d9c/faa 0 2024-09-16T02:06:15.600 INFO:tasks.workunit.client.0.smithi110.stdout:4/657: rename d4/d8/d17/d6b/d98/lc1 to d4/d8/d17/d6b/d98/lcf 0 2024-09-16T02:06:15.601 INFO:tasks.workunit.client.0.smithi110.stdout:7/598: mknod d3/d15/d38/d4f/d10/d76/cb6 0 2024-09-16T02:06:15.603 INFO:tasks.workunit.client.0.smithi110.stdout:7/599: chown d3/d7a/f91 0 1 2024-09-16T02:06:15.604 INFO:tasks.workunit.client.0.smithi110.stdout:0/714: dread d3/d4/dc/d14/d7e/d81/d89/fb0 [0,4194304] 0 2024-09-16T02:06:15.605 INFO:tasks.workunit.client.0.smithi110.stdout:4/658: mkdir d4/db4/dd0 0 2024-09-16T02:06:15.607 INFO:tasks.workunit.client.0.smithi110.stdout:5/839: dwrite d5/dd/df/d11/fb9 [4194304,4194304] 0 2024-09-16T02:06:15.607 INFO:tasks.workunit.client.0.smithi110.stdout:7/600: mkdir d3/d15/d81/db7 0 2024-09-16T02:06:15.609 INFO:tasks.workunit.client.0.smithi110.stdout:0/715: mknod d3/cdb 0 2024-09-16T02:06:15.610 INFO:tasks.workunit.client.0.smithi110.stdout:1/880: dwrite d0/d1/df2/d10f/d32/f4f [0,4194304] 0 2024-09-16T02:06:15.613 INFO:tasks.workunit.client.0.smithi110.stdout:7/601: symlink d3/d62/lb8 0 2024-09-16T02:06:15.614 INFO:tasks.workunit.client.0.smithi110.stdout:5/840: mkdir d5/dd/df/d28/dab/d111 0 2024-09-16T02:06:15.614 INFO:tasks.workunit.client.0.smithi110.stdout:7/602: truncate d3/d15/d81/f95 254938 0 2024-09-16T02:06:15.615 INFO:tasks.workunit.client.0.smithi110.stdout:4/659: mkdir d4/d8/d31/d80/dd1 0 2024-09-16T02:06:15.617 INFO:tasks.workunit.client.0.smithi110.stdout:0/716: rmdir d3/d4/d85/d93 39 2024-09-16T02:06:15.624 INFO:tasks.workunit.client.0.smithi110.stdout:4/660: chown d4/d8/d31/d80/d18/lb3 42648798 1 2024-09-16T02:06:15.625 INFO:tasks.workunit.client.0.smithi110.stdout:0/717: unlink d3/d4/dc/d10/cba 0 2024-09-16T02:06:15.627 INFO:tasks.workunit.client.0.smithi110.stdout:1/881: creat d0/d1/df2/d10f/d32/d40/f12a x:0 0 0 2024-09-16T02:06:15.629 INFO:tasks.workunit.client.0.smithi110.stdout:0/718: readlink d3/d4/dc/d10/lc3 0 2024-09-16T02:06:15.632 INFO:tasks.workunit.client.0.smithi110.stdout:5/841: getdents d5/dd/df/d28/d6f/d8e 0 2024-09-16T02:06:15.635 INFO:tasks.workunit.client.0.smithi110.stdout:5/842: creat d5/dd/df/d28/dab/d111/f112 x:0 0 0 2024-09-16T02:06:15.637 INFO:tasks.workunit.client.0.smithi110.stdout:5/843: mkdir d5/dd/d90/df6/d106/d113 0 2024-09-16T02:06:15.643 INFO:tasks.workunit.client.0.smithi110.stdout:5/844: dwrite d5/d71/d89/fb6 [0,4194304] 0 2024-09-16T02:06:15.644 INFO:tasks.workunit.client.0.smithi110.stdout:7/603: write d3/d15/d38/d4f/f22 [125426,8172] 0 2024-09-16T02:06:15.645 INFO:tasks.workunit.client.0.smithi110.stdout:5/845: chown d5/d36/f67 2141854352 1 2024-09-16T02:06:15.649 INFO:tasks.workunit.client.0.smithi110.stdout:4/661: dread d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [0,4194304] 0 2024-09-16T02:06:15.655 INFO:tasks.workunit.client.0.smithi110.stdout:7/604: link d3/d7a/f97 d3/d62/fb9 0 2024-09-16T02:06:15.655 INFO:tasks.workunit.client.0.smithi110.stdout:4/662: creat d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 x:0 0 0 2024-09-16T02:06:15.665 INFO:tasks.workunit.client.0.smithi110.stdout:7/605: dwrite d3/d62/fb9 [0,4194304] 0 2024-09-16T02:06:15.666 INFO:tasks.workunit.client.0.smithi110.stdout:0/719: dwrite d3/d6/f99 [0,4194304] 0 2024-09-16T02:06:15.666 INFO:tasks.workunit.client.0.smithi110.stdout:5/846: dread d5/dd/df/f9e [0,4194304] 0 2024-09-16T02:06:15.674 INFO:tasks.workunit.client.0.smithi110.stdout:7/606: creat d3/d15/d38/d4f/d10/d11/d8f/fba x:0 0 0 2024-09-16T02:06:15.676 INFO:tasks.workunit.client.0.smithi110.stdout:7/607: write d3/f26 [1426920,78700] 0 2024-09-16T02:06:15.688 INFO:tasks.workunit.client.0.smithi110.stdout:7/608: dread d3/d15/d38/d4f/d10/d2c/f72 [0,4194304] 0 2024-09-16T02:06:15.688 INFO:tasks.workunit.client.0.smithi110.stdout:4/663: dwrite d4/d8/d31/d5d/fa3 [0,4194304] 0 2024-09-16T02:06:15.690 INFO:tasks.workunit.client.0.smithi110.stdout:7/609: creat d3/d15/d44/fbb x:0 0 0 2024-09-16T02:06:15.702 INFO:tasks.workunit.client.0.smithi110.stdout:0/720: write d3/d4/dc/d14/d7e/d81/d86/fb6 [999171,112086] 0 2024-09-16T02:06:15.707 INFO:tasks.workunit.client.0.smithi110.stdout:7/610: write d3/d15/d38/d4f/d10/d2c/f85 [346515,115192] 0 2024-09-16T02:06:15.707 INFO:tasks.workunit.client.0.smithi110.stdout:4/664: write d4/d8/d91/fb8 [690993,12050] 0 2024-09-16T02:06:15.709 INFO:tasks.workunit.client.0.smithi110.stdout:4/665: chown d4/d8/d31/d80/d18/f57 59 1 2024-09-16T02:06:15.711 INFO:tasks.workunit.client.0.smithi110.stdout:0/721: symlink d3/d6/d43/da7/ldc 0 2024-09-16T02:06:15.712 INFO:tasks.workunit.client.0.smithi110.stdout:7/611: unlink d3/d62/d65/lb3 0 2024-09-16T02:06:15.716 INFO:tasks.workunit.client.0.smithi110.stdout:4/666: fdatasync d4/d8/d17/d23/f37 0 2024-09-16T02:06:15.717 INFO:tasks.workunit.client.0.smithi110.stdout:4/667: write d4/d8/d91/fb8 [1502225,26287] 0 2024-09-16T02:06:15.724 INFO:tasks.workunit.client.0.smithi110.stdout:0/722: truncate d3/d4/d85/d93/da1/fb5 6299203 0 2024-09-16T02:06:15.737 INFO:tasks.workunit.client.0.smithi110.stdout:4/668: dread d4/d8/d17/d23/f82 [0,4194304] 0 2024-09-16T02:06:15.743 INFO:tasks.workunit.client.0.smithi110.stdout:4/669: creat d4/d8/d31/fd3 x:0 0 0 2024-09-16T02:06:15.744 INFO:tasks.workunit.client.0.smithi110.stdout:0/723: dread d3/f17 [0,4194304] 0 2024-09-16T02:06:15.746 INFO:tasks.workunit.client.0.smithi110.stdout:7/612: dread d3/d15/d38/d4f/d10/d11/d73/f93 [0,4194304] 0 2024-09-16T02:06:15.747 INFO:tasks.workunit.client.0.smithi110.stdout:4/670: creat d4/d8/d17/d23/d4c/da5/db2/dc4/fd4 x:0 0 0 2024-09-16T02:06:15.751 INFO:tasks.workunit.client.0.smithi110.stdout:4/671: mkdir d4/d8/d31/d73/dd5 0 2024-09-16T02:06:15.754 INFO:tasks.workunit.client.0.smithi110.stdout:0/724: rename d3/d6/d43/d55/d59/f5c to d3/d6/d43/d55/fdd 0 2024-09-16T02:06:15.755 INFO:tasks.workunit.client.0.smithi110.stdout:7/613: creat d3/d15/d81/db7/fbc x:0 0 0 2024-09-16T02:06:15.757 INFO:tasks.workunit.client.0.smithi110.stdout:0/725: creat d3/d4/d85/d93/fde x:0 0 0 2024-09-16T02:06:15.757 INFO:tasks.workunit.client.0.smithi110.stdout:4/672: dwrite d4/d8/d17/d23/f82 [0,4194304] 0 2024-09-16T02:06:15.763 INFO:tasks.workunit.client.0.smithi110.stdout:4/673: chown d4/db4/d55/c8e 9 1 2024-09-16T02:06:15.766 INFO:tasks.workunit.client.0.smithi110.stdout:0/726: dwrite d3/d4/dc/fb8 [0,4194304] 0 2024-09-16T02:06:15.772 INFO:tasks.workunit.client.0.smithi110.stdout:4/674: dwrite d4/d8/d17/d23/f82 [0,4194304] 0 2024-09-16T02:06:15.774 INFO:tasks.workunit.client.0.smithi110.stdout:4/675: fsync d4/d8/d17/d23/f9e 0 2024-09-16T02:06:15.781 INFO:tasks.workunit.client.0.smithi110.stdout:4/676: mkdir d4/dd6 0 2024-09-16T02:06:15.787 INFO:tasks.workunit.client.0.smithi110.stdout:7/614: dread d3/d15/d38/d4f/d10/d11/d8f/fad [0,4194304] 0 2024-09-16T02:06:15.787 INFO:tasks.workunit.client.0.smithi110.stdout:0/727: dwrite d3/d4/d6d/f79 [0,4194304] 0 2024-09-16T02:06:15.791 INFO:tasks.workunit.client.0.smithi110.stdout:0/728: creat d3/d4/dc/d14/d7e/d81/d86/fdf x:0 0 0 2024-09-16T02:06:15.793 INFO:tasks.workunit.client.0.smithi110.stdout:7/615: rename d3/d15/d38/d4f/d10/c1d to d3/d15/d3a/d80/cbd 0 2024-09-16T02:06:15.867 INFO:tasks.workunit.client.0.smithi110.stdout:7/616: creat d3/d15/d38/d4f/d10/d11/d3e/d40/fbe x:0 0 0 2024-09-16T02:06:15.869 INFO:tasks.workunit.client.0.smithi110.stdout:0/729: rename d3/d6/d43/d55/f7d to d3/d4/dc/d10/fe0 0 2024-09-16T02:06:15.869 INFO:tasks.workunit.client.0.smithi110.stdout:4/677: dread d4/d8/d31/d6f/fbc [0,4194304] 0 2024-09-16T02:06:15.874 INFO:tasks.workunit.client.0.smithi110.stdout:7/617: dwrite d3/d15/d81/db7/fbc [0,4194304] 0 2024-09-16T02:06:15.874 INFO:tasks.workunit.client.0.smithi110.stdout:4/678: creat d4/d8/d17/d23/d4c/da5/db2/dc4/fd7 x:0 0 0 2024-09-16T02:06:15.879 INFO:tasks.workunit.client.0.smithi110.stdout:4/679: rmdir d4/d8/d17/d23/d4c/d6d/d7f 39 2024-09-16T02:06:15.881 INFO:tasks.workunit.client.0.smithi110.stdout:0/730: write d3/d6/d43/d55/d59/f9c [462788,91321] 0 2024-09-16T02:06:15.881 INFO:tasks.workunit.client.0.smithi110.stdout:7/618: dwrite d3/d15/d38/d4f/d10/d11/d73/d7b/f8e [0,4194304] 0 2024-09-16T02:06:15.887 INFO:tasks.workunit.client.0.smithi110.stdout:4/680: rename d4/db4/d55/f9a to d4/d8/d31/d5d/fd8 0 2024-09-16T02:06:15.887 INFO:tasks.workunit.client.0.smithi110.stdout:7/619: truncate d3/f34 4522127 0 2024-09-16T02:06:15.889 INFO:tasks.workunit.client.0.smithi110.stdout:0/731: creat d3/d92/d9a/fe1 x:0 0 0 2024-09-16T02:06:15.889 INFO:tasks.workunit.client.0.smithi110.stdout:7/620: stat d3/f9 0 2024-09-16T02:06:15.892 INFO:tasks.workunit.client.0.smithi110.stdout:4/681: creat d4/db4/fd9 x:0 0 0 2024-09-16T02:06:15.893 INFO:tasks.workunit.client.0.smithi110.stdout:7/621: truncate d3/f19 4349916 0 2024-09-16T02:06:15.894 INFO:tasks.workunit.client.0.smithi110.stdout:0/732: rmdir d3/d4/dc/d70/d8b 39 2024-09-16T02:06:15.895 INFO:tasks.workunit.client.0.smithi110.stdout:7/622: write d3/d15/d38/d4f/d10/f94 [259961,74302] 0 2024-09-16T02:06:15.895 INFO:tasks.workunit.client.0.smithi110.stdout:0/733: rmdir d3 39 2024-09-16T02:06:15.898 INFO:tasks.workunit.client.0.smithi110.stdout:7/623: symlink d3/d15/d38/d4f/d10/d11/d73/d7b/lbf 0 2024-09-16T02:06:15.899 INFO:tasks.workunit.client.0.smithi110.stdout:7/624: truncate d3/f8 5301457 0 2024-09-16T02:06:15.902 INFO:tasks.workunit.client.0.smithi110.stdout:7/625: creat d3/d15/d38/d4f/d10/fc0 x:0 0 0 2024-09-16T02:06:15.903 INFO:tasks.workunit.client.0.smithi110.stdout:7/626: unlink d3/f14 0 2024-09-16T02:06:15.913 INFO:tasks.workunit.client.0.smithi110.stdout:7/627: rename d3/d15/d38/d4f/d10/d11/d73/d7b to d3/d62/d65/dc1 0 2024-09-16T02:06:15.914 INFO:tasks.workunit.client.0.smithi110.stdout:7/628: dread - d3/d62/d65/f9e zero size 2024-09-16T02:06:15.914 INFO:tasks.workunit.client.0.smithi110.stdout:0/734: dread d3/d4/dc/d70/f72 [0,4194304] 0 2024-09-16T02:06:15.918 INFO:tasks.workunit.client.0.smithi110.stdout:0/735: chown d3/d4/d85/d98/lcf 5821 1 2024-09-16T02:06:15.919 INFO:tasks.workunit.client.0.smithi110.stdout:7/629: symlink d3/d15/d38/d4f/d10/d76/lc2 0 2024-09-16T02:06:15.925 INFO:tasks.workunit.client.0.smithi110.stdout:7/630: unlink d3/c5e 0 2024-09-16T02:06:15.927 INFO:tasks.workunit.client.0.smithi110.stdout:7/631: rename d3/lf to d3/d62/d65/dc1/lc3 0 2024-09-16T02:06:15.934 INFO:tasks.workunit.client.0.smithi110.stdout:7/632: dwrite d3/d15/d38/d4f/d2e/f71 [0,4194304] 0 2024-09-16T02:06:15.935 INFO:tasks.workunit.client.0.smithi110.stdout:0/736: dread d3/d6/d43/fab [0,4194304] 0 2024-09-16T02:06:15.936 INFO:tasks.workunit.client.0.smithi110.stdout:0/737: stat d3/d4/dc/d14/d7e/d81/d89/fbc 0 2024-09-16T02:06:15.939 INFO:tasks.workunit.client.0.smithi110.stdout:0/738: mknod d3/d4/dc/d14/d7e/ce2 0 2024-09-16T02:06:15.941 INFO:tasks.workunit.client.0.smithi110.stdout:7/633: mknod d3/d15/d38/d4f/d10/d76/d88/cc4 0 2024-09-16T02:06:15.942 INFO:tasks.workunit.client.0.smithi110.stdout:7/634: readlink d3/d15/l1f 0 2024-09-16T02:06:15.945 INFO:tasks.workunit.client.0.smithi110.stdout:7/635: rmdir d3/d15/d38/d4f/d10/d76 39 2024-09-16T02:06:15.947 INFO:tasks.workunit.client.0.smithi110.stdout:0/739: truncate d3/d4/d6d/fcd 507554 0 2024-09-16T02:06:15.949 INFO:tasks.workunit.client.0.smithi110.stdout:7/636: truncate d3/f19 2455713 0 2024-09-16T02:06:15.954 INFO:tasks.workunit.client.0.smithi110.stdout:0/740: creat d3/d4/dc/d70/fe3 x:0 0 0 2024-09-16T02:06:15.958 INFO:tasks.workunit.client.0.smithi110.stdout:7/637: write d3/d15/d38/d4f/f18 [5858535,107907] 0 2024-09-16T02:06:15.961 INFO:tasks.workunit.client.0.smithi110.stdout:0/741: read d3/f1a [16687,75836] 0 2024-09-16T02:06:15.962 INFO:tasks.workunit.client.0.smithi110.stdout:7/638: mkdir d3/d15/d38/d4f/d10/d11/d3e/dc5 0 2024-09-16T02:06:15.968 INFO:tasks.workunit.client.0.smithi110.stdout:0/742: symlink d3/d6/d43/d55/d59/le4 0 2024-09-16T02:06:15.968 INFO:tasks.workunit.client.0.smithi110.stdout:7/639: creat d3/d15/d3a/fc6 x:0 0 0 2024-09-16T02:06:16.008 INFO:tasks.workunit.client.0.smithi110.stdout:7/640: creat d3/d15/d38/d4f/d10/d11/d3e/fc7 x:0 0 0 2024-09-16T02:06:16.015 INFO:tasks.workunit.client.0.smithi110.stdout:0/743: truncate d3/d4/d6d/f79 585536 0 2024-09-16T02:06:16.017 INFO:tasks.workunit.client.0.smithi110.stdout:0/744: creat d3/d4/dc/d10/dbd/fe5 x:0 0 0 2024-09-16T02:06:16.018 INFO:tasks.workunit.client.0.smithi110.stdout:7/641: truncate d3/d15/d38/d4f/d10/d11/f2d 936102 0 2024-09-16T02:06:16.020 INFO:tasks.workunit.client.0.smithi110.stdout:0/745: rename d3/d6/l77 to d3/d4/dc/d14/d7e/le6 0 2024-09-16T02:06:16.021 INFO:tasks.workunit.client.0.smithi110.stdout:7/642: dread d3/d15/d38/d4f/d10/d11/d3e/d40/f99 [0,4194304] 0 2024-09-16T02:06:16.028 INFO:tasks.workunit.client.0.smithi110.stdout:0/746: dwrite d3/d4/dc/f1c [0,4194304] 0 2024-09-16T02:06:16.032 INFO:tasks.workunit.client.0.smithi110.stdout:0/747: rename d3/d4/dc/lc7 to d3/d6/d43/da7/le7 0 2024-09-16T02:06:16.036 INFO:tasks.workunit.client.0.smithi110.stdout:0/748: mkdir d3/d4/dc/d14/d76/de8 0 2024-09-16T02:06:16.046 INFO:tasks.workunit.client.0.smithi110.stdout:0/749: write d3/f82 [1391439,106401] 0 2024-09-16T02:06:16.048 INFO:tasks.workunit.client.0.smithi110.stdout:7/643: dread d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 [0,4194304] 0 2024-09-16T02:06:16.051 INFO:tasks.workunit.client.0.smithi110.stdout:0/750: rename d3/d4/d85/fa2 to d3/d6/d4b/fe9 0 2024-09-16T02:06:16.052 INFO:tasks.workunit.client.0.smithi110.stdout:7/644: mknod d3/d15/d38/d4f/d10/d11/d3e/cc8 0 2024-09-16T02:06:16.053 INFO:tasks.workunit.client.0.smithi110.stdout:0/751: truncate d3/d6/d43/d55/d59/f88 143396 0 2024-09-16T02:06:16.054 INFO:tasks.workunit.client.0.smithi110.stdout:0/752: creat d3/d4/d41/fea x:0 0 0 2024-09-16T02:06:16.056 INFO:tasks.workunit.client.0.smithi110.stdout:0/753: chown d3/d4/dc/d14/fcc 26 1 2024-09-16T02:06:16.058 INFO:tasks.workunit.client.0.smithi110.stdout:0/754: mkdir d3/d4/deb 0 2024-09-16T02:06:16.061 INFO:tasks.workunit.client.0.smithi110.stdout:0/755: rename d3/d4/dc/d14/fcc to d3/d4/dc/d10/fec 0 2024-09-16T02:06:16.063 INFO:tasks.workunit.client.0.smithi110.stdout:0/756: chown d3/d4/dc/d14/d7e/d81/d86/cd9 2770 1 2024-09-16T02:06:16.064 INFO:tasks.workunit.client.0.smithi110.stdout:7/645: dread d3/d15/d38/d4f/d2e/f4c [0,4194304] 0 2024-09-16T02:06:16.073 INFO:tasks.workunit.client.0.smithi110.stdout:0/757: link d3/d4/dc/d14/d7e/d81/d89/fcb d3/d4/dc/d70/d8b/fed 0 2024-09-16T02:06:16.074 INFO:tasks.workunit.client.0.smithi110.stdout:0/758: read - d3/d4/dc/fb7 zero size 2024-09-16T02:06:16.075 INFO:tasks.workunit.client.0.smithi110.stdout:7/646: dwrite d3/d15/d38/d4f/d10/d11/f75 [4194304,4194304] 0 2024-09-16T02:06:16.076 INFO:tasks.workunit.client.0.smithi110.stdout:0/759: mknod d3/cee 0 2024-09-16T02:06:16.085 INFO:tasks.workunit.client.0.smithi110.stdout:0/760: dwrite d3/d4/dc/d10/fec [0,4194304] 0 2024-09-16T02:06:16.087 INFO:tasks.workunit.client.0.smithi110.stdout:7/647: write d3/d15/d38/d4f/fe [1548528,84246] 0 2024-09-16T02:06:16.089 INFO:tasks.workunit.client.0.smithi110.stdout:7/648: chown d3/d15/d38/d4f/fe 12110 1 2024-09-16T02:06:16.089 INFO:tasks.workunit.client.0.smithi110.stdout:0/761: symlink d3/d6/lef 0 2024-09-16T02:06:16.092 INFO:tasks.workunit.client.0.smithi110.stdout:0/762: getdents d3/d92/d9a/dd4 0 2024-09-16T02:06:16.092 INFO:tasks.workunit.client.0.smithi110.stdout:7/649: creat d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/db5/fc9 x:0 0 0 2024-09-16T02:06:16.094 INFO:tasks.workunit.client.0.smithi110.stdout:7/650: creat d3/d15/d38/d4f/d10/d11/d3e/d40/fca x:0 0 0 2024-09-16T02:06:16.099 INFO:tasks.workunit.client.0.smithi110.stdout:0/763: write d3/f17 [3284460,31018] 0 2024-09-16T02:06:16.101 INFO:tasks.workunit.client.0.smithi110.stdout:7/651: dwrite d3/d62/d65/dc1/f8e [0,4194304] 0 2024-09-16T02:06:16.107 INFO:tasks.workunit.client.0.smithi110.stdout:7/652: creat d3/d15/d38/d4f/d10/d76/fcb x:0 0 0 2024-09-16T02:06:16.111 INFO:tasks.workunit.client.0.smithi110.stdout:7/653: fsync d3/d15/d38/d4f/d10/d11/d8f/fad 0 2024-09-16T02:06:16.112 INFO:tasks.workunit.client.0.smithi110.stdout:7/654: write d3/d15/d38/d4f/d10/d7d/fab [478668,112922] 0 2024-09-16T02:06:16.113 INFO:tasks.workunit.client.0.smithi110.stdout:7/655: stat d3/d15/d38/d4f/d2e/l5d 0 2024-09-16T02:06:16.117 INFO:tasks.workunit.client.0.smithi110.stdout:7/656: symlink d3/d15/d44/lcc 0 2024-09-16T02:06:16.117 INFO:tasks.workunit.client.0.smithi110.stdout:0/764: dread d3/f17 [8388608,4194304] 0 2024-09-16T02:06:16.118 INFO:tasks.workunit.client.0.smithi110.stdout:7/657: creat d3/d7a/fcd x:0 0 0 2024-09-16T02:06:16.120 INFO:tasks.workunit.client.0.smithi110.stdout:0/765: mknod d3/d4/deb/cf0 0 2024-09-16T02:06:16.120 INFO:tasks.workunit.client.0.smithi110.stdout:7/658: write d3/d15/d38/d4f/d10/d11/d3e/f98 [1810742,13210] 0 2024-09-16T02:06:16.122 INFO:tasks.workunit.client.0.smithi110.stdout:7/659: dread d3/d15/d38/d4f/d10/d11/f3f [0,4194304] 0 2024-09-16T02:06:16.123 INFO:tasks.workunit.client.0.smithi110.stdout:0/766: read d3/d4/dc/d14/f19 [1711438,78673] 0 2024-09-16T02:06:16.125 INFO:tasks.workunit.client.0.smithi110.stdout:0/767: fdatasync d3/f1b 0 2024-09-16T02:06:16.129 INFO:tasks.workunit.client.0.smithi110.stdout:7/660: dwrite d3/d15/d38/d4f/d10/f94 [0,4194304] 0 2024-09-16T02:06:16.135 INFO:tasks.workunit.client.0.smithi110.stdout:7/661: rename d3/d62/c67 to d3/d15/d38/d4f/d10/d11/d3e/d40/d50/cce 0 2024-09-16T02:06:16.137 INFO:tasks.workunit.client.0.smithi110.stdout:0/768: truncate d3/d6/d43/d55/d59/f9c 258887 0 2024-09-16T02:06:16.138 INFO:tasks.workunit.client.0.smithi110.stdout:0/769: chown d3/d4/dc/d14/d7e 0 1 2024-09-16T02:06:16.140 INFO:tasks.workunit.client.0.smithi110.stdout:7/662: link d3/d15/d44/cb0 d3/d15/d38/d4f/d10/d11/d3e/d40/ccf 0 2024-09-16T02:06:16.143 INFO:tasks.workunit.client.0.smithi110.stdout:0/770: mkdir d3/d4/dc/d70/d8b/db3/df1 0 2024-09-16T02:06:16.154 INFO:tasks.workunit.client.0.smithi110.stdout:7/663: dread d3/f34 [0,4194304] 0 2024-09-16T02:06:16.274 INFO:tasks.workunit.client.0.smithi110.stdout:0/771: write d3/d92/d9a/fc1 [851133,32697] 0 2024-09-16T02:06:16.274 INFO:tasks.workunit.client.0.smithi110.stdout:7/664: chown d3/d15/d38/d4f/d10/d11/d3e/d40/d50/l5c 10351 1 2024-09-16T02:06:16.275 INFO:tasks.workunit.client.0.smithi110.stdout:0/772: chown d3/d4/dc/d10/l42 153829 1 2024-09-16T02:06:16.277 INFO:tasks.workunit.client.0.smithi110.stdout:0/773: truncate d3/d4/dc/fb7 423691 0 2024-09-16T02:06:16.322 INFO:tasks.workunit.client.0.smithi110.stdout:7/665: symlink d3/d15/d38/d4f/d10/d11/d3e/ld0 0 2024-09-16T02:06:16.322 INFO:tasks.workunit.client.0.smithi110.stdout:7/666: write d3/d7a/f91 [258053,13073] 0 2024-09-16T02:06:16.323 INFO:tasks.workunit.client.0.smithi110.stdout:7/667: chown d3/ca0 6 1 2024-09-16T02:06:16.327 INFO:tasks.workunit.client.0.smithi110.stdout:7/668: rename d3/d15/d38/d4f/d2e/l5d to d3/d15/d3a/d80/ld1 0 2024-09-16T02:06:16.330 INFO:tasks.workunit.client.0.smithi110.stdout:7/669: symlink d3/d15/d38/d4f/d10/d11/ld2 0 2024-09-16T02:06:16.331 INFO:tasks.workunit.client.0.smithi110.stdout:7/670: dread - d3/d15/d38/d4f/d10/d11/d8f/fba zero size 2024-09-16T02:06:16.334 INFO:tasks.workunit.client.0.smithi110.stdout:0/774: dread d3/d4/dc/d14/d7e/d81/fa3 [0,4194304] 0 2024-09-16T02:06:16.334 INFO:tasks.workunit.client.0.smithi110.stdout:7/671: write d3/d15/d38/d4f/d10/d11/d73/f93 [5259765,102865] 0 2024-09-16T02:06:16.336 INFO:tasks.workunit.client.0.smithi110.stdout:7/672: read d3/d15/d38/d4f/d10/f29 [877580,23739] 0 2024-09-16T02:06:16.338 INFO:tasks.workunit.client.0.smithi110.stdout:0/775: fsync d3/d4/dc/d75/fae 0 2024-09-16T02:06:16.343 INFO:tasks.workunit.client.0.smithi110.stdout:7/673: dwrite d3/d15/d3a/fc6 [0,4194304] 0 2024-09-16T02:06:16.343 INFO:tasks.workunit.client.0.smithi110.stdout:0/776: readlink d3/d6/d43/lc4 0 2024-09-16T02:06:16.344 INFO:tasks.workunit.client.0.smithi110.stdout:7/674: fsync d3/d15/d38/d4f/d10/d2c/f85 0 2024-09-16T02:06:16.346 INFO:tasks.workunit.client.0.smithi110.stdout:0/777: mkdir d3/d4/df2 0 2024-09-16T02:06:16.347 INFO:tasks.workunit.client.0.smithi110.stdout:0/778: read - d3/d4/dc/d70/fe3 zero size 2024-09-16T02:06:16.349 INFO:tasks.workunit.client.0.smithi110.stdout:7/675: unlink d3/d15/d38/d4f/d10/d11/d3e/d40/f4b 0 2024-09-16T02:06:16.351 INFO:tasks.workunit.client.0.smithi110.stdout:0/779: mkdir d3/d4/df2/df3 0 2024-09-16T02:06:16.354 INFO:tasks.workunit.client.0.smithi110.stdout:0/780: creat d3/d4/dc/d14/ff4 x:0 0 0 2024-09-16T02:06:16.357 INFO:tasks.workunit.client.0.smithi110.stdout:0/781: mkdir d3/d4/dc/d75/df5 0 2024-09-16T02:06:16.363 INFO:tasks.workunit.client.0.smithi110.stdout:7/676: truncate d3/d15/d81/db7/fbc 3565411 0 2024-09-16T02:06:16.363 INFO:tasks.workunit.client.0.smithi110.stdout:0/782: dwrite d3/d6/f99 [0,4194304] 0 2024-09-16T02:06:16.373 INFO:tasks.workunit.client.0.smithi110.stdout:0/783: dread d3/d4/dc/d10/f3c [0,4194304] 0 2024-09-16T02:06:16.389 INFO:tasks.workunit.client.0.smithi110.stdout:0/784: dwrite d3/f28 [0,4194304] 0 2024-09-16T02:06:16.389 INFO:tasks.workunit.client.0.smithi110.stdout:0/785: readlink d3/d6/l36 0 2024-09-16T02:06:16.390 INFO:tasks.workunit.client.0.smithi110.stdout:0/786: read - d3/d4/dc/d10/dbd/fe5 zero size 2024-09-16T02:06:16.397 INFO:tasks.workunit.client.0.smithi110.stdout:0/787: dread d3/d4/dc/d10/fec [0,4194304] 0 2024-09-16T02:06:16.399 INFO:tasks.workunit.client.0.smithi110.stdout:0/788: symlink d3/lf6 0 2024-09-16T02:06:16.401 INFO:tasks.workunit.client.0.smithi110.stdout:0/789: mknod d3/d4/deb/cf7 0 2024-09-16T02:06:16.406 INFO:tasks.workunit.client.0.smithi110.stdout:0/790: write d3/d6/d43/f67 [1007351,98579] 0 2024-09-16T02:06:16.409 INFO:tasks.workunit.client.0.smithi110.stdout:0/791: symlink d3/d4/dc/d10/dbd/lf8 0 2024-09-16T02:06:16.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/792: mkdir d3/d4/dc/d14/df9 0 2024-09-16T02:06:16.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/793: chown d3/d4/f11 3004 1 2024-09-16T02:06:16.413 INFO:tasks.workunit.client.0.smithi110.stdout:0/794: mkdir d3/d4/dc/d75/dfa 0 2024-09-16T02:06:16.414 INFO:tasks.workunit.client.0.smithi110.stdout:0/795: creat d3/d6/d43/d55/d59/ffb x:0 0 0 2024-09-16T02:06:16.420 INFO:tasks.workunit.client.0.smithi110.stdout:0/796: write d3/d6/d43/da7/fd7 [1110227,97946] 0 2024-09-16T02:06:16.422 INFO:tasks.workunit.client.0.smithi110.stdout:0/797: truncate d3/d6/d43/d55/f6f 2116345 0 2024-09-16T02:06:16.427 INFO:tasks.workunit.client.0.smithi110.stdout:0/798: link d3/d6/d43/d55/l84 d3/d4/dc/d14/d7e/d81/d86/lfc 0 2024-09-16T02:06:16.435 INFO:tasks.workunit.client.0.smithi110.stdout:0/799: write d3/d4/dc/d10/f87 [2107632,78904] 0 2024-09-16T02:06:16.438 INFO:tasks.workunit.client.0.smithi110.stdout:0/800: mknod d3/d4/dc/d14/d76/cfd 0 2024-09-16T02:06:16.439 INFO:tasks.workunit.client.0.smithi110.stdout:0/801: chown d3/d6/d43/d55/d59/f9c 141 1 2024-09-16T02:06:16.443 INFO:tasks.workunit.client.0.smithi110.stdout:0/802: link d3/d4/dc/d14/d7e/d81/fd3 d3/d4/dc/d75/ffe 0 2024-09-16T02:06:16.456 INFO:tasks.workunit.client.0.smithi110.stdout:0/803: truncate d3/d4/dc/fb8 2100722 0 2024-09-16T02:06:16.459 INFO:tasks.workunit.client.0.smithi110.stdout:0/804: getdents d3/d6 0 2024-09-16T02:06:16.462 INFO:tasks.workunit.client.0.smithi110.stdout:0/805: fsync d3/d4/dc/d14/d7e/d81/d89/f9b 0 2024-09-16T02:06:16.476 INFO:tasks.workunit.client.0.smithi110.stdout:0/806: dwrite d3/d4/d41/f5f [0,4194304] 0 2024-09-16T02:06:16.480 INFO:tasks.workunit.client.0.smithi110.stdout:0/807: dread d3/d4/d41/f5f [0,4194304] 0 2024-09-16T02:06:16.483 INFO:tasks.workunit.client.0.smithi110.stdout:0/808: write d3/d4/dc/f1c [4222981,97550] 0 2024-09-16T02:06:16.528 INFO:tasks.workunit.client.0.smithi110.stdout:8/681: sync 2024-09-16T02:06:16.528 INFO:tasks.workunit.client.0.smithi110.stdout:6/839: sync 2024-09-16T02:06:16.528 INFO:tasks.workunit.client.0.smithi110.stdout:3/694: sync 2024-09-16T02:06:16.528 INFO:tasks.workunit.client.0.smithi110.stdout:2/879: sync 2024-09-16T02:06:16.530 INFO:tasks.workunit.client.0.smithi110.stdout:2/880: chown d0/d5f/dc0/ddc/ddd/f24 1490 1 2024-09-16T02:06:16.531 INFO:tasks.workunit.client.0.smithi110.stdout:3/695: unlink d8/d48/d5b/d6a/d75/d88/c91 0 2024-09-16T02:06:16.532 INFO:tasks.workunit.client.0.smithi110.stdout:3/696: write d8/d48/d5b/ff1 [887608,37645] 0 2024-09-16T02:06:16.533 INFO:tasks.workunit.client.0.smithi110.stdout:3/697: dread - d8/d48/d5b/d6a/d75/d88/dac/fb0 zero size 2024-09-16T02:06:16.534 INFO:tasks.workunit.client.0.smithi110.stdout:8/682: rename d3/d2b/d27/da7/l20 to d3/d2b/d27/da7/d8f/leb 0 2024-09-16T02:06:16.535 INFO:tasks.workunit.client.0.smithi110.stdout:8/683: write d3/d2b/d65/d7f/fa5 [1652542,2390] 0 2024-09-16T02:06:16.540 INFO:tasks.workunit.client.0.smithi110.stdout:6/840: dread d0/f47 [0,4194304] 0 2024-09-16T02:06:16.542 INFO:tasks.workunit.client.0.smithi110.stdout:8/684: symlink d3/lec 0 2024-09-16T02:06:16.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/698: dwrite d8/d48/d5b/d92/f81 [0,4194304] 0 2024-09-16T02:06:16.547 INFO:tasks.workunit.client.0.smithi110.stdout:6/841: symlink d0/d2/d5/d1e/d48/l106 0 2024-09-16T02:06:16.547 INFO:tasks.workunit.client.0.smithi110.stdout:8/685: mknod d3/d2b/d27/d45/d86/ced 0 2024-09-16T02:06:16.549 INFO:tasks.workunit.client.0.smithi110.stdout:3/699: fsync d8/d29/f73 0 2024-09-16T02:06:16.552 INFO:tasks.workunit.client.0.smithi110.stdout:8/686: mknod d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/d98/cee 0 2024-09-16T02:06:16.561 INFO:tasks.workunit.client.0.smithi110.stdout:3/700: write d8/d48/d5b/d92/dc7/d1b/d3a/f70 [4107269,16049] 0 2024-09-16T02:06:16.562 INFO:tasks.workunit.client.0.smithi110.stdout:8/687: write d3/f3c [4086791,32967] 0 2024-09-16T02:06:16.564 INFO:tasks.workunit.client.0.smithi110.stdout:6/842: dwrite d0/d2/f1c [4194304,4194304] 0 2024-09-16T02:06:16.566 INFO:tasks.workunit.client.0.smithi110.stdout:6/843: dread d0/d2/d18/d1d/fd4 [0,4194304] 0 2024-09-16T02:06:16.571 INFO:tasks.workunit.client.0.smithi110.stdout:3/701: rename d8/d48/d5b/d92/dc7/d1b/lca to d8/d48/d5b/lfc 0 2024-09-16T02:06:16.572 INFO:tasks.workunit.client.0.smithi110.stdout:8/688: creat d3/d2b/d27/da7/d1a/d36/d60/fef x:0 0 0 2024-09-16T02:06:16.573 INFO:tasks.workunit.client.0.smithi110.stdout:3/702: stat d8/d48/d5b/d6a/d75/d88/dac 0 2024-09-16T02:06:16.573 INFO:tasks.workunit.client.0.smithi110.stdout:6/844: rename d0/d2/d5/d84/le2 to d0/d2/d5/d55/l107 0 2024-09-16T02:06:16.587 INFO:tasks.workunit.client.0.smithi110.stdout:3/703: dread d8/d29/dbd/f26 [0,4194304] 0 2024-09-16T02:06:16.589 INFO:tasks.workunit.client.0.smithi110.stdout:3/704: read d8/f79 [4526,77735] 0 2024-09-16T02:06:16.589 INFO:tasks.workunit.client.0.smithi110.stdout:6/845: write d0/d2/d57/d75/df0/fb6 [1753215,112217] 0 2024-09-16T02:06:16.594 INFO:tasks.workunit.client.0.smithi110.stdout:8/689: dread d3/d2b/d27/da7/d1a/d36/d60/d62/fc5 [0,4194304] 0 2024-09-16T02:06:16.595 INFO:tasks.workunit.client.0.smithi110.stdout:3/705: getdents d8/d48/d5b/d92/dd8 0 2024-09-16T02:06:16.599 INFO:tasks.workunit.client.0.smithi110.stdout:3/706: mknod d8/d48/d4b/cfd 0 2024-09-16T02:06:16.601 INFO:tasks.workunit.client.0.smithi110.stdout:6/846: getdents d0/d29/d2a/d2f 0 2024-09-16T02:06:16.603 INFO:tasks.workunit.client.0.smithi110.stdout:6/847: fsync d0/f83 0 2024-09-16T02:06:16.608 INFO:tasks.workunit.client.0.smithi110.stdout:6/848: fdatasync d0/d2/d18/d1d/f3d 0 2024-09-16T02:06:16.608 INFO:tasks.workunit.client.0.smithi110.stdout:3/707: link d8/d48/d5b/d92/dc7/fcf d8/d48/d5b/ffe 0 2024-09-16T02:06:16.610 INFO:tasks.workunit.client.0.smithi110.stdout:6/849: fdatasync d0/d2/d5/d94/fc9 0 2024-09-16T02:06:16.611 INFO:tasks.workunit.client.0.smithi110.stdout:3/708: read - d8/d29/fd4 zero size 2024-09-16T02:06:16.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/850: creat d0/d29/d2a/f108 x:0 0 0 2024-09-16T02:06:16.613 INFO:tasks.workunit.client.0.smithi110.stdout:6/851: chown d0/d2/d5/db8/dd1/dd8 10197 1 2024-09-16T02:06:16.614 INFO:tasks.workunit.client.0.smithi110.stdout:8/690: write d3/d2b/f1e [10247367,22449] 0 2024-09-16T02:06:16.615 INFO:tasks.workunit.client.0.smithi110.stdout:3/709: creat d8/fff x:0 0 0 2024-09-16T02:06:16.620 INFO:tasks.workunit.client.0.smithi110.stdout:6/852: dwrite d0/d2/f1c [4194304,4194304] 0 2024-09-16T02:06:16.621 INFO:tasks.workunit.client.0.smithi110.stdout:3/710: rename d8/fb9 to d8/d29/dbd/dc6/f100 0 2024-09-16T02:06:16.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/853: creat d0/d2/d5/d1e/d48/f109 x:0 0 0 2024-09-16T02:06:16.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/854: stat d0/d2/d5/d84/d62/l67 0 2024-09-16T02:06:16.625 INFO:tasks.workunit.client.0.smithi110.stdout:3/711: fsync d8/d29/fbe 0 2024-09-16T02:06:16.627 INFO:tasks.workunit.client.0.smithi110.stdout:3/712: fsync d8/fb 0 2024-09-16T02:06:16.649 INFO:tasks.workunit.client.0.smithi110.stdout:3/713: dwrite f4 [0,4194304] 0 2024-09-16T02:06:16.652 INFO:tasks.workunit.client.0.smithi110.stdout:3/714: rmdir d8/d48/d5b/d6a/d75/d88 39 2024-09-16T02:06:16.653 INFO:tasks.workunit.client.0.smithi110.stdout:3/715: chown d8/d48/d5b/d92/dc7/d1b/d3a/lbf 1525943 1 2024-09-16T02:06:16.655 INFO:tasks.workunit.client.0.smithi110.stdout:3/716: read - d8/d29/dbd/dc6/f100 zero size 2024-09-16T02:06:16.667 INFO:tasks.workunit.client.0.smithi110.stdout:1/882: sync 2024-09-16T02:06:16.667 INFO:tasks.workunit.client.0.smithi110.stdout:9/803: sync 2024-09-16T02:06:16.667 INFO:tasks.workunit.client.0.smithi110.stdout:5/847: sync 2024-09-16T02:06:16.667 INFO:tasks.workunit.client.0.smithi110.stdout:4/682: sync 2024-09-16T02:06:16.668 INFO:tasks.workunit.client.0.smithi110.stdout:5/848: read - d5/d36/d3d/f10d zero size 2024-09-16T02:06:16.677 INFO:tasks.workunit.client.0.smithi110.stdout:5/849: creat d5/dd/df/d28/d9c/f114 x:0 0 0 2024-09-16T02:06:16.680 INFO:tasks.workunit.client.0.smithi110.stdout:9/804: rename d1/dd/d6a/d6c/d6f/d79/d26/d8e/f108 to d1/d5/d20/d55/d82/f112 0 2024-09-16T02:06:16.680 INFO:tasks.workunit.client.0.smithi110.stdout:5/850: creat d5/d36/d3d/f115 x:0 0 0 2024-09-16T02:06:16.683 INFO:tasks.workunit.client.0.smithi110.stdout:3/717: write d8/d48/d5b/d92/dc7/d1b/d3a/f50 [1124162,125854] 0 2024-09-16T02:06:16.684 INFO:tasks.workunit.client.0.smithi110.stdout:4/683: rename d4/d8/d31/d6f/d93/f96 to d4/d8/d17/d23/d4c/d6d/dc6/fda 0 2024-09-16T02:06:16.686 INFO:tasks.workunit.client.0.smithi110.stdout:5/851: symlink d5/dd/df/d11/d6d/l116 0 2024-09-16T02:06:16.689 INFO:tasks.workunit.client.0.smithi110.stdout:5/852: dread - d5/dd/df/d28/d6f/d8e/dbc/fca zero size 2024-09-16T02:06:16.701 INFO:tasks.workunit.client.0.smithi110.stdout:1/883: dwrite d0/da/f81 [0,4194304] 0 2024-09-16T02:06:16.705 INFO:tasks.workunit.client.0.smithi110.stdout:5/853: rmdir d5/dd/df/d11 39 2024-09-16T02:06:16.706 INFO:tasks.workunit.client.0.smithi110.stdout:9/805: write d1/dd/d6a/d6c/d6f/d79/de/d1f/fe8 [386017,130964] 0 2024-09-16T02:06:16.706 INFO:tasks.workunit.client.0.smithi110.stdout:4/684: write d4/d8/d17/d23/d4c/d6d/d3c/d3d/f47 [1999129,39639] 0 2024-09-16T02:06:16.708 INFO:tasks.workunit.client.0.smithi110.stdout:4/685: dread - d4/d8/d91/fc8 zero size 2024-09-16T02:06:16.709 INFO:tasks.workunit.client.0.smithi110.stdout:3/718: dread d8/d48/f8e [0,4194304] 0 2024-09-16T02:06:16.709 INFO:tasks.workunit.client.0.smithi110.stdout:5/854: chown d5/dd/fcd 234398 1 2024-09-16T02:06:16.711 INFO:tasks.workunit.client.0.smithi110.stdout:1/884: rename d0/d1/d4/d46/f5e to d0/d1/d4/d46/d7a/df4/f12b 0 2024-09-16T02:06:16.712 INFO:tasks.workunit.client.0.smithi110.stdout:4/686: write d4/d8/d17/d23/d4c/f9f [2267844,49500] 0 2024-09-16T02:06:16.716 INFO:tasks.workunit.client.0.smithi110.stdout:1/885: fsync d0/da/f92 0 2024-09-16T02:06:16.720 INFO:tasks.workunit.client.0.smithi110.stdout:3/719: rmdir d8/d48/d5b/d6a/d75/d88 39 2024-09-16T02:06:16.723 INFO:tasks.workunit.client.0.smithi110.stdout:5/855: getdents d5/dd/df/d28/d6f/d8e/dd6/d10c 0 2024-09-16T02:06:16.726 INFO:tasks.workunit.client.0.smithi110.stdout:9/806: link d1/dd/d6a/d6c/d75/d8c/d38/d3d/c91 d1/dd/d6a/d6c/d6f/d79/d26/d8e/c113 0 2024-09-16T02:06:16.729 INFO:tasks.workunit.client.0.smithi110.stdout:9/807: chown d1/dd/d6a/d6c/d6f/d79/de/d94/ffe 483 1 2024-09-16T02:06:16.730 INFO:tasks.workunit.client.0.smithi110.stdout:5/856: symlink d5/dd/d90/df6/l117 0 2024-09-16T02:06:16.734 INFO:tasks.workunit.client.0.smithi110.stdout:1/886: creat d0/da/d8d/df6/dc4/f12c x:0 0 0 2024-09-16T02:06:16.738 INFO:tasks.workunit.client.0.smithi110.stdout:4/687: dwrite d4/fc [0,4194304] 0 2024-09-16T02:06:16.739 INFO:tasks.workunit.client.0.smithi110.stdout:3/720: rename d8/d48/d5b/d92/f8a to d8/d48/d5b/d92/dc7/d1b/f101 0 2024-09-16T02:06:16.739 INFO:tasks.workunit.client.0.smithi110.stdout:1/887: mknod d0/d1/dab/c12d 0 2024-09-16T02:06:16.742 INFO:tasks.workunit.client.0.smithi110.stdout:9/808: rename d1/dd/d6a/d6c/d75/c99 to d1/d1b/df0/c114 0 2024-09-16T02:06:16.743 INFO:tasks.workunit.client.0.smithi110.stdout:3/721: mkdir d8/d29/d102 0 2024-09-16T02:06:16.747 INFO:tasks.workunit.client.0.smithi110.stdout:4/688: creat d4/d8/d17/d23/d4c/d6d/d3c/fdb x:0 0 0 2024-09-16T02:06:16.755 INFO:tasks.workunit.client.0.smithi110.stdout:9/809: getdents d1/dd/d6a/d6c/d9b 0 2024-09-16T02:06:16.755 INFO:tasks.workunit.client.0.smithi110.stdout:3/722: link d8/d48/d5b/d92/dc7/d1b/f9f d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/de6/f103 0 2024-09-16T02:06:16.758 INFO:tasks.workunit.client.0.smithi110.stdout:3/723: creat d8/d48/d7c/d87/da9/f104 x:0 0 0 2024-09-16T02:06:16.759 INFO:tasks.workunit.client.0.smithi110.stdout:9/810: rename d1/d1b/d23/f71 to d1/dd/d6a/d6c/d75/f115 0 2024-09-16T02:06:16.761 INFO:tasks.workunit.client.0.smithi110.stdout:3/724: chown d8/d48/d5b/d6a/d75/feb 95 1 2024-09-16T02:06:16.762 INFO:tasks.workunit.client.0.smithi110.stdout:9/811: truncate d1/dd/d6a/d6c/d75/d86/fad 873382 0 2024-09-16T02:06:16.764 INFO:tasks.workunit.client.0.smithi110.stdout:9/812: truncate d1/dd/d6a/d6c/d6f/d79/de/f110 204291 0 2024-09-16T02:06:16.764 INFO:tasks.workunit.client.0.smithi110.stdout:5/857: truncate d5/dd/df/d11/d6d/fc4 622632 0 2024-09-16T02:06:16.765 INFO:tasks.workunit.client.0.smithi110.stdout:5/858: write d5/dd/df/d11/d6d/fc8 [216500,10911] 0 2024-09-16T02:06:16.773 INFO:tasks.workunit.client.0.smithi110.stdout:4/689: dwrite d4/d8/d31/d5d/fd8 [0,4194304] 0 2024-09-16T02:06:16.779 INFO:tasks.workunit.client.0.smithi110.stdout:4/690: readlink d4/d8/d17/d23/d35/l40 0 2024-09-16T02:06:16.779 INFO:tasks.workunit.client.0.smithi110.stdout:3/725: dwrite d8/d48/d7c/d87/fb3 [0,4194304] 0 2024-09-16T02:06:16.786 INFO:tasks.workunit.client.0.smithi110.stdout:5/859: dwrite d5/dd/fbe [0,4194304] 0 2024-09-16T02:06:16.792 INFO:tasks.workunit.client.0.smithi110.stdout:4/691: mknod d4/d8/d17/d23/cdc 0 2024-09-16T02:06:16.796 INFO:tasks.workunit.client.0.smithi110.stdout:3/726: mknod d8/d48/d5b/d6a/d75/d88/dac/c105 0 2024-09-16T02:06:16.796 INFO:tasks.workunit.client.0.smithi110.stdout:5/860: symlink d5/d71/l118 0 2024-09-16T02:06:16.797 INFO:tasks.workunit.client.0.smithi110.stdout:4/692: fdatasync d4/d8/d17/d23/d4c/d6d/d4f/fa2 0 2024-09-16T02:06:16.804 INFO:tasks.workunit.client.0.smithi110.stdout:5/861: dwrite d5/dd/df/d11/f32 [4194304,4194304] 0 2024-09-16T02:06:16.810 INFO:tasks.workunit.client.0.smithi110.stdout:3/727: rmdir d8/d48/d5b/d92/de3 0 2024-09-16T02:06:16.812 INFO:tasks.workunit.client.0.smithi110.stdout:9/813: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e [4194304,4194304] 0 2024-09-16T02:06:16.812 INFO:tasks.workunit.client.0.smithi110.stdout:4/693: dread d4/d8/d17/d23/d4c/d6d/d3c/d3d/f47 [0,4194304] 0 2024-09-16T02:06:16.817 INFO:tasks.workunit.client.0.smithi110.stdout:9/814: truncate d1/dd/d6a/d6c/d6f/d79/f17 8376100 0 2024-09-16T02:06:16.817 INFO:tasks.workunit.client.0.smithi110.stdout:5/862: dread d5/dd/df/f38 [0,4194304] 0 2024-09-16T02:06:16.819 INFO:tasks.workunit.client.0.smithi110.stdout:5/863: mkdir d5/de7/d119 0 2024-09-16T02:06:16.824 INFO:tasks.workunit.client.0.smithi110.stdout:5/864: rename d5/dd/df/d28 to d5/dd/df/d11/d6d/d11a 0 2024-09-16T02:06:16.827 INFO:tasks.workunit.client.0.smithi110.stdout:5/865: rename d5/f13 to d5/dd/df/d11/d6d/d11a/dab/d111/f11b 0 2024-09-16T02:06:16.833 INFO:tasks.workunit.client.0.smithi110.stdout:5/866: dwrite d5/dd/df/d11/f50 [0,4194304] 0 2024-09-16T02:06:16.833 INFO:tasks.workunit.client.0.smithi110.stdout:3/728: write d8/d48/d5b/d6a/fb6 [1350104,99801] 0 2024-09-16T02:06:16.834 INFO:tasks.workunit.client.0.smithi110.stdout:4/694: write d4/d8/d17/d23/d4c/d6d/d4f/f69 [994740,55253] 0 2024-09-16T02:06:16.840 INFO:tasks.workunit.client.0.smithi110.stdout:3/729: creat d8/d29/dbd/dc6/dd3/f106 x:0 0 0 2024-09-16T02:06:16.841 INFO:tasks.workunit.client.0.smithi110.stdout:9/815: write d1/dd/d6a/d6c/d75/d8c/fbd [1027297,88977] 0 2024-09-16T02:06:16.845 INFO:tasks.workunit.client.0.smithi110.stdout:5/867: creat d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/f11c x:0 0 0 2024-09-16T02:06:16.845 INFO:tasks.workunit.client.0.smithi110.stdout:9/816: creat d1/dd/d6a/d6c/d75/d86/f116 x:0 0 0 2024-09-16T02:06:16.847 INFO:tasks.workunit.client.0.smithi110.stdout:3/730: mknod d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5/c107 0 2024-09-16T02:06:16.851 INFO:tasks.workunit.client.0.smithi110.stdout:5/868: rename d5/dd/df/d11/d6d/d11a/d6f/d8e/dac/ff2 to d5/dd/d90/f11d 0 2024-09-16T02:06:16.854 INFO:tasks.workunit.client.0.smithi110.stdout:3/731: dwrite d8/d48/d5b/ff1 [0,4194304] 0 2024-09-16T02:06:16.857 INFO:tasks.workunit.client.0.smithi110.stdout:4/695: write d4/d8/d17/d23/d4c/d6d/dc6/fda [412060,10262] 0 2024-09-16T02:06:16.859 INFO:tasks.workunit.client.0.smithi110.stdout:5/869: creat d5/dd/df/d11/d6d/d11a/d77/de9/f11e x:0 0 0 2024-09-16T02:06:16.862 INFO:tasks.workunit.client.0.smithi110.stdout:5/870: symlink d5/dd/d90/d108/l11f 0 2024-09-16T02:06:16.863 INFO:tasks.workunit.client.0.smithi110.stdout:7/677: sync 2024-09-16T02:06:16.864 INFO:tasks.workunit.client.0.smithi110.stdout:5/871: write d5/d36/dd5/ff8 [561915,82326] 0 2024-09-16T02:06:16.865 INFO:tasks.workunit.client.0.smithi110.stdout:4/696: read d4/d8/d17/d23/f74 [196245,100642] 0 2024-09-16T02:06:16.867 INFO:tasks.workunit.client.0.smithi110.stdout:4/697: fsync d4/d8/d17/d23/d4c/d6d/dc6/fda 0 2024-09-16T02:06:16.870 INFO:tasks.workunit.client.0.smithi110.stdout:3/732: dread d8/d48/d5b/d92/dc7/fcf [0,4194304] 0 2024-09-16T02:06:16.889 INFO:tasks.workunit.client.0.smithi110.stdout:5/872: rename d5/dd/d90/f11d to d5/dd/df/f120 0 2024-09-16T02:06:16.891 INFO:tasks.workunit.client.0.smithi110.stdout:5/873: unlink d5/d36/dd5/ff8 0 2024-09-16T02:06:16.897 INFO:tasks.workunit.client.0.smithi110.stdout:7/678: dwrite d3/d15/d38/d4f/d10/f29 [0,4194304] 0 2024-09-16T02:06:16.901 INFO:tasks.workunit.client.0.smithi110.stdout:4/698: dwrite d4/d8/d17/d23/d4c/d6d/d4f/f58 [0,4194304] 0 2024-09-16T02:06:16.902 INFO:tasks.workunit.client.0.smithi110.stdout:3/733: dwrite d8/f2a [0,4194304] 0 2024-09-16T02:06:16.904 INFO:tasks.workunit.client.0.smithi110.stdout:7/679: rename d3/d15/d38/d4f/d10/fc0 to d3/d15/d3a/fd3 0 2024-09-16T02:06:16.908 INFO:tasks.workunit.client.0.smithi110.stdout:4/699: mknod d4/d8/d17/d23/d4c/cdd 0 2024-09-16T02:06:16.912 INFO:tasks.workunit.client.0.smithi110.stdout:4/700: write d4/d8/d17/d23/d4c/d6d/d4f/f69 [72085,59061] 0 2024-09-16T02:06:16.913 INFO:tasks.workunit.client.0.smithi110.stdout:7/680: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/fca [0,4194304] 0 2024-09-16T02:06:16.916 INFO:tasks.workunit.client.0.smithi110.stdout:7/681: write d3/d15/d38/d4f/d10/d11/d3e/f42 [2756852,102125] 0 2024-09-16T02:06:16.916 INFO:tasks.workunit.client.0.smithi110.stdout:3/734: dread d8/f56 [0,4194304] 0 2024-09-16T02:06:16.917 INFO:tasks.workunit.client.0.smithi110.stdout:4/701: unlink d4/d8/d31/d73/f66 0 2024-09-16T02:06:16.920 INFO:tasks.workunit.client.0.smithi110.stdout:4/702: creat d4/db4/d55/fde x:0 0 0 2024-09-16T02:06:16.920 INFO:tasks.workunit.client.0.smithi110.stdout:7/682: symlink d3/d15/d38/d4f/d10/d7d/ld4 0 2024-09-16T02:06:16.921 INFO:tasks.workunit.client.0.smithi110.stdout:3/735: mkdir d8/d48/d5b/d92/dc7/d1b/d36/d83/d108 0 2024-09-16T02:06:16.924 INFO:tasks.workunit.client.0.smithi110.stdout:4/703: dread - d4/d8/d17/d23/d35/f87 zero size 2024-09-16T02:06:16.925 INFO:tasks.workunit.client.0.smithi110.stdout:3/736: mkdir d8/d109 0 2024-09-16T02:06:16.929 INFO:tasks.workunit.client.0.smithi110.stdout:4/704: link d4/d8/d31/d73/lb5 d4/d8/d17/d23/d4c/ldf 0 2024-09-16T02:06:16.946 INFO:tasks.workunit.client.0.smithi110.stdout:7/683: write d3/f19 [3243068,5599] 0 2024-09-16T02:06:16.947 INFO:tasks.workunit.client.0.smithi110.stdout:7/684: fdatasync d3/d15/d38/d4f/d2e/f71 0 2024-09-16T02:06:16.950 INFO:tasks.workunit.client.0.smithi110.stdout:7/685: dread d3/d15/d38/d4f/d10/d11/d3e/d40/f99 [0,4194304] 0 2024-09-16T02:06:16.952 INFO:tasks.workunit.client.0.smithi110.stdout:3/737: dwrite d8/d29/f73 [0,4194304] 0 2024-09-16T02:06:16.957 INFO:tasks.workunit.client.0.smithi110.stdout:7/686: rename d3/d15/d81 to d3/d15/d38/d4f/d10/d11/d3e/dd5 0 2024-09-16T02:06:16.961 INFO:tasks.workunit.client.0.smithi110.stdout:3/738: getdents d8/d48/d5b/d92/dc7/d1b 0 2024-09-16T02:06:16.965 INFO:tasks.workunit.client.0.smithi110.stdout:3/739: dread - d8/d48/d5b/d92/dc7/d1b/d3a/f85 zero size 2024-09-16T02:06:16.965 INFO:tasks.workunit.client.0.smithi110.stdout:7/687: dwrite d3/d15/d3a/d80/f9d [0,4194304] 0 2024-09-16T02:06:16.967 INFO:tasks.workunit.client.0.smithi110.stdout:3/740: fdatasync d8/d48/d5b/d92/f5a 0 2024-09-16T02:06:16.973 INFO:tasks.workunit.client.0.smithi110.stdout:7/688: mkdir d3/d15/d38/d4f/d10/d76/dd6 0 2024-09-16T02:06:16.973 INFO:tasks.workunit.client.0.smithi110.stdout:3/741: read d8/d48/f8e [406782,47494] 0 2024-09-16T02:06:17.002 INFO:tasks.workunit.client.0.smithi110.stdout:7/689: symlink d3/d7a/ld7 0 2024-09-16T02:06:17.002 INFO:tasks.workunit.client.0.smithi110.stdout:3/742: fsync d8/d29/d45/f5f 0 2024-09-16T02:06:17.005 INFO:tasks.workunit.client.0.smithi110.stdout:7/690: creat d3/d15/d38/d4f/d10/d2c/fd8 x:0 0 0 2024-09-16T02:06:17.007 INFO:tasks.workunit.client.0.smithi110.stdout:3/743: rename d8/l33 to d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/l10a 0 2024-09-16T02:06:17.008 INFO:tasks.workunit.client.0.smithi110.stdout:7/691: unlink d3/d15/d38/d4f/d10/c8c 0 2024-09-16T02:06:17.010 INFO:tasks.workunit.client.0.smithi110.stdout:7/692: fdatasync d3/d15/d38/d4f/d10/d7d/fab 0 2024-09-16T02:06:17.013 INFO:tasks.workunit.client.0.smithi110.stdout:3/744: dwrite d8/f2a [0,4194304] 0 2024-09-16T02:06:17.021 INFO:tasks.workunit.client.0.smithi110.stdout:3/745: write d8/d48/d5b/d92/dc7/d1b/fa2 [63435,65943] 0 2024-09-16T02:06:17.024 INFO:tasks.workunit.client.0.smithi110.stdout:3/746: truncate d8/d48/d5b/d92/f5a 5525428 0 2024-09-16T02:06:17.025 INFO:tasks.workunit.client.0.smithi110.stdout:3/747: rmdir d8/d48/d5b/d6a/d75 39 2024-09-16T02:06:17.028 INFO:tasks.workunit.client.0.smithi110.stdout:3/748: fsync d8/d29/dbd/f7a 0 2024-09-16T02:06:17.033 INFO:tasks.workunit.client.0.smithi110.stdout:7/693: dread d3/d15/d38/d4f/d10/d11/f5f [0,4194304] 0 2024-09-16T02:06:17.034 INFO:tasks.workunit.client.0.smithi110.stdout:7/694: write d3/d15/d38/d4f/d10/d7d/fab [1360299,49850] 0 2024-09-16T02:06:17.037 INFO:tasks.workunit.client.0.smithi110.stdout:7/695: rmdir d3/d15/d38/d4f/d10/d76 39 2024-09-16T02:06:17.040 INFO:tasks.workunit.client.0.smithi110.stdout:3/749: dwrite d8/d48/d5b/d92/dc7/f21 [0,4194304] 0 2024-09-16T02:06:17.045 INFO:tasks.workunit.client.0.smithi110.stdout:3/750: mknod d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/de6/c10b 0 2024-09-16T02:06:17.049 INFO:tasks.workunit.client.0.smithi110.stdout:3/751: chown d8/d48/d5b/d92/dc7/d1b/d36/d83 7 1 2024-09-16T02:06:17.049 INFO:tasks.workunit.client.0.smithi110.stdout:3/752: fsync d8/d48/d5b/d92/dc7/d1b/d36/d83/fad 0 2024-09-16T02:06:17.051 INFO:tasks.workunit.client.0.smithi110.stdout:3/753: stat d8/d48/d5b/d92/dc7/d1b/f9f 0 2024-09-16T02:06:17.055 INFO:tasks.workunit.client.0.smithi110.stdout:3/754: link d8/d48/d5b/d92/dc7/d1b/d36/f37 d8/d48/d7c/d87/f10c 0 2024-09-16T02:06:17.057 INFO:tasks.workunit.client.0.smithi110.stdout:3/755: creat d8/d29/dbd/dc6/f10d x:0 0 0 2024-09-16T02:06:17.059 INFO:tasks.workunit.client.0.smithi110.stdout:3/756: dread d8/d48/d5b/d92/dc7/d1b/fa2 [0,4194304] 0 2024-09-16T02:06:17.075 INFO:tasks.workunit.client.0.smithi110.stdout:3/757: dwrite d8/d48/d5b/d92/dc7/d1b/f101 [0,4194304] 0 2024-09-16T02:06:17.078 INFO:tasks.workunit.client.0.smithi110.stdout:3/758: creat d8/d29/dbd/dc6/dd3/f10e x:0 0 0 2024-09-16T02:06:17.080 INFO:tasks.workunit.client.0.smithi110.stdout:3/759: symlink d8/d48/d5b/d92/dc7/d1b/d36/l10f 0 2024-09-16T02:06:17.083 INFO:tasks.workunit.client.0.smithi110.stdout:3/760: read d8/f5c [745322,122209] 0 2024-09-16T02:06:17.085 INFO:tasks.workunit.client.0.smithi110.stdout:3/761: unlink d8/d48/d7c/l94 0 2024-09-16T02:06:17.089 INFO:tasks.workunit.client.0.smithi110.stdout:3/762: truncate d8/d29/dbd/f38 929879 0 2024-09-16T02:06:17.093 INFO:tasks.workunit.client.0.smithi110.stdout:3/763: getdents d8/d48/d4b 0 2024-09-16T02:06:17.093 INFO:tasks.workunit.client.0.smithi110.stdout:3/764: readlink d8/d29/dbd/dc6/dd3/lfb 0 2024-09-16T02:06:17.102 INFO:tasks.workunit.client.0.smithi110.stdout:3/765: creat d8/d48/d5b/d92/dc7/d1b/d36/d83/d108/f110 x:0 0 0 2024-09-16T02:06:17.106 INFO:tasks.workunit.client.0.smithi110.stdout:3/766: symlink d8/d48/d5b/d6a/d75/d88/l111 0 2024-09-16T02:06:17.108 INFO:tasks.workunit.client.0.smithi110.stdout:3/767: symlink d8/d29/dbd/dc6/dd3/l112 0 2024-09-16T02:06:17.109 INFO:tasks.workunit.client.0.smithi110.stdout:3/768: dread d8/f56 [0,4194304] 0 2024-09-16T02:06:17.111 INFO:tasks.workunit.client.0.smithi110.stdout:3/769: dread - d8/d29/f96 zero size 2024-09-16T02:06:17.112 INFO:tasks.workunit.client.0.smithi110.stdout:3/770: creat d8/d29/dbd/f113 x:0 0 0 2024-09-16T02:06:17.123 INFO:tasks.workunit.client.0.smithi110.stdout:3/771: write d8/d29/d45/f5f [4449916,120662] 0 2024-09-16T02:06:17.126 INFO:tasks.workunit.client.0.smithi110.stdout:3/772: mkdir d8/d48/d5b/d92/dc7/d1b/d3a/d43/d114 0 2024-09-16T02:06:17.126 INFO:tasks.workunit.client.0.smithi110.stdout:3/773: chown d8/d48/d5b/d92/dc7/d1b/d36/d83/d108 3 1 2024-09-16T02:06:17.136 INFO:tasks.workunit.client.0.smithi110.stdout:3/774: dread d8/d29/dbd/fa4 [0,4194304] 0 2024-09-16T02:06:17.141 INFO:tasks.workunit.client.0.smithi110.stdout:3/775: link d8/d48/d5b/d92/l7b d8/d48/d5b/d6a/l115 0 2024-09-16T02:06:17.143 INFO:tasks.workunit.client.0.smithi110.stdout:3/776: write d8/d48/d5b/d92/dc7/d1b/fa2 [370664,105215] 0 2024-09-16T02:06:17.144 INFO:tasks.workunit.client.0.smithi110.stdout:3/777: fsync d8/d29/dbd/dc6/f82 0 2024-09-16T02:06:17.147 INFO:tasks.workunit.client.0.smithi110.stdout:3/778: creat d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5/f116 x:0 0 0 2024-09-16T02:06:17.151 INFO:tasks.workunit.client.0.smithi110.stdout:3/779: mkdir d8/d48/d5b/d92/dc7/d1b/d117 0 2024-09-16T02:06:17.152 INFO:tasks.workunit.client.0.smithi110.stdout:3/780: chown d8/d48/d5b/d6a/d75 0 1 2024-09-16T02:06:17.155 INFO:tasks.workunit.client.0.smithi110.stdout:3/781: mknod d8/d48/d5b/d6a/def/c118 0 2024-09-16T02:06:17.157 INFO:tasks.workunit.client.0.smithi110.stdout:3/782: unlink d8/d48/d5b/f76 0 2024-09-16T02:06:17.161 INFO:tasks.workunit.client.0.smithi110.stdout:3/783: dread d8/d48/d5b/d6a/fb2 [0,4194304] 0 2024-09-16T02:06:17.164 INFO:tasks.workunit.client.0.smithi110.stdout:3/784: mknod d8/d48/d5b/d92/dc7/d1b/d36/d57/d64/c119 0 2024-09-16T02:06:17.166 INFO:tasks.workunit.client.0.smithi110.stdout:3/785: creat d8/d48/d5b/d92/dc7/d1b/d3a/d43/f11a x:0 0 0 2024-09-16T02:06:17.184 INFO:tasks.workunit.client.0.smithi110.stdout:3/786: dwrite d8/d48/d5b/d92/dc7/d1b/d36/d83/fad [0,4194304] 0 2024-09-16T02:06:17.195 INFO:tasks.workunit.client.0.smithi110.stdout:3/787: dread d8/d48/d5b/d92/dc7/f7e [0,4194304] 0 2024-09-16T02:06:17.197 INFO:tasks.workunit.client.0.smithi110.stdout:3/788: creat d8/d29/d45/f11b x:0 0 0 2024-09-16T02:06:17.198 INFO:tasks.workunit.client.0.smithi110.stdout:3/789: read - d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/fec zero size 2024-09-16T02:06:17.198 INFO:tasks.workunit.client.0.smithi110.stdout:3/790: stat d8/d48/d5b/d6a/def 0 2024-09-16T02:06:17.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:16 smithi165 ceph-mon[34621]: pgmap v32: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 134 MiB/s wr, 331 op/s 2024-09-16T02:06:17.201 INFO:tasks.workunit.client.0.smithi110.stdout:3/791: mkdir d8/d48/d5b/d6a/d75/d88/d11c 0 2024-09-16T02:06:17.204 INFO:tasks.workunit.client.0.smithi110.stdout:3/792: creat d8/d48/d5b/f11d x:0 0 0 2024-09-16T02:06:17.205 INFO:tasks.workunit.client.0.smithi110.stdout:3/793: chown d8/d48/d5b/d92/dd8 154866 1 2024-09-16T02:06:17.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:16 smithi110 ceph-mon[27634]: pgmap v32: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 60 MiB/s rd, 134 MiB/s wr, 331 op/s 2024-09-16T02:06:17.209 INFO:tasks.workunit.client.0.smithi110.stdout:3/794: link d8/d48/d5b/d92/dc7/d1b/d36/la3 d8/d29/l11e 0 2024-09-16T02:06:17.211 INFO:tasks.workunit.client.0.smithi110.stdout:3/795: symlink d8/d29/dbd/l11f 0 2024-09-16T02:06:17.217 INFO:tasks.workunit.client.0.smithi110.stdout:3/796: dwrite f4 [4194304,4194304] 0 2024-09-16T02:06:17.219 INFO:tasks.workunit.client.0.smithi110.stdout:3/797: read d8/d48/d5b/d92/dc7/d1b/f24 [887404,111872] 0 2024-09-16T02:06:17.220 INFO:tasks.workunit.client.0.smithi110.stdout:3/798: chown d8/d29/dbd/dc6/dd3/f106 83942 1 2024-09-16T02:06:17.226 INFO:tasks.workunit.client.0.smithi110.stdout:3/799: dwrite d8/d29/f73 [0,4194304] 0 2024-09-16T02:06:17.228 INFO:tasks.workunit.client.0.smithi110.stdout:3/800: write d8/d48/f8e [1648121,74615] 0 2024-09-16T02:06:17.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/801: mkdir d8/d48/d5b/d92/dd8/d120 0 2024-09-16T02:06:17.592 INFO:tasks.workunit.client.0.smithi110.stdout:0/809: sync 2024-09-16T02:06:17.592 INFO:tasks.workunit.client.0.smithi110.stdout:2/881: sync 2024-09-16T02:06:17.592 INFO:tasks.workunit.client.0.smithi110.stdout:6/855: sync 2024-09-16T02:06:17.592 INFO:tasks.workunit.client.0.smithi110.stdout:8/691: sync 2024-09-16T02:06:17.595 INFO:tasks.workunit.client.0.smithi110.stdout:0/810: mkdir d3/d4/d41/dff 0 2024-09-16T02:06:17.598 INFO:tasks.workunit.client.0.smithi110.stdout:2/882: getdents d0/db/d105/d41/db3/df9 0 2024-09-16T02:06:17.600 INFO:tasks.workunit.client.0.smithi110.stdout:0/811: dwrite d3/d4/dc/d10/f35 [0,4194304] 0 2024-09-16T02:06:17.603 INFO:tasks.workunit.client.0.smithi110.stdout:2/883: mknod d0/d5f/dc0/ddc/ddd/d18/dc/de7/c12e 0 2024-09-16T02:06:17.604 INFO:tasks.workunit.client.0.smithi110.stdout:0/812: mkdir d3/d4/d6d/d100 0 2024-09-16T02:06:17.604 INFO:tasks.workunit.client.0.smithi110.stdout:2/884: chown d0/d5f/dc0/ddc/ddd/dfa/d104 5108 1 2024-09-16T02:06:17.607 INFO:tasks.workunit.client.0.smithi110.stdout:0/813: mkdir d3/d4/d85/d93/d101 0 2024-09-16T02:06:17.609 INFO:tasks.workunit.client.0.smithi110.stdout:6/856: write d0/d2/d5/d55/fe8 [140165,91035] 0 2024-09-16T02:06:17.611 INFO:tasks.workunit.client.0.smithi110.stdout:0/814: truncate d3/d6/d43/d55/fa4 667867 0 2024-09-16T02:06:17.612 INFO:tasks.workunit.client.0.smithi110.stdout:6/857: mkdir d0/d2/d57/d75/d10a 0 2024-09-16T02:06:17.614 INFO:tasks.workunit.client.0.smithi110.stdout:6/858: readlink d0/d2/d5/db8/l82 0 2024-09-16T02:06:17.625 INFO:tasks.workunit.client.0.smithi110.stdout:2/885: dwrite d0/d5f/dc0/ddc/ddd/f7c [0,4194304] 0 2024-09-16T02:06:17.625 INFO:tasks.workunit.client.0.smithi110.stdout:2/886: read - d0/db/d105/d39/f3f zero size 2024-09-16T02:06:17.633 INFO:tasks.workunit.client.0.smithi110.stdout:2/887: creat d0/f12f x:0 0 0 2024-09-16T02:06:17.636 INFO:tasks.workunit.client.0.smithi110.stdout:2/888: rename d0/d5f/dc0/d10f/d113 to d0/d5f/dc0/d130 0 2024-09-16T02:06:17.641 INFO:tasks.workunit.client.0.smithi110.stdout:2/889: mknod d0/d5f/dc0/ddc/c131 0 2024-09-16T02:06:17.642 INFO:tasks.workunit.client.0.smithi110.stdout:0/815: truncate d3/d4/dc/d14/d7e/d81/d86/fb6 271419 0 2024-09-16T02:06:17.643 INFO:tasks.workunit.client.0.smithi110.stdout:2/890: dread - d0/db/d105/d39/d87/ff6 zero size 2024-09-16T02:06:17.649 INFO:tasks.workunit.client.0.smithi110.stdout:2/891: creat d0/db/f132 x:0 0 0 2024-09-16T02:06:17.664 INFO:tasks.workunit.client.0.smithi110.stdout:2/892: link d0/db/d33/f8d d0/db/d47/da1/dad/dd5/f133 0 2024-09-16T02:06:17.671 INFO:tasks.workunit.client.0.smithi110.stdout:2/893: dread d0/db/d105/f42 [0,4194304] 0 2024-09-16T02:06:17.678 INFO:tasks.workunit.client.0.smithi110.stdout:2/894: dwrite d0/db/d105/f8c [0,4194304] 0 2024-09-16T02:06:17.682 INFO:tasks.workunit.client.0.smithi110.stdout:2/895: mknod d0/db/d47/d48/da0/d12d/c134 0 2024-09-16T02:06:17.688 INFO:tasks.workunit.client.0.smithi110.stdout:2/896: dread d0/fc5 [0,4194304] 0 2024-09-16T02:06:17.689 INFO:tasks.workunit.client.0.smithi110.stdout:0/816: write d3/d4/dc/fb8 [2871931,100796] 0 2024-09-16T02:06:17.690 INFO:tasks.workunit.client.0.smithi110.stdout:0/817: chown d3/d92 4 1 2024-09-16T02:06:17.690 INFO:tasks.workunit.client.0.smithi110.stdout:2/897: chown d0/d5f/dc0/ddc/ddd/d18/dc/f7f 1 1 2024-09-16T02:06:17.691 INFO:tasks.workunit.client.0.smithi110.stdout:2/898: stat d0/d5f/dc0/ddc/ddd/d18/f98 0 2024-09-16T02:06:17.693 INFO:tasks.workunit.client.0.smithi110.stdout:0/818: chown d3/d4/dc/d14/d7e/le6 8580 1 2024-09-16T02:06:17.696 INFO:tasks.workunit.client.0.smithi110.stdout:2/899: unlink d0/d5f/dc0/ddc/ddd/l13 0 2024-09-16T02:06:17.699 INFO:tasks.workunit.client.0.smithi110.stdout:2/900: creat d0/db/d47/d48/f135 x:0 0 0 2024-09-16T02:06:17.703 INFO:tasks.workunit.client.0.smithi110.stdout:2/901: unlink d0/db/d105/d39/d87/d120/f121 0 2024-09-16T02:06:17.705 INFO:tasks.workunit.client.0.smithi110.stdout:2/902: truncate d0/db/d105/d41/fae 9179192 0 2024-09-16T02:06:17.711 INFO:tasks.workunit.client.0.smithi110.stdout:2/903: creat d0/d5f/dc0/d10f/d128/f136 x:0 0 0 2024-09-16T02:06:17.713 INFO:tasks.workunit.client.0.smithi110.stdout:0/819: dwrite d3/d6/d43/da7/fbe [0,4194304] 0 2024-09-16T02:06:17.716 INFO:tasks.workunit.client.0.smithi110.stdout:2/904: mkdir d0/d5f/dc0/ddc/ddd/db5/d137 0 2024-09-16T02:06:17.721 INFO:tasks.workunit.client.0.smithi110.stdout:0/820: mkdir d3/d4/d85/d102 0 2024-09-16T02:06:17.722 INFO:tasks.workunit.client.0.smithi110.stdout:2/905: write d0/d5f/dc0/ddc/ddd/dfa/d3b/f53 [4257014,49180] 0 2024-09-16T02:06:17.725 INFO:tasks.workunit.client.0.smithi110.stdout:0/821: symlink d3/d4/dc/l103 0 2024-09-16T02:06:17.728 INFO:tasks.workunit.client.0.smithi110.stdout:0/822: mknod d3/d6/d43/d55/dbb/c104 0 2024-09-16T02:06:17.729 INFO:tasks.workunit.client.0.smithi110.stdout:2/906: rename d0/db/c20 to d0/db/d47/da1/dad/df3/c138 0 2024-09-16T02:06:17.738 INFO:tasks.workunit.client.0.smithi110.stdout:2/907: dwrite d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/f11e [4194304,4194304] 0 2024-09-16T02:06:17.741 INFO:tasks.workunit.client.0.smithi110.stdout:0/823: dread d3/d6/f21 [0,4194304] 0 2024-09-16T02:06:17.746 INFO:tasks.workunit.client.0.smithi110.stdout:0/824: creat d3/d4/dc/d70/d8b/db3/f105 x:0 0 0 2024-09-16T02:06:17.748 INFO:tasks.workunit.client.0.smithi110.stdout:0/825: write d3/d4/dc/d10/f87 [2873323,36604] 0 2024-09-16T02:06:17.753 INFO:tasks.workunit.client.0.smithi110.stdout:2/908: dwrite d0/db/d105/d58/fab [0,4194304] 0 2024-09-16T02:06:17.756 INFO:tasks.workunit.client.0.smithi110.stdout:0/826: dwrite d3/d4/dc/d75/fd8 [0,4194304] 0 2024-09-16T02:06:17.765 INFO:tasks.workunit.client.0.smithi110.stdout:0/827: write d3/d4/dc/d10/f8e [142033,68588] 0 2024-09-16T02:06:17.767 INFO:tasks.workunit.client.0.smithi110.stdout:0/828: fsync d3/d6/d43/d55/d59/f9f 0 2024-09-16T02:06:17.769 INFO:tasks.workunit.client.0.smithi110.stdout:0/829: truncate d3/d6/d43/da7/fd7 4533736 0 2024-09-16T02:06:17.773 INFO:tasks.workunit.client.0.smithi110.stdout:0/830: getdents d3/d6/d43/da7 0 2024-09-16T02:06:17.774 INFO:tasks.workunit.client.0.smithi110.stdout:2/909: dread d0/db/d47/f50 [0,4194304] 0 2024-09-16T02:06:17.775 INFO:tasks.workunit.client.0.smithi110.stdout:2/910: dread - d0/d5f/dc0/ddc/ddd/f99 zero size 2024-09-16T02:06:17.777 INFO:tasks.workunit.client.0.smithi110.stdout:0/831: rmdir d3/d4/dc/d75/dfa 0 2024-09-16T02:06:17.778 INFO:tasks.workunit.client.0.smithi110.stdout:0/832: write d3/d6/f99 [2074283,49967] 0 2024-09-16T02:06:17.784 INFO:tasks.workunit.client.0.smithi110.stdout:0/833: getdents d3 0 2024-09-16T02:06:17.787 INFO:tasks.workunit.client.0.smithi110.stdout:0/834: rename d3/d4/dc/l31 to d3/d4/df2/l106 0 2024-09-16T02:06:17.789 INFO:tasks.workunit.client.0.smithi110.stdout:1/888: sync 2024-09-16T02:06:17.789 INFO:tasks.workunit.client.0.smithi110.stdout:5/874: sync 2024-09-16T02:06:17.789 INFO:tasks.workunit.client.0.smithi110.stdout:9/817: sync 2024-09-16T02:06:17.791 INFO:tasks.workunit.client.0.smithi110.stdout:0/835: rename d3/d6/d43/c53 to d3/d4/dc/d14/d7e/c107 0 2024-09-16T02:06:17.796 INFO:tasks.workunit.client.0.smithi110.stdout:9/818: truncate d1/dd/d6a/d6c/d6f/fde 613524 0 2024-09-16T02:06:17.797 INFO:tasks.workunit.client.0.smithi110.stdout:2/911: dwrite d0/db/d105/d41/f111 [4194304,4194304] 0 2024-09-16T02:06:17.798 INFO:tasks.workunit.client.0.smithi110.stdout:0/836: mkdir d3/d108 0 2024-09-16T02:06:17.799 INFO:tasks.workunit.client.0.smithi110.stdout:1/889: mkdir d0/d12e 0 2024-09-16T02:06:17.802 INFO:tasks.workunit.client.0.smithi110.stdout:0/837: unlink d3/d4/d41/fea 0 2024-09-16T02:06:17.803 INFO:tasks.workunit.client.0.smithi110.stdout:0/838: fdatasync d3/d6/d43/d55/d59/fa6 0 2024-09-16T02:06:17.806 INFO:tasks.workunit.client.0.smithi110.stdout:1/890: mkdir d0/da/d7c/d12f 0 2024-09-16T02:06:17.807 INFO:tasks.workunit.client.0.smithi110.stdout:1/891: chown d0/da/d7c/c110 2756 1 2024-09-16T02:06:17.807 INFO:tasks.workunit.client.0.smithi110.stdout:5/875: dread d5/d36/f67 [4194304,4194304] 0 2024-09-16T02:06:17.811 INFO:tasks.workunit.client.0.smithi110.stdout:9/819: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/def/d117 0 2024-09-16T02:06:17.811 INFO:tasks.workunit.client.0.smithi110.stdout:9/820: chown d1/dd/d6a/d6c/d75 221122 1 2024-09-16T02:06:17.816 INFO:tasks.workunit.client.0.smithi110.stdout:2/912: getdents d0/db/d47/da1/dad/d10b 0 2024-09-16T02:06:17.819 INFO:tasks.workunit.client.0.smithi110.stdout:5/876: truncate d5/dd/df/d11/d6d/d11a/f6b 1251362 0 2024-09-16T02:06:17.822 INFO:tasks.workunit.client.0.smithi110.stdout:1/892: dwrite d0/d1/d4/d46/f106 [0,4194304] 0 2024-09-16T02:06:17.826 INFO:tasks.workunit.client.0.smithi110.stdout:9/821: dread d1/dd/d6a/d6c/d6f/fde [0,4194304] 0 2024-09-16T02:06:17.828 INFO:tasks.workunit.client.0.smithi110.stdout:2/913: mknod d0/db/d47/da1/dad/d10b/c139 0 2024-09-16T02:06:17.833 INFO:tasks.workunit.client.0.smithi110.stdout:0/839: dwrite d3/d4/d6d/faf [0,4194304] 0 2024-09-16T02:06:17.835 INFO:tasks.workunit.client.0.smithi110.stdout:5/877: rmdir d5/dd/df/d11/d6d/d11a/d9c/dc3 0 2024-09-16T02:06:17.838 INFO:tasks.workunit.client.0.smithi110.stdout:2/914: truncate d0/db/d105/d58/dec/d100/fcc 805575 0 2024-09-16T02:06:17.843 INFO:tasks.workunit.client.0.smithi110.stdout:5/878: dwrite d5/d71/d89/fb6 [0,4194304] 0 2024-09-16T02:06:17.846 INFO:tasks.workunit.client.0.smithi110.stdout:9/822: dread d1/dd/d6a/d6c/d6f/d79/f68 [0,4194304] 0 2024-09-16T02:06:17.847 INFO:tasks.workunit.client.0.smithi110.stdout:1/893: truncate d0/d25/fe4 1025877 0 2024-09-16T02:06:17.847 INFO:tasks.workunit.client.0.smithi110.stdout:2/915: dwrite d0/f3 [0,4194304] 0 2024-09-16T02:06:17.849 INFO:tasks.workunit.client.0.smithi110.stdout:1/894: chown d0/da/f81 49 1 2024-09-16T02:06:17.855 INFO:tasks.workunit.client.0.smithi110.stdout:9/823: mknod d1/d5/d20/c118 0 2024-09-16T02:06:17.856 INFO:tasks.workunit.client.0.smithi110.stdout:1/895: truncate d0/d1/d4/d46/d7a/df4/fa9 907100 0 2024-09-16T02:06:17.856 INFO:tasks.workunit.client.0.smithi110.stdout:0/840: truncate d3/d4/d41/f5f 2676567 0 2024-09-16T02:06:17.860 INFO:tasks.workunit.client.0.smithi110.stdout:2/916: mkdir d0/db/d105/d41/db3/db8/d13a 0 2024-09-16T02:06:17.861 INFO:tasks.workunit.client.0.smithi110.stdout:9/824: symlink d1/dd/d6a/d6c/d75/d8c/d38/l119 0 2024-09-16T02:06:17.861 INFO:tasks.workunit.client.0.smithi110.stdout:2/917: chown d0/db/d105/d41/db3/df9 1162386 1 2024-09-16T02:06:17.862 INFO:tasks.workunit.client.0.smithi110.stdout:1/896: truncate d0/d1/df2/d10f/fa7 22367 0 2024-09-16T02:06:17.869 INFO:tasks.workunit.client.0.smithi110.stdout:2/918: rename d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/c12b to d0/db/c13b 0 2024-09-16T02:06:17.870 INFO:tasks.workunit.client.0.smithi110.stdout:0/841: dread d3/f1b [4194304,4194304] 0 2024-09-16T02:06:17.873 INFO:tasks.workunit.client.0.smithi110.stdout:2/919: creat d0/d5f/dc0/ddc/ddd/f13c x:0 0 0 2024-09-16T02:06:17.874 INFO:tasks.workunit.client.0.smithi110.stdout:5/879: dread d5/dd/f12 [0,4194304] 0 2024-09-16T02:06:17.878 INFO:tasks.workunit.client.0.smithi110.stdout:0/842: dwrite d3/d4/f11 [4194304,4194304] 0 2024-09-16T02:06:17.883 INFO:tasks.workunit.client.0.smithi110.stdout:5/880: dwrite d5/f2c [0,4194304] 0 2024-09-16T02:06:17.884 INFO:tasks.workunit.client.0.smithi110.stdout:5/881: read - d5/d36/d45/ffe zero size 2024-09-16T02:06:17.884 INFO:tasks.workunit.client.0.smithi110.stdout:5/882: chown d5 3414922 1 2024-09-16T02:06:17.887 INFO:tasks.workunit.client.0.smithi110.stdout:2/920: link d0/db/d105/d39/d87/c91 d0/db/d105/d39/d87/d120/c13d 0 2024-09-16T02:06:17.891 INFO:tasks.workunit.client.0.smithi110.stdout:2/921: creat d0/d5f/dc0/ddc/ddd/d18/dc/dfd/f13e x:0 0 0 2024-09-16T02:06:17.892 INFO:tasks.workunit.client.0.smithi110.stdout:0/843: link d3/d6/d43/d55/d59/f9c d3/d4/df2/df3/f109 0 2024-09-16T02:06:17.894 INFO:tasks.workunit.client.0.smithi110.stdout:5/883: mknod d5/d36/d45/c121 0 2024-09-16T02:06:17.895 INFO:tasks.workunit.client.0.smithi110.stdout:1/897: dwrite d0/da/d7c/f9e [0,4194304] 0 2024-09-16T02:06:17.898 INFO:tasks.workunit.client.0.smithi110.stdout:2/922: truncate d0/d5f/dc0/ddc/ddd/d18/dc/f61 587774 0 2024-09-16T02:06:17.899 INFO:tasks.workunit.client.0.smithi110.stdout:1/898: creat d0/d1/d4/dc2/f130 x:0 0 0 2024-09-16T02:06:17.901 INFO:tasks.workunit.client.0.smithi110.stdout:5/884: rename d5/dd/c5d to d5/d36/dd5/c122 0 2024-09-16T02:06:17.902 INFO:tasks.workunit.client.0.smithi110.stdout:0/844: truncate d3/d4/dc/fb7 840284 0 2024-09-16T02:06:17.902 INFO:tasks.workunit.client.0.smithi110.stdout:5/885: dread - d5/d36/d45/d47/fe4 zero size 2024-09-16T02:06:17.905 INFO:tasks.workunit.client.0.smithi110.stdout:1/899: symlink d0/da/d8d/df6/dc4/de8/l131 0 2024-09-16T02:06:17.907 INFO:tasks.workunit.client.0.smithi110.stdout:5/886: symlink d5/d36/dd5/l123 0 2024-09-16T02:06:17.908 INFO:tasks.workunit.client.0.smithi110.stdout:5/887: chown d5/de7 13313 1 2024-09-16T02:06:17.910 INFO:tasks.workunit.client.0.smithi110.stdout:1/900: creat d0/da/d7c/da8/dec/f132 x:0 0 0 2024-09-16T02:06:17.911 INFO:tasks.workunit.client.0.smithi110.stdout:1/901: chown d0/d1/d4/d46/d7a/df4/fcb 1 1 2024-09-16T02:06:17.912 INFO:tasks.workunit.client.0.smithi110.stdout:2/923: dread d0/db/d105/d41/db3/db8/fc3 [0,4194304] 0 2024-09-16T02:06:17.913 INFO:tasks.workunit.client.0.smithi110.stdout:2/924: stat d0/d5f 0 2024-09-16T02:06:17.915 INFO:tasks.workunit.client.0.smithi110.stdout:5/888: creat d5/f124 x:0 0 0 2024-09-16T02:06:17.920 INFO:tasks.workunit.client.0.smithi110.stdout:5/889: symlink d5/dd/df/d11/d6d/d11a/d6f/d8e/l125 0 2024-09-16T02:06:17.925 INFO:tasks.workunit.client.0.smithi110.stdout:5/890: chown d5/dd/df/d11/d6d/d11a/lf7 9904992 1 2024-09-16T02:06:17.927 INFO:tasks.workunit.client.0.smithi110.stdout:1/902: link d0/d1/d4/f26 d0/da/d7c/da8/dec/f133 0 2024-09-16T02:06:17.929 INFO:tasks.workunit.client.0.smithi110.stdout:0/845: dwrite d3/d6/d4b/f51 [0,4194304] 0 2024-09-16T02:06:17.931 INFO:tasks.workunit.client.0.smithi110.stdout:5/891: rename d5/dd/f12 to d5/de7/d119/f126 0 2024-09-16T02:06:17.934 INFO:tasks.workunit.client.0.smithi110.stdout:1/903: mkdir d0/d1/d4/d46/d51/d134 0 2024-09-16T02:06:17.935 INFO:tasks.workunit.client.0.smithi110.stdout:1/904: truncate d0/d1/f109 526615 0 2024-09-16T02:06:17.942 INFO:tasks.workunit.client.0.smithi110.stdout:2/925: dwrite d0/db/d33/f8d [0,4194304] 0 2024-09-16T02:06:17.944 INFO:tasks.workunit.client.0.smithi110.stdout:1/905: rename d0/d1/d4 to d0/d1/df2/d10f/d32/d40/dbf/d135 0 2024-09-16T02:06:17.947 INFO:tasks.workunit.client.0.smithi110.stdout:0/846: mknod d3/d4/dc/d70/c10a 0 2024-09-16T02:06:17.947 INFO:tasks.workunit.client.0.smithi110.stdout:5/892: write d5/dd/df/d11/d6d/d11a/d9c/faa [234685,6270] 0 2024-09-16T02:06:17.952 INFO:tasks.workunit.client.0.smithi110.stdout:2/926: creat d0/db/d47/d48/da0/d12d/f13f x:0 0 0 2024-09-16T02:06:17.953 INFO:tasks.workunit.client.0.smithi110.stdout:1/906: creat d0/da/d7c/da8/f136 x:0 0 0 2024-09-16T02:06:17.954 INFO:tasks.workunit.client.0.smithi110.stdout:0/847: chown d3/d4/dc/d10/l3a 93185 1 2024-09-16T02:06:17.955 INFO:tasks.workunit.client.0.smithi110.stdout:5/893: symlink d5/de7/d119/l127 0 2024-09-16T02:06:17.958 INFO:tasks.workunit.client.0.smithi110.stdout:0/848: mknod d3/d4/d85/d93/c10b 0 2024-09-16T02:06:17.960 INFO:tasks.workunit.client.0.smithi110.stdout:1/907: rename d0/d25/d63/f19 to d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d7a/df4/f137 0 2024-09-16T02:06:17.962 INFO:tasks.workunit.client.0.smithi110.stdout:5/894: mknod d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/c128 0 2024-09-16T02:06:17.967 INFO:tasks.workunit.client.0.smithi110.stdout:5/895: fdatasync d5/d71/f81 0 2024-09-16T02:06:17.968 INFO:tasks.workunit.client.0.smithi110.stdout:0/849: mkdir d3/d4/dc/d14/df9/d10c 0 2024-09-16T02:06:17.969 INFO:tasks.workunit.client.0.smithi110.stdout:1/908: fsync d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d7a/df4/fa9 0 2024-09-16T02:06:17.972 INFO:tasks.workunit.client.0.smithi110.stdout:1/909: chown d0/d1/df2/d10f/d32/d9f/f108 28 1 2024-09-16T02:06:17.972 INFO:tasks.workunit.client.0.smithi110.stdout:2/927: dwrite d0/db/d105/d41/fae [8388608,4194304] 0 2024-09-16T02:06:17.978 INFO:tasks.workunit.client.0.smithi110.stdout:1/910: readlink d0/d1/dab/l125 0 2024-09-16T02:06:17.978 INFO:tasks.workunit.client.0.smithi110.stdout:0/850: symlink d3/d6/d4b/l10d 0 2024-09-16T02:06:17.979 INFO:tasks.workunit.client.0.smithi110.stdout:5/896: mkdir d5/dd/df/d129 0 2024-09-16T02:06:17.980 INFO:tasks.workunit.client.0.smithi110.stdout:5/897: write d5/dd/df/f35 [6217217,13953] 0 2024-09-16T02:06:17.981 INFO:tasks.workunit.client.0.smithi110.stdout:2/928: write d0/d5f/dc0/ddc/ddd/f99 [521893,23071] 0 2024-09-16T02:06:17.984 INFO:tasks.workunit.client.0.smithi110.stdout:5/898: truncate d5/dd/df/d11/d6d/d11a/d77/de9/dfc/f100 178860 0 2024-09-16T02:06:17.985 INFO:tasks.workunit.client.0.smithi110.stdout:5/899: chown d5/d36/d45/d47/c63 33370545 1 2024-09-16T02:06:17.999 INFO:tasks.workunit.client.0.smithi110.stdout:1/911: rename d0/d25/l6d to d0/da/d8d/df6/d10d/l138 0 2024-09-16T02:06:18.001 INFO:tasks.workunit.client.0.smithi110.stdout:1/912: write d0/d1/df2/d10f/d32/d40/f12a [1004210,45238] 0 2024-09-16T02:06:18.001 INFO:tasks.workunit.client.0.smithi110.stdout:5/900: creat d5/d71/d89/f12a x:0 0 0 2024-09-16T02:06:18.003 INFO:tasks.workunit.client.0.smithi110.stdout:0/851: creat d3/d4/dc/d14/d76/de8/f10e x:0 0 0 2024-09-16T02:06:18.003 INFO:tasks.workunit.client.0.smithi110.stdout:1/913: stat d0/d1/df2/d10f/d32/d40/dbf/fd3 0 2024-09-16T02:06:18.005 INFO:tasks.workunit.client.0.smithi110.stdout:1/914: fsync d0/d1/df2/d10f/d32/d40/dbf/ff9 0 2024-09-16T02:06:18.006 INFO:tasks.workunit.client.0.smithi110.stdout:5/901: dread d5/dd/df/d11/f32 [4194304,4194304] 0 2024-09-16T02:06:18.007 INFO:tasks.workunit.client.0.smithi110.stdout:2/929: link d0/db/d105/f5a d0/db/f140 0 2024-09-16T02:06:18.010 INFO:tasks.workunit.client.0.smithi110.stdout:1/915: dread d0/d1/df2/d10f/f34 [0,4194304] 0 2024-09-16T02:06:18.010 INFO:tasks.workunit.client.0.smithi110.stdout:2/930: chown d0/db/f2e 6620 1 2024-09-16T02:06:18.012 INFO:tasks.workunit.client.0.smithi110.stdout:5/902: rename d5/dd/df/d11/d6d/d11a/d77/fcf to d5/dd/d90/f12b 0 2024-09-16T02:06:18.015 INFO:tasks.workunit.client.0.smithi110.stdout:2/931: creat d0/d5f/f141 x:0 0 0 2024-09-16T02:06:18.015 INFO:tasks.workunit.client.0.smithi110.stdout:5/903: dread - d5/dd/df/d11/d6d/fdd zero size 2024-09-16T02:06:18.017 INFO:tasks.workunit.client.0.smithi110.stdout:1/916: dwrite d0/d1/df2/d10f/ffe [0,4194304] 0 2024-09-16T02:06:18.019 INFO:tasks.workunit.client.0.smithi110.stdout:5/904: unlink d5/f6 0 2024-09-16T02:06:18.020 INFO:tasks.workunit.client.0.smithi110.stdout:1/917: mknod d0/da/d8d/df6/dd0/c139 0 2024-09-16T02:06:18.021 INFO:tasks.workunit.client.0.smithi110.stdout:1/918: dread - d0/d1/df2/d10f/d9a/ffb zero size 2024-09-16T02:06:18.021 INFO:tasks.workunit.client.0.smithi110.stdout:2/932: mknod d0/d5f/dc0/ddc/ddd/d18/dc/dfd/d125/c142 0 2024-09-16T02:06:18.025 INFO:tasks.workunit.client.0.smithi110.stdout:2/933: creat d0/db/d47/f143 x:0 0 0 2024-09-16T02:06:18.028 INFO:tasks.workunit.client.0.smithi110.stdout:2/934: chown d0/db/d33/ca4 253 1 2024-09-16T02:06:18.029 INFO:tasks.workunit.client.0.smithi110.stdout:2/935: stat d0/d5f/dc0/ddc/ddd/d18/dc/d9e 0 2024-09-16T02:06:18.032 INFO:tasks.workunit.client.0.smithi110.stdout:0/852: write d3/d4/dc/d14/d7e/d81/d89/fcb [987716,19377] 0 2024-09-16T02:06:18.033 INFO:tasks.workunit.client.0.smithi110.stdout:2/936: mkdir d0/db/d47/da1/dad/d10b/d144 0 2024-09-16T02:06:18.034 INFO:tasks.workunit.client.0.smithi110.stdout:1/919: link d0/d1/df2/d10f/d32/d40/cd9 d0/d25/c13a 0 2024-09-16T02:06:18.035 INFO:tasks.workunit.client.0.smithi110.stdout:2/937: truncate d0/d5f/dc0/ddc/ddd/d18/dc/dfd/f13e 870881 0 2024-09-16T02:06:18.039 INFO:tasks.workunit.client.0.smithi110.stdout:2/938: write d0/fc5 [557042,2375] 0 2024-09-16T02:06:18.042 INFO:tasks.workunit.client.0.smithi110.stdout:5/905: write d5/dd/df/d11/d6d/d11a/d6f/fcb [2144335,77279] 0 2024-09-16T02:06:18.043 INFO:tasks.workunit.client.0.smithi110.stdout:2/939: creat d0/d5f/dc0/ddc/f145 x:0 0 0 2024-09-16T02:06:18.046 INFO:tasks.workunit.client.0.smithi110.stdout:2/940: write d0/db/d105/d58/dec/d100/f103 [956415,100501] 0 2024-09-16T02:06:18.047 INFO:tasks.workunit.client.0.smithi110.stdout:5/906: link d5/dd/df/d11/d6d/d11a/d9c/f114 d5/d36/db5/f12c 0 2024-09-16T02:06:18.047 INFO:tasks.workunit.client.0.smithi110.stdout:2/941: dread - d0/db/d105/d39/f86 zero size 2024-09-16T02:06:18.047 INFO:tasks.workunit.client.0.smithi110.stdout:5/907: readlink d5/lce 0 2024-09-16T02:06:18.049 INFO:tasks.workunit.client.0.smithi110.stdout:5/908: stat d5/dd/df/d11/d6d/d11a/f93 0 2024-09-16T02:06:18.050 INFO:tasks.workunit.client.0.smithi110.stdout:5/909: fdatasync d5/f124 0 2024-09-16T02:06:18.050 INFO:tasks.workunit.client.0.smithi110.stdout:2/942: mkdir d0/d5f/dc0/ddc/ddd/d18/dc/dfd/d125/d146 0 2024-09-16T02:06:18.051 INFO:tasks.workunit.client.0.smithi110.stdout:0/853: dread d3/d4/dc/f49 [0,4194304] 0 2024-09-16T02:06:18.054 INFO:tasks.workunit.client.0.smithi110.stdout:5/910: dread d5/dd/df/d11/f50 [0,4194304] 0 2024-09-16T02:06:18.055 INFO:tasks.workunit.client.0.smithi110.stdout:0/854: stat d3/d6/d43/d55/d59/f88 0 2024-09-16T02:06:18.055 INFO:tasks.workunit.client.0.smithi110.stdout:2/943: dread d0/db/d47/d48/fc4 [0,4194304] 0 2024-09-16T02:06:18.056 INFO:tasks.workunit.client.0.smithi110.stdout:5/911: chown d5/dd/df/d11/d6d/d11a/lba 50770 1 2024-09-16T02:06:18.061 INFO:tasks.workunit.client.0.smithi110.stdout:2/944: rename d0/db/d47/f143 to d0/db/d47/da1/dad/d10b/f147 0 2024-09-16T02:06:18.064 INFO:tasks.workunit.client.0.smithi110.stdout:5/912: mknod d5/d36/d45/c12d 0 2024-09-16T02:06:18.068 INFO:tasks.workunit.client.0.smithi110.stdout:0/855: write d3/d6/d43/d55/d59/f9c [300169,80811] 0 2024-09-16T02:06:18.073 INFO:tasks.workunit.client.0.smithi110.stdout:2/945: creat d0/db/d105/d39/f148 x:0 0 0 2024-09-16T02:06:18.073 INFO:tasks.workunit.client.0.smithi110.stdout:5/913: creat d5/dd/f12e x:0 0 0 2024-09-16T02:06:18.073 INFO:tasks.workunit.client.0.smithi110.stdout:5/914: chown d5/f8c 59659 1 2024-09-16T02:06:18.073 INFO:tasks.workunit.client.0.smithi110.stdout:5/915: readlink d5/le 0 2024-09-16T02:06:18.073 INFO:tasks.workunit.client.0.smithi110.stdout:0/856: mknod d3/d92/c10f 0 2024-09-16T02:06:18.074 INFO:tasks.workunit.client.0.smithi110.stdout:2/946: read d0/db/f36 [6391314,57440] 0 2024-09-16T02:06:18.077 INFO:tasks.workunit.client.0.smithi110.stdout:2/947: creat d0/db/d47/da1/dad/dd5/f149 x:0 0 0 2024-09-16T02:06:18.078 INFO:tasks.workunit.client.0.smithi110.stdout:5/916: rename d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/c128 to d5/dd/df/d11/c12f 0 2024-09-16T02:06:18.078 INFO:tasks.workunit.client.0.smithi110.stdout:0/857: dread d3/d6/d43/d55/fa4 [0,4194304] 0 2024-09-16T02:06:18.080 INFO:tasks.workunit.client.0.smithi110.stdout:2/948: mkdir d0/db/d105/d39/d87/d120/d14a 0 2024-09-16T02:06:18.081 INFO:tasks.workunit.client.0.smithi110.stdout:2/949: chown d0/db/d105/d39/c3e 42579 1 2024-09-16T02:06:18.081 INFO:tasks.workunit.client.0.smithi110.stdout:0/858: rename d3/d4/dc/d70/d8b/db3/df1 to d3/d4/d41/d110 0 2024-09-16T02:06:18.082 INFO:tasks.workunit.client.0.smithi110.stdout:5/917: truncate d5/dd/df/d11/d6d/f74 478861 0 2024-09-16T02:06:18.084 INFO:tasks.workunit.client.0.smithi110.stdout:2/950: dread d0/f3 [4194304,4194304] 0 2024-09-16T02:06:18.093 INFO:tasks.workunit.client.0.smithi110.stdout:2/951: truncate d0/db/d47/d48/da0/ff2 1579628 0 2024-09-16T02:06:18.094 INFO:tasks.workunit.client.0.smithi110.stdout:2/952: write d0/db/d105/d41/fae [2550411,64195] 0 2024-09-16T02:06:18.095 INFO:tasks.workunit.client.0.smithi110.stdout:2/953: chown d0/db/d33/f6c 0 1 2024-09-16T02:06:18.095 INFO:tasks.workunit.client.0.smithi110.stdout:2/954: stat d0/c6e 0 2024-09-16T02:06:18.096 INFO:tasks.workunit.client.0.smithi110.stdout:5/918: write d5/d36/fc9 [4669212,12422] 0 2024-09-16T02:06:18.097 INFO:tasks.workunit.client.0.smithi110.stdout:0/859: write d3/d4/dc/d14/d7e/d81/f97 [772463,23631] 0 2024-09-16T02:06:18.097 INFO:tasks.workunit.client.0.smithi110.stdout:2/955: chown d0/db/d105/d41/fc1 66586592 1 2024-09-16T02:06:18.100 INFO:tasks.workunit.client.0.smithi110.stdout:0/860: mkdir d3/d4/dc/d75/d111 0 2024-09-16T02:06:18.102 INFO:tasks.workunit.client.0.smithi110.stdout:2/956: write d0/db/d105/d58/f82 [5120346,111598] 0 2024-09-16T02:06:18.105 INFO:tasks.workunit.client.0.smithi110.stdout:5/919: rename d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/f11c to d5/d71/d8f/de5/f130 0 2024-09-16T02:06:18.109 INFO:tasks.workunit.client.0.smithi110.stdout:5/920: symlink d5/d71/d89/l131 0 2024-09-16T02:06:18.111 INFO:tasks.workunit.client.0.smithi110.stdout:5/921: mkdir d5/d71/d89/d132 0 2024-09-16T02:06:18.115 INFO:tasks.workunit.client.0.smithi110.stdout:5/922: rename d5/d36/d3d/l4e to d5/dd/df/d11/d6d/d11a/d6f/d8e/l133 0 2024-09-16T02:06:18.116 INFO:tasks.workunit.client.0.smithi110.stdout:3/802: sync 2024-09-16T02:06:18.116 INFO:tasks.workunit.client.0.smithi110.stdout:7/696: sync 2024-09-16T02:06:18.116 INFO:tasks.workunit.client.0.smithi110.stdout:4/705: sync 2024-09-16T02:06:18.117 INFO:tasks.workunit.client.0.smithi110.stdout:5/923: truncate d5/f124 692426 0 2024-09-16T02:06:18.119 INFO:tasks.workunit.client.0.smithi110.stdout:4/706: chown d4/d8/d17/d23/d4c/d6d/d7f 7 1 2024-09-16T02:06:18.119 INFO:tasks.workunit.client.0.smithi110.stdout:7/697: fdatasync d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 0 2024-09-16T02:06:18.120 INFO:tasks.workunit.client.0.smithi110.stdout:3/803: mknod d8/d48/d5b/d92/dc7/d1b/d117/c121 0 2024-09-16T02:06:18.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/924: getdents d5/dd/df/d129 0 2024-09-16T02:06:18.123 INFO:tasks.workunit.client.0.smithi110.stdout:2/957: dwrite d0/db/f83 [0,4194304] 0 2024-09-16T02:06:18.123 INFO:tasks.workunit.client.0.smithi110.stdout:4/707: creat d4/d8/d31/d73/fe0 x:0 0 0 2024-09-16T02:06:18.125 INFO:tasks.workunit.client.0.smithi110.stdout:4/708: truncate d4/db4/d55/fde 646183 0 2024-09-16T02:06:18.130 INFO:tasks.workunit.client.0.smithi110.stdout:3/804: mknod d8/d48/d5b/d92/dc7/d1b/d36/d83/c122 0 2024-09-16T02:06:18.131 INFO:tasks.workunit.client.0.smithi110.stdout:7/698: getdents d3/d15/d38/d4f/d10/d11/d3e/dc5 0 2024-09-16T02:06:18.135 INFO:tasks.workunit.client.0.smithi110.stdout:5/925: truncate d5/d36/d3d/f4f 147909 0 2024-09-16T02:06:18.138 INFO:tasks.workunit.client.0.smithi110.stdout:2/958: mkdir d0/d5f/dc0/ddc/ddd/dfa/d3b/d14b 0 2024-09-16T02:06:18.138 INFO:tasks.workunit.client.0.smithi110.stdout:3/805: symlink d8/d29/l123 0 2024-09-16T02:06:18.138 INFO:tasks.workunit.client.0.smithi110.stdout:2/959: chown d0/c6e 114 1 2024-09-16T02:06:18.145 INFO:tasks.workunit.client.0.smithi110.stdout:2/960: creat d0/db/d105/d39/d87/d120/f14c x:0 0 0 2024-09-16T02:06:18.146 INFO:tasks.workunit.client.0.smithi110.stdout:4/709: dwrite d4/d8/d17/d23/d35/f9b [0,4194304] 0 2024-09-16T02:06:18.151 INFO:tasks.workunit.client.0.smithi110.stdout:7/699: mkdir d3/d15/d38/d4f/d10/dd9 0 2024-09-16T02:06:18.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/700: write d3/d15/d3a/fc6 [4387457,123582] 0 2024-09-16T02:06:18.160 INFO:tasks.workunit.client.0.smithi110.stdout:3/806: dread d8/d48/d5b/d92/dc7/d1b/d36/f37 [0,4194304] 0 2024-09-16T02:06:18.162 INFO:tasks.workunit.client.0.smithi110.stdout:5/926: creat d5/d36/d45/f134 x:0 0 0 2024-09-16T02:06:18.163 INFO:tasks.workunit.client.0.smithi110.stdout:2/961: creat d0/db/d47/da1/dad/d10b/d144/f14d x:0 0 0 2024-09-16T02:06:18.166 INFO:tasks.workunit.client.0.smithi110.stdout:3/807: truncate d8/d29/f74 1042925 0 2024-09-16T02:06:18.169 INFO:tasks.workunit.client.0.smithi110.stdout:4/710: link d4/d8/d31/d80/d18/lb3 d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/le1 0 2024-09-16T02:06:18.170 INFO:tasks.workunit.client.0.smithi110.stdout:3/808: write f7 [1156478,17939] 0 2024-09-16T02:06:18.173 INFO:tasks.workunit.client.0.smithi110.stdout:2/962: mknod d0/db/d105/d39/d87/d120/d14a/c14e 0 2024-09-16T02:06:18.174 INFO:tasks.workunit.client.0.smithi110.stdout:4/711: creat d4/d8/d17/d23/d4c/da5/fe2 x:0 0 0 2024-09-16T02:06:18.176 INFO:tasks.workunit.client.0.smithi110.stdout:5/927: write d5/d36/f64 [327507,107581] 0 2024-09-16T02:06:18.179 INFO:tasks.workunit.client.0.smithi110.stdout:2/963: creat d0/db/d47/da1/dad/dd5/f14f x:0 0 0 2024-09-16T02:06:18.181 INFO:tasks.workunit.client.0.smithi110.stdout:2/964: stat d0/db/d105/d58/f102 0 2024-09-16T02:06:18.181 INFO:tasks.workunit.client.0.smithi110.stdout:5/928: symlink d5/dd/df/d11/d6d/l135 0 2024-09-16T02:06:18.182 INFO:tasks.workunit.client.0.smithi110.stdout:4/712: dwrite d4/d8/d31/fd3 [0,4194304] 0 2024-09-16T02:06:18.183 INFO:tasks.workunit.client.0.smithi110.stdout:3/809: link d8/f51 d8/d48/d7c/d87/f124 0 2024-09-16T02:06:18.184 INFO:tasks.workunit.client.0.smithi110.stdout:2/965: fsync d0/d5f/dc0/ddc/ddd/f2c 0 2024-09-16T02:06:18.186 INFO:tasks.workunit.client.0.smithi110.stdout:2/966: fdatasync d0/db/d47/da1/dad/dd5/f133 0 2024-09-16T02:06:18.186 INFO:tasks.workunit.client.0.smithi110.stdout:5/929: creat d5/dd/d90/d108/f136 x:0 0 0 2024-09-16T02:06:18.193 INFO:tasks.workunit.client.0.smithi110.stdout:4/713: dread d4/d8/d17/d23/d4c/d6d/d4f/f69 [0,4194304] 0 2024-09-16T02:06:18.194 INFO:tasks.workunit.client.0.smithi110.stdout:4/714: chown d4/d8/d17/fa1 78821 1 2024-09-16T02:06:18.196 INFO:tasks.workunit.client.0.smithi110.stdout:5/930: read d5/f7f [768380,5651] 0 2024-09-16T02:06:18.197 INFO:tasks.workunit.client.0.smithi110.stdout:3/810: dread d8/d48/d5b/d92/dc7/d1b/d36/fc1 [0,4194304] 0 2024-09-16T02:06:18.198 INFO:tasks.workunit.client.0.smithi110.stdout:2/967: mknod d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/c150 0 2024-09-16T02:06:18.204 INFO:tasks.workunit.client.0.smithi110.stdout:3/811: dwrite d8/d48/d5b/d92/dc7/d1b/fa2 [0,4194304] 0 2024-09-16T02:06:18.206 INFO:tasks.workunit.client.0.smithi110.stdout:4/715: write d4/f14 [388235,50144] 0 2024-09-16T02:06:18.209 INFO:tasks.workunit.client.0.smithi110.stdout:5/931: truncate d5/dd/df/d11/d6d/d11a/f6b 1161526 0 2024-09-16T02:06:18.210 INFO:tasks.workunit.client.0.smithi110.stdout:3/812: truncate d8/d29/dbd/dc6/f82 623867 0 2024-09-16T02:06:18.220 INFO:tasks.workunit.client.0.smithi110.stdout:2/968: link d0/d5f/dc0/ddc/ddd/d18/c7d d0/d5f/dc0/ddc/ddd/dfa/d3b/daf/c151 0 2024-09-16T02:06:18.222 INFO:tasks.workunit.client.0.smithi110.stdout:2/969: dread d0/db/d105/d41/db3/db8/fc3 [0,4194304] 0 2024-09-16T02:06:18.223 INFO:tasks.workunit.client.0.smithi110.stdout:5/932: getdents d5/dd/d90/df6 0 2024-09-16T02:06:18.226 INFO:tasks.workunit.client.0.smithi110.stdout:3/813: write d8/d48/d5b/d92/dc7/f11 [4026814,54177] 0 2024-09-16T02:06:18.230 INFO:tasks.workunit.client.0.smithi110.stdout:5/933: creat d5/dd/df/d11/d6d/f137 x:0 0 0 2024-09-16T02:06:18.231 INFO:tasks.workunit.client.0.smithi110.stdout:4/716: dread d4/f21 [0,4194304] 0 2024-09-16T02:06:18.233 INFO:tasks.workunit.client.0.smithi110.stdout:3/814: mknod d8/d48/d5b/d92/dc7/d1b/d36/c125 0 2024-09-16T02:06:18.235 INFO:tasks.workunit.client.0.smithi110.stdout:3/815: chown d8/d48/d5b/d92/dc7/d1b/d3a/lbf 0 1 2024-09-16T02:06:18.236 INFO:tasks.workunit.client.0.smithi110.stdout:5/934: getdents d5/dd/d90 0 2024-09-16T02:06:18.239 INFO:tasks.workunit.client.0.smithi110.stdout:3/816: chown d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5/f6c 51 1 2024-09-16T02:06:18.239 INFO:tasks.workunit.client.0.smithi110.stdout:5/935: dread - d5/dd/df/d11/d6d/d11a/ff4 zero size 2024-09-16T02:06:18.240 INFO:tasks.workunit.client.0.smithi110.stdout:2/970: dread d0/db/d105/f66 [4194304,4194304] 0 2024-09-16T02:06:18.241 INFO:tasks.workunit.client.0.smithi110.stdout:4/717: dwrite d4/d8/d17/d23/d4c/da5/fe2 [0,4194304] 0 2024-09-16T02:06:18.242 INFO:tasks.workunit.client.0.smithi110.stdout:2/971: chown d0/db/d105/d39/l77 3541 1 2024-09-16T02:06:18.243 INFO:tasks.workunit.client.0.smithi110.stdout:4/718: chown d4/d8/d17/d23/f70 6771501 1 2024-09-16T02:06:18.247 INFO:tasks.workunit.client.0.smithi110.stdout:3/817: mknod d8/d48/d5b/d6a/def/c126 0 2024-09-16T02:06:18.249 INFO:tasks.workunit.client.0.smithi110.stdout:4/719: readlink d4/d8/d31/d73/la7 0 2024-09-16T02:06:18.250 INFO:tasks.workunit.client.0.smithi110.stdout:3/818: fdatasync d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/fec 0 2024-09-16T02:06:18.252 INFO:tasks.workunit.client.0.smithi110.stdout:2/972: mknod d0/db/d105/d41/db3/db8/de1/c152 0 2024-09-16T02:06:18.254 INFO:tasks.workunit.client.0.smithi110.stdout:5/936: dwrite d5/d71/f81 [0,4194304] 0 2024-09-16T02:06:18.257 INFO:tasks.workunit.client.0.smithi110.stdout:4/720: dread d4/d8/d31/fd3 [0,4194304] 0 2024-09-16T02:06:18.257 INFO:tasks.workunit.client.0.smithi110.stdout:4/721: readlink d4/d8/d31/d80/d90/lb1 0 2024-09-16T02:06:18.258 INFO:tasks.workunit.client.0.smithi110.stdout:2/973: creat d0/d5f/dc0/d10f/d128/f153 x:0 0 0 2024-09-16T02:06:18.264 INFO:tasks.workunit.client.0.smithi110.stdout:4/722: mknod d4/d8/d17/d23/d4c/d6d/d3c/ce3 0 2024-09-16T02:06:18.264 INFO:tasks.workunit.client.0.smithi110.stdout:2/974: creat d0/db/d105/d41/db3/db8/d13a/f154 x:0 0 0 2024-09-16T02:06:18.267 INFO:tasks.workunit.client.0.smithi110.stdout:5/937: write d5/d36/d3d/f79 [3351216,58026] 0 2024-09-16T02:06:18.268 INFO:tasks.workunit.client.0.smithi110.stdout:3/819: truncate d8/d29/d45/f5f 4284287 0 2024-09-16T02:06:18.268 INFO:tasks.workunit.client.0.smithi110.stdout:2/975: truncate d0/db/d105/f4a 824891 0 2024-09-16T02:06:18.269 INFO:tasks.workunit.client.0.smithi110.stdout:2/976: chown d0/db/d47 43497729 1 2024-09-16T02:06:18.270 INFO:tasks.workunit.client.0.smithi110.stdout:3/820: creat d8/d48/d7c/d87/da9/f127 x:0 0 0 2024-09-16T02:06:18.271 INFO:tasks.workunit.client.0.smithi110.stdout:2/977: chown d0/db/d105/d41/db3/db8/de1/c152 987810 1 2024-09-16T02:06:18.273 INFO:tasks.workunit.client.0.smithi110.stdout:5/938: read d5/d36/d45/d47/f88 [5511545,36132] 0 2024-09-16T02:06:18.277 INFO:tasks.workunit.client.0.smithi110.stdout:3/821: dread d8/d48/d5b/d92/dc7/d1b/fb1 [0,4194304] 0 2024-09-16T02:06:18.278 INFO:tasks.workunit.client.0.smithi110.stdout:3/822: mknod d8/d48/c128 0 2024-09-16T02:06:18.279 INFO:tasks.workunit.client.0.smithi110.stdout:4/723: dwrite d4/fac [0,4194304] 0 2024-09-16T02:06:18.279 INFO:tasks.workunit.client.0.smithi110.stdout:3/823: chown d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5 128 1 2024-09-16T02:06:18.281 INFO:tasks.workunit.client.0.smithi110.stdout:3/824: write d8/d29/dbd/dc6/ffa [983268,17740] 0 2024-09-16T02:06:18.285 INFO:tasks.workunit.client.0.smithi110.stdout:8/692: sync 2024-09-16T02:06:18.285 INFO:tasks.workunit.client.0.smithi110.stdout:6/859: sync 2024-09-16T02:06:18.287 INFO:tasks.workunit.client.0.smithi110.stdout:3/825: mkdir d8/d48/d5b/d92/dc7/d1b/d36/d83/d108/d129 0 2024-09-16T02:06:18.288 INFO:tasks.workunit.client.0.smithi110.stdout:3/826: readlink d8/d29/dbd/l11f 0 2024-09-16T02:06:18.289 INFO:tasks.workunit.client.0.smithi110.stdout:8/693: stat d3/d2b/d27/da7/d1a/d36/d60/cc4 0 2024-09-16T02:06:18.294 INFO:tasks.workunit.client.0.smithi110.stdout:4/724: getdents d4/d8/d17/d23/d4c/d6d/dc6 0 2024-09-16T02:06:18.297 INFO:tasks.workunit.client.0.smithi110.stdout:8/694: unlink d3/d2b/d27/da7/d1a/de9/l4e 0 2024-09-16T02:06:18.300 INFO:tasks.workunit.client.0.smithi110.stdout:4/725: dwrite d4/f11 [4194304,4194304] 0 2024-09-16T02:06:18.335 INFO:tasks.workunit.client.0.smithi110.stdout:6/860: write d0/d2/f69 [324663,85920] 0 2024-09-16T02:06:18.336 INFO:tasks.workunit.client.0.smithi110.stdout:8/695: rename d3/d2b/d27/f47 to d3/d2b/d27/da7/dc7/ff0 0 2024-09-16T02:06:18.342 INFO:tasks.workunit.client.0.smithi110.stdout:3/827: dwrite d8/d48/d5b/d92/dc7/f2b [0,4194304] 0 2024-09-16T02:06:18.375 INFO:tasks.workunit.client.0.smithi110.stdout:6/861: write d0/d2/f8d [3197261,100364] 0 2024-09-16T02:06:18.384 INFO:tasks.workunit.client.0.smithi110.stdout:8/696: dwrite d3/d2b/d27/da7/d1a/d36/f4f [4194304,4194304] 0 2024-09-16T02:06:18.388 INFO:tasks.workunit.client.0.smithi110.stdout:4/726: creat d4/d8/d17/d23/d4c/fe4 x:0 0 0 2024-09-16T02:06:18.388 INFO:tasks.workunit.client.0.smithi110.stdout:3/828: dwrite d8/d29/f96 [0,4194304] 0 2024-09-16T02:06:18.389 INFO:tasks.workunit.client.0.smithi110.stdout:8/697: creat d3/d2b/d27/da7/d1a/d36/d60/d83/ff1 x:0 0 0 2024-09-16T02:06:18.391 INFO:tasks.workunit.client.0.smithi110.stdout:4/727: creat d4/d8/d17/d23/d35/fe5 x:0 0 0 2024-09-16T02:06:18.396 INFO:tasks.workunit.client.0.smithi110.stdout:4/728: creat d4/d8/d17/d23/d35/fe6 x:0 0 0 2024-09-16T02:06:18.404 INFO:tasks.workunit.client.0.smithi110.stdout:8/698: dread d3/d2b/d27/da7/d1a/d36/d60/f64 [0,4194304] 0 2024-09-16T02:06:18.409 INFO:tasks.workunit.client.0.smithi110.stdout:4/729: dread d4/f15 [0,4194304] 0 2024-09-16T02:06:18.414 INFO:tasks.workunit.client.0.smithi110.stdout:6/862: write d0/d2/d5/d84/d16/f33 [739339,15518] 0 2024-09-16T02:06:18.416 INFO:tasks.workunit.client.0.smithi110.stdout:6/863: creat d0/d2/d57/d75/de7/df5/f10b x:0 0 0 2024-09-16T02:06:18.418 INFO:tasks.workunit.client.0.smithi110.stdout:4/730: unlink d4/d8/c8d 0 2024-09-16T02:06:18.420 INFO:tasks.workunit.client.0.smithi110.stdout:4/731: symlink d4/d8/d31/d80/le7 0 2024-09-16T02:06:18.421 INFO:tasks.workunit.client.0.smithi110.stdout:3/829: truncate d8/d29/d45/f68 3099785 0 2024-09-16T02:06:18.422 INFO:tasks.workunit.client.0.smithi110.stdout:6/864: dwrite d0/d29/d2a/fb9 [0,4194304] 0 2024-09-16T02:06:18.428 INFO:tasks.workunit.client.0.smithi110.stdout:3/830: dread d8/d48/d5b/d92/dc7/d1b/fa2 [0,4194304] 0 2024-09-16T02:06:18.428 INFO:tasks.workunit.client.0.smithi110.stdout:8/699: write d3/d2b/d27/d45/d66/d6b/fb0 [827999,77010] 0 2024-09-16T02:06:18.430 INFO:tasks.workunit.client.0.smithi110.stdout:3/831: write d8/d29/d45/f11b [986540,23816] 0 2024-09-16T02:06:18.431 INFO:tasks.workunit.client.0.smithi110.stdout:4/732: link d4/d8/d17/fa1 d4/d8/d31/d80/d18/fe8 0 2024-09-16T02:06:18.432 INFO:tasks.workunit.client.0.smithi110.stdout:3/832: dread - d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/de6/f103 zero size 2024-09-16T02:06:18.437 INFO:tasks.workunit.client.0.smithi110.stdout:4/733: mknod d4/d8/d17/d23/d4c/d6d/d4f/ce9 0 2024-09-16T02:06:18.438 INFO:tasks.workunit.client.0.smithi110.stdout:6/865: link d0/l9b d0/d2/d5/db8/dd1/l10c 0 2024-09-16T02:06:18.438 INFO:tasks.workunit.client.0.smithi110.stdout:4/734: write d4/d8/d17/d23/d35/f42 [921708,23612] 0 2024-09-16T02:06:18.441 INFO:tasks.workunit.client.0.smithi110.stdout:3/833: rename d8/d29/dbd/f26 to d8/d48/d5b/d92/dc7/d1b/f12a 0 2024-09-16T02:06:18.443 INFO:tasks.workunit.client.0.smithi110.stdout:8/700: unlink d3/c5 0 2024-09-16T02:06:18.443 INFO:tasks.workunit.client.0.smithi110.stdout:3/834: write d8/d48/d5b/d92/dc7/f21 [3149282,986] 0 2024-09-16T02:06:18.446 INFO:tasks.workunit.client.0.smithi110.stdout:4/735: symlink d4/d8/d17/d23/d4c/d6d/d7f/lea 0 2024-09-16T02:06:18.450 INFO:tasks.workunit.client.0.smithi110.stdout:3/835: creat d8/d48/d7c/d87/f12b x:0 0 0 2024-09-16T02:06:18.452 INFO:tasks.workunit.client.0.smithi110.stdout:8/701: rename d3/d2b/d65/f9d to d3/d2b/d27/da7/d1a/d36/d60/d83/ff2 0 2024-09-16T02:06:18.454 INFO:tasks.workunit.client.0.smithi110.stdout:3/836: dread d8/d48/d5b/d6a/fb2 [0,4194304] 0 2024-09-16T02:06:18.455 INFO:tasks.workunit.client.0.smithi110.stdout:3/837: truncate d8/fff 454719 0 2024-09-16T02:06:18.455 INFO:tasks.workunit.client.0.smithi110.stdout:3/838: readlink d8/d48/d5b/d92/l78 0 2024-09-16T02:06:18.456 INFO:tasks.workunit.client.0.smithi110.stdout:3/839: truncate d8/ff5 341304 0 2024-09-16T02:06:18.458 INFO:tasks.workunit.client.0.smithi110.stdout:6/866: write d0/d29/d2a/d2d/fce [1124246,109003] 0 2024-09-16T02:06:18.459 INFO:tasks.workunit.client.0.smithi110.stdout:3/840: read - d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/dc3/de6/f103 zero size 2024-09-16T02:06:18.464 INFO:tasks.workunit.client.0.smithi110.stdout:4/736: dread d4/d8/d31/f39 [0,4194304] 0 2024-09-16T02:06:18.464 INFO:tasks.workunit.client.0.smithi110.stdout:8/702: creat d3/d2b/d27/da7/d1a/d6c/ff3 x:0 0 0 2024-09-16T02:06:18.465 INFO:tasks.workunit.client.0.smithi110.stdout:8/703: chown d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/cea 855276652 1 2024-09-16T02:06:18.466 INFO:tasks.workunit.client.0.smithi110.stdout:6/867: readlink d0/d29/d2a/d2d/daa/lb1 0 2024-09-16T02:06:18.469 INFO:tasks.workunit.client.0.smithi110.stdout:4/737: creat d4/d8/d17/feb x:0 0 0 2024-09-16T02:06:18.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/738: creat d4/d8/d17/d23/d4c/d6d/d3c/d3d/fec x:0 0 0 2024-09-16T02:06:18.481 INFO:tasks.workunit.client.0.smithi110.stdout:3/841: getdents d8/d48/d5b/d6a/d75/d88 0 2024-09-16T02:06:18.481 INFO:tasks.workunit.client.0.smithi110.stdout:3/842: readlink d8/d29/dbd/l11f 0 2024-09-16T02:06:18.482 INFO:tasks.workunit.client.0.smithi110.stdout:8/704: link d3/c30 d3/d2b/d27/d45/d86/cf4 0 2024-09-16T02:06:18.483 INFO:tasks.workunit.client.0.smithi110.stdout:6/868: getdents d0/d29/d2a/d2d/daa 0 2024-09-16T02:06:18.486 INFO:tasks.workunit.client.0.smithi110.stdout:4/739: rename d4/d8/c1d to d4/ced 0 2024-09-16T02:06:18.488 INFO:tasks.workunit.client.0.smithi110.stdout:8/705: symlink d3/d2b/d27/da7/d1a/d36/d60/d62/lf5 0 2024-09-16T02:06:18.489 INFO:tasks.workunit.client.0.smithi110.stdout:6/869: creat d0/d29/d2a/f10d x:0 0 0 2024-09-16T02:06:18.492 INFO:tasks.workunit.client.0.smithi110.stdout:3/843: dread d8/d48/d5b/d92/f81 [0,4194304] 0 2024-09-16T02:06:18.492 INFO:tasks.workunit.client.0.smithi110.stdout:6/870: mkdir d0/d29/d2a/d2f/d34/d10e 0 2024-09-16T02:06:18.493 INFO:tasks.workunit.client.0.smithi110.stdout:6/871: chown d0/d2/d57/d75/df0 2236 1 2024-09-16T02:06:18.494 INFO:tasks.workunit.client.0.smithi110.stdout:4/740: symlink d4/d8/lee 0 2024-09-16T02:06:18.498 INFO:tasks.workunit.client.0.smithi110.stdout:3/844: rename d8/d29/dbd/dc6/dd3 to d8/d48/d7c/d87/d12c 0 2024-09-16T02:06:18.500 INFO:tasks.workunit.client.0.smithi110.stdout:3/845: truncate d8/d48/d5b/d92/dc7/d1b/d3a/d43/da5/f116 256414 0 2024-09-16T02:06:18.502 INFO:tasks.workunit.client.0.smithi110.stdout:8/706: write d3/d2b/d27/da7/d1a/d36/d60/f81 [532797,71511] 0 2024-09-16T02:06:18.502 INFO:tasks.workunit.client.0.smithi110.stdout:4/741: mkdir d4/dd6/def 0 2024-09-16T02:06:18.506 INFO:tasks.workunit.client.0.smithi110.stdout:6/872: dwrite d0/d2/f14 [0,4194304] 0 2024-09-16T02:06:18.511 INFO:tasks.workunit.client.0.smithi110.stdout:4/742: rename d4/fac to d4/d8/d17/d23/d4c/da5/ff0 0 2024-09-16T02:06:18.513 INFO:tasks.workunit.client.0.smithi110.stdout:4/743: read - d4/d8/d17/d23/d4c/d6d/d3c/fdb zero size 2024-09-16T02:06:18.513 INFO:tasks.workunit.client.0.smithi110.stdout:3/846: dwrite d8/d48/d5b/d92/dc7/d1b/f24 [0,4194304] 0 2024-09-16T02:06:18.514 INFO:tasks.workunit.client.0.smithi110.stdout:8/707: creat d3/d2b/d27/da7/d1a/d36/d60/ff6 x:0 0 0 2024-09-16T02:06:18.516 INFO:tasks.workunit.client.0.smithi110.stdout:6/873: mkdir d0/d2/d57/d75/ded/d10f 0 2024-09-16T02:06:18.652 INFO:tasks.workunit.client.0.smithi110.stdout:4/744: unlink d4/d8/d17/d23/d4c/d6d/d3c/d3d/fec 0 2024-09-16T02:06:18.652 INFO:tasks.workunit.client.0.smithi110.stdout:3/847: rename d8/d48/d5b/d92/dc7/f84 to d8/d29/d102/f12d 0 2024-09-16T02:06:18.657 INFO:tasks.workunit.client.0.smithi110.stdout:6/874: dread d0/d2/d18/d1d/fd4 [0,4194304] 0 2024-09-16T02:06:18.657 INFO:tasks.workunit.client.0.smithi110.stdout:6/875: chown d0/d2/d5/db8/dd1/f102 2 1 2024-09-16T02:06:18.658 INFO:tasks.workunit.client.0.smithi110.stdout:3/848: rename d8/d48/d5b/d92/l78 to d8/d48/d5b/d92/dc7/d1b/d3a/d43/l12e 0 2024-09-16T02:06:18.716 INFO:tasks.workunit.client.0.smithi110.stdout:6/876: truncate d0/d29/d2a/d2f/f5f 2400588 0 2024-09-16T02:06:18.716 INFO:tasks.workunit.client.0.smithi110.stdout:4/745: creat d4/d8/d17/d23/d4c/d6d/d3c/ff1 x:0 0 0 2024-09-16T02:06:18.725 INFO:tasks.workunit.client.0.smithi110.stdout:4/746: dwrite d4/d8/d17/d23/d4c/d6d/d4f/f69 [0,4194304] 0 2024-09-16T02:06:18.727 INFO:tasks.workunit.client.0.smithi110.stdout:6/877: dwrite d0/d29/f3f [0,4194304] 0 2024-09-16T02:06:18.727 INFO:tasks.workunit.client.0.smithi110.stdout:3/849: dwrite d8/d48/d5b/d92/f49 [0,4194304] 0 2024-09-16T02:06:18.735 INFO:tasks.workunit.client.0.smithi110.stdout:3/850: mknod d8/d48/d5b/d92/dc7/d1b/d36/d83/c12f 0 2024-09-16T02:06:18.736 INFO:tasks.workunit.client.0.smithi110.stdout:4/747: dwrite d4/db4/d55/fde [0,4194304] 0 2024-09-16T02:06:18.736 INFO:tasks.workunit.client.0.smithi110.stdout:6/878: mknod d0/d2/d5/d94/dba/dde/c110 0 2024-09-16T02:06:18.744 INFO:tasks.workunit.client.0.smithi110.stdout:6/879: creat d0/d2/d5/d55/f111 x:0 0 0 2024-09-16T02:06:18.745 INFO:tasks.workunit.client.0.smithi110.stdout:6/880: fsync d0/d2/f8d 0 2024-09-16T02:06:18.746 INFO:tasks.workunit.client.0.smithi110.stdout:6/881: chown d0/d29/f32 85163 1 2024-09-16T02:06:18.747 INFO:tasks.workunit.client.0.smithi110.stdout:3/851: link d8/d29/dbd/dc6/f10d d8/d48/d5b/d6a/def/f130 0 2024-09-16T02:06:18.752 INFO:tasks.workunit.client.0.smithi110.stdout:4/748: truncate d4/d8/d17/d23/f9e 3744131 0 2024-09-16T02:06:18.759 INFO:tasks.workunit.client.0.smithi110.stdout:4/749: dread d4/d8/d17/d23/f70 [0,4194304] 0 2024-09-16T02:06:18.764 INFO:tasks.workunit.client.0.smithi110.stdout:3/852: getdents d8 0 2024-09-16T02:06:18.764 INFO:tasks.workunit.client.0.smithi110.stdout:6/882: dread d0/d2/d5/d84/f4b [0,4194304] 0 2024-09-16T02:06:18.764 INFO:tasks.workunit.client.0.smithi110.stdout:4/750: fdatasync d4/d8/f67 0 2024-09-16T02:06:18.767 INFO:tasks.workunit.client.0.smithi110.stdout:4/751: creat d4/db4/ff2 x:0 0 0 2024-09-16T02:06:18.773 INFO:tasks.workunit.client.0.smithi110.stdout:3/853: creat d8/d48/d5b/d92/dc7/d1b/d3a/f131 x:0 0 0 2024-09-16T02:06:18.773 INFO:tasks.workunit.client.0.smithi110.stdout:6/883: link d0/d29/d2a/l77 d0/d29/d2a/d2d/daa/l112 0 2024-09-16T02:06:18.775 INFO:tasks.workunit.client.0.smithi110.stdout:4/752: rmdir d4/d8/d31/d6f/d93/dc5 0 2024-09-16T02:06:18.777 INFO:tasks.workunit.client.0.smithi110.stdout:6/884: mkdir d0/d2/d5/d1e/d48/d113 0 2024-09-16T02:06:18.781 INFO:tasks.workunit.client.0.smithi110.stdout:4/753: dwrite d4/d8/d17/d23/d4c/d6d/d4f/f69 [4194304,4194304] 0 2024-09-16T02:06:18.787 INFO:tasks.workunit.client.0.smithi110.stdout:3/854: write d8/f51 [724052,78408] 0 2024-09-16T02:06:18.790 INFO:tasks.workunit.client.0.smithi110.stdout:4/754: write d4/f15 [1352308,69389] 0 2024-09-16T02:06:18.792 INFO:tasks.workunit.client.0.smithi110.stdout:4/755: fsync d4/d8/d91/fc8 0 2024-09-16T02:06:18.795 INFO:tasks.workunit.client.0.smithi110.stdout:6/885: dwrite d0/d2/d57/d75/df0/fc5 [4194304,4194304] 0 2024-09-16T02:06:18.796 INFO:tasks.workunit.client.0.smithi110.stdout:4/756: mknod d4/d8/d17/d6b/d98/cf3 0 2024-09-16T02:06:18.797 INFO:tasks.workunit.client.0.smithi110.stdout:4/757: fsync d4/d8/d31/d80/faf 0 2024-09-16T02:06:18.800 INFO:tasks.workunit.client.0.smithi110.stdout:4/758: symlink d4/d8/d17/d23/d4c/d6d/d7f/lf4 0 2024-09-16T02:06:18.802 INFO:tasks.workunit.client.0.smithi110.stdout:3/855: write d8/d48/d5b/d92/dc7/d1b/d3a/f85 [983208,31993] 0 2024-09-16T02:06:18.802 INFO:tasks.workunit.client.0.smithi110.stdout:4/759: read - d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fce zero size 2024-09-16T02:06:18.808 INFO:tasks.workunit.client.0.smithi110.stdout:4/760: getdents d4/d8/d17/d23/d4c/d6d/d4f 0 2024-09-16T02:06:18.809 INFO:tasks.workunit.client.0.smithi110.stdout:4/761: chown d4/d8/d17/d23/d4c/f9f 126723574 1 2024-09-16T02:06:18.809 INFO:tasks.workunit.client.0.smithi110.stdout:4/762: chown d4/db4/dd0 13834740 1 2024-09-16T02:06:18.814 INFO:tasks.workunit.client.0.smithi110.stdout:4/763: dwrite d4/d8/d31/d6f/fae [0,4194304] 0 2024-09-16T02:06:18.816 INFO:tasks.workunit.client.0.smithi110.stdout:4/764: dread - d4/d8/d17/d23/d4c/d6d/d7f/f8a zero size 2024-09-16T02:06:18.822 INFO:tasks.workunit.client.0.smithi110.stdout:4/765: link d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 d4/d8/d17/d23/d61/ff5 0 2024-09-16T02:06:18.824 INFO:tasks.workunit.client.0.smithi110.stdout:4/766: unlink d4/d8/d31/d5d/fd8 0 2024-09-16T02:06:18.827 INFO:tasks.workunit.client.0.smithi110.stdout:4/767: mknod d4/d8/d17/d23/d4c/d6d/d3c/d3d/cf6 0 2024-09-16T02:06:18.838 INFO:tasks.workunit.client.0.smithi110.stdout:4/768: truncate d4/d8/d31/d6f/fae 1575542 0 2024-09-16T02:06:18.843 INFO:tasks.workunit.client.0.smithi110.stdout:4/769: write d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 [898322,42209] 0 2024-09-16T02:06:18.846 INFO:tasks.workunit.client.0.smithi110.stdout:4/770: creat d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/ff7 x:0 0 0 2024-09-16T02:06:18.848 INFO:tasks.workunit.client.0.smithi110.stdout:4/771: creat d4/d8/d31/d80/d18/ff8 x:0 0 0 2024-09-16T02:06:18.850 INFO:tasks.workunit.client.0.smithi110.stdout:4/772: creat d4/d8/d17/d6b/d98/ff9 x:0 0 0 2024-09-16T02:06:18.851 INFO:tasks.workunit.client.0.smithi110.stdout:4/773: read - d4/d8/d17/d23/d4c/d6d/d4f/fa2 zero size 2024-09-16T02:06:18.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/774: creat d4/d8/d17/d23/d4c/d6d/d4f/ffa x:0 0 0 2024-09-16T02:06:18.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/775: dread - d4/d8/d17/d23/d35/fe6 zero size 2024-09-16T02:06:18.867 INFO:tasks.workunit.client.0.smithi110.stdout:4/776: write f3 [2087406,71962] 0 2024-09-16T02:06:18.868 INFO:tasks.workunit.client.0.smithi110.stdout:4/777: stat d4/d8/d91/fc8 0 2024-09-16T02:06:18.875 INFO:tasks.workunit.client.0.smithi110.stdout:4/778: dwrite d4/d8/d17/d23/f4a [0,4194304] 0 2024-09-16T02:06:18.877 INFO:tasks.workunit.client.0.smithi110.stdout:4/779: truncate d4/d8/d31/d73/fe0 246156 0 2024-09-16T02:06:18.880 INFO:tasks.workunit.client.0.smithi110.stdout:4/780: creat d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/ffb x:0 0 0 2024-09-16T02:06:18.889 INFO:tasks.workunit.client.0.smithi110.stdout:9/825: sync 2024-09-16T02:06:18.896 INFO:tasks.workunit.client.0.smithi110.stdout:9/826: dwrite d1/dd/d6a/de7/ffb [0,4194304] 0 2024-09-16T02:06:18.898 INFO:tasks.workunit.client.0.smithi110.stdout:9/827: write d1/dd/d6a/de7/ffb [2259848,118009] 0 2024-09-16T02:06:18.901 INFO:tasks.workunit.client.0.smithi110.stdout:9/828: fsync d1/dd/d6a/d6c/d6f/d79/de/d1f/f4a 0 2024-09-16T02:06:18.913 INFO:tasks.workunit.client.0.smithi110.stdout:9/829: dwrite d1/d5/d20/d55/fab [0,4194304] 0 2024-09-16T02:06:18.919 INFO:tasks.workunit.client.0.smithi110.stdout:9/830: dread d1/d5/fb6 [0,4194304] 0 2024-09-16T02:06:18.921 INFO:tasks.workunit.client.0.smithi110.stdout:9/831: dread - d1/dd/d6a/d6c/d6f/d79/de/d1f/d103/f106 zero size 2024-09-16T02:06:18.923 INFO:tasks.workunit.client.0.smithi110.stdout:9/832: mknod d1/d1b/daa/ded/c11a 0 2024-09-16T02:06:18.932 INFO:tasks.workunit.client.0.smithi110.stdout:9/833: dwrite d1/fc [8388608,4194304] 0 2024-09-16T02:06:18.937 INFO:tasks.workunit.client.0.smithi110.stdout:9/834: getdents d1/d2b 0 2024-09-16T02:06:18.942 INFO:tasks.workunit.client.0.smithi110.stdout:9/835: truncate d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe5 694364 0 2024-09-16T02:06:18.943 INFO:tasks.workunit.client.0.smithi110.stdout:9/836: mknod d1/dd/d6a/d6c/d75/d86/c11b 0 2024-09-16T02:06:18.947 INFO:tasks.workunit.client.0.smithi110.stdout:9/837: rmdir d1/dd/d6a/d6c/d6f/d79/de/ddf 0 2024-09-16T02:06:18.961 INFO:tasks.workunit.client.0.smithi110.stdout:9/838: dwrite d1/dd/d6a/d6c/d6f/d79/d26/d8e/fe9 [0,4194304] 0 2024-09-16T02:06:18.963 INFO:tasks.workunit.client.0.smithi110.stdout:9/839: write d1/d5/d20/d83/f111 [500678,41048] 0 2024-09-16T02:06:18.964 INFO:tasks.workunit.client.0.smithi110.stdout:9/840: dread d1/d5/fb6 [0,4194304] 0 2024-09-16T02:06:18.967 INFO:tasks.workunit.client.0.smithi110.stdout:9/841: mknod d1/dd/d6a/d6c/d75/d8c/d38/d3d/c11c 0 2024-09-16T02:06:18.969 INFO:tasks.workunit.client.0.smithi110.stdout:9/842: creat d1/dd/d6a/f11d x:0 0 0 2024-09-16T02:06:18.971 INFO:tasks.workunit.client.0.smithi110.stdout:9/843: rmdir d1/d1b/daa 39 2024-09-16T02:06:18.973 INFO:tasks.workunit.client.0.smithi110.stdout:9/844: unlink d1/dd/d6a/d6c/d9b/f10d 0 2024-09-16T02:06:18.975 INFO:tasks.workunit.client.0.smithi110.stdout:9/845: dread - d1/dd/d6a/d6c/d6f/d79/de/d94/ffe zero size 2024-09-16T02:06:18.984 INFO:tasks.workunit.client.0.smithi110.stdout:9/846: dread d1/d1b/f22 [0,4194304] 0 2024-09-16T02:06:19.000 INFO:tasks.workunit.client.0.smithi110.stdout:9/847: rename d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/l9e to d1/d5/d20/l11e 0 2024-09-16T02:06:19.002 INFO:tasks.workunit.client.0.smithi110.stdout:9/848: chown d1/dd/d6a/d6c/d75/d8c/d38/d3d/c91 7162 1 2024-09-16T02:06:19.003 INFO:tasks.workunit.client.0.smithi110.stdout:9/849: readlink d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd/lee 0 2024-09-16T02:06:19.009 INFO:tasks.workunit.client.0.smithi110.stdout:9/850: link d1/dd/d6a/d6c/d6f/d79/de/d1f/la0 d1/d5/l11f 0 2024-09-16T02:06:19.021 INFO:tasks.workunit.client.0.smithi110.stdout:9/851: write d1/dd/d6a/d6c/d6f/fdb [452536,9141] 0 2024-09-16T02:06:19.023 INFO:tasks.workunit.client.0.smithi110.stdout:9/852: dread - d1/d5/d20/fbe zero size 2024-09-16T02:06:19.028 INFO:tasks.workunit.client.0.smithi110.stdout:9/853: rename d1/d1b/d23/f4c to d1/dd/d6a/d6c/d75/d8c/d38/d3d/f120 0 2024-09-16T02:06:19.039 INFO:tasks.workunit.client.0.smithi110.stdout:9/854: dread d1/d1b/faf [0,4194304] 0 2024-09-16T02:06:19.040 INFO:tasks.workunit.client.0.smithi110.stdout:9/855: fdatasync d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe3 0 2024-09-16T02:06:19.042 INFO:tasks.workunit.client.0.smithi110.stdout:9/856: fdatasync d1/dd/f104 0 2024-09-16T02:06:19.046 INFO:tasks.workunit.client.0.smithi110.stdout:9/857: creat d1/d1b/d23/d7c/f121 x:0 0 0 2024-09-16T02:06:19.049 INFO:tasks.workunit.client.0.smithi110.stdout:9/858: fdatasync d1/dd/d6a/d6c/d75/d86/f101 0 2024-09-16T02:06:19.056 INFO:tasks.workunit.client.0.smithi110.stdout:9/859: getdents d1/d5/d20/d55/d82 0 2024-09-16T02:06:19.060 INFO:tasks.workunit.client.0.smithi110.stdout:9/860: truncate d1/dd/f58 5401174 0 2024-09-16T02:06:19.077 INFO:tasks.workunit.client.0.smithi110.stdout:9/861: dread d1/dd/d6a/d6c/d6f/d79/f40 [0,4194304] 0 2024-09-16T02:06:19.086 INFO:tasks.workunit.client.0.smithi110.stdout:9/862: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/fc5 [0,4194304] 0 2024-09-16T02:06:19.088 INFO:tasks.workunit.client.0.smithi110.stdout:9/863: truncate d1/d1b/faf 2068157 0 2024-09-16T02:06:19.093 INFO:tasks.workunit.client.0.smithi110.stdout:9/864: rename d1/dd/d6a/d6c/d75/d86/fc2 to d1/dd/d6a/d6c/d6f/d79/de/d1f/d103/f122 0 2024-09-16T02:06:19.097 INFO:tasks.workunit.client.0.smithi110.stdout:9/865: symlink d1/dd/d6a/d6c/d6f/d79/de/d1f/d103/l123 0 2024-09-16T02:06:19.097 INFO:tasks.workunit.client.0.smithi110.stdout:9/866: symlink d1/dd/d6a/d6c/d6f/l124 0 2024-09-16T02:06:19.099 INFO:tasks.workunit.client.0.smithi110.stdout:9/867: creat d1/d1b/df0/f125 x:0 0 0 2024-09-16T02:06:19.104 INFO:tasks.workunit.client.0.smithi110.stdout:9/868: rename d1/dd/d6a/d6c/d6f/d79/d26/l64 to d1/dd/d6a/d6c/d6f/d79/d29/db4/l126 0 2024-09-16T02:06:19.105 INFO:tasks.workunit.client.0.smithi110.stdout:9/869: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/f127 x:0 0 0 2024-09-16T02:06:19.111 INFO:tasks.workunit.client.0.smithi110.stdout:9/870: read d1/dd/d6a/d6c/d75/d8c/d38/d3d/f4e [3532928,19997] 0 2024-09-16T02:06:19.114 INFO:tasks.workunit.client.0.smithi110.stdout:9/871: rename d1/dd/d6a/d6c/d9b/cb5 to d1/dd/d6a/de7/c128 0 2024-09-16T02:06:19.122 INFO:tasks.workunit.client.0.smithi110.stdout:9/872: write d1/dd/d6a/d6c/d6f/d79/d26/f92 [120371,98026] 0 2024-09-16T02:06:19.124 INFO:tasks.workunit.client.0.smithi110.stdout:9/873: fdatasync d1/d5/d20/d83/f102 0 2024-09-16T02:06:19.138 INFO:tasks.workunit.client.0.smithi110.stdout:9/874: dread d1/d2b/fe1 [0,4194304] 0 2024-09-16T02:06:19.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:18 smithi165 ceph-mon[34621]: pgmap v33: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 43 MiB/s rd, 94 MiB/s wr, 270 op/s 2024-09-16T02:06:19.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:19.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:18 smithi110 ceph-mon[27634]: pgmap v33: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 43 MiB/s rd, 94 MiB/s wr, 270 op/s 2024-09-16T02:06:19.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:19.221 INFO:tasks.workunit.client.0.smithi110.stdout:7/701: sync 2024-09-16T02:06:19.222 INFO:tasks.workunit.client.0.smithi110.stdout:0/861: sync 2024-09-16T02:06:19.222 INFO:tasks.workunit.client.0.smithi110.stdout:5/939: sync 2024-09-16T02:06:19.222 INFO:tasks.workunit.client.0.smithi110.stdout:1/920: sync 2024-09-16T02:06:19.223 INFO:tasks.workunit.client.0.smithi110.stdout:7/702: dread - d3/d15/d38/d4f/d10/d11/d3e/dd5/fa7 zero size 2024-09-16T02:06:19.224 INFO:tasks.workunit.client.0.smithi110.stdout:7/703: read - d3/d7a/fcd zero size 2024-09-16T02:06:19.224 INFO:tasks.workunit.client.0.smithi110.stdout:0/862: mknod d3/d4/dc/d10/c112 0 2024-09-16T02:06:19.238 INFO:tasks.workunit.client.0.smithi110.stdout:1/921: dwrite d0/d1/df2/d10f/d32/f38 [0,4194304] 0 2024-09-16T02:06:19.239 INFO:tasks.workunit.client.0.smithi110.stdout:7/704: dwrite d3/d15/d38/d4f/d10/d2c/f86 [0,4194304] 0 2024-09-16T02:06:19.240 INFO:tasks.workunit.client.0.smithi110.stdout:0/863: dwrite d3/d6/d43/d55/d59/f88 [0,4194304] 0 2024-09-16T02:06:19.243 INFO:tasks.workunit.client.0.smithi110.stdout:5/940: dread d5/dd/f4c [0,4194304] 0 2024-09-16T02:06:19.244 INFO:tasks.workunit.client.0.smithi110.stdout:1/922: chown d0/d1/df2/d10f/d32/d6e/l8c 6065 1 2024-09-16T02:06:19.248 INFO:tasks.workunit.client.0.smithi110.stdout:5/941: stat d5/dd/df/d11/d6d/d11a/d77/d9f/fe1 0 2024-09-16T02:06:19.248 INFO:tasks.workunit.client.0.smithi110.stdout:1/923: fdatasync d0/d1/df2/d10f/f5d 0 2024-09-16T02:06:19.248 INFO:tasks.workunit.client.0.smithi110.stdout:1/924: stat d0/da/fcf 0 2024-09-16T02:06:19.249 INFO:tasks.workunit.client.0.smithi110.stdout:0/864: creat d3/d4/d85/d102/f113 x:0 0 0 2024-09-16T02:06:19.252 INFO:tasks.workunit.client.0.smithi110.stdout:5/942: dread - d5/d36/db5/fdf zero size 2024-09-16T02:06:19.254 INFO:tasks.workunit.client.0.smithi110.stdout:1/925: rename d0/da/d8d/fb4 to d0/d1/df2/d107/f13b 0 2024-09-16T02:06:19.256 INFO:tasks.workunit.client.0.smithi110.stdout:5/943: rmdir d5/dd/df 39 2024-09-16T02:06:19.256 INFO:tasks.workunit.client.0.smithi110.stdout:1/926: truncate d0/d1/dab/f124 673280 0 2024-09-16T02:06:19.257 INFO:tasks.workunit.client.0.smithi110.stdout:7/705: dread d3/d15/d38/d4f/fd [0,4194304] 0 2024-09-16T02:06:19.262 INFO:tasks.workunit.client.0.smithi110.stdout:1/927: link d0/d1/df2/d10f/d32/d40/dbf/d135/d46/ca3 d0/d1/dab/c13c 0 2024-09-16T02:06:19.263 INFO:tasks.workunit.client.0.smithi110.stdout:7/706: dwrite d3/d15/d38/d4f/fd [0,4194304] 0 2024-09-16T02:06:19.268 INFO:tasks.workunit.client.0.smithi110.stdout:1/928: rename d0/da/d8d/df6/dc4/d79/ffa to d0/d1/df2/d10f/d32/d40/dbf/d135/dc2/f13d 0 2024-09-16T02:06:19.269 INFO:tasks.workunit.client.0.smithi110.stdout:7/707: creat d3/d15/d38/d4f/d10/d11/d3e/dd5/fda x:0 0 0 2024-09-16T02:06:19.270 INFO:tasks.workunit.client.0.smithi110.stdout:1/929: truncate d0/da/d8d/df6/dc4/de8/f10a 244874 0 2024-09-16T02:06:19.272 INFO:tasks.workunit.client.0.smithi110.stdout:1/930: write d0/d1/df2/d10f/d32/d40/dbf/d135/f31 [1702174,35881] 0 2024-09-16T02:06:19.273 INFO:tasks.workunit.client.0.smithi110.stdout:7/708: rename d3/f9 to d3/d15/d38/d4f/d10/d2c/fdb 0 2024-09-16T02:06:19.273 INFO:tasks.workunit.client.0.smithi110.stdout:1/931: readlink d0/d1/df2/d10f/d32/d40/dbf/d135/laa 0 2024-09-16T02:06:19.276 INFO:tasks.workunit.client.0.smithi110.stdout:1/932: rmdir d0/da/d8d/df6/dc4 39 2024-09-16T02:06:19.276 INFO:tasks.workunit.client.0.smithi110.stdout:7/709: read d3/d15/d38/d4f/d2e/f59 [147914,124854] 0 2024-09-16T02:06:19.278 INFO:tasks.workunit.client.0.smithi110.stdout:5/944: write d5/dd/fcd [189874,53540] 0 2024-09-16T02:06:19.280 INFO:tasks.workunit.client.0.smithi110.stdout:7/710: chown d3/d15/d38/d4f/d10/d2c/c45 0 1 2024-09-16T02:06:19.280 INFO:tasks.workunit.client.0.smithi110.stdout:0/865: dwrite d3/d4/f27 [0,4194304] 0 2024-09-16T02:06:19.282 INFO:tasks.workunit.client.0.smithi110.stdout:1/933: unlink d0/d1/df2/d10f/d32/d40/dbf/d135/d46/df7/l120 0 2024-09-16T02:06:19.283 INFO:tasks.workunit.client.0.smithi110.stdout:0/866: write d3/d4/dc/d14/d76/de8/f10e [309989,52665] 0 2024-09-16T02:06:19.284 INFO:tasks.workunit.client.0.smithi110.stdout:5/945: fsync d5/dd/df/d11/d6d/d11a/d6f/fcb 0 2024-09-16T02:06:19.286 INFO:tasks.workunit.client.0.smithi110.stdout:5/946: readlink d5/dd/df/d11/d6d/d11a/d77/l98 0 2024-09-16T02:06:19.286 INFO:tasks.workunit.client.0.smithi110.stdout:1/934: write d0/d1/df2/d10f/d9a/ffb [403274,68733] 0 2024-09-16T02:06:19.288 INFO:tasks.workunit.client.0.smithi110.stdout:5/947: fsync d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/fca 0 2024-09-16T02:06:19.291 INFO:tasks.workunit.client.0.smithi110.stdout:0/867: mkdir d3/d6/d114 0 2024-09-16T02:06:19.292 INFO:tasks.workunit.client.0.smithi110.stdout:1/935: truncate d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d7a/f126 269466 0 2024-09-16T02:06:19.292 INFO:tasks.workunit.client.0.smithi110.stdout:5/948: mknod d5/dd/df/d11/d6d/d11a/dab/d111/c138 0 2024-09-16T02:06:19.301 INFO:tasks.workunit.client.0.smithi110.stdout:5/949: getdents d5/d36/d3d/dff 0 2024-09-16T02:06:19.301 INFO:tasks.workunit.client.0.smithi110.stdout:7/711: dread d3/d15/d38/d4f/d10/d11/d3e/d40/fca [0,4194304] 0 2024-09-16T02:06:19.302 INFO:tasks.workunit.client.0.smithi110.stdout:5/950: write d5/dd/df/d11/d6d/d11a/d9c/faa [95981,119107] 0 2024-09-16T02:06:19.305 INFO:tasks.workunit.client.0.smithi110.stdout:0/868: dread d3/d4/dc/d75/fd8 [0,4194304] 0 2024-09-16T02:06:19.309 INFO:tasks.workunit.client.0.smithi110.stdout:5/951: mkdir d5/d71/d89/d132/d139 0 2024-09-16T02:06:19.310 INFO:tasks.workunit.client.0.smithi110.stdout:1/936: dwrite d0/da/f6a [0,4194304] 0 2024-09-16T02:06:19.316 INFO:tasks.workunit.client.0.smithi110.stdout:5/952: creat d5/dd/df/d11/d6d/d11a/dab/d111/f13a x:0 0 0 2024-09-16T02:06:19.321 INFO:tasks.workunit.client.0.smithi110.stdout:0/869: dwrite d3/f1a [0,4194304] 0 2024-09-16T02:06:19.322 INFO:tasks.workunit.client.0.smithi110.stdout:1/937: dwrite d0/da/f92 [0,4194304] 0 2024-09-16T02:06:19.323 INFO:tasks.workunit.client.0.smithi110.stdout:0/870: readlink d3/d4/dc/d14/l78 0 2024-09-16T02:06:19.323 INFO:tasks.workunit.client.0.smithi110.stdout:7/712: dread d3/d15/d38/d4f/d10/f29 [0,4194304] 0 2024-09-16T02:06:19.325 INFO:tasks.workunit.client.0.smithi110.stdout:7/713: stat d3/d15/d38/d4f/ca9 0 2024-09-16T02:06:19.330 INFO:tasks.workunit.client.0.smithi110.stdout:5/953: write d5/dd/df/d11/d6d/f74 [965567,101309] 0 2024-09-16T02:06:19.336 INFO:tasks.workunit.client.0.smithi110.stdout:1/938: rename d0/da/d8d/df6/l103 to d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d7a/d9b/l13e 0 2024-09-16T02:06:19.337 INFO:tasks.workunit.client.0.smithi110.stdout:0/871: dwrite d3/d6/d43/d55/fa4 [0,4194304] 0 2024-09-16T02:06:19.339 INFO:tasks.workunit.client.0.smithi110.stdout:0/872: chown d3/d6/d4b/c4c 1938 1 2024-09-16T02:06:19.340 INFO:tasks.workunit.client.0.smithi110.stdout:0/873: stat d3/d4/dc/d75/fc5 0 2024-09-16T02:06:19.342 INFO:tasks.workunit.client.0.smithi110.stdout:1/939: creat d0/da/d7c/d11e/f13f x:0 0 0 2024-09-16T02:06:19.342 INFO:tasks.workunit.client.0.smithi110.stdout:0/874: fdatasync d3/d4/dc/d10/f35 0 2024-09-16T02:06:19.345 INFO:tasks.workunit.client.0.smithi110.stdout:0/875: mkdir d3/d4/d85/d93/da1/d115 0 2024-09-16T02:06:19.346 INFO:tasks.workunit.client.0.smithi110.stdout:0/876: chown d3/d4/d85 96 1 2024-09-16T02:06:19.347 INFO:tasks.workunit.client.0.smithi110.stdout:0/877: chown d3/d4/dc/cc6 4888103 1 2024-09-16T02:06:19.348 INFO:tasks.workunit.client.0.smithi110.stdout:1/940: creat d0/f140 x:0 0 0 2024-09-16T02:06:19.350 INFO:tasks.workunit.client.0.smithi110.stdout:0/878: creat d3/d4/dc/d14/f116 x:0 0 0 2024-09-16T02:06:19.353 INFO:tasks.workunit.client.0.smithi110.stdout:0/879: mknod d3/d4/deb/c117 0 2024-09-16T02:06:19.355 INFO:tasks.workunit.client.0.smithi110.stdout:7/714: write d3/f34 [4834087,42921] 0 2024-09-16T02:06:19.356 INFO:tasks.workunit.client.0.smithi110.stdout:1/941: dwrite d0/d1/df2/d10f/d32/d40/dbf/ff9 [0,4194304] 0 2024-09-16T02:06:19.357 INFO:tasks.workunit.client.0.smithi110.stdout:7/715: stat d3/d15/d38/d4f/ca9 0 2024-09-16T02:06:19.358 INFO:tasks.workunit.client.0.smithi110.stdout:7/716: chown d3/d15/d38/d4f/d10/d11 967 1 2024-09-16T02:06:19.361 INFO:tasks.workunit.client.0.smithi110.stdout:1/942: symlink d0/d25/l141 0 2024-09-16T02:06:19.364 INFO:tasks.workunit.client.0.smithi110.stdout:1/943: creat d0/d1/df2/d10f/d32/d40/dbf/dfd/f142 x:0 0 0 2024-09-16T02:06:19.367 INFO:tasks.workunit.client.0.smithi110.stdout:1/944: creat d0/d1/df2/d10f/d32/d9f/f143 x:0 0 0 2024-09-16T02:06:19.371 INFO:tasks.workunit.client.0.smithi110.stdout:1/945: creat d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d51/f144 x:0 0 0 2024-09-16T02:06:19.375 INFO:tasks.workunit.client.0.smithi110.stdout:0/880: dwrite d3/d4/dc/fb7 [0,4194304] 0 2024-09-16T02:06:19.380 INFO:tasks.workunit.client.0.smithi110.stdout:1/946: dwrite d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d51/f144 [0,4194304] 0 2024-09-16T02:06:19.381 INFO:tasks.workunit.client.0.smithi110.stdout:0/881: getdents d3/d4/dc/d14/d7e/d81 0 2024-09-16T02:06:19.386 INFO:tasks.workunit.client.0.smithi110.stdout:0/882: read d3/d4/dc/d14/d7e/d81/d86/fb6 [119125,3535] 0 2024-09-16T02:06:19.396 INFO:tasks.workunit.client.0.smithi110.stdout:1/947: dread d0/da/d8d/df6/dd0/fd5 [0,4194304] 0 2024-09-16T02:06:19.397 INFO:tasks.workunit.client.0.smithi110.stdout:1/948: dread - d0/d1/df2/d10f/d9a/fc3 zero size 2024-09-16T02:06:19.406 INFO:tasks.workunit.client.0.smithi110.stdout:1/949: write d0/d1/df2/d10f/d32/d6e/f6f [481874,89103] 0 2024-09-16T02:06:19.409 INFO:tasks.workunit.client.0.smithi110.stdout:0/883: dread d3/d4/dc/d10/fec [0,4194304] 0 2024-09-16T02:06:19.410 INFO:tasks.workunit.client.0.smithi110.stdout:0/884: chown d3/d6/d43/da7/fd7 74547 1 2024-09-16T02:06:19.411 INFO:tasks.workunit.client.0.smithi110.stdout:0/885: chown d3/d6/c6c 685 1 2024-09-16T02:06:19.417 INFO:tasks.workunit.client.0.smithi110.stdout:1/950: dwrite d0/d1/df2/d10f/f34 [0,4194304] 0 2024-09-16T02:06:19.420 INFO:tasks.workunit.client.0.smithi110.stdout:0/886: link d3/l3d d3/d4/l118 0 2024-09-16T02:06:19.421 INFO:tasks.workunit.client.0.smithi110.stdout:1/951: creat d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d51/f145 x:0 0 0 2024-09-16T02:06:19.423 INFO:tasks.workunit.client.0.smithi110.stdout:1/952: read d0/d25/d63/f111 [1132020,23239] 0 2024-09-16T02:06:19.426 INFO:tasks.workunit.client.0.smithi110.stdout:1/953: symlink d0/da/d7c/da8/l146 0 2024-09-16T02:06:19.428 INFO:tasks.workunit.client.0.smithi110.stdout:0/887: write d3/d4/fb4 [5144843,53882] 0 2024-09-16T02:06:19.429 INFO:tasks.workunit.client.0.smithi110.stdout:1/954: symlink d0/d1/df2/d107/l147 0 2024-09-16T02:06:19.430 INFO:tasks.workunit.client.0.smithi110.stdout:1/955: dread - d0/d1/df2/d10f/d9a/da2/f115 zero size 2024-09-16T02:06:19.435 INFO:tasks.workunit.client.0.smithi110.stdout:0/888: write d3/d4/dc/d10/dbd/fc8 [195125,63464] 0 2024-09-16T02:06:19.436 INFO:tasks.workunit.client.0.smithi110.stdout:0/889: write d3/d4/dc/d10/f87 [2857806,118336] 0 2024-09-16T02:06:19.437 INFO:tasks.workunit.client.0.smithi110.stdout:1/956: rename d0/d1/df2/d10f/d32/d40/dbf/d135/cd6 to d0/d1/df2/d10f/d9a/c148 0 2024-09-16T02:06:19.439 INFO:tasks.workunit.client.0.smithi110.stdout:1/957: creat d0/d1/df2/d10f/d32/d9f/f149 x:0 0 0 2024-09-16T02:06:19.444 INFO:tasks.workunit.client.0.smithi110.stdout:0/890: truncate d3/d4/d6d/faf 1276798 0 2024-09-16T02:06:19.450 INFO:tasks.workunit.client.0.smithi110.stdout:1/958: dread d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d7a/df4/fcb [0,4194304] 0 2024-09-16T02:06:19.455 INFO:tasks.workunit.client.0.smithi110.stdout:0/891: dwrite d3/d4/d6d/faf [0,4194304] 0 2024-09-16T02:06:19.457 INFO:tasks.workunit.client.0.smithi110.stdout:1/959: creat d0/d1/f14a x:0 0 0 2024-09-16T02:06:19.458 INFO:tasks.workunit.client.0.smithi110.stdout:0/892: mkdir d3/d4/d119 0 2024-09-16T02:06:19.459 INFO:tasks.workunit.client.0.smithi110.stdout:1/960: mkdir d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d75/d14b 0 2024-09-16T02:06:19.459 INFO:tasks.workunit.client.0.smithi110.stdout:0/893: rename d3/d4/d41/d110 to d3/d4/d41/d110/d11a 22 2024-09-16T02:06:19.461 INFO:tasks.workunit.client.0.smithi110.stdout:0/894: dread - d3/d4/dc/d70/fe3 zero size 2024-09-16T02:06:19.463 INFO:tasks.workunit.client.0.smithi110.stdout:1/961: truncate d0/f14 105902 0 2024-09-16T02:06:19.464 INFO:tasks.workunit.client.0.smithi110.stdout:1/962: fdatasync d0/d1/df2/d10f/d32/d40/f12a 0 2024-09-16T02:06:19.474 INFO:tasks.workunit.client.0.smithi110.stdout:0/895: write d3/d6/d4b/f4d [643604,37895] 0 2024-09-16T02:06:19.476 INFO:tasks.workunit.client.0.smithi110.stdout:0/896: fdatasync d3/d4/dc/d14/d7e/d81/fd3 0 2024-09-16T02:06:19.479 INFO:tasks.workunit.client.0.smithi110.stdout:1/963: write d0/d1/df2/d10f/d9a/fc3 [396600,10174] 0 2024-09-16T02:06:19.480 INFO:tasks.workunit.client.0.smithi110.stdout:0/897: unlink d3/d6/d43/d55/fdd 0 2024-09-16T02:06:19.480 INFO:tasks.workunit.client.0.smithi110.stdout:1/964: write d0/d1/df2/d10f/d32/d40/f97 [1329144,74559] 0 2024-09-16T02:06:19.482 INFO:tasks.workunit.client.0.smithi110.stdout:0/898: write d3/d4/dc/d14/f116 [520164,89149] 0 2024-09-16T02:06:19.484 INFO:tasks.workunit.client.0.smithi110.stdout:1/965: truncate d0/d1/df2/d10f/d32/f4f 4943532 0 2024-09-16T02:06:19.490 INFO:tasks.workunit.client.0.smithi110.stdout:1/966: chown d0/d1/df2/d10f/d32/d6e/fe2 257984 1 2024-09-16T02:06:19.491 INFO:tasks.workunit.client.0.smithi110.stdout:0/899: mkdir d3/d4/d6d/d100/d11b 0 2024-09-16T02:06:19.501 INFO:tasks.workunit.client.0.smithi110.stdout:0/900: dwrite d3/d4/d41/f60 [4194304,4194304] 0 2024-09-16T02:06:19.505 INFO:tasks.workunit.client.0.smithi110.stdout:0/901: symlink d3/d4/dc/d75/l11c 0 2024-09-16T02:06:19.508 INFO:tasks.workunit.client.0.smithi110.stdout:1/967: dwrite d0/d1/df2/d10f/d32/d6e/f8a [0,4194304] 0 2024-09-16T02:06:19.514 INFO:tasks.workunit.client.0.smithi110.stdout:1/968: unlink d0/d1/ld8 0 2024-09-16T02:06:19.515 INFO:tasks.workunit.client.0.smithi110.stdout:0/902: dwrite d3/d4/df2/df3/f109 [0,4194304] 0 2024-09-16T02:06:19.517 INFO:tasks.workunit.client.0.smithi110.stdout:1/969: write d0/d1/df2/d10f/d32/d6e/f6f [482757,33497] 0 2024-09-16T02:06:19.520 INFO:tasks.workunit.client.0.smithi110.stdout:1/970: dread - d0/d1/df2/d107/f13b zero size 2024-09-16T02:06:19.520 INFO:tasks.workunit.client.0.smithi110.stdout:1/971: fdatasync d0/d1/f14a 0 2024-09-16T02:06:19.521 INFO:tasks.workunit.client.0.smithi110.stdout:0/903: link d3/d4/dc/d10/dbd/fc8 d3/d4/d41/f11d 0 2024-09-16T02:06:19.523 INFO:tasks.workunit.client.0.smithi110.stdout:1/972: symlink d0/d1/df2/l14c 0 2024-09-16T02:06:19.524 INFO:tasks.workunit.client.0.smithi110.stdout:0/904: getdents d3/d4/d6d/d100/d11b 0 2024-09-16T02:06:19.525 INFO:tasks.workunit.client.0.smithi110.stdout:1/973: write d0/d1/df2/d10f/d9a/ffb [786789,115589] 0 2024-09-16T02:06:19.527 INFO:tasks.workunit.client.0.smithi110.stdout:1/974: creat d0/da/d7c/f14d x:0 0 0 2024-09-16T02:06:19.531 INFO:tasks.workunit.client.0.smithi110.stdout:0/905: symlink d3/d6/d43/da7/dda/l11e 0 2024-09-16T02:06:19.532 INFO:tasks.workunit.client.0.smithi110.stdout:1/975: creat d0/d1/df2/d10f/d32/d40/dbf/d135/d46/f14e x:0 0 0 2024-09-16T02:06:19.533 INFO:tasks.workunit.client.0.smithi110.stdout:0/906: creat d3/d4/df2/f11f x:0 0 0 2024-09-16T02:06:19.534 INFO:tasks.workunit.client.0.smithi110.stdout:1/976: fdatasync d0/da/d8d/df6/dc4/de8/f10a 0 2024-09-16T02:06:19.537 INFO:tasks.workunit.client.0.smithi110.stdout:1/977: rename d0/da/d8d/df6/dd0/c129 to d0/d12e/c14f 0 2024-09-16T02:06:19.537 INFO:tasks.workunit.client.0.smithi110.stdout:0/907: dread d3/d4/dc/d14/d7e/d81/f97 [0,4194304] 0 2024-09-16T02:06:19.537 INFO:tasks.workunit.client.0.smithi110.stdout:1/978: chown d0/d12e 361503 1 2024-09-16T02:06:19.541 INFO:tasks.workunit.client.0.smithi110.stdout:1/979: truncate d0/da/d8d/df6/dc4/f66 554394 0 2024-09-16T02:06:19.544 INFO:tasks.workunit.client.0.smithi110.stdout:0/908: dwrite d3/d6/d43/da7/fd7 [4194304,4194304] 0 2024-09-16T02:06:19.549 INFO:tasks.workunit.client.0.smithi110.stdout:0/909: dread d3/d4/d6d/faf [0,4194304] 0 2024-09-16T02:06:19.552 INFO:tasks.workunit.client.0.smithi110.stdout:0/910: symlink d3/d4/d85/d93/da1/l120 0 2024-09-16T02:06:19.556 INFO:tasks.workunit.client.0.smithi110.stdout:0/911: creat d3/d6/d43/d55/dbb/f121 x:0 0 0 2024-09-16T02:06:19.565 INFO:tasks.workunit.client.0.smithi110.stdout:1/980: write d0/d1/df2/d10f/f7e [4854386,112977] 0 2024-09-16T02:06:19.566 INFO:tasks.workunit.client.0.smithi110.stdout:1/981: read - d0/d1/df2/d10f/d9a/da2/f115 zero size 2024-09-16T02:06:19.567 INFO:tasks.workunit.client.0.smithi110.stdout:1/982: write d0/da/f92 [4298870,83302] 0 2024-09-16T02:06:19.569 INFO:tasks.workunit.client.0.smithi110.stdout:1/983: readlink d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d51/l5b 0 2024-09-16T02:06:19.688 INFO:tasks.workunit.client.0.smithi110.stdout:1/984: link d0/d25/l101 d0/d1/df2/d10f/d32/d40/dbf/d135/d46/l150 0 2024-09-16T02:06:19.689 INFO:tasks.workunit.client.0.smithi110.stdout:0/912: dwrite d3/d6/f21 [0,4194304] 0 2024-09-16T02:06:19.740 INFO:tasks.workunit.client.0.smithi110.stdout:0/913: dwrite d3/d4/dc/d14/d7e/d81/d86/fb6 [0,4194304] 0 2024-09-16T02:06:19.740 INFO:tasks.workunit.client.0.smithi110.stdout:1/985: dwrite d0/da/d8d/f9d [0,4194304] 0 2024-09-16T02:06:19.743 INFO:tasks.workunit.client.0.smithi110.stdout:0/914: stat d3/d6/d43/d55/d59/f88 0 2024-09-16T02:06:19.745 INFO:tasks.workunit.client.0.smithi110.stdout:0/915: creat d3/d4/dc/d14/d7e/f122 x:0 0 0 2024-09-16T02:06:19.746 INFO:tasks.workunit.client.0.smithi110.stdout:0/916: stat d3/d4/dc/d70/fe3 0 2024-09-16T02:06:19.752 INFO:tasks.workunit.client.0.smithi110.stdout:0/917: mknod d3/d4/dc/d14/d7e/c123 0 2024-09-16T02:06:19.761 INFO:tasks.workunit.client.0.smithi110.stdout:1/986: dwrite d0/d25/fe4 [0,4194304] 0 2024-09-16T02:06:19.767 INFO:tasks.workunit.client.0.smithi110.stdout:1/987: truncate d0/d25/f4a 1316609 0 2024-09-16T02:06:19.773 INFO:tasks.workunit.client.0.smithi110.stdout:1/988: creat d0/d1/df2/d10f/f151 x:0 0 0 2024-09-16T02:06:19.775 INFO:tasks.workunit.client.0.smithi110.stdout:0/918: dwrite d3/d92/fa9 [0,4194304] 0 2024-09-16T02:06:19.780 INFO:tasks.workunit.client.0.smithi110.stdout:0/919: rename d3/d4/dc/d70/d8b to d3/d4/df2/df3/d124 0 2024-09-16T02:06:19.784 INFO:tasks.workunit.client.0.smithi110.stdout:0/920: fsync d3/d6/d4b/fe9 0 2024-09-16T02:06:19.788 INFO:tasks.workunit.client.0.smithi110.stdout:0/921: rename d3/d4/dc/d14/d7e/c123 to d3/d6/d4b/c125 0 2024-09-16T02:06:19.788 INFO:tasks.workunit.client.0.smithi110.stdout:0/922: chown d3/d4/d41/c65 0 1 2024-09-16T02:06:19.799 INFO:tasks.workunit.client.0.smithi110.stdout:1/989: dread d0/d1/df2/d10f/d32/d40/dbf/d135/d46/d51/f7f [0,4194304] 0 2024-09-16T02:06:19.800 INFO:tasks.workunit.client.0.smithi110.stdout:1/990: fsync d0/da/d8d/df6/dc4/de8/f10a 0 2024-09-16T02:06:19.801 INFO:tasks.workunit.client.0.smithi110.stdout:0/923: dread d3/d4/d85/d93/da1/fb5 [4194304,4194304] 0 2024-09-16T02:06:19.802 INFO:tasks.workunit.client.0.smithi110.stdout:1/991: creat d0/d25/d63/f152 x:0 0 0 2024-09-16T02:06:19.802 INFO:tasks.workunit.client.0.smithi110.stdout:0/924: chown d3/d4/dc/d75/df5 24676 1 2024-09-16T02:06:19.806 INFO:tasks.workunit.client.0.smithi110.stdout:1/992: mkdir d0/da/d8d/df6/dc4/d153 0 2024-09-16T02:06:19.812 INFO:tasks.workunit.client.0.smithi110.stdout:1/993: dwrite d0/da/d7c/da8/dec/f132 [0,4194304] 0 2024-09-16T02:06:19.820 INFO:tasks.workunit.client.0.smithi110.stdout:0/925: dwrite d3/d4/dc/d10/dbd/fc8 [0,4194304] 0 2024-09-16T02:06:19.820 INFO:tasks.workunit.client.0.smithi110.stdout:1/994: creat d0/d1/df2/d10f/f154 x:0 0 0 2024-09-16T02:06:19.822 INFO:tasks.workunit.client.0.smithi110.stdout:1/995: stat d0/d1/df2/d107/f13b 0 2024-09-16T02:06:19.824 INFO:tasks.workunit.client.0.smithi110.stdout:1/996: truncate d0/da/d8d/df6/dc4/de8/f10a 958151 0 2024-09-16T02:06:19.825 INFO:tasks.workunit.client.0.smithi110.stdout:0/926: mkdir d3/d4/dc/d14/df9/d10c/d126 0 2024-09-16T02:06:19.825 INFO:tasks.workunit.client.0.smithi110.stdout:8/708: sync 2024-09-16T02:06:19.825 INFO:tasks.workunit.client.0.smithi110.stdout:2/978: sync 2024-09-16T02:06:19.828 INFO:tasks.workunit.client.0.smithi110.stdout:8/709: rmdir d3/d2b/d27/da7/d1a/d36 39 2024-09-16T02:06:19.832 INFO:tasks.workunit.client.0.smithi110.stdout:2/979: rename d0/db/d105/d41/db3/db8/f11a to d0/db/d47/d48/da0/f155 0 2024-09-16T02:06:19.832 INFO:tasks.workunit.client.0.smithi110.stdout:0/927: truncate d3/d6/d43/fab 1666816 0 2024-09-16T02:06:19.841 INFO:tasks.workunit.client.0.smithi110.stdout:1/997: link d0/d1/df2/d10f/d32/d40/dbf/d135/d46/ca3 d0/d12e/c155 0 2024-09-16T02:06:19.851 INFO:tasks.workunit.client.0.smithi110.stdout:0/928: write d3/d4/d6d/f79 [679108,42703] 0 2024-09-16T02:06:19.852 INFO:tasks.workunit.client.0.smithi110.stdout:8/710: truncate d3/d31/fc2 220174 0 2024-09-16T02:06:19.854 INFO:tasks.workunit.client.0.smithi110.stdout:8/711: dread - d3/d2b/d27/d45/d66/fdd zero size 2024-09-16T02:06:19.856 INFO:tasks.workunit.client.0.smithi110.stdout:2/980: dwrite d0/d5f/dc0/ddc/ddd/d18/dc/f57 [0,4194304] 0 2024-09-16T02:06:19.857 INFO:tasks.workunit.client.0.smithi110.stdout:2/981: write d0/db/f83 [836480,64889] 0 2024-09-16T02:06:19.858 INFO:tasks.workunit.client.0.smithi110.stdout:0/929: truncate d3/d6/d43/d55/f6f 1553502 0 2024-09-16T02:06:19.861 INFO:tasks.workunit.client.0.smithi110.stdout:0/930: chown d3/d4/dc/d14/df9/d10c/d126 1708287 1 2024-09-16T02:06:19.862 INFO:tasks.workunit.client.0.smithi110.stdout:0/931: dread - d3/d4/dc/d14/d7e/d81/fd3 zero size 2024-09-16T02:06:19.863 INFO:tasks.workunit.client.0.smithi110.stdout:0/932: fdatasync d3/d4/d6d/f79 0 2024-09-16T02:06:19.866 INFO:tasks.workunit.client.0.smithi110.stdout:2/982: symlink d0/db/d47/da1/dad/dd5/l156 0 2024-09-16T02:06:19.867 INFO:tasks.workunit.client.0.smithi110.stdout:8/712: creat d3/d2b/d27/da7/d1a/d36/d60/da1/ff7 x:0 0 0 2024-09-16T02:06:19.872 INFO:tasks.workunit.client.0.smithi110.stdout:8/713: fdatasync d3/d2b/d27/d45/d66/d6b/d8d/f9a 0 2024-09-16T02:06:19.877 INFO:tasks.workunit.client.0.smithi110.stdout:8/714: unlink d3/d2b/d27/da7/d1a/de9/f1f 0 2024-09-16T02:06:19.879 INFO:tasks.workunit.client.0.smithi110.stdout:0/933: write d3/d4/dc/d75/fae [526609,72650] 0 2024-09-16T02:06:19.880 INFO:tasks.workunit.client.0.smithi110.stdout:8/715: creat d3/d2b/d27/da7/d8f/ff8 x:0 0 0 2024-09-16T02:06:19.883 INFO:tasks.workunit.client.0.smithi110.stdout:8/716: rmdir d3/d2b/d27/da7/d1a/d36 39 2024-09-16T02:06:19.885 INFO:tasks.workunit.client.0.smithi110.stdout:0/934: dwrite d3/d6/d4b/f4d [4194304,4194304] 0 2024-09-16T02:06:19.886 INFO:tasks.workunit.client.0.smithi110.stdout:8/717: fdatasync d3/d2b/f4a 0 2024-09-16T02:06:19.887 INFO:tasks.workunit.client.0.smithi110.stdout:0/935: chown d3/d4/d6d/faf 19295331 1 2024-09-16T02:06:19.888 INFO:tasks.workunit.client.0.smithi110.stdout:0/936: write d3/d4/dc/d70/fe3 [963439,24177] 0 2024-09-16T02:06:19.899 INFO:tasks.workunit.client.0.smithi110.stdout:8/718: write d3/d2b/f2e [3276549,86981] 0 2024-09-16T02:06:19.906 INFO:tasks.workunit.client.0.smithi110.stdout:0/937: getdents d3/d4/dc/d70 0 2024-09-16T02:06:19.907 INFO:tasks.workunit.client.0.smithi110.stdout:8/719: fdatasync d3/d2b/d27/f4d 0 2024-09-16T02:06:19.912 INFO:tasks.workunit.client.0.smithi110.stdout:0/938: creat d3/d4/d41/d110/f127 x:0 0 0 2024-09-16T02:06:19.916 INFO:tasks.workunit.client.0.smithi110.stdout:8/720: dread d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/ddc/f91 [0,4194304] 0 2024-09-16T02:06:19.918 INFO:tasks.workunit.client.0.smithi110.stdout:8/721: mkdir d3/d2b/d27/d45/d66/d6b/df9 0 2024-09-16T02:06:19.920 INFO:tasks.workunit.client.0.smithi110.stdout:8/722: unlink d3/d2b/d27/da7/d1a/d36/d60/d62/lf5 0 2024-09-16T02:06:20.139 INFO:tasks.workunit.client.0.smithi110.stdout:6/886: sync 2024-09-16T02:06:20.140 INFO:tasks.workunit.client.0.smithi110.stdout:5/954: sync 2024-09-16T02:06:20.144 INFO:tasks.workunit.client.0.smithi110.stdout:5/955: creat d5/dd/df/d11/d6d/d11a/dab/f13b x:0 0 0 2024-09-16T02:06:20.144 INFO:tasks.workunit.client.0.smithi110.stdout:6/887: mkdir d0/d2/d57/d114 0 2024-09-16T02:06:20.147 INFO:tasks.workunit.client.0.smithi110.stdout:6/888: read d0/d2/d5/d94/dba/dde/fe1 [48267,44778] 0 2024-09-16T02:06:20.148 INFO:tasks.workunit.client.0.smithi110.stdout:5/956: creat d5/f13c x:0 0 0 2024-09-16T02:06:20.149 INFO:tasks.workunit.client.0.smithi110.stdout:5/957: chown d5/d36/d45/d47/feb 7 1 2024-09-16T02:06:20.151 INFO:tasks.workunit.client.0.smithi110.stdout:5/958: mknod d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/c13d 0 2024-09-16T02:06:20.152 INFO:tasks.workunit.client.0.smithi110.stdout:5/959: mkdir d5/de7/d13e 0 2024-09-16T02:06:20.322 INFO:tasks.workunit.client.0.smithi110.stdout:3/856: sync 2024-09-16T02:06:20.322 INFO:tasks.workunit.client.0.smithi110.stdout:7/717: sync 2024-09-16T02:06:20.322 INFO:tasks.workunit.client.0.smithi110.stdout:9/875: sync 2024-09-16T02:06:20.322 INFO:tasks.workunit.client.0.smithi110.stdout:4/781: sync 2024-09-16T02:06:20.324 INFO:tasks.workunit.client.0.smithi110.stdout:9/876: chown d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/cd0 35654 1 2024-09-16T02:06:20.324 INFO:tasks.workunit.client.0.smithi110.stdout:3/857: creat d8/d48/d7c/f132 x:0 0 0 2024-09-16T02:06:20.326 INFO:tasks.workunit.client.0.smithi110.stdout:9/877: readlink d1/d5/d20/l11e 0 2024-09-16T02:06:20.331 INFO:tasks.workunit.client.0.smithi110.stdout:4/782: rename d4/d8/d91 to d4/d8/d31/d80/dfc 0 2024-09-16T02:06:20.336 INFO:tasks.workunit.client.0.smithi110.stdout:3/858: write d8/d48/d5b/d6a/fa7 [783438,124728] 0 2024-09-16T02:06:20.339 INFO:tasks.workunit.client.0.smithi110.stdout:4/783: link d4/d8/d17/d23/d4c/d6d/d4f/f58 d4/dd6/def/ffd 0 2024-09-16T02:06:20.340 INFO:tasks.workunit.client.0.smithi110.stdout:4/784: fsync d4/d8/d31/d80/faf 0 2024-09-16T02:06:20.342 INFO:tasks.workunit.client.0.smithi110.stdout:3/859: creat d8/d48/d5b/d92/dc7/d1b/d3a/d43/f133 x:0 0 0 2024-09-16T02:06:20.347 INFO:tasks.workunit.client.0.smithi110.stdout:9/878: dwrite d1/d2b/fe1 [0,4194304] 0 2024-09-16T02:06:20.348 INFO:tasks.workunit.client.0.smithi110.stdout:4/785: dwrite d4/d8/d31/d80/dfc/fb8 [0,4194304] 0 2024-09-16T02:06:20.355 INFO:tasks.workunit.client.0.smithi110.stdout:4/786: symlink d4/d8/d17/d6b/d98/lfe 0 2024-09-16T02:06:20.357 INFO:tasks.workunit.client.0.smithi110.stdout:3/860: write d8/d48/d5b/d92/dc7/d1b/f31 [1791631,118349] 0 2024-09-16T02:06:20.359 INFO:tasks.workunit.client.0.smithi110.stdout:3/861: write d8/d48/d5b/d92/dc7/d1b/f24 [4032075,14205] 0 2024-09-16T02:06:20.360 INFO:tasks.workunit.client.0.smithi110.stdout:9/879: rename d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe5 to d1/dd/d6a/d6c/d75/d8c/d38/d3d/f129 0 2024-09-16T02:06:20.361 INFO:tasks.workunit.client.0.smithi110.stdout:3/862: fsync d8/d48/d5b/f11d 0 2024-09-16T02:06:20.364 INFO:tasks.workunit.client.0.smithi110.stdout:4/787: dread d4/d8/d17/d23/d4c/f9f [0,4194304] 0 2024-09-16T02:06:20.368 INFO:tasks.workunit.client.0.smithi110.stdout:9/880: chown d1/d1b/faf 20 1 2024-09-16T02:06:20.369 INFO:tasks.workunit.client.0.smithi110.stdout:4/788: creat d4/d8/d17/d23/d35/fff x:0 0 0 2024-09-16T02:06:20.371 INFO:tasks.workunit.client.0.smithi110.stdout:9/881: truncate d1/dd/d6a/d6c/d6f/f7e 631356 0 2024-09-16T02:06:20.372 INFO:tasks.workunit.client.0.smithi110.stdout:4/789: write d4/d8/d31/d80/fbd [1019760,79024] 0 2024-09-16T02:06:20.381 INFO:tasks.workunit.client.0.smithi110.stdout:9/882: getdents d1/dd/d6a/d6c 0 2024-09-16T02:06:20.386 INFO:tasks.workunit.client.0.smithi110.stdout:4/790: write d4/d8/d31/d80/d18/f57 [2357377,92931] 0 2024-09-16T02:06:20.392 INFO:tasks.workunit.client.0.smithi110.stdout:4/791: dwrite f3 [0,4194304] 0 2024-09-16T02:06:20.393 INFO:tasks.workunit.client.0.smithi110.stdout:4/792: fsync d4/db4/ff2 0 2024-09-16T02:06:20.394 INFO:tasks.workunit.client.0.smithi110.stdout:9/883: dwrite d1/dd/d6a/d6c/d75/f115 [0,4194304] 0 2024-09-16T02:06:20.394 INFO:tasks.workunit.client.0.smithi110.stdout:4/793: chown d4/d8/d31/d80/d18/l50 54 1 2024-09-16T02:06:20.397 INFO:tasks.workunit.client.0.smithi110.stdout:4/794: write d4/d8/d17/d23/d4c/da5/db2/dc4/fd7 [906494,2019] 0 2024-09-16T02:06:20.403 INFO:tasks.workunit.client.0.smithi110.stdout:4/795: creat d4/d8/d31/d73/dd5/f100 x:0 0 0 2024-09-16T02:06:20.406 INFO:tasks.workunit.client.0.smithi110.stdout:4/796: creat d4/d8/d31/d80/dfc/f101 x:0 0 0 2024-09-16T02:06:20.408 INFO:tasks.workunit.client.0.smithi110.stdout:4/797: creat d4/db4/f102 x:0 0 0 2024-09-16T02:06:20.408 INFO:tasks.workunit.client.0.smithi110.stdout:4/798: stat d4/d8/d17/d23/d4c/d6d/d7f 0 2024-09-16T02:06:20.414 INFO:tasks.workunit.client.0.smithi110.stdout:9/884: dwrite d1/dd/d6a/d6c/d6f/d79/d26/f45 [0,4194304] 0 2024-09-16T02:06:20.416 INFO:tasks.workunit.client.0.smithi110.stdout:9/885: write d1/dd/d6a/de7/ffb [4203003,60498] 0 2024-09-16T02:06:20.420 INFO:tasks.workunit.client.0.smithi110.stdout:9/886: rmdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc 39 2024-09-16T02:06:20.423 INFO:tasks.workunit.client.0.smithi110.stdout:9/887: dread d1/dd/d6a/d6c/d6f/d79/d26/f92 [0,4194304] 0 2024-09-16T02:06:20.423 INFO:tasks.workunit.client.0.smithi110.stdout:9/888: read d1/d1b/faf [91883,57691] 0 2024-09-16T02:06:20.441 INFO:tasks.workunit.client.0.smithi110.stdout:4/799: dread d4/d8/d17/fa1 [0,4194304] 0 2024-09-16T02:06:20.449 INFO:tasks.workunit.client.0.smithi110.stdout:9/889: dread d1/dd/d6a/d6c/d6f/d79/de/d1f/f4a [0,4194304] 0 2024-09-16T02:06:20.449 INFO:tasks.workunit.client.0.smithi110.stdout:4/800: dwrite d4/d8/d17/d23/d4c/d6d/d3c/fcc [0,4194304] 0 2024-09-16T02:06:20.454 INFO:tasks.workunit.client.0.smithi110.stdout:9/890: read d1/dd/d6a/d6c/d75/d8c/d38/d3d/f120 [4288478,75667] 0 2024-09-16T02:06:20.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/801: getdents d4/d8/d31/d5d/d84 0 2024-09-16T02:06:20.455 INFO:tasks.workunit.client.0.smithi110.stdout:4/802: chown d4/d8/d17/d23/d4c/d6d/d4f/da9/dad 93 1 2024-09-16T02:06:20.456 INFO:tasks.workunit.client.0.smithi110.stdout:9/891: creat d1/dd/d6a/d6c/d75/f12a x:0 0 0 2024-09-16T02:06:20.457 INFO:tasks.workunit.client.0.smithi110.stdout:9/892: dread - d1/d5/d20/fbe zero size 2024-09-16T02:06:20.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/803: mkdir d4/d8/d17/d23/d61/d103 0 2024-09-16T02:06:20.460 INFO:tasks.workunit.client.0.smithi110.stdout:9/893: creat d1/dd/d6a/d6c/d75/d86/f12b x:0 0 0 2024-09-16T02:06:20.463 INFO:tasks.workunit.client.0.smithi110.stdout:4/804: dread d4/d8/d31/d80/d18/f94 [0,4194304] 0 2024-09-16T02:06:20.469 INFO:tasks.workunit.client.0.smithi110.stdout:4/805: mknod d4/d8/c104 0 2024-09-16T02:06:20.470 INFO:tasks.workunit.client.0.smithi110.stdout:9/894: write d1/dd/d6a/d6c/d6f/f7e [470477,69654] 0 2024-09-16T02:06:20.470 INFO:tasks.workunit.client.0.smithi110.stdout:4/806: chown d4/d8/d17/d23/d4c/d6d/d4f 929507 1 2024-09-16T02:06:20.475 INFO:tasks.workunit.client.0.smithi110.stdout:4/807: dread d4/d8/d31/d80/dfc/fb8 [0,4194304] 0 2024-09-16T02:06:20.482 INFO:tasks.workunit.client.0.smithi110.stdout:4/808: mknod d4/c105 0 2024-09-16T02:06:20.483 INFO:tasks.workunit.client.0.smithi110.stdout:9/895: dwrite d1/dd/d6a/d6c/d6f/ff2 [0,4194304] 0 2024-09-16T02:06:20.485 INFO:tasks.workunit.client.0.smithi110.stdout:4/809: mkdir d4/d8/d17/d23/d4c/da5/d106 0 2024-09-16T02:06:20.486 INFO:tasks.workunit.client.0.smithi110.stdout:4/810: chown d4/d8/d17/l38 32 1 2024-09-16T02:06:20.487 INFO:tasks.workunit.client.0.smithi110.stdout:9/896: dread d1/dd/d6a/d6c/d6f/f7e [0,4194304] 0 2024-09-16T02:06:20.488 INFO:tasks.workunit.client.0.smithi110.stdout:9/897: chown d1/dd/d6a/d6c/d6f/d79 528490603 1 2024-09-16T02:06:20.489 INFO:tasks.workunit.client.0.smithi110.stdout:9/898: dread - d1/d1b/d23/d7c/f121 zero size 2024-09-16T02:06:20.491 INFO:tasks.workunit.client.0.smithi110.stdout:9/899: rmdir d1/dd/d6a/d6c/d6f/d79/d26 39 2024-09-16T02:06:20.492 INFO:tasks.workunit.client.0.smithi110.stdout:9/900: write d1/dd/d6a/d6c/d6f/fdb [285281,59490] 0 2024-09-16T02:06:20.493 INFO:tasks.workunit.client.0.smithi110.stdout:9/901: stat d1/dd/d6a/d6c/l8d 0 2024-09-16T02:06:20.497 INFO:tasks.workunit.client.0.smithi110.stdout:9/902: truncate d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/fc3 3959771 0 2024-09-16T02:06:20.500 INFO:tasks.workunit.client.0.smithi110.stdout:9/903: symlink d1/dd/d6a/d6c/d6f/d79/d29/db4/l12c 0 2024-09-16T02:06:20.514 INFO:tasks.workunit.client.0.smithi110.stdout:9/904: write d1/dd/d6a/d6c/d75/d8c/f41 [3906815,2978] 0 2024-09-16T02:06:20.517 INFO:tasks.workunit.client.0.smithi110.stdout:9/905: unlink d1/dd/d6a/d6c/d6f/d79/l51 0 2024-09-16T02:06:20.525 INFO:tasks.workunit.client.0.smithi110.stdout:9/906: write d1/dd/d6a/d6c/d6f/d79/de/d1f/f57 [4217085,56471] 0 2024-09-16T02:06:20.526 INFO:tasks.workunit.client.0.smithi110.stdout:9/907: mknod d1/dd/d6a/d6c/d75/d86/c12d 0 2024-09-16T02:06:20.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/908: write d1/dd/d6a/d6c/d6f/fdb [493687,25277] 0 2024-09-16T02:06:20.533 INFO:tasks.workunit.client.0.smithi110.stdout:9/909: write d1/dd/d6a/d6c/d75/f7b [4543733,22771] 0 2024-09-16T02:06:20.539 INFO:tasks.workunit.client.0.smithi110.stdout:9/910: dwrite d1/dd/d6a/d6c/d75/d8c/fbd [0,4194304] 0 2024-09-16T02:06:20.540 INFO:tasks.workunit.client.0.smithi110.stdout:9/911: chown d1/d1b/d23/d7c/f81 26861308 1 2024-09-16T02:06:20.552 INFO:tasks.workunit.client.0.smithi110.stdout:9/912: write d1/d5/d20/d55/d82/fd8 [1111698,12105] 0 2024-09-16T02:06:20.555 INFO:tasks.workunit.client.0.smithi110.stdout:9/913: mknod d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd/c12e 0 2024-09-16T02:06:20.556 INFO:tasks.workunit.client.0.smithi110.stdout:9/914: rmdir d1/dd/d6a/d6c 39 2024-09-16T02:06:20.562 INFO:tasks.workunit.client.0.smithi110.stdout:9/915: creat d1/dd/d6a/d6c/d6f/d79/d29/f12f x:0 0 0 2024-09-16T02:06:20.572 INFO:tasks.workunit.client.0.smithi110.stdout:9/916: dwrite d1/dd/d6a/d6c/d6f/d79/f5c [4194304,4194304] 0 2024-09-16T02:06:20.575 INFO:tasks.workunit.client.0.smithi110.stdout:9/917: truncate d1/d1b/f22 1702995 0 2024-09-16T02:06:20.577 INFO:tasks.workunit.client.0.smithi110.stdout:9/918: chown d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/cd0 2 1 2024-09-16T02:06:20.579 INFO:tasks.workunit.client.0.smithi110.stdout:9/919: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/fe8 1 1 2024-09-16T02:06:20.583 INFO:tasks.workunit.client.0.smithi110.stdout:9/920: mkdir d1/d1b/d23/d7c/d130 0 2024-09-16T02:06:20.588 INFO:tasks.workunit.client.0.smithi110.stdout:9/921: write d1/dd/d6a/d6c/d6f/d79/f40 [2622649,2400] 0 2024-09-16T02:06:20.593 INFO:tasks.workunit.client.0.smithi110.stdout:9/922: link d1/dd/d6a/cf8 d1/c131 0 2024-09-16T02:06:20.597 INFO:tasks.workunit.client.0.smithi110.stdout:9/923: dread d1/d1b/f22 [0,4194304] 0 2024-09-16T02:06:20.643 INFO:tasks.workunit.client.0.smithi110.stdout:1/998: sync 2024-09-16T02:06:20.657 INFO:tasks.workunit.client.0.smithi110.stdout:1/999: write d0/d1/df2/d10f/d32/d40/dbf/fed [1817446,69528] 0 2024-09-16T02:06:21.054 INFO:tasks.workunit.client.0.smithi110.stdout:2/983: sync 2024-09-16T02:06:21.100 INFO:tasks.workunit.client.0.smithi110.stdout:2/984: creat d0/d5f/dc0/ddc/ddd/dfa/d3b/d14b/f157 x:0 0 0 2024-09-16T02:06:21.117 INFO:tasks.workunit.client.0.smithi110.stdout:2/985: dread d0/db/d105/d39/d87/f119 [0,4194304] 0 2024-09-16T02:06:21.155 INFO:tasks.workunit.client.0.smithi110.stdout:0/939: sync 2024-09-16T02:06:21.156 INFO:tasks.workunit.client.0.smithi110.stdout:0/940: symlink d3/d6/l128 0 2024-09-16T02:06:21.158 INFO:tasks.workunit.client.0.smithi110.stdout:0/941: rename d3/d4/dc/d14/d76/cfd to d3/d4/df2/c129 0 2024-09-16T02:06:21.163 INFO:tasks.workunit.client.0.smithi110.stdout:0/942: dwrite d3/d4/df2/f11f [0,4194304] 0 2024-09-16T02:06:21.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:20 smithi165 ceph-mon[34621]: pgmap v34: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 138 MiB/s wr, 409 op/s 2024-09-16T02:06:21.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:20 smithi110 ceph-mon[27634]: pgmap v34: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 138 MiB/s wr, 409 op/s 2024-09-16T02:06:21.243 INFO:tasks.workunit.client.0.smithi110.stdout:0/943: mknod d3/d4/df2/df3/d124/c12a 0 2024-09-16T02:06:21.244 INFO:tasks.workunit.client.0.smithi110.stdout:0/944: write d3/d4/dc/d14/d7e/d81/d89/fcb [710071,101245] 0 2024-09-16T02:06:21.247 INFO:tasks.workunit.client.0.smithi110.stdout:0/945: mknod d3/d6/d43/da7/dda/c12b 0 2024-09-16T02:06:21.248 INFO:tasks.workunit.client.0.smithi110.stdout:0/946: rmdir d3/d4/d85/d93/da1 39 2024-09-16T02:06:21.250 INFO:tasks.workunit.client.0.smithi110.stdout:0/947: mknod d3/d6/d43/c12c 0 2024-09-16T02:06:21.301 INFO:tasks.workunit.client.0.smithi110.stdout:6/889: sync 2024-09-16T02:06:21.301 INFO:tasks.workunit.client.0.smithi110.stdout:8/723: sync 2024-09-16T02:06:21.305 INFO:tasks.workunit.client.0.smithi110.stdout:6/890: mknod d0/d2/d5/d94/dba/dde/c115 0 2024-09-16T02:06:21.311 INFO:tasks.workunit.client.0.smithi110.stdout:8/724: dwrite d3/d2b/d27/f59 [0,4194304] 0 2024-09-16T02:06:21.315 INFO:tasks.workunit.client.0.smithi110.stdout:8/725: dread d3/d2b/d27/d45/fe7 [0,4194304] 0 2024-09-16T02:06:21.315 INFO:tasks.workunit.client.0.smithi110.stdout:6/891: dwrite d0/d2/d5/f52 [0,4194304] 0 2024-09-16T02:06:21.319 INFO:tasks.workunit.client.0.smithi110.stdout:6/892: symlink d0/d2/l116 0 2024-09-16T02:06:21.319 INFO:tasks.workunit.client.0.smithi110.stdout:8/726: rmdir d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8 39 2024-09-16T02:06:21.322 INFO:tasks.workunit.client.0.smithi110.stdout:8/727: dread d3/d2b/d27/d45/fe7 [0,4194304] 0 2024-09-16T02:06:21.325 INFO:tasks.workunit.client.0.smithi110.stdout:8/728: rmdir d3/d2b/d27/da7/d8f 39 2024-09-16T02:06:21.337 INFO:tasks.workunit.client.0.smithi110.stdout:8/729: dwrite d3/f2a [0,4194304] 0 2024-09-16T02:06:21.348 INFO:tasks.workunit.client.0.smithi110.stdout:8/730: write d3/d2b/d27/da7/d1a/d36/d60/f64 [1746907,114897] 0 2024-09-16T02:06:21.349 INFO:tasks.workunit.client.0.smithi110.stdout:6/893: dread d0/d2/d57/f95 [0,4194304] 0 2024-09-16T02:06:21.352 INFO:tasks.workunit.client.0.smithi110.stdout:8/731: rmdir d3/d2b/d27/da7/d1a/d36/d60 39 2024-09-16T02:06:21.392 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T02:06:21.392 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-16T02:06:21.440 INFO:tasks.workunit.client.0.smithi110.stdout:8/732: rmdir d3/d31 39 2024-09-16T02:06:21.445 INFO:tasks.workunit.client.0.smithi110.stdout:8/733: symlink d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/dc6/lfa 0 2024-09-16T02:06:21.445 INFO:tasks.workunit.client.0.smithi110.stdout:8/734: stat d3/d2b/d27/da7/d1a/d36/c78 0 2024-09-16T02:06:21.445 INFO:tasks.workunit.client.0.smithi110.stdout:6/894: dread d0/d2/d5/d84/f6d [0,4194304] 0 2024-09-16T02:06:21.448 INFO:tasks.workunit.client.0.smithi110.stdout:8/735: rename d3/d2b/d27/d45/d86/cf4 to d3/d2b/d27/da7/d1a/d36/d60/da1/cfb 0 2024-09-16T02:06:21.449 INFO:tasks.workunit.client.0.smithi110.stdout:6/895: mknod d0/d2/d5/db8/c117 0 2024-09-16T02:06:21.449 INFO:tasks.workunit.client.0.smithi110.stdout:8/736: chown d3/c35 1 1 2024-09-16T02:06:21.451 INFO:tasks.workunit.client.0.smithi110.stdout:6/896: creat d0/d2/d5/d1e/d48/d113/f118 x:0 0 0 2024-09-16T02:06:21.452 INFO:tasks.workunit.client.0.smithi110.stdout:8/737: truncate d3/d2b/d27/da7/f26 2079471 0 2024-09-16T02:06:21.455 INFO:tasks.workunit.client.0.smithi110.stdout:6/897: creat d0/d2/d5/db8/dd1/df9/f119 x:0 0 0 2024-09-16T02:06:21.456 INFO:tasks.workunit.client.0.smithi110.stdout:8/738: mknod d3/d2b/d27/da7/d8f/cfc 0 2024-09-16T02:06:21.465 INFO:tasks.workunit.client.0.smithi110.stdout:6/898: write d0/d2/d57/d75/f81 [1888163,104326] 0 2024-09-16T02:06:21.465 INFO:tasks.workunit.client.0.smithi110.stdout:8/739: write d3/d2b/d27/da7/d1a/f5d [289515,3397] 0 2024-09-16T02:06:21.466 INFO:tasks.workunit.client.0.smithi110.stdout:6/899: chown d0/d2/d5/f4e 40422605 1 2024-09-16T02:06:21.468 INFO:tasks.workunit.client.0.smithi110.stdout:8/740: unlink d3/d2b/d27/da7/d1a/d36/f8a 0 2024-09-16T02:06:21.469 INFO:tasks.workunit.client.0.smithi110.stdout:6/900: symlink d0/d2/d5/db8/d9c/l11a 0 2024-09-16T02:06:21.472 INFO:tasks.workunit.client.0.smithi110.stdout:6/901: mknod d0/d29/d2a/d2d/daa/c11b 0 2024-09-16T02:06:21.473 INFO:tasks.workunit.client.0.smithi110.stdout:6/902: fdatasync d0/d2/d57/d75/fe0 0 2024-09-16T02:06:21.475 INFO:tasks.workunit.client.0.smithi110.stdout:8/741: getdents d3/d2b/d27/da7/d8f 0 2024-09-16T02:06:21.481 INFO:tasks.workunit.client.0.smithi110.stdout:8/742: readlink d3/d31/l3f 0 2024-09-16T02:06:21.482 INFO:tasks.workunit.client.0.smithi110.stdout:8/743: chown d3/d2b/f1e 336140133 1 2024-09-16T02:06:21.486 INFO:tasks.workunit.client.0.smithi110.stdout:6/903: dwrite d0/d2/d5/db8/f7e [0,4194304] 0 2024-09-16T02:06:21.489 INFO:tasks.workunit.client.0.smithi110.stdout:8/744: rmdir d3/d2b/d27/d45/d66/d6b/df9 0 2024-09-16T02:06:21.490 INFO:tasks.workunit.client.0.smithi110.stdout:6/904: mkdir d0/d2/d57/d75/ded/d10f/d11c 0 2024-09-16T02:06:21.492 INFO:tasks.workunit.client.0.smithi110.stdout:8/745: mkdir d3/d2b/d27/da7/d1a/dfd 0 2024-09-16T02:06:21.494 INFO:tasks.workunit.client.0.smithi110.stdout:6/905: unlink d0/d2/d18/d1d/fd4 0 2024-09-16T02:06:21.495 INFO:tasks.workunit.client.0.smithi110.stdout:8/746: readlink d3/d2b/d27/d45/d66/d6b/d8d/lcd 0 2024-09-16T02:06:21.497 INFO:tasks.workunit.client.0.smithi110.stdout:6/906: creat d0/d29/d2a/d2d/d8b/f11d x:0 0 0 2024-09-16T02:06:21.497 INFO:tasks.workunit.client.0.smithi110.stdout:8/747: creat d3/d2b/d27/da7/d8f/ffe x:0 0 0 2024-09-16T02:06:21.504 INFO:tasks.workunit.client.0.smithi110.stdout:5/960: sync 2024-09-16T02:06:21.506 INFO:tasks.workunit.client.0.smithi110.stdout:8/748: dread d3/d2b/d27/da7/d1a/d36/d60/f64 [0,4194304] 0 2024-09-16T02:06:21.507 INFO:tasks.workunit.client.0.smithi110.stdout:5/961: creat d5/dd/df/d11/d6d/d11a/d9c/f13f x:0 0 0 2024-09-16T02:06:21.508 INFO:tasks.workunit.client.0.smithi110.stdout:5/962: stat d5/dd/df/d11/d6d/d11a/d6f/d8e/dd6 0 2024-09-16T02:06:21.511 INFO:tasks.workunit.client.0.smithi110.stdout:5/963: unlink d5/dd/d90/d108/l11f 0 2024-09-16T02:06:21.512 INFO:tasks.workunit.client.0.smithi110.stdout:5/964: write d5/dd/f12e [813838,22908] 0 2024-09-16T02:06:21.512 INFO:tasks.workunit.client.0.smithi110.stdout:8/749: write d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/fae [3309131,30796] 0 2024-09-16T02:06:21.514 INFO:tasks.workunit.client.0.smithi110.stdout:6/907: dread d0/f10 [0,4194304] 0 2024-09-16T02:06:21.515 INFO:tasks.workunit.client.0.smithi110.stdout:8/750: mkdir d3/d2b/d27/da7/d1a/dfd/dff 0 2024-09-16T02:06:21.517 INFO:tasks.workunit.client.0.smithi110.stdout:8/751: fsync d3/d2b/d27/da7/d1a/fd4 0 2024-09-16T02:06:21.519 INFO:tasks.workunit.client.0.smithi110.stdout:8/752: read - d3/d2b/d27/da7/d1a/d6c/ff3 zero size 2024-09-16T02:06:21.519 INFO:tasks.workunit.client.0.smithi110.stdout:6/908: truncate d0/d2/d18/ff8 1008679 0 2024-09-16T02:06:21.530 INFO:tasks.workunit.client.0.smithi110.stdout:6/909: truncate d0/d2/d5/d1e/f44 1423176 0 2024-09-16T02:06:21.531 INFO:tasks.workunit.client.0.smithi110.stdout:8/753: fdatasync d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/ddc/fb3 0 2024-09-16T02:06:21.537 INFO:tasks.workunit.client.0.smithi110.stdout:8/754: rmdir d3/d2b/d27/da7/d1a/d36/d60/da1/db5 39 2024-09-16T02:06:21.538 INFO:tasks.workunit.client.0.smithi110.stdout:8/755: readlink d3/d2b/d27/d45/d86/le8 0 2024-09-16T02:06:21.540 INFO:tasks.workunit.client.0.smithi110.stdout:8/756: dread - d3/d2b/d27/da7/d1a/d36/d60/fac zero size 2024-09-16T02:06:21.544 INFO:tasks.workunit.client.0.smithi110.stdout:6/910: dwrite d0/d29/f32 [4194304,4194304] 0 2024-09-16T02:06:21.550 INFO:tasks.workunit.client.0.smithi110.stdout:6/911: dread d0/d2/d5/d84/f6d [0,4194304] 0 2024-09-16T02:06:21.550 INFO:tasks.workunit.client.0.smithi110.stdout:8/757: dwrite d3/d2b/f70 [0,4194304] 0 2024-09-16T02:06:21.551 INFO:tasks.workunit.client.0.smithi110.stdout:6/912: unlink d0/d29/d2a/d2f/l6f 0 2024-09-16T02:06:21.554 INFO:tasks.workunit.client.0.smithi110.stdout:6/913: chown d0/d2/d57/d75/de7/df5/ffc 0 1 2024-09-16T02:06:21.554 INFO:tasks.workunit.client.0.smithi110.stdout:6/914: stat d0/d2/d57/da0 0 2024-09-16T02:06:21.559 INFO:tasks.workunit.client.0.smithi110.stdout:6/915: rmdir d0/d2/d18/d1d 39 2024-09-16T02:06:21.561 INFO:tasks.workunit.client.0.smithi110.stdout:8/758: link d3/d31/fc2 d3/d2b/d27/da7/d1a/d36/d60/d62/f100 0 2024-09-16T02:06:21.563 INFO:tasks.workunit.client.0.smithi110.stdout:8/759: chown d3/d2b/d27/da7/d1a/d36/d60/d62/fc3 12000186 1 2024-09-16T02:06:21.563 INFO:tasks.workunit.client.0.smithi110.stdout:6/916: creat d0/d2/f11e x:0 0 0 2024-09-16T02:06:21.565 INFO:tasks.workunit.client.0.smithi110.stdout:6/917: mkdir d0/d2/d57/da0/d11f 0 2024-09-16T02:06:21.567 INFO:tasks.workunit.client.0.smithi110.stdout:8/760: mknod d3/d2b/d27/da7/d1a/d6c/c101 0 2024-09-16T02:06:21.568 INFO:tasks.workunit.client.0.smithi110.stdout:6/918: getdents d0/d2/d57/d75/d10a 0 2024-09-16T02:06:21.569 INFO:tasks.workunit.client.0.smithi110.stdout:6/919: fsync d0/d2/d5/db8/dd1/df9/f119 0 2024-09-16T02:06:21.570 INFO:tasks.workunit.client.0.smithi110.stdout:8/761: read d3/d31/fd0 [47778,63933] 0 2024-09-16T02:06:21.572 INFO:tasks.workunit.client.0.smithi110.stdout:6/920: fsync d0/d29/d2a/fa9 0 2024-09-16T02:06:21.577 INFO:tasks.workunit.client.0.smithi110.stdout:6/921: rename d0/d2/d57/d75/de7/df5 to d0/d2/d57/d114/d120 0 2024-09-16T02:06:21.579 INFO:tasks.workunit.client.0.smithi110.stdout:6/922: mkdir d0/d2/d5/d94/dba/d121 0 2024-09-16T02:06:21.583 INFO:tasks.workunit.client.0.smithi110.stdout:6/923: rmdir d0/d29/d2a/d2d/deb 0 2024-09-16T02:06:21.583 INFO:tasks.workunit.client.0.smithi110.stdout:8/762: dread d3/f3c [0,4194304] 0 2024-09-16T02:06:21.588 INFO:tasks.workunit.client.0.smithi110.stdout:8/763: rename d3/d2b/d27/da7/f26 to d3/d2b/d27/da7/d1a/d36/d60/d83/f102 0 2024-09-16T02:06:21.595 INFO:tasks.workunit.client.0.smithi110.stdout:8/764: dwrite d3/d2b/d27/da7/d8f/ffe [0,4194304] 0 2024-09-16T02:06:21.597 INFO:tasks.workunit.client.0.smithi110.stdout:8/765: chown d3/d2b/d27/d45/d66/d6b/d8d 1 1 2024-09-16T02:06:21.598 INFO:tasks.workunit.client.0.smithi110.stdout:6/924: dwrite d0/d2/d5/d94/dba/dde/fe1 [0,4194304] 0 2024-09-16T02:06:21.603 INFO:tasks.workunit.client.0.smithi110.stdout:3/863: sync 2024-09-16T02:06:21.603 INFO:tasks.workunit.client.0.smithi110.stdout:7/718: sync 2024-09-16T02:06:21.605 INFO:tasks.workunit.client.0.smithi110.stdout:3/864: dread - d8/d48/d5b/d92/dc7/d1b/d3a/d43/f133 zero size 2024-09-16T02:06:21.606 INFO:tasks.workunit.client.0.smithi110.stdout:6/925: dread d0/d2/d18/d1d/fa4 [0,4194304] 0 2024-09-16T02:06:21.607 INFO:tasks.workunit.client.0.smithi110.stdout:8/766: unlink d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/ddc/cd7 0 2024-09-16T02:06:21.608 INFO:tasks.workunit.client.0.smithi110.stdout:7/719: mknod d3/d15/d38/d4f/d10/d11/d3e/d40/d50/cdc 0 2024-09-16T02:06:21.617 INFO:tasks.workunit.client.0.smithi110.stdout:6/926: mkdir d0/d2/d5/d94/dba/dde/d122 0 2024-09-16T02:06:21.618 INFO:tasks.workunit.client.0.smithi110.stdout:7/720: creat d3/d15/d38/d4f/d10/d2c/fdd x:0 0 0 2024-09-16T02:06:21.620 INFO:tasks.workunit.client.0.smithi110.stdout:6/927: symlink d0/d2/l123 0 2024-09-16T02:06:21.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/928: creat d0/d2/d57/d75/de7/f124 x:0 0 0 2024-09-16T02:06:21.625 INFO:tasks.workunit.client.0.smithi110.stdout:7/721: rename d3/f8 to d3/d15/d38/d4f/d10/d76/dd6/fde 0 2024-09-16T02:06:21.628 INFO:tasks.workunit.client.0.smithi110.stdout:6/929: truncate d0/d2/d5/d84/d16/f13 1728767 0 2024-09-16T02:06:21.629 INFO:tasks.workunit.client.0.smithi110.stdout:7/722: readlink d3/d15/d38/d4f/l37 0 2024-09-16T02:06:21.633 INFO:tasks.workunit.client.0.smithi110.stdout:7/723: mkdir d3/d15/ddf 0 2024-09-16T02:06:21.634 INFO:tasks.workunit.client.0.smithi110.stdout:6/930: truncate d0/d2/d5/d1e/f44 1980369 0 2024-09-16T02:06:21.636 INFO:tasks.workunit.client.0.smithi110.stdout:3/865: dwrite d8/d29/f74 [0,4194304] 0 2024-09-16T02:06:21.636 INFO:tasks.workunit.client.0.smithi110.stdout:7/724: fdatasync d3/d15/d38/d4f/d10/d76/fcb 0 2024-09-16T02:06:21.640 INFO:tasks.workunit.client.0.smithi110.stdout:7/725: creat d3/d7a/fe0 x:0 0 0 2024-09-16T02:06:21.642 INFO:tasks.workunit.client.0.smithi110.stdout:3/866: fdatasync d8/d48/d5b/d92/dc7/d1b/f60 0 2024-09-16T02:06:21.647 INFO:tasks.workunit.client.0.smithi110.stdout:3/867: fdatasync d8/d48/d5b/d6a/def/ff2 0 2024-09-16T02:06:21.653 INFO:tasks.workunit.client.0.smithi110.stdout:3/868: dwrite d8/f2a [0,4194304] 0 2024-09-16T02:06:21.655 INFO:tasks.workunit.client.0.smithi110.stdout:3/869: write d8/d48/d5b/d92/dc7/d1b/fa2 [2104649,63176] 0 2024-09-16T02:06:21.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/870: stat d8/d48/d5b/d92/dc7/d1b/f12a 0 2024-09-16T02:06:21.665 INFO:tasks.workunit.client.0.smithi110.stdout:6/931: dwrite d0/f47 [0,4194304] 0 2024-09-16T02:06:21.669 INFO:tasks.workunit.client.0.smithi110.stdout:7/726: dwrite d3/d15/d38/d4f/fd [4194304,4194304] 0 2024-09-16T02:06:21.669 INFO:tasks.workunit.client.0.smithi110.stdout:6/932: write d0/d2/d5/d84/d16/f33 [222794,93179] 0 2024-09-16T02:06:21.670 INFO:tasks.workunit.client.0.smithi110.stdout:6/933: readlink d0/d2/d5/d84/d16/l56 0 2024-09-16T02:06:21.676 INFO:tasks.workunit.client.0.smithi110.stdout:7/727: creat d3/d15/d38/d4f/fe1 x:0 0 0 2024-09-16T02:06:21.680 INFO:tasks.workunit.client.0.smithi110.stdout:7/728: read d3/d15/d38/d4f/d10/d11/d8f/f96 [14664,86714] 0 2024-09-16T02:06:21.686 INFO:tasks.workunit.client.0.smithi110.stdout:7/729: mkdir d3/d15/d38/d4f/d10/de2 0 2024-09-16T02:06:21.687 INFO:tasks.workunit.client.0.smithi110.stdout:7/730: chown d3/d15/d38/d4f/d10/d11/d3e/f42 746034094 1 2024-09-16T02:06:21.688 INFO:tasks.workunit.client.0.smithi110.stdout:7/731: chown d3/d15/d38/d4f/d10/d11/d3e/dd5/db7 110007893 1 2024-09-16T02:06:21.690 INFO:tasks.workunit.client.0.smithi110.stdout:7/732: fsync d3/d62/fb9 0 2024-09-16T02:06:21.704 INFO:tasks.workunit.client.0.smithi110.stdout:6/934: dwrite d0/d2/d57/d75/f90 [0,4194304] 0 2024-09-16T02:06:21.705 INFO:tasks.workunit.client.0.smithi110.stdout:6/935: chown d0/d2/d5/d1e/d48 3198 1 2024-09-16T02:06:21.711 INFO:tasks.workunit.client.0.smithi110.stdout:7/733: write d3/d15/d38/f6a [794160,123589] 0 2024-09-16T02:06:21.716 INFO:tasks.workunit.client.0.smithi110.stdout:4/811: sync 2024-09-16T02:06:21.716 INFO:tasks.workunit.client.0.smithi110.stdout:2/986: sync 2024-09-16T02:06:21.716 INFO:tasks.workunit.client.0.smithi110.stdout:9/924: sync 2024-09-16T02:06:21.716 INFO:tasks.workunit.client.0.smithi110.stdout:0/948: sync 2024-09-16T02:06:21.719 INFO:tasks.workunit.client.0.smithi110.stdout:0/949: mkdir d3/d4/dc/d14/df9/d12d 0 2024-09-16T02:06:21.724 INFO:tasks.workunit.client.0.smithi110.stdout:4/812: creat d4/d8/d31/d5d/d84/f107 x:0 0 0 2024-09-16T02:06:21.729 INFO:tasks.workunit.client.0.smithi110.stdout:0/950: mkdir d3/d4/dc/d70/d12e 0 2024-09-16T02:06:21.729 INFO:tasks.workunit.client.0.smithi110.stdout:0/951: stat d3/d6/c2f 0 2024-09-16T02:06:21.739 INFO:tasks.workunit.client.0.smithi110.stdout:0/952: rename d3/d4/dc/d10/dbd/lf8 to d3/l12f 0 2024-09-16T02:06:21.740 INFO:tasks.workunit.client.0.smithi110.stdout:0/953: stat d3/d6/f99 0 2024-09-16T02:06:21.742 INFO:tasks.workunit.client.0.smithi110.stdout:2/987: getdents d0/d5f/dc0/ddc/ddd/db5 0 2024-09-16T02:06:21.747 INFO:tasks.workunit.client.0.smithi110.stdout:0/954: rename d3/d4/dc/d10/fec to d3/d92/d9a/dd4/f130 0 2024-09-16T02:06:21.748 INFO:tasks.workunit.client.0.smithi110.stdout:7/734: write d3/f90 [3573339,7695] 0 2024-09-16T02:06:21.749 INFO:tasks.workunit.client.0.smithi110.stdout:2/988: mkdir d0/d5f/dc0/ddc/ddd/dfa/d158 0 2024-09-16T02:06:21.749 INFO:tasks.workunit.client.0.smithi110.stdout:6/936: dwrite d0/d29/fd3 [0,4194304] 0 2024-09-16T02:06:21.752 INFO:tasks.workunit.client.0.smithi110.stdout:0/955: readlink d3/d4/dc/d14/l4f 0 2024-09-16T02:06:21.759 INFO:tasks.workunit.client.0.smithi110.stdout:9/925: write d1/dd/d6a/d6c/d6f/d79/de/d1f/fbf [490882,16895] 0 2024-09-16T02:06:21.760 INFO:tasks.workunit.client.0.smithi110.stdout:0/956: chown d3/d4/d41/f5f 85718 1 2024-09-16T02:06:21.761 INFO:tasks.workunit.client.0.smithi110.stdout:7/735: mknod d3/d15/d38/d4f/d10/d11/d3e/d40/d50/ce3 0 2024-09-16T02:06:21.768 INFO:tasks.workunit.client.0.smithi110.stdout:4/813: dwrite d4/d8/d17/d23/d4c/d6d/d4f/f75 [0,4194304] 0 2024-09-16T02:06:21.774 INFO:tasks.workunit.client.0.smithi110.stdout:9/926: mkdir d1/dd/d6a/d6c/d6f/d79/de/d132 0 2024-09-16T02:06:21.776 INFO:tasks.workunit.client.0.smithi110.stdout:6/937: creat d0/d2/d18/f125 x:0 0 0 2024-09-16T02:06:21.777 INFO:tasks.workunit.client.0.smithi110.stdout:6/938: chown d0/d29/d2a/d2f/f99 0 1 2024-09-16T02:06:21.778 INFO:tasks.workunit.client.0.smithi110.stdout:0/957: mknod d3/d6/d114/c131 0 2024-09-16T02:06:21.780 INFO:tasks.workunit.client.0.smithi110.stdout:2/989: getdents d0 0 2024-09-16T02:06:21.781 INFO:tasks.workunit.client.0.smithi110.stdout:2/990: dread - d0/db/d47/da1/dad/d10b/f147 zero size 2024-09-16T02:06:21.783 INFO:tasks.workunit.client.0.smithi110.stdout:9/927: creat d1/d1b/d23/d7c/d130/f133 x:0 0 0 2024-09-16T02:06:21.784 INFO:tasks.workunit.client.0.smithi110.stdout:7/736: creat d3/d15/fe4 x:0 0 0 2024-09-16T02:06:21.785 INFO:tasks.workunit.client.0.smithi110.stdout:6/939: creat d0/d29/d2a/d2d/daa/f126 x:0 0 0 2024-09-16T02:06:21.786 INFO:tasks.workunit.client.0.smithi110.stdout:0/958: mknod d3/d4/df2/df3/c132 0 2024-09-16T02:06:21.787 INFO:tasks.workunit.client.0.smithi110.stdout:6/940: read d0/d29/d2a/d2f/f58 [8425113,88954] 0 2024-09-16T02:06:21.791 INFO:tasks.workunit.client.0.smithi110.stdout:4/814: getdents d4/d8/d17/d23/d4c 0 2024-09-16T02:06:21.797 INFO:tasks.workunit.client.0.smithi110.stdout:4/815: dread d4/d8/d17/d23/d4c/d6d/d4f/f75 [0,4194304] 0 2024-09-16T02:06:21.798 INFO:tasks.workunit.client.0.smithi110.stdout:6/941: rmdir d0/d2/d5/db8/dd1/df9 39 2024-09-16T02:06:21.799 INFO:tasks.workunit.client.0.smithi110.stdout:4/816: write f3 [5251857,128122] 0 2024-09-16T02:06:21.801 INFO:tasks.workunit.client.0.smithi110.stdout:9/928: dread d1/dd/d6a/d6c/d75/fa6 [0,4194304] 0 2024-09-16T02:06:21.802 INFO:tasks.workunit.client.0.smithi110.stdout:2/991: creat d0/db/d105/d41/db3/db8/de1/f159 x:0 0 0 2024-09-16T02:06:21.802 INFO:tasks.workunit.client.0.smithi110.stdout:0/959: write d3/d6/d43/d55/d59/f9c [4780563,97359] 0 2024-09-16T02:06:21.806 INFO:tasks.workunit.client.0.smithi110.stdout:8/767: sync 2024-09-16T02:06:21.806 INFO:tasks.workunit.client.0.smithi110.stdout:5/965: sync 2024-09-16T02:06:21.809 INFO:tasks.workunit.client.0.smithi110.stdout:7/737: dread d3/d15/d38/d4f/d10/d11/d3e/dd5/f82 [0,4194304] 0 2024-09-16T02:06:21.813 INFO:tasks.workunit.client.0.smithi110.stdout:2/992: write d0/db/d105/f8a [2837039,287] 0 2024-09-16T02:06:21.816 INFO:tasks.workunit.client.0.smithi110.stdout:6/942: dwrite d0/d2/d5/d84/d62/fa6 [0,4194304] 0 2024-09-16T02:06:21.816 INFO:tasks.workunit.client.0.smithi110.stdout:4/817: link d4/d8/d17/d23/d61/ff5 d4/d8/d17/d23/d61/d103/f108 0 2024-09-16T02:06:21.818 INFO:tasks.workunit.client.0.smithi110.stdout:0/960: creat d3/d4/dc/d14/df9/d12d/f133 x:0 0 0 2024-09-16T02:06:21.819 INFO:tasks.workunit.client.0.smithi110.stdout:5/966: truncate d5/dd/df/d11/d6d/d11a/dab/f107 865311 0 2024-09-16T02:06:21.820 INFO:tasks.workunit.client.0.smithi110.stdout:5/967: chown d5/d36/d45/ce2 11 1 2024-09-16T02:06:21.821 INFO:tasks.workunit.client.0.smithi110.stdout:5/968: fdatasync d5/dd/f12e 0 2024-09-16T02:06:21.822 INFO:tasks.workunit.client.0.smithi110.stdout:5/969: fsync d5/d36/fc9 0 2024-09-16T02:06:21.823 INFO:tasks.workunit.client.0.smithi110.stdout:2/993: creat d0/db/d47/da1/dad/df3/f15a x:0 0 0 2024-09-16T02:06:21.824 INFO:tasks.workunit.client.0.smithi110.stdout:2/994: readlink d0/db/d47/da1/la3 0 2024-09-16T02:06:21.827 INFO:tasks.workunit.client.0.smithi110.stdout:8/768: symlink d3/d2b/d27/d3a/ddb/l103 0 2024-09-16T02:06:21.829 INFO:tasks.workunit.client.0.smithi110.stdout:7/738: creat d3/d15/d38/d4f/d10/de2/fe5 x:0 0 0 2024-09-16T02:06:21.830 INFO:tasks.workunit.client.0.smithi110.stdout:9/929: getdents d1/dd/d6a/d6c/d6f/d79 0 2024-09-16T02:06:21.837 INFO:tasks.workunit.client.0.smithi110.stdout:6/943: dread d0/d2/d18/f46 [0,4194304] 0 2024-09-16T02:06:21.837 INFO:tasks.workunit.client.0.smithi110.stdout:4/818: mkdir d4/d8/d17/d23/d4c/d6d/d3c/d109 0 2024-09-16T02:06:21.839 INFO:tasks.workunit.client.0.smithi110.stdout:0/961: write d3/d4/dc/d14/d7e/d81/d89/f9b [608974,131033] 0 2024-09-16T02:06:21.842 INFO:tasks.workunit.client.0.smithi110.stdout:2/995: write d0/db/d47/d48/daa/fbd [4507206,10440] 0 2024-09-16T02:06:21.844 INFO:tasks.workunit.client.0.smithi110.stdout:5/970: symlink d5/dd/l140 0 2024-09-16T02:06:21.845 INFO:tasks.workunit.client.0.smithi110.stdout:4/819: mknod d4/d8/d17/d23/d4c/d6d/d4f/c10a 0 2024-09-16T02:06:21.846 INFO:tasks.workunit.client.0.smithi110.stdout:6/944: mknod d0/d29/d2a/d2d/d8b/c127 0 2024-09-16T02:06:21.846 INFO:tasks.workunit.client.0.smithi110.stdout:5/971: read - d5/dd/df/d11/d6d/d11a/d9c/f114 zero size 2024-09-16T02:06:21.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/739: write d3/d15/d38/d4f/d10/f39 [2533487,28344] 0 2024-09-16T02:06:21.848 INFO:tasks.workunit.client.0.smithi110.stdout:3/871: sync 2024-09-16T02:06:21.851 INFO:tasks.workunit.client.0.smithi110.stdout:0/962: rmdir d3/d4/dc/d75 39 2024-09-16T02:06:21.851 INFO:tasks.workunit.client.0.smithi110.stdout:7/740: chown d3/d15/d38/f8d 3 1 2024-09-16T02:06:21.853 INFO:tasks.workunit.client.0.smithi110.stdout:2/996: rename d0/db/d105/d41/db3/lca to d0/db/d105/d58/dec/d100/l15b 0 2024-09-16T02:06:21.853 INFO:tasks.workunit.client.0.smithi110.stdout:5/972: readlink d5/dd/l3e 0 2024-09-16T02:06:21.857 INFO:tasks.workunit.client.0.smithi110.stdout:9/930: dwrite d1/dd/d6a/d6c/d6f/d79/d29/fb3 [0,4194304] 0 2024-09-16T02:06:21.858 INFO:tasks.workunit.client.0.smithi110.stdout:7/741: fsync d3/d15/d38/d4f/d10/d76/fcb 0 2024-09-16T02:06:21.864 INFO:tasks.workunit.client.0.smithi110.stdout:6/945: mknod d0/d2/d57/d114/d120/c128 0 2024-09-16T02:06:21.867 INFO:tasks.workunit.client.0.smithi110.stdout:5/973: fsync d5/dd/df/f38 0 2024-09-16T02:06:21.873 INFO:tasks.workunit.client.0.smithi110.stdout:6/946: write d0/d2/d5/d55/f111 [559229,45318] 0 2024-09-16T02:06:21.875 INFO:tasks.workunit.client.0.smithi110.stdout:8/769: dwrite d3/d2b/d27/da7/dc7/ff0 [0,4194304] 0 2024-09-16T02:06:21.877 INFO:tasks.workunit.client.0.smithi110.stdout:4/820: dread d4/d8/d17/d23/f4a [0,4194304] 0 2024-09-16T02:06:21.881 INFO:tasks.workunit.client.0.smithi110.stdout:3/872: truncate d8/d48/d5b/d92/dc7/f2b 2486958 0 2024-09-16T02:06:21.888 INFO:tasks.workunit.client.0.smithi110.stdout:7/742: dwrite d3/d15/d38/d4f/d10/d2c/fd8 [0,4194304] 0 2024-09-16T02:06:21.893 INFO:tasks.workunit.client.0.smithi110.stdout:3/873: stat d8/d48/d5b/d92/dc7/ce0 0 2024-09-16T02:06:21.895 INFO:tasks.workunit.client.0.smithi110.stdout:5/974: truncate d5/dd/df/d11/fb9 212094 0 2024-09-16T02:06:21.895 INFO:tasks.workunit.client.0.smithi110.stdout:8/770: write d3/d2b/d27/da7/d1a/d6c/ff3 [309556,110221] 0 2024-09-16T02:06:21.895 INFO:tasks.workunit.client.0.smithi110.stdout:9/931: dwrite d1/d1b/d23/fc7 [0,4194304] 0 2024-09-16T02:06:21.903 INFO:tasks.workunit.client.0.smithi110.stdout:6/947: dwrite d0/d2/fc0 [0,4194304] 0 2024-09-16T02:06:21.904 INFO:tasks.workunit.client.0.smithi110.stdout:2/997: dread d0/d5f/dc0/ddc/ddd/dfa/d3b/f53 [0,4194304] 0 2024-09-16T02:06:21.905 INFO:tasks.workunit.client.0.smithi110.stdout:7/743: readlink d3/d15/d44/l6c 0 2024-09-16T02:06:21.910 INFO:tasks.workunit.client.0.smithi110.stdout:3/874: mkdir d8/d29/d45/d134 0 2024-09-16T02:06:21.917 INFO:tasks.workunit.client.0.smithi110.stdout:4/821: dwrite d4/d8/d31/f39 [0,4194304] 0 2024-09-16T02:06:21.917 INFO:tasks.workunit.client.0.smithi110.stdout:0/963: dread d3/d6/f39 [0,4194304] 0 2024-09-16T02:06:21.919 INFO:tasks.workunit.client.0.smithi110.stdout:5/975: write d5/d36/d45/d47/feb [539129,44458] 0 2024-09-16T02:06:21.920 INFO:tasks.workunit.client.0.smithi110.stdout:8/771: dwrite d3/d2b/d27/da7/d1a/f5d [0,4194304] 0 2024-09-16T02:06:21.928 INFO:tasks.workunit.client.0.smithi110.stdout:8/772: stat d3/f44 0 2024-09-16T02:06:21.930 INFO:tasks.workunit.client.0.smithi110.stdout:3/875: symlink d8/d48/l135 0 2024-09-16T02:06:21.931 INFO:tasks.workunit.client.0.smithi110.stdout:5/976: read - d5/f13c zero size 2024-09-16T02:06:21.931 INFO:tasks.workunit.client.0.smithi110.stdout:2/998: truncate d0/db/f2e 292208 0 2024-09-16T02:06:21.934 INFO:tasks.workunit.client.0.smithi110.stdout:4/822: dread d4/d8/d17/d23/d4c/d6d/d3c/f81 [0,4194304] 0 2024-09-16T02:06:21.934 INFO:tasks.workunit.client.0.smithi110.stdout:6/948: write d0/d2/d57/d7a/f9a [493937,57162] 0 2024-09-16T02:06:21.939 INFO:tasks.workunit.client.0.smithi110.stdout:8/773: creat d3/d2b/d27/d45/dce/f104 x:0 0 0 2024-09-16T02:06:21.942 INFO:tasks.workunit.client.0.smithi110.stdout:5/977: mkdir d5/dd/d90/df6/d106/d141 0 2024-09-16T02:06:21.943 INFO:tasks.workunit.client.0.smithi110.stdout:4/823: unlink d4/d8/d31/l3f 0 2024-09-16T02:06:21.943 INFO:tasks.workunit.client.0.smithi110.stdout:9/932: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/f48 [0,4194304] 0 2024-09-16T02:06:21.944 INFO:tasks.workunit.client.0.smithi110.stdout:5/978: dread - d5/dd/df/d11/d6d/fdd zero size 2024-09-16T02:06:21.946 INFO:tasks.workunit.client.0.smithi110.stdout:6/949: symlink d0/d2/d5/db8/dd1/dd8/l129 0 2024-09-16T02:06:21.948 INFO:tasks.workunit.client.0.smithi110.stdout:0/964: dread d3/d4/dc/f1c [0,4194304] 0 2024-09-16T02:06:21.950 INFO:tasks.workunit.client.0.smithi110.stdout:5/979: creat d5/d36/db5/f142 x:0 0 0 2024-09-16T02:06:21.950 INFO:tasks.workunit.client.0.smithi110.stdout:9/933: mknod d1/dd/d6a/d6c/d6f/d79/de/d132/c134 0 2024-09-16T02:06:21.952 INFO:tasks.workunit.client.0.smithi110.stdout:4/824: truncate d4/d8/d17/d23/f82 3571634 0 2024-09-16T02:06:21.956 INFO:tasks.workunit.client.0.smithi110.stdout:4/825: truncate d4/d8/d17/d23/d35/f42 5055936 0 2024-09-16T02:06:21.960 INFO:tasks.workunit.client.0.smithi110.stdout:5/980: chown d5/d36/dd5/c122 0 1 2024-09-16T02:06:21.960 INFO:tasks.workunit.client.0.smithi110.stdout:2/999: truncate d0/d5f/dc0/ddc/ddd/f24 7666396 0 2024-09-16T02:06:21.961 INFO:tasks.workunit.client.0.smithi110.stdout:7/744: dread d3/d15/d38/d4f/d10/f94 [0,4194304] 0 2024-09-16T02:06:21.963 INFO:tasks.workunit.client.0.smithi110.stdout:9/934: creat d1/dd/d6a/d6c/d6f/d79/d29/db4/f135 x:0 0 0 2024-09-16T02:06:21.970 INFO:tasks.workunit.client.0.smithi110.stdout:4/826: creat d4/d8/d17/d23/d4c/f10b x:0 0 0 2024-09-16T02:06:21.971 INFO:tasks.workunit.client.0.smithi110.stdout:3/876: dread d8/d29/f73 [0,4194304] 0 2024-09-16T02:06:21.971 INFO:tasks.workunit.client.0.smithi110.stdout:5/981: rmdir d5/dd/df/d11/d6d/d11a/d77/d9f 39 2024-09-16T02:06:21.973 INFO:tasks.workunit.client.0.smithi110.stdout:7/745: symlink d3/d15/d38/d4f/d10/d11/d3e/d40/le6 0 2024-09-16T02:06:21.974 INFO:tasks.workunit.client.0.smithi110.stdout:9/935: truncate d1/dd/f104 993728 0 2024-09-16T02:06:21.976 INFO:tasks.workunit.client.0.smithi110.stdout:6/950: dwrite d0/d2/d5/d84/f80 [0,4194304] 0 2024-09-16T02:06:21.977 INFO:tasks.workunit.client.0.smithi110.stdout:8/774: getdents d3/d2b/d65/d7f 0 2024-09-16T02:06:21.979 INFO:tasks.workunit.client.0.smithi110.stdout:0/965: write d3/d4/dc/d75/ffe [550685,95489] 0 2024-09-16T02:06:21.980 INFO:tasks.workunit.client.0.smithi110.stdout:6/951: stat d0/d2/d5/d1e/cfb 0 2024-09-16T02:06:21.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/827: mkdir d4/d8/d17/d23/d4c/d6d/d3c/d3d/d10c 0 2024-09-16T02:06:21.984 INFO:tasks.workunit.client.0.smithi110.stdout:4/828: stat d4/d8/d17/d23/lc9 0 2024-09-16T02:06:21.987 INFO:tasks.workunit.client.0.smithi110.stdout:7/746: fdatasync d3/d15/d38/d4f/d10/d11/d3e/d40/fca 0 2024-09-16T02:06:21.988 INFO:tasks.workunit.client.0.smithi110.stdout:7/747: read d3/f34 [644901,90382] 0 2024-09-16T02:06:21.995 INFO:tasks.workunit.client.0.smithi110.stdout:6/952: truncate d0/d2/d5/d1e/fb5 756297 0 2024-09-16T02:06:21.998 INFO:tasks.workunit.client.0.smithi110.stdout:3/877: write f7 [4759960,32616] 0 2024-09-16T02:06:22.003 INFO:tasks.workunit.client.0.smithi110.stdout:9/936: dwrite d1/dd/d6a/d6c/d6f/d79/de/d1f/f3e [0,4194304] 0 2024-09-16T02:06:22.032 INFO:tasks.workunit.client.0.smithi110.stdout:5/982: rename d5/dd/df/f38 to d5/dd/df/d11/d6d/d11a/f143 0 2024-09-16T02:06:22.032 INFO:tasks.workunit.client.0.smithi110.stdout:5/983: readlink d5/dd/l1a 0 2024-09-16T02:06:22.033 INFO:tasks.workunit.client.0.smithi110.stdout:4/829: creat d4/d8/d17/d23/d4c/d6d/d3c/d3d/d10c/f10d x:0 0 0 2024-09-16T02:06:22.035 INFO:tasks.workunit.client.0.smithi110.stdout:7/748: mknod d3/d15/d38/d4f/d10/dd9/ce7 0 2024-09-16T02:06:22.038 INFO:tasks.workunit.client.0.smithi110.stdout:3/878: readlink d8/d48/d5b/d92/dc7/d1b/d36/la3 0 2024-09-16T02:06:22.040 INFO:tasks.workunit.client.0.smithi110.stdout:9/937: symlink d1/dd/d6a/d6c/d6f/l136 0 2024-09-16T02:06:22.043 INFO:tasks.workunit.client.0.smithi110.stdout:0/966: rename d3/d4/dc/d14/d7e/d81/fd3 to d3/d4/d85/d93/da1/d115/f134 0 2024-09-16T02:06:22.045 INFO:tasks.workunit.client.0.smithi110.stdout:8/775: link d3/fb9 d3/d2b/d27/f105 0 2024-09-16T02:06:22.046 INFO:tasks.workunit.client.0.smithi110.stdout:7/749: mkdir d3/d15/d38/d4f/d10/d76/dd6/de8 0 2024-09-16T02:06:22.048 INFO:tasks.workunit.client.0.smithi110.stdout:7/750: chown d3/d62/d65/dc1/la4 0 1 2024-09-16T02:06:22.052 INFO:tasks.workunit.client.0.smithi110.stdout:0/967: rename d3/d6/d43/da7 to d3/d4/d85/d102/d135 0 2024-09-16T02:06:22.053 INFO:tasks.workunit.client.0.smithi110.stdout:6/953: dread d0/d2/d5/d55/f8f [0,4194304] 0 2024-09-16T02:06:22.055 INFO:tasks.workunit.client.0.smithi110.stdout:9/938: creat d1/d1b/daa/ded/f137 x:0 0 0 2024-09-16T02:06:22.055 INFO:tasks.workunit.client.0.smithi110.stdout:5/984: dread d5/dd/fbe [0,4194304] 0 2024-09-16T02:06:22.059 INFO:tasks.workunit.client.0.smithi110.stdout:0/968: creat d3/d4/d85/d93/da1/d115/f136 x:0 0 0 2024-09-16T02:06:22.062 INFO:tasks.workunit.client.0.smithi110.stdout:8/776: dwrite d3/d2b/d27/d45/fe7 [0,4194304] 0 2024-09-16T02:06:22.064 INFO:tasks.workunit.client.0.smithi110.stdout:9/939: dread d1/dd/d6a/d6c/d6f/d79/de/f110 [0,4194304] 0 2024-09-16T02:06:22.065 INFO:tasks.workunit.client.0.smithi110.stdout:0/969: symlink d3/d4/d6d/l137 0 2024-09-16T02:06:22.066 INFO:tasks.workunit.client.0.smithi110.stdout:3/879: dread d8/d48/d5b/d6a/fe2 [0,4194304] 0 2024-09-16T02:06:22.067 INFO:tasks.workunit.client.0.smithi110.stdout:5/985: mkdir d5/dd/df/d11/d6d/d11a/d6f/d8e/dac/d144 0 2024-09-16T02:06:22.067 INFO:tasks.workunit.client.0.smithi110.stdout:5/986: chown d5/d36/f67 215318 1 2024-09-16T02:06:22.067 INFO:tasks.workunit.client.0.smithi110.stdout:8/777: mknod d3/d2b/d27/d45/d86/c106 0 2024-09-16T02:06:22.069 INFO:tasks.workunit.client.0.smithi110.stdout:5/987: fdatasync d5/dd/df/d11/d6d/d11a/d9c/faa 0 2024-09-16T02:06:22.069 INFO:tasks.workunit.client.0.smithi110.stdout:5/988: fdatasync d5/d71/d89/f12a 0 2024-09-16T02:06:22.070 INFO:tasks.workunit.client.0.smithi110.stdout:9/940: mknod d1/d2b/c138 0 2024-09-16T02:06:22.073 INFO:tasks.workunit.client.0.smithi110.stdout:6/954: getdents d0/d2/d5/d94 0 2024-09-16T02:06:22.077 INFO:tasks.workunit.client.0.smithi110.stdout:8/778: rename d3/d2b/d27/da7/d1a/d36/f8b to d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/d98/f107 0 2024-09-16T02:06:22.078 INFO:tasks.workunit.client.0.smithi110.stdout:5/989: mknod d5/dd/df/d11/d6d/d11a/d6f/d8e/dbc/c145 0 2024-09-16T02:06:22.079 INFO:tasks.workunit.client.0.smithi110.stdout:4/830: write d4/d8/f5a [483637,90957] 0 2024-09-16T02:06:22.080 INFO:tasks.workunit.client.0.smithi110.stdout:9/941: mknod d1/dd/d6a/d6c/d6f/d79/de/d132/c139 0 2024-09-16T02:06:22.081 INFO:tasks.workunit.client.0.smithi110.stdout:8/779: dread d3/d2b/f70 [0,4194304] 0 2024-09-16T02:06:22.082 INFO:tasks.workunit.client.0.smithi110.stdout:9/942: chown d1/dd/d6a/d6c/d75/d8c/f3a 0 1 2024-09-16T02:06:22.085 INFO:tasks.workunit.client.0.smithi110.stdout:7/751: write d3/d15/d38/d4f/d10/d11/d3e/dd5/f95 [419746,30305] 0 2024-09-16T02:06:22.089 INFO:tasks.workunit.client.0.smithi110.stdout:0/970: link d3/d6/l128 d3/d4/dc/d14/df9/d12d/l138 0 2024-09-16T02:06:22.094 INFO:tasks.workunit.client.0.smithi110.stdout:9/943: rename d1/d5/d20/l90 to d1/dd/d6a/d6c/d75/l13a 0 2024-09-16T02:06:22.096 INFO:tasks.workunit.client.0.smithi110.stdout:6/955: unlink d0/d2/d5/db8/dd1/l10c 0 2024-09-16T02:06:22.097 INFO:tasks.workunit.client.0.smithi110.stdout:3/880: dwrite d8/d48/d5b/d6a/d75/d8b/fbb [0,4194304] 0 2024-09-16T02:06:22.098 INFO:tasks.workunit.client.0.smithi110.stdout:6/956: stat d0/d29/d2a/d2f/d34/ca2 0 2024-09-16T02:06:22.102 INFO:tasks.workunit.client.0.smithi110.stdout:8/780: dread d3/d2b/d27/da7/d1a/d36/d60/fb2 [0,4194304] 0 2024-09-16T02:06:22.103 INFO:tasks.workunit.client.0.smithi110.stdout:4/831: write d4/db4/fa8 [7033061,48781] 0 2024-09-16T02:06:22.105 INFO:tasks.workunit.client.0.smithi110.stdout:0/971: unlink d3/d6/d43/d55/d59/ffb 0 2024-09-16T02:06:22.106 INFO:tasks.workunit.client.0.smithi110.stdout:9/944: mknod d1/d1b/d23/d7c/c13b 0 2024-09-16T02:06:22.106 INFO:tasks.workunit.client.0.smithi110.stdout:0/972: chown d3/d4/df2/df3/d124/db3/f105 13442 1 2024-09-16T02:06:22.108 INFO:tasks.workunit.client.0.smithi110.stdout:7/752: mknod d3/d15/d38/d4f/d10/d11/d3e/dc5/ce9 0 2024-09-16T02:06:22.109 INFO:tasks.workunit.client.0.smithi110.stdout:0/973: chown d3/d4/dc/d75/fc5 520 1 2024-09-16T02:06:22.110 INFO:tasks.workunit.client.0.smithi110.stdout:0/974: readlink d3/d4/dc/d75/l11c 0 2024-09-16T02:06:22.110 INFO:tasks.workunit.client.0.smithi110.stdout:5/990: creat d5/f146 x:0 0 0 2024-09-16T02:06:22.112 INFO:tasks.workunit.client.0.smithi110.stdout:8/781: dread - d3/fb9 zero size 2024-09-16T02:06:22.113 INFO:tasks.workunit.client.0.smithi110.stdout:4/832: unlink d4/d8/d17/d23/d4c/fe4 0 2024-09-16T02:06:22.115 INFO:tasks.workunit.client.0.smithi110.stdout:9/945: dread d1/d5/d20/d55/d82/fd8 [0,4194304] 0 2024-09-16T02:06:22.117 INFO:tasks.workunit.client.0.smithi110.stdout:9/946: write d1/dd/d6a/d6c/d75/f115 [3577644,102687] 0 2024-09-16T02:06:22.120 INFO:tasks.workunit.client.0.smithi110.stdout:0/975: mkdir d3/d4/dc/d14/d7e/d81/d86/d139 0 2024-09-16T02:06:22.121 INFO:tasks.workunit.client.0.smithi110.stdout:3/881: write d8/f4d [754933,110743] 0 2024-09-16T02:06:22.121 INFO:tasks.workunit.client.0.smithi110.stdout:5/991: mknod d5/dd/df/d11/d6d/d11a/d77/de9/dfc/c147 0 2024-09-16T02:06:22.122 INFO:tasks.workunit.client.0.smithi110.stdout:0/976: stat d3/d6/d4b/c4c 0 2024-09-16T02:06:22.128 INFO:tasks.workunit.client.0.smithi110.stdout:9/947: dread - d1/dd/d6a/d6c/d75/d86/f116 zero size 2024-09-16T02:06:22.134 INFO:tasks.workunit.client.0.smithi110.stdout:6/957: dread d0/d2/f1c [4194304,4194304] 0 2024-09-16T02:06:22.135 INFO:tasks.workunit.client.0.smithi110.stdout:4/833: dwrite d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 [0,4194304] 0 2024-09-16T02:06:22.135 INFO:tasks.workunit.client.0.smithi110.stdout:7/753: rename d3/d15/d38/d4f/d10/d2c/fd8 to d3/d15/d38/d4f/d10/fea 0 2024-09-16T02:06:22.136 INFO:tasks.workunit.client.0.smithi110.stdout:0/977: mkdir d3/d4/d13a 0 2024-09-16T02:06:22.139 INFO:tasks.workunit.client.0.smithi110.stdout:5/992: readlink d5/dd/df/d11/d6d/d11a/d6f/d8e/dac/dc5/lef 0 2024-09-16T02:06:22.144 INFO:tasks.workunit.client.0.smithi110.stdout:0/978: mkdir d3/d4/dc/d14/df9/d10c/d13b 0 2024-09-16T02:06:22.148 INFO:tasks.workunit.client.0.smithi110.stdout:3/882: dread d8/d29/f42 [0,4194304] 0 2024-09-16T02:06:22.150 INFO:tasks.workunit.client.0.smithi110.stdout:3/883: truncate d8/d48/d5b/d6a/fb2 1052500 0 2024-09-16T02:06:22.155 INFO:tasks.workunit.client.0.smithi110.stdout:4/834: dread d4/d8/d17/d23/f70 [0,4194304] 0 2024-09-16T02:06:22.157 INFO:tasks.workunit.client.0.smithi110.stdout:3/884: readlink d8/d48/d5b/d6a/l115 0 2024-09-16T02:06:22.161 INFO:tasks.workunit.client.0.smithi110.stdout:0/979: link d3/d4/dc/f49 d3/d4/dc/d14/d7e/f13c 0 2024-09-16T02:06:22.162 INFO:tasks.workunit.client.0.smithi110.stdout:6/958: dwrite d0/d29/dc1/fe3 [0,4194304] 0 2024-09-16T02:06:22.163 INFO:tasks.workunit.client.0.smithi110.stdout:3/885: rename d8/d48/d7c/d87/da9/f104 to d8/d29/d45/d134/f136 0 2024-09-16T02:06:22.163 INFO:tasks.workunit.client.0.smithi110.stdout:7/754: write d3/d15/d38/d4f/d10/d11/f68 [4016244,126609] 0 2024-09-16T02:06:22.168 INFO:tasks.workunit.client.0.smithi110.stdout:6/959: truncate d0/d2/d57/d114/d120/f10b 454694 0 2024-09-16T02:06:22.170 INFO:tasks.workunit.client.0.smithi110.stdout:0/980: mknod d3/d4/d41/c13d 0 2024-09-16T02:06:22.170 INFO:tasks.workunit.client.0.smithi110.stdout:7/755: chown d3/d15/d38/d4f/d10/d11/d3e/f42 91515932 1 2024-09-16T02:06:22.171 INFO:tasks.workunit.client.0.smithi110.stdout:6/960: chown d0/d29/d2a/cca 1010 1 2024-09-16T02:06:22.171 INFO:tasks.workunit.client.0.smithi110.stdout:5/993: dwrite d5/dd/df/d11/d6d/d11a/f93 [0,4194304] 0 2024-09-16T02:06:22.174 INFO:tasks.workunit.client.0.smithi110.stdout:4/835: write d4/d8/d17/d23/f37 [2563069,35730] 0 2024-09-16T02:06:22.177 INFO:tasks.workunit.client.0.smithi110.stdout:5/994: mknod d5/dd/df/d92/c148 0 2024-09-16T02:06:22.180 INFO:tasks.workunit.client.0.smithi110.stdout:7/756: dread - d3/d15/d38/d4f/d10/d11/d3e/d40/fbe zero size 2024-09-16T02:06:22.184 INFO:tasks.workunit.client.0.smithi110.stdout:4/836: mknod d4/d8/d17/d23/d4c/da5/c10e 0 2024-09-16T02:06:22.185 INFO:tasks.workunit.client.0.smithi110.stdout:4/837: readlink d4/db4/l79 0 2024-09-16T02:06:22.186 INFO:tasks.workunit.client.0.smithi110.stdout:5/995: rename d5/d36/d45/d47/l82 to d5/d71/d89/d132/l149 0 2024-09-16T02:06:22.187 INFO:tasks.workunit.client.0.smithi110.stdout:4/838: read d4/d8/d17/d23/f74 [22727,110701] 0 2024-09-16T02:06:22.187 INFO:tasks.workunit.client.0.smithi110.stdout:3/886: dwrite d8/d48/d5b/d6a/d75/d88/dac/fce [0,4194304] 0 2024-09-16T02:06:22.189 INFO:tasks.workunit.client.0.smithi110.stdout:7/757: unlink d3/d15/d38/d4f/d10/d2c/l49 0 2024-09-16T02:06:22.191 INFO:tasks.workunit.client.0.smithi110.stdout:3/887: dread - d8/d48/d5b/d92/dc7/d1b/d3a/f131 zero size 2024-09-16T02:06:22.192 INFO:tasks.workunit.client.0.smithi110.stdout:7/758: fdatasync d3/d15/d38/d4f/d10/f39 0 2024-09-16T02:06:22.194 INFO:tasks.workunit.client.0.smithi110.stdout:5/996: symlink d5/dd/df/d11/d6d/d11a/d6f/d8e/dd6/d10c/l14a 0 2024-09-16T02:06:22.196 INFO:tasks.workunit.client.0.smithi110.stdout:3/888: rmdir d8/d48/d5b/d6a/d75/d88 39 2024-09-16T02:06:22.197 INFO:tasks.workunit.client.0.smithi110.stdout:7/759: dread d3/d15/d38/d4f/fd [4194304,4194304] 0 2024-09-16T02:06:22.198 INFO:tasks.workunit.client.0.smithi110.stdout:3/889: dread - d8/d48/d5b/d92/dc7/d1b/f9f zero size 2024-09-16T02:06:22.200 INFO:tasks.workunit.client.0.smithi110.stdout:5/997: dread - d5/dd/df/d11/d6d/f110 zero size 2024-09-16T02:06:22.203 INFO:tasks.workunit.client.0.smithi110.stdout:6/961: dread d0/d29/d2a/f2b [0,4194304] 0 2024-09-16T02:06:22.204 INFO:tasks.workunit.client.0.smithi110.stdout:5/998: truncate d5/d71/d89/f94 984600 0 2024-09-16T02:06:22.206 INFO:tasks.workunit.client.0.smithi110.stdout:3/890: fsync d8/d29/d45/f68 0 2024-09-16T02:06:22.206 INFO:tasks.workunit.client.0.smithi110.stdout:3/891: stat d8/d48/d5b/ce1 0 2024-09-16T02:06:22.207 INFO:tasks.workunit.client.0.smithi110.stdout:6/962: mkdir d0/d2/d5/d1e/d48/d113/d12a 0 2024-09-16T02:06:22.207 INFO:tasks.workunit.client.0.smithi110.stdout:3/892: write d8/f4d [1507168,80427] 0 2024-09-16T02:06:22.211 INFO:tasks.workunit.client.0.smithi110.stdout:3/893: creat d8/f137 x:0 0 0 2024-09-16T02:06:22.212 INFO:tasks.workunit.client.0.smithi110.stdout:6/963: mknod d0/d2/d57/d75/df0/c12b 0 2024-09-16T02:06:22.213 INFO:tasks.workunit.client.0.smithi110.stdout:4/839: dread d4/d8/d17/d23/d4c/f5b [0,4194304] 0 2024-09-16T02:06:22.214 INFO:tasks.workunit.client.0.smithi110.stdout:5/999: unlink d5/dd/df/d11/d6d/d11a/d6f/cd1 0 2024-09-16T02:06:22.216 INFO:tasks.workunit.client.0.smithi110.stdout:3/894: creat d8/d29/d102/f138 x:0 0 0 2024-09-16T02:06:22.216 INFO:tasks.workunit.client.0.smithi110.stdout:7/760: write d3/d15/d38/d4f/d2e/f71 [1161912,30471] 0 2024-09-16T02:06:22.218 INFO:tasks.workunit.client.0.smithi110.stdout:7/761: stat d3/d15/d38/d4f/d10/d11/d8f/fba 0 2024-09-16T02:06:22.219 INFO:tasks.workunit.client.0.smithi110.stdout:6/964: rename d0/d29/d2a/d2f/l4f to d0/d2/d57/d114/l12c 0 2024-09-16T02:06:22.220 INFO:tasks.workunit.client.0.smithi110.stdout:4/840: mknod d4/d8/d31/d73/dd5/c10f 0 2024-09-16T02:06:22.222 INFO:tasks.workunit.client.0.smithi110.stdout:7/762: dread - d3/d7a/fac zero size 2024-09-16T02:06:22.223 INFO:tasks.workunit.client.0.smithi110.stdout:7/763: chown d3/d15/d38/d4f/d10/d7d/da2 3067409 1 2024-09-16T02:06:22.230 INFO:tasks.workunit.client.0.smithi110.stdout:3/895: creat d8/d48/d5b/d6a/d75/f139 x:0 0 0 2024-09-16T02:06:22.233 INFO:tasks.workunit.client.0.smithi110.stdout:4/841: write d4/db4/fcd [8276903,128102] 0 2024-09-16T02:06:22.238 INFO:tasks.workunit.client.0.smithi110.stdout:3/896: mkdir d8/d48/d5b/d6a/d75/d88/d13a 0 2024-09-16T02:06:22.239 INFO:tasks.workunit.client.0.smithi110.stdout:7/764: link d3/caa d3/d62/d65/dc1/ceb 0 2024-09-16T02:06:22.242 INFO:tasks.workunit.client.0.smithi110.stdout:4/842: dwrite d4/d8/d31/fd3 [4194304,4194304] 0 2024-09-16T02:06:22.245 INFO:tasks.workunit.client.0.smithi110.stdout:3/897: getdents d8/d48/d5b/d92 0 2024-09-16T02:06:22.247 INFO:tasks.workunit.client.0.smithi110.stdout:3/898: read d8/d48/d5b/d92/dc7/fe7 [4412325,41494] 0 2024-09-16T02:06:22.248 INFO:tasks.workunit.client.0.smithi110.stdout:7/765: mkdir d3/d15/d38/d4f/d10/d76/dd6/de8/dec 0 2024-09-16T02:06:22.251 INFO:tasks.workunit.client.0.smithi110.stdout:4/843: creat d4/d8/d17/d23/d4c/d6d/d4f/da9/f110 x:0 0 0 2024-09-16T02:06:22.260 INFO:tasks.workunit.client.0.smithi110.stdout:7/766: write d3/d15/d44/fbb [1047722,127530] 0 2024-09-16T02:06:22.265 INFO:tasks.workunit.client.0.smithi110.stdout:3/899: dread d8/d48/d5b/d92/dc7/d1b/d36/f71 [0,4194304] 0 2024-09-16T02:06:22.266 INFO:tasks.workunit.client.0.smithi110.stdout:4/844: dwrite d4/d8/d17/d23/f51 [0,4194304] 0 2024-09-16T02:06:22.270 INFO:tasks.workunit.client.0.smithi110.stdout:3/900: rename d8/f15 to d8/d48/d7c/d87/d12c/f13b 0 2024-09-16T02:06:22.272 INFO:tasks.workunit.client.0.smithi110.stdout:3/901: dread d8/ff5 [0,4194304] 0 2024-09-16T02:06:22.274 INFO:tasks.workunit.client.0.smithi110.stdout:4/845: rename d4/d8/d31/d80/f24 to d4/d8/d17/d23/d61/f111 0 2024-09-16T02:06:22.278 INFO:tasks.workunit.client.0.smithi110.stdout:7/767: dread d3/d15/d38/d4f/d10/d7d/fab [0,4194304] 0 2024-09-16T02:06:22.280 INFO:tasks.workunit.client.0.smithi110.stdout:3/902: dwrite d8/d48/d5b/d92/dc7/d1b/d3a/f85 [0,4194304] 0 2024-09-16T02:06:22.281 INFO:tasks.workunit.client.0.smithi110.stdout:7/768: creat d3/d15/d3a/fed x:0 0 0 2024-09-16T02:06:22.282 INFO:tasks.workunit.client.0.smithi110.stdout:7/769: write d3/d15/d38/d4f/fe1 [940150,105107] 0 2024-09-16T02:06:22.283 INFO:tasks.workunit.client.0.smithi110.stdout:7/770: dread - d3/d15/d3a/fed zero size 2024-09-16T02:06:22.285 INFO:tasks.workunit.client.0.smithi110.stdout:7/771: fsync d3/d15/d38/d4f/d10/d2c/f86 0 2024-09-16T02:06:22.289 INFO:tasks.workunit.client.0.smithi110.stdout:7/772: chown d3/d15/d38/d4f/d10/d2c/c36 10 1 2024-09-16T02:06:22.295 INFO:tasks.workunit.client.0.smithi110.stdout:7/773: truncate d3/d15/d38/d4f/d10/d2c/fdb 4458649 0 2024-09-16T02:06:22.297 INFO:tasks.workunit.client.0.smithi110.stdout:4/846: truncate d4/d8/d31/d80/dfc/fb8 3350176 0 2024-09-16T02:06:22.300 INFO:tasks.workunit.client.0.smithi110.stdout:7/774: rename d3/d15/d38/d4f/d10/d11/d3e/ld0 to d3/d15/d38/d4f/d10/d7d/da2/lee 0 2024-09-16T02:06:22.303 INFO:tasks.workunit.client.0.smithi110.stdout:3/903: dwrite d8/d48/d5b/d6a/ff8 [0,4194304] 0 2024-09-16T02:06:22.305 INFO:tasks.workunit.client.0.smithi110.stdout:7/775: mkdir d3/d15/d38/d4f/d10/d76/def 0 2024-09-16T02:06:22.312 INFO:tasks.workunit.client.0.smithi110.stdout:4/847: dwrite d4/f21 [4194304,4194304] 0 2024-09-16T02:06:22.313 INFO:tasks.workunit.client.0.smithi110.stdout:4/848: write d4/d8/d31/d73/fe0 [1217204,104545] 0 2024-09-16T02:06:22.429 INFO:tasks.workunit.client.0.smithi110.stdout:7/776: creat d3/d15/d38/d4f/d10/d76/dd6/de8/ff0 x:0 0 0 2024-09-16T02:06:22.444 INFO:tasks.workunit.client.0.smithi110.stdout:7/777: dread d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/fbc [0,4194304] 0 2024-09-16T02:06:22.445 INFO:tasks.workunit.client.0.smithi110.stdout:4/849: dread d4/d8/d17/d23/d4c/f9f [0,4194304] 0 2024-09-16T02:06:22.446 INFO:tasks.workunit.client.0.smithi110.stdout:7/778: mkdir d3/d7a/df1 0 2024-09-16T02:06:22.446 INFO:tasks.workunit.client.0.smithi110.stdout:4/850: write d4/d8/d31/fd3 [8560611,81404] 0 2024-09-16T02:06:22.450 INFO:tasks.workunit.client.0.smithi110.stdout:3/904: write d8/d29/dbd/dc6/f10d [318649,48564] 0 2024-09-16T02:06:22.454 INFO:tasks.workunit.client.0.smithi110.stdout:4/851: creat d4/d8/d31/d73/dd5/f112 x:0 0 0 2024-09-16T02:06:22.455 INFO:tasks.workunit.client.0.smithi110.stdout:3/905: mknod d8/c13c 0 2024-09-16T02:06:22.455 INFO:tasks.workunit.client.0.smithi110.stdout:3/906: dread - d8/d48/d5b/d6a/def/ff2 zero size 2024-09-16T02:06:22.457 INFO:tasks.workunit.client.0.smithi110.stdout:3/907: chown d8/d48/d5b/d92/dc7/d1b/d3a/f50 2806451 1 2024-09-16T02:06:22.458 INFO:tasks.workunit.client.0.smithi110.stdout:4/852: rmdir d4/d8/d31/d5d 39 2024-09-16T02:06:22.461 INFO:tasks.workunit.client.0.smithi110.stdout:7/779: write d3/d15/d38/f8d [619287,123589] 0 2024-09-16T02:06:22.462 INFO:tasks.workunit.client.0.smithi110.stdout:7/780: fdatasync d3/d15/d44/fbb 0 2024-09-16T02:06:22.464 INFO:tasks.workunit.client.0.smithi110.stdout:4/853: mkdir d4/d8/d113 0 2024-09-16T02:06:22.469 INFO:tasks.workunit.client.0.smithi110.stdout:4/854: creat d4/d8/d17/d23/d4c/d6d/d7f/f114 x:0 0 0 2024-09-16T02:06:22.470 INFO:tasks.workunit.client.0.smithi110.stdout:7/781: truncate d3/d15/d38/d4f/d10/d2c/fdb 237494 0 2024-09-16T02:06:22.470 INFO:tasks.workunit.client.0.smithi110.stdout:4/855: chown d4/c1e 16184123 1 2024-09-16T02:06:22.475 INFO:tasks.workunit.client.0.smithi110.stdout:3/908: dwrite d8/d48/d5b/d6a/fb6 [0,4194304] 0 2024-09-16T02:06:22.476 INFO:tasks.workunit.client.0.smithi110.stdout:4/856: creat d4/d8/d17/d23/d4c/d6d/d7f/f115 x:0 0 0 2024-09-16T02:06:22.477 INFO:tasks.workunit.client.0.smithi110.stdout:3/909: fsync d8/d29/dbd/dc6/f10d 0 2024-09-16T02:06:22.481 INFO:tasks.workunit.client.0.smithi110.stdout:4/857: mknod d4/d8/d17/d23/d4c/d6d/d3c/c116 0 2024-09-16T02:06:22.485 INFO:tasks.workunit.client.0.smithi110.stdout:3/910: dwrite d8/d48/d5b/d92/dc7/d1b/fa2 [4194304,4194304] 0 2024-09-16T02:06:22.486 INFO:tasks.workunit.client.0.smithi110.stdout:7/782: dread d3/d15/d38/d4f/d2e/f71 [0,4194304] 0 2024-09-16T02:06:22.497 INFO:tasks.workunit.client.0.smithi110.stdout:3/911: dwrite d8/d48/d7c/d87/f10c [0,4194304] 0 2024-09-16T02:06:22.500 INFO:tasks.workunit.client.0.smithi110.stdout:7/783: creat d3/d15/ff2 x:0 0 0 2024-09-16T02:06:22.503 INFO:tasks.workunit.client.0.smithi110.stdout:7/784: mknod d3/d15/d38/d4f/d10/d76/cf3 0 2024-09-16T02:06:22.505 INFO:tasks.workunit.client.0.smithi110.stdout:7/785: readlink d3/d15/d38/l69 0 2024-09-16T02:06:22.505 INFO:tasks.workunit.client.0.smithi110.stdout:3/912: write d8/d48/d5b/d92/dc7/d1b/d36/f40 [641510,43661] 0 2024-09-16T02:06:22.509 INFO:tasks.workunit.client.0.smithi110.stdout:7/786: mkdir d3/d15/d3a/d80/df4 0 2024-09-16T02:06:22.511 INFO:tasks.workunit.client.0.smithi110.stdout:7/787: mkdir d3/d15/d38/d4f/d10/d11/d73/df5 0 2024-09-16T02:06:22.514 INFO:tasks.workunit.client.0.smithi110.stdout:7/788: unlink d3/d15/d38/d4f/d10/d2c/f86 0 2024-09-16T02:06:22.525 INFO:tasks.workunit.client.0.smithi110.stdout:3/913: dwrite d8/fd1 [0,4194304] 0 2024-09-16T02:06:22.528 INFO:tasks.workunit.client.0.smithi110.stdout:3/914: dread d8/d29/dbd/dc6/f10d [0,4194304] 0 2024-09-16T02:06:22.534 INFO:tasks.workunit.client.0.smithi110.stdout:7/789: dwrite d3/d15/d38/d4f/d10/d11/f28 [8388608,4194304] 0 2024-09-16T02:06:22.536 INFO:tasks.workunit.client.0.smithi110.stdout:7/790: truncate d3/d15/d38/d4f/d10/de2/fe5 292046 0 2024-09-16T02:06:22.542 INFO:tasks.workunit.client.0.smithi110.stdout:7/791: dread d3/d15/d38/d4f/d10/f94 [0,4194304] 0 2024-09-16T02:06:22.546 INFO:tasks.workunit.client.0.smithi110.stdout:7/792: creat d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/ff6 x:0 0 0 2024-09-16T02:06:22.549 INFO:tasks.workunit.client.0.smithi110.stdout:7/793: mkdir d3/d15/d38/d4f/d10/d11/d3e/df7 0 2024-09-16T02:06:22.555 INFO:tasks.workunit.client.0.smithi110.stdout:3/915: dread d8/d48/d5b/d92/dc7/fe7 [0,4194304] 0 2024-09-16T02:06:22.557 INFO:tasks.workunit.client.0.smithi110.stdout:3/916: creat d8/d48/d5b/d92/dc7/d1b/d36/d83/d108/f13d x:0 0 0 2024-09-16T02:06:22.559 INFO:tasks.workunit.client.0.smithi110.stdout:7/794: write d3/d15/d38/d4f/d10/d11/d8f/fba [1031741,69254] 0 2024-09-16T02:06:22.561 INFO:tasks.workunit.client.0.smithi110.stdout:7/795: chown d3/d15/d38/d4f/d10/d11/d3e/d40/d50/cdc 37012658 1 2024-09-16T02:06:22.561 INFO:tasks.workunit.client.0.smithi110.stdout:3/917: truncate d8/d48/d5b/d92/dc7/d1b/d3a/d43/f67 647138 0 2024-09-16T02:06:22.567 INFO:tasks.workunit.client.0.smithi110.stdout:3/918: rename d8/d29/d102/f12d to d8/d48/d5b/d92/dc7/d1b/d36/d57/f13e 0 2024-09-16T02:06:22.569 INFO:tasks.workunit.client.0.smithi110.stdout:7/796: dwrite d3/d15/d38/d4f/d10/d11/d73/f93 [0,4194304] 0 2024-09-16T02:06:22.569 INFO:tasks.workunit.client.0.smithi110.stdout:3/919: read d8/d29/f42 [2551740,75329] 0 2024-09-16T02:06:22.572 INFO:tasks.workunit.client.0.smithi110.stdout:3/920: chown d8/d48/d5b/d92/dc7/d1b/d3a/f85 0 1 2024-09-16T02:06:22.572 INFO:tasks.workunit.client.0.smithi110.stdout:7/797: write d3/d15/d38/d4f/d10/d11/d3e/dd5/fa7 [505537,81107] 0 2024-09-16T02:06:22.577 INFO:tasks.workunit.client.0.smithi110.stdout:7/798: truncate d3/d15/d38/d4f/d10/d2c/fdb 184230 0 2024-09-16T02:06:22.578 INFO:tasks.workunit.client.0.smithi110.stdout:3/921: dread d8/d29/dbd/dc6/f82 [0,4194304] 0 2024-09-16T02:06:22.580 INFO:tasks.workunit.client.0.smithi110.stdout:3/922: dread - d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/fec zero size 2024-09-16T02:06:22.580 INFO:tasks.workunit.client.0.smithi110.stdout:7/799: creat d3/d15/d38/ff8 x:0 0 0 2024-09-16T02:06:22.581 INFO:tasks.workunit.client.0.smithi110.stdout:3/923: fsync f2 0 2024-09-16T02:06:22.591 INFO:tasks.workunit.client.0.smithi110.stdout:3/924: dread d8/d48/d5b/d92/dc7/f2b [0,4194304] 0 2024-09-16T02:06:22.592 INFO:tasks.workunit.client.0.smithi110.stdout:7/800: write d3/d15/d38/f3b [3858765,100231] 0 2024-09-16T02:06:22.596 INFO:tasks.workunit.client.0.smithi110.stdout:7/801: unlink d3/d15/d38/d4f/d10/d11/f28 0 2024-09-16T02:06:22.599 INFO:tasks.workunit.client.0.smithi110.stdout:3/925: creat d8/d48/d5b/d92/dc7/d1b/d3a/f13f x:0 0 0 2024-09-16T02:06:22.600 INFO:tasks.workunit.client.0.smithi110.stdout:7/802: symlink d3/d15/d38/d4f/d10/d11/lf9 0 2024-09-16T02:06:22.600 INFO:tasks.workunit.client.0.smithi110.stdout:3/926: chown d8/d29/dbd/dc6 1 1 2024-09-16T02:06:22.603 INFO:tasks.workunit.client.0.smithi110.stdout:7/803: truncate d3/d15/d38/d4f/d10/d76/dd6/de8/ff0 846495 0 2024-09-16T02:06:22.605 INFO:tasks.workunit.client.0.smithi110.stdout:7/804: chown d3/d15/d38/d4f/d10/d11/d73/f93 13774184 1 2024-09-16T02:06:22.606 INFO:tasks.workunit.client.0.smithi110.stdout:3/927: dwrite d8/d48/d5b/ffe [0,4194304] 0 2024-09-16T02:06:22.617 INFO:tasks.workunit.client.0.smithi110.stdout:7/805: link d3/d15/d38/d4f/d10/d2c/fdd d3/d15/d38/d4f/d10/d11/d3e/dd5/ffa 0 2024-09-16T02:06:22.618 INFO:tasks.workunit.client.0.smithi110.stdout:7/806: stat d3/d15/d38/d4f/d10/d11/f5f 0 2024-09-16T02:06:22.625 INFO:tasks.workunit.client.0.smithi110.stdout:7/807: dwrite d3/d15/d38/d4f/d10/de2/fe5 [0,4194304] 0 2024-09-16T02:06:22.627 INFO:tasks.workunit.client.0.smithi110.stdout:3/928: link d8/d48/d5b/d92/l7b d8/d48/d4b/l140 0 2024-09-16T02:06:22.627 INFO:tasks.workunit.client.0.smithi110.stdout:7/808: chown d3/d15/d38/d4f/d10/d11/d3e/dd5/fa7 3133163 1 2024-09-16T02:06:22.630 INFO:tasks.workunit.client.0.smithi110.stdout:3/929: dread - d8/d48/d5b/d6a/d75/d8b/ff3 zero size 2024-09-16T02:06:22.635 INFO:tasks.workunit.client.0.smithi110.stdout:3/930: mkdir d8/d48/d5b/d6a/d75/d88/d141 0 2024-09-16T02:06:22.640 INFO:tasks.workunit.client.0.smithi110.stdout:7/809: dread d3/d15/d38/d4f/d10/d11/d3e/d40/fca [0,4194304] 0 2024-09-16T02:06:22.647 INFO:tasks.workunit.client.0.smithi110.stdout:3/931: write d8/d48/d5b/d92/dc7/d1b/d3a/f70 [4563444,89688] 0 2024-09-16T02:06:22.650 INFO:tasks.workunit.client.0.smithi110.stdout:3/932: symlink d8/d48/d5b/d92/dc7/d1b/d36/d83/l142 0 2024-09-16T02:06:22.651 INFO:tasks.workunit.client.0.smithi110.stdout:3/933: stat d8/d29/l11e 0 2024-09-16T02:06:22.653 INFO:tasks.workunit.client.0.smithi110.stdout:3/934: truncate d8/f5c 1015531 0 2024-09-16T02:06:22.656 INFO:tasks.workunit.client.0.smithi110.stdout:7/810: dwrite d3/d15/d38/d4f/d10/d11/d3e/dd5/ffa [0,4194304] 0 2024-09-16T02:06:22.661 INFO:tasks.workunit.client.0.smithi110.stdout:7/811: mknod d3/d15/d38/d4f/d10/d11/d3e/dc5/cfb 0 2024-09-16T02:06:22.775 INFO:tasks.workunit.client.0.smithi110.stdout:7/812: link d3/d7a/c9a d3/d15/d38/d4f/d10/d11/d3e/d40/d50/cfc 0 2024-09-16T02:06:22.842 INFO:tasks.workunit.client.0.smithi110.stdout:7/813: rename d3/d15/d38/d4f/d2e/f59 to d3/d15/d38/d4f/d10/d76/dd6/ffd 0 2024-09-16T02:06:22.845 INFO:tasks.workunit.client.0.smithi110.stdout:7/814: mkdir d3/d15/d38/d4f/d10/d76/dd6/de8/dec/dfe 0 2024-09-16T02:06:22.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/815: creat d3/d15/d38/fff x:0 0 0 2024-09-16T02:06:22.848 INFO:tasks.workunit.client.0.smithi110.stdout:7/816: write d3/f90 [4024506,76531] 0 2024-09-16T02:06:22.849 INFO:tasks.workunit.client.0.smithi110.stdout:7/817: stat d3/d15/d38/d4f/d10/d2c/fdd 0 2024-09-16T02:06:22.853 INFO:tasks.workunit.client.0.smithi110.stdout:7/818: getdents d3/d15/d38/d4f/d10/de2 0 2024-09-16T02:06:22.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:22 smithi110 ceph-mon[27634]: pgmap v35: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 40 MiB/s rd, 84 MiB/s wr, 264 op/s 2024-09-16T02:06:23.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:22 smithi165 ceph-mon[34621]: pgmap v35: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 40 MiB/s rd, 84 MiB/s wr, 264 op/s 2024-09-16T02:06:23.314 INFO:tasks.workunit.client.0.smithi110.stdout:8/782: sync 2024-09-16T02:06:23.395 INFO:tasks.workunit.client.0.smithi110.stdout:8/783: creat d3/d2b/d27/da7/f108 x:0 0 0 2024-09-16T02:06:23.397 INFO:tasks.workunit.client.0.smithi110.stdout:8/784: mkdir d3/d2b/d27/d45/d66/d109 0 2024-09-16T02:06:23.398 INFO:tasks.workunit.client.0.smithi110.stdout:8/785: chown d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/dd9 1086518972 1 2024-09-16T02:06:23.400 INFO:tasks.workunit.client.0.smithi110.stdout:8/786: mknod d3/d2b/d27/da7/d1a/d36/d60/c10a 0 2024-09-16T02:06:23.402 INFO:tasks.workunit.client.0.smithi110.stdout:8/787: chown d3/d2b/d27/d45/lb7 13 1 2024-09-16T02:06:23.404 INFO:tasks.workunit.client.0.smithi110.stdout:8/788: readlink d3/d2b/l7a 0 2024-09-16T02:06:23.406 INFO:tasks.workunit.client.0.smithi110.stdout:8/789: write d3/d31/f5a [2424257,66158] 0 2024-09-16T02:06:23.431 INFO:tasks.workunit.client.0.smithi110.stdout:8/790: dwrite d3/d2b/d27/d45/d66/d6b/d8d/f9a [0,4194304] 0 2024-09-16T02:06:23.447 INFO:tasks.workunit.client.0.smithi110.stdout:8/791: dread d3/d2b/d27/da7/d1a/d36/d60/d83/f102 [0,4194304] 0 2024-09-16T02:06:23.451 INFO:tasks.workunit.client.0.smithi110.stdout:8/792: mknod d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/c10b 0 2024-09-16T02:06:23.470 INFO:tasks.workunit.client.0.smithi110.stdout:8/793: dread d3/d2b/d27/da7/d1a/d36/d60/d62/fa0 [0,4194304] 0 2024-09-16T02:06:23.472 INFO:tasks.workunit.client.0.smithi110.stdout:8/794: symlink d3/d2b/d27/d45/d66/d6b/d8d/l10c 0 2024-09-16T02:06:23.481 INFO:tasks.workunit.client.0.smithi110.stdout:9/948: sync 2024-09-16T02:06:23.482 INFO:tasks.workunit.client.0.smithi110.stdout:9/949: chown d1/d5/d20/d55/d82 85214791 1 2024-09-16T02:06:23.484 INFO:tasks.workunit.client.0.smithi110.stdout:9/950: readlink d1/dd/d6a/d6c/d6f/d79/de/d1f/la0 0 2024-09-16T02:06:23.488 INFO:tasks.workunit.client.0.smithi110.stdout:9/951: mkdir d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/d13c 0 2024-09-16T02:06:23.489 INFO:tasks.workunit.client.0.smithi110.stdout:9/952: stat d1/dd/d6a/d6c/d6f/d79/d26/d8e/ddd/lee 0 2024-09-16T02:06:23.499 INFO:tasks.workunit.client.0.smithi110.stdout:9/953: write d1/dd/f104 [160075,112946] 0 2024-09-16T02:06:23.503 INFO:tasks.workunit.client.0.smithi110.stdout:9/954: mknod d1/d1b/dd6/c13d 0 2024-09-16T02:06:23.509 INFO:tasks.workunit.client.0.smithi110.stdout:9/955: write d1/dd/d6a/d6c/d6f/d79/de/f3b [290369,84652] 0 2024-09-16T02:06:23.512 INFO:tasks.workunit.client.0.smithi110.stdout:9/956: dread d1/d5/fa4 [0,4194304] 0 2024-09-16T02:06:23.513 INFO:tasks.workunit.client.0.smithi110.stdout:9/957: stat d1/l32 0 2024-09-16T02:06:23.516 INFO:tasks.workunit.client.0.smithi110.stdout:9/958: creat d1/d5/f13e x:0 0 0 2024-09-16T02:06:23.517 INFO:tasks.workunit.client.0.smithi110.stdout:9/959: chown d1/dd/d6a/d6c/d6f/d79/de/l50 22 1 2024-09-16T02:06:23.519 INFO:tasks.workunit.client.0.smithi110.stdout:9/960: mknod d1/d1b/daa/ded/c13f 0 2024-09-16T02:06:23.525 INFO:tasks.workunit.client.0.smithi110.stdout:9/961: dread d1/d1b/f22 [0,4194304] 0 2024-09-16T02:06:23.527 INFO:tasks.workunit.client.0.smithi110.stdout:9/962: fsync d1/dd/d6a/d6c/d6f/fd9 0 2024-09-16T02:06:23.533 INFO:tasks.workunit.client.0.smithi110.stdout:9/963: write d1/f4f [3277639,23567] 0 2024-09-16T02:06:23.539 INFO:tasks.workunit.client.0.smithi110.stdout:9/964: dread d1/d5/d20/d55/f78 [0,4194304] 0 2024-09-16T02:06:23.540 INFO:tasks.workunit.client.0.smithi110.stdout:9/965: chown d1/dd/d6a/d6c/d75/d8c/d38/d3d/c91 3845 1 2024-09-16T02:06:23.543 INFO:tasks.workunit.client.0.smithi110.stdout:9/966: creat d1/dd/d6a/d6c/d6f/d79/de/d1f/d103/f140 x:0 0 0 2024-09-16T02:06:23.544 INFO:tasks.workunit.client.0.smithi110.stdout:9/967: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/c80 1 1 2024-09-16T02:06:23.561 INFO:tasks.workunit.client.0.smithi110.stdout:9/968: dread d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/fc3 [0,4194304] 0 2024-09-16T02:06:23.562 INFO:tasks.workunit.client.0.smithi110.stdout:9/969: chown d1/dd/d6a/d6c/d75/d86/cb1 18177831 1 2024-09-16T02:06:23.562 INFO:tasks.workunit.client.0.smithi110.stdout:9/970: chown d1/d1b/d23/d7c 511227 1 2024-09-16T02:06:23.564 INFO:tasks.workunit.client.0.smithi110.stdout:9/971: creat d1/dd/d6a/d6c/d6f/d79/d26/d8e/d93/f141 x:0 0 0 2024-09-16T02:06:23.566 INFO:tasks.workunit.client.0.smithi110.stdout:9/972: fdatasync d1/dd/d6a/d6c/d75/d86/f116 0 2024-09-16T02:06:23.569 INFO:tasks.workunit.client.0.smithi110.stdout:9/973: chown d1/d2b/lce 2840843 1 2024-09-16T02:06:23.571 INFO:tasks.workunit.client.0.smithi110.stdout:9/974: mkdir d1/d1b/daa/d142 0 2024-09-16T02:06:23.582 INFO:tasks.workunit.client.0.smithi110.stdout:9/975: dread d1/d1b/f1d [0,4194304] 0 2024-09-16T02:06:23.589 INFO:tasks.workunit.client.0.smithi110.stdout:9/976: write d1/dd/d6a/d6c/d6f/d79/d26/d8e/dbc/fe3 [416478,107197] 0 2024-09-16T02:06:23.591 INFO:tasks.workunit.client.0.smithi110.stdout:9/977: mknod d1/dd/d6a/d6c/d6f/d79/de/d132/c143 0 2024-09-16T02:06:23.594 INFO:tasks.workunit.client.0.smithi110.stdout:9/978: creat d1/d1b/d23/f144 x:0 0 0 2024-09-16T02:06:23.599 INFO:tasks.workunit.client.0.smithi110.stdout:9/979: dread d1/dd/d6a/d6c/d6f/d79/d26/fc0 [0,4194304] 0 2024-09-16T02:06:23.608 INFO:tasks.workunit.client.0.smithi110.stdout:9/980: dwrite d1/dd/d6a/d6c/d6f/ff2 [0,4194304] 0 2024-09-16T02:06:23.608 INFO:tasks.workunit.client.0.smithi110.stdout:9/981: symlink d1/dd/d6a/d6c/d6f/d79/de/d1f/l145 0 2024-09-16T02:06:23.609 INFO:tasks.workunit.client.0.smithi110.stdout:9/982: chown d1/dd/d6a/d6c/d6f/d79/de 8040546 1 2024-09-16T02:06:23.611 INFO:tasks.workunit.client.0.smithi110.stdout:9/983: symlink d1/l146 0 2024-09-16T02:06:23.613 INFO:tasks.workunit.client.0.smithi110.stdout:9/984: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/la0 59 1 2024-09-16T02:06:23.615 INFO:tasks.workunit.client.0.smithi110.stdout:9/985: symlink d1/dd/d6a/d6c/d6f/d79/d26/l147 0 2024-09-16T02:06:23.619 INFO:tasks.workunit.client.0.smithi110.stdout:0/981: sync 2024-09-16T02:06:23.619 INFO:tasks.workunit.client.0.smithi110.stdout:7/819: sync 2024-09-16T02:06:23.619 INFO:tasks.workunit.client.0.smithi110.stdout:4/858: sync 2024-09-16T02:06:23.619 INFO:tasks.workunit.client.0.smithi110.stdout:3/935: sync 2024-09-16T02:06:23.619 INFO:tasks.workunit.client.0.smithi110.stdout:6/965: sync 2024-09-16T02:06:23.622 INFO:tasks.workunit.client.0.smithi110.stdout:9/986: dwrite d1/dd/d6a/f11d [0,4194304] 0 2024-09-16T02:06:23.624 INFO:tasks.workunit.client.0.smithi110.stdout:6/966: write d0/d29/d2a/d2d/d8b/f11d [481281,73863] 0 2024-09-16T02:06:23.624 INFO:tasks.workunit.client.0.smithi110.stdout:4/859: stat d4/d8/d17/d23/d4c/d6d/d3c/d3d 0 2024-09-16T02:06:23.627 INFO:tasks.workunit.client.0.smithi110.stdout:4/860: readlink d4/d8/d17/d23/d4c/d6d/d7f/la6 0 2024-09-16T02:06:23.631 INFO:tasks.workunit.client.0.smithi110.stdout:7/820: dread d3/d15/d38/d4f/d10/d11/f2d [0,4194304] 0 2024-09-16T02:06:23.633 INFO:tasks.workunit.client.0.smithi110.stdout:7/821: dread d3/d15/d38/d4f/d10/d11/f2d [0,4194304] 0 2024-09-16T02:06:23.639 INFO:tasks.workunit.client.0.smithi110.stdout:6/967: fsync d0/d2/d5/d55/fe8 0 2024-09-16T02:06:23.644 INFO:tasks.workunit.client.0.smithi110.stdout:7/822: creat d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/f100 x:0 0 0 2024-09-16T02:06:23.650 INFO:tasks.workunit.client.0.smithi110.stdout:0/982: write d3/d4/dc/fb8 [2991276,56029] 0 2024-09-16T02:06:23.651 INFO:tasks.workunit.client.0.smithi110.stdout:7/823: read d3/d62/d65/dc1/f8e [2402593,130151] 0 2024-09-16T02:06:23.653 INFO:tasks.workunit.client.0.smithi110.stdout:3/936: getdents d8/d48/d5b/d92/dc7/d1b/d36/d83/d108 0 2024-09-16T02:06:23.654 INFO:tasks.workunit.client.0.smithi110.stdout:4/861: dread d4/f86 [0,4194304] 0 2024-09-16T02:06:23.655 INFO:tasks.workunit.client.0.smithi110.stdout:0/983: mknod d3/d4/d85/d93/da1/d115/c13e 0 2024-09-16T02:06:23.656 INFO:tasks.workunit.client.0.smithi110.stdout:7/824: rmdir d3/d15 39 2024-09-16T02:06:23.657 INFO:tasks.workunit.client.0.smithi110.stdout:3/937: symlink d8/d29/dbd/l143 0 2024-09-16T02:06:23.660 INFO:tasks.workunit.client.0.smithi110.stdout:0/984: mkdir d3/d4/dc/d14/d7e/d81/d13f 0 2024-09-16T02:06:23.661 INFO:tasks.workunit.client.0.smithi110.stdout:7/825: fdatasync d3/d62/d65/dc1/f8e 0 2024-09-16T02:06:23.664 INFO:tasks.workunit.client.0.smithi110.stdout:3/938: symlink d8/d29/dbd/l144 0 2024-09-16T02:06:23.665 INFO:tasks.workunit.client.0.smithi110.stdout:0/985: creat d3/d4/dc/d14/d76/f140 x:0 0 0 2024-09-16T02:06:23.666 INFO:tasks.workunit.client.0.smithi110.stdout:0/986: chown d3/d4/d85/d93/da1/d115 1844 1 2024-09-16T02:06:23.667 INFO:tasks.workunit.client.0.smithi110.stdout:6/968: write d0/d2/d5/d1e/f7f [1038569,68603] 0 2024-09-16T02:06:23.669 INFO:tasks.workunit.client.0.smithi110.stdout:6/969: chown d0/d2/d5/db8/fbf 1 1 2024-09-16T02:06:23.670 INFO:tasks.workunit.client.0.smithi110.stdout:4/862: getdents d4/d8/d31/d80 0 2024-09-16T02:06:23.671 INFO:tasks.workunit.client.0.smithi110.stdout:4/863: write d4/d8/d31/d73/fe0 [1597568,46140] 0 2024-09-16T02:06:23.671 INFO:tasks.workunit.client.0.smithi110.stdout:7/826: truncate d3/d62/d65/dc1/fb4 1810253 0 2024-09-16T02:06:23.678 INFO:tasks.workunit.client.0.smithi110.stdout:7/827: mkdir d3/d15/d38/d4f/d10/d11/d3e/dd5/d101 0 2024-09-16T02:06:23.681 INFO:tasks.workunit.client.0.smithi110.stdout:4/864: mkdir d4/dd6/def/d117 0 2024-09-16T02:06:23.686 INFO:tasks.workunit.client.0.smithi110.stdout:0/987: dread d3/d4/d85/d102/d135/fbe [0,4194304] 0 2024-09-16T02:06:23.686 INFO:tasks.workunit.client.0.smithi110.stdout:7/828: mknod d3/d15/d38/d4f/d10/d11/d73/df5/c102 0 2024-09-16T02:06:23.690 INFO:tasks.workunit.client.0.smithi110.stdout:4/865: unlink d4/d8/d17/d23/d4c/ldf 0 2024-09-16T02:06:23.694 INFO:tasks.workunit.client.0.smithi110.stdout:0/988: mknod d3/d4/d6d/d100/d11b/c141 0 2024-09-16T02:06:23.697 INFO:tasks.workunit.client.0.smithi110.stdout:4/866: creat d4/d8/d17/d23/d4c/d6d/d3c/d3d/f118 x:0 0 0 2024-09-16T02:06:23.698 INFO:tasks.workunit.client.0.smithi110.stdout:4/867: dread - d4/d8/d31/d80/dfc/fc8 zero size 2024-09-16T02:06:23.698 INFO:tasks.workunit.client.0.smithi110.stdout:7/829: mkdir d3/d15/d38/d4f/d10/d11/d8f/d9b/d103 0 2024-09-16T02:06:23.700 INFO:tasks.workunit.client.0.smithi110.stdout:3/939: write d8/d48/d5b/d92/dc7/d1b/f35 [4228196,55731] 0 2024-09-16T02:06:23.706 INFO:tasks.workunit.client.0.smithi110.stdout:0/989: dread d3/d6/d43/f67 [0,4194304] 0 2024-09-16T02:06:23.714 INFO:tasks.workunit.client.0.smithi110.stdout:6/970: dwrite d0/fc7 [0,4194304] 0 2024-09-16T02:06:23.716 INFO:tasks.workunit.client.0.smithi110.stdout:4/868: dread d4/d8/d17/d23/d4c/d6d/f99 [0,4194304] 0 2024-09-16T02:06:23.717 INFO:tasks.workunit.client.0.smithi110.stdout:4/869: dread - d4/d8/d17/d23/d35/f87 zero size 2024-09-16T02:06:23.726 INFO:tasks.workunit.client.0.smithi110.stdout:0/990: link d3/d4/dc/d14/d7e/d81/d86/cd9 d3/d6/d43/d55/c142 0 2024-09-16T02:06:23.728 INFO:tasks.workunit.client.0.smithi110.stdout:6/971: link d0/d29/d2a/d2f/lf1 d0/d29/d2a/d2d/l12d 0 2024-09-16T02:06:23.741 INFO:tasks.workunit.client.0.smithi110.stdout:6/972: chown d0/d2/d57/d75 3 1 2024-09-16T02:06:23.742 INFO:tasks.workunit.client.0.smithi110.stdout:0/991: getdents d3/d108 0 2024-09-16T02:06:23.745 INFO:tasks.workunit.client.0.smithi110.stdout:4/870: dread d4/dd6/def/ffd [0,4194304] 0 2024-09-16T02:06:23.745 INFO:tasks.workunit.client.0.smithi110.stdout:4/871: fdatasync d4/d8/d31/d80/dfc/f101 0 2024-09-16T02:06:23.745 INFO:tasks.workunit.client.0.smithi110.stdout:4/872: read - d4/d8/d17/d23/d4c/d6d/d4f/fa2 zero size 2024-09-16T02:06:23.745 INFO:tasks.workunit.client.0.smithi110.stdout:0/992: rename d3/d6/d43/d55/d59/le4 to d3/d4/dc/d14/d7e/d81/d86/l143 0 2024-09-16T02:06:23.745 INFO:tasks.workunit.client.0.smithi110.stdout:0/993: dread - d3/d4/dc/d14/d7e/d81/d86/fdf zero size 2024-09-16T02:06:23.745 INFO:tasks.workunit.client.0.smithi110.stdout:4/873: creat d4/d8/d31/d80/dbf/f119 x:0 0 0 2024-09-16T02:06:23.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/830: write d3/d62/d65/dc1/fb4 [1053410,121707] 0 2024-09-16T02:06:23.752 INFO:tasks.workunit.client.0.smithi110.stdout:3/940: write d8/d48/d5b/d92/dc7/d1b/f9f [728952,72326] 0 2024-09-16T02:06:23.762 INFO:tasks.workunit.client.0.smithi110.stdout:0/994: dread d3/d4/dc/f3e [0,4194304] 0 2024-09-16T02:06:23.763 INFO:tasks.workunit.client.0.smithi110.stdout:4/874: dread d4/f15 [0,4194304] 0 2024-09-16T02:06:23.765 INFO:tasks.workunit.client.0.smithi110.stdout:7/831: link d3/d15/d44/l6c d3/d62/d65/l104 0 2024-09-16T02:06:23.766 INFO:tasks.workunit.client.0.smithi110.stdout:7/832: write d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/f100 [645332,120307] 0 2024-09-16T02:06:23.767 INFO:tasks.workunit.client.0.smithi110.stdout:8/795: sync 2024-09-16T02:06:23.767 INFO:tasks.workunit.client.0.smithi110.stdout:3/941: getdents d8/d48/d5b/d6a/d75/d88 0 2024-09-16T02:06:23.768 INFO:tasks.workunit.client.0.smithi110.stdout:4/875: symlink d4/d8/d17/d23/d61/d103/l11a 0 2024-09-16T02:06:23.771 INFO:tasks.workunit.client.0.smithi110.stdout:3/942: mkdir d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/d145 0 2024-09-16T02:06:23.772 INFO:tasks.workunit.client.0.smithi110.stdout:4/876: truncate d4/d8/d17/d23/d4c/d6d/d4f/da9/f110 78161 0 2024-09-16T02:06:23.772 INFO:tasks.workunit.client.0.smithi110.stdout:8/796: symlink d3/d2b/d27/d45/l10d 0 2024-09-16T02:06:23.774 INFO:tasks.workunit.client.0.smithi110.stdout:7/833: creat d3/d15/f105 x:0 0 0 2024-09-16T02:06:23.777 INFO:tasks.workunit.client.0.smithi110.stdout:3/943: creat d8/d48/d7c/d87/d12c/f146 x:0 0 0 2024-09-16T02:06:23.781 INFO:tasks.workunit.client.0.smithi110.stdout:7/834: creat d3/d15/d38/d4f/d10/d11/d3e/dc5/f106 x:0 0 0 2024-09-16T02:06:23.786 INFO:tasks.workunit.client.0.smithi110.stdout:8/797: symlink d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/l10e 0 2024-09-16T02:06:23.786 INFO:tasks.workunit.client.0.smithi110.stdout:4/877: creat d4/d8/d17/d23/d4c/d6d/d3c/f11b x:0 0 0 2024-09-16T02:06:23.786 INFO:tasks.workunit.client.0.smithi110.stdout:8/798: stat d3/f3c 0 2024-09-16T02:06:23.795 INFO:tasks.workunit.client.0.smithi110.stdout:8/799: symlink d3/d2b/d27/da7/d1a/d36/l10f 0 2024-09-16T02:06:23.797 INFO:tasks.workunit.client.0.smithi110.stdout:4/878: creat d4/d8/d17/d23/d4c/d6d/f11c x:0 0 0 2024-09-16T02:06:23.798 INFO:tasks.workunit.client.0.smithi110.stdout:8/800: write d3/d2b/f2e [3179255,42294] 0 2024-09-16T02:06:23.798 INFO:tasks.workunit.client.0.smithi110.stdout:4/879: dread - d4/d8/d31/d80/dfc/f101 zero size 2024-09-16T02:06:23.804 INFO:tasks.workunit.client.0.smithi110.stdout:4/880: creat d4/d8/d31/d5d/f11d x:0 0 0 2024-09-16T02:06:23.806 INFO:tasks.workunit.client.0.smithi110.stdout:4/881: symlink d4/d8/d31/d5d/d84/l11e 0 2024-09-16T02:06:23.807 INFO:tasks.workunit.client.0.smithi110.stdout:8/801: link d3/d31/c32 d3/d2b/d27/da7/d1a/de9/c110 0 2024-09-16T02:06:23.809 INFO:tasks.workunit.client.0.smithi110.stdout:8/802: symlink d3/d2b/d27/da7/d8f/l111 0 2024-09-16T02:06:23.810 INFO:tasks.workunit.client.0.smithi110.stdout:4/882: mknod d4/d8/d17/d23/d4c/d6d/d3c/c11f 0 2024-09-16T02:06:23.816 INFO:tasks.workunit.client.0.smithi110.stdout:4/883: dwrite d4/d8/d17/d23/f37 [4194304,4194304] 0 2024-09-16T02:06:23.819 INFO:tasks.workunit.client.0.smithi110.stdout:4/884: mkdir d4/d8/d31/d80/dfc/d120 0 2024-09-16T02:06:23.821 INFO:tasks.workunit.client.0.smithi110.stdout:4/885: mknod d4/d8/d17/d23/d35/c121 0 2024-09-16T02:06:23.829 INFO:tasks.workunit.client.0.smithi110.stdout:7/835: write d3/d7a/f91 [1131876,59195] 0 2024-09-16T02:06:23.829 INFO:tasks.workunit.client.0.smithi110.stdout:3/944: dwrite d8/d48/d5b/d92/dc7/d1b/d36/d83/fad [0,4194304] 0 2024-09-16T02:06:23.831 INFO:tasks.workunit.client.0.smithi110.stdout:3/945: dread - d8/d29/d102/f138 zero size 2024-09-16T02:06:23.832 INFO:tasks.workunit.client.0.smithi110.stdout:4/886: link d4/db4/fd9 d4/dd6/def/d117/f122 0 2024-09-16T02:06:23.834 INFO:tasks.workunit.client.0.smithi110.stdout:4/887: read - d4/d8/d17/d23/d4c/d6d/d3c/fdb zero size 2024-09-16T02:06:23.835 INFO:tasks.workunit.client.0.smithi110.stdout:3/946: mknod d8/d48/d5b/d6a/d75/da8/c147 0 2024-09-16T02:06:23.836 INFO:tasks.workunit.client.0.smithi110.stdout:3/947: fsync d8/d48/d7c/f132 0 2024-09-16T02:06:23.838 INFO:tasks.workunit.client.0.smithi110.stdout:4/888: chown d4/ced 7475 1 2024-09-16T02:06:23.840 INFO:tasks.workunit.client.0.smithi110.stdout:7/836: dwrite d3/d15/d3a/fd3 [0,4194304] 0 2024-09-16T02:06:23.841 INFO:tasks.workunit.client.0.smithi110.stdout:4/889: write d4/d8/d17/d23/d4c/f10b [569895,90651] 0 2024-09-16T02:06:23.843 INFO:tasks.workunit.client.0.smithi110.stdout:8/803: write d3/d2b/d27/da7/d1a/d36/d60/da1/dbd/da8/ddc/f93 [241874,129493] 0 2024-09-16T02:06:23.844 INFO:tasks.workunit.client.0.smithi110.stdout:3/948: fsync d8/d48/d5b/d6a/fe5 0 2024-09-16T02:06:23.847 INFO:tasks.workunit.client.0.smithi110.stdout:4/890: dread d4/d8/d31/d80/d18/f43 [4194304,4194304] 0 2024-09-16T02:06:23.850 INFO:tasks.workunit.client.0.smithi110.stdout:4/891: mkdir d4/db4/d123 0 2024-09-16T02:06:23.852 INFO:tasks.workunit.client.0.smithi110.stdout:8/804: rename d3/d2b/d27/da7/d1a/d36/d60/d83/f102 to d3/d2b/d27/d45/dce/f112 0 2024-09-16T02:06:23.854 INFO:tasks.workunit.client.0.smithi110.stdout:4/892: write d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [4255243,37261] 0 2024-09-16T02:06:23.858 INFO:tasks.workunit.client.0.smithi110.stdout:8/805: creat d3/d2b/d27/d45/d66/d6b/f113 x:0 0 0 2024-09-16T02:06:23.860 INFO:tasks.workunit.client.0.smithi110.stdout:3/949: rename d8/d29/dbd/dc6/f82 to d8/d48/d5b/f148 0 2024-09-16T02:06:23.862 INFO:tasks.workunit.client.0.smithi110.stdout:8/806: mknod d3/d2b/d27/da7/c114 0 2024-09-16T02:06:23.862 INFO:tasks.workunit.client.0.smithi110.stdout:8/807: dread - d3/d2b/d27/d45/dce/f104 zero size 2024-09-16T02:06:23.864 INFO:tasks.workunit.client.0.smithi110.stdout:4/893: getdents d4/dd6/def 0 2024-09-16T02:06:23.869 INFO:tasks.workunit.client.0.smithi110.stdout:8/808: symlink d3/d2b/d27/da7/d1a/d36/d60/l115 0 2024-09-16T02:06:23.869 INFO:tasks.workunit.client.0.smithi110.stdout:3/950: getdents d8/d48/d5b/d92/dc7/d1b/d36/d57 0 2024-09-16T02:06:23.871 INFO:tasks.workunit.client.0.smithi110.stdout:4/894: dwrite d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 [0,4194304] 0 2024-09-16T02:06:23.871 INFO:tasks.workunit.client.0.smithi110.stdout:3/951: chown d8/d48/d5b/d92/dc7/d1b/d36/d57/d97/ff7 16471218 1 2024-09-16T02:06:23.874 INFO:tasks.workunit.client.0.smithi110.stdout:8/809: dread d3/d2b/d65/fbe [0,4194304] 0 2024-09-16T02:06:23.878 INFO:tasks.workunit.client.0.smithi110.stdout:4/895: rename d4/d8/c30 to d4/d8/d31/d5d/d84/c124 0 2024-09-16T02:06:23.879 INFO:tasks.workunit.client.0.smithi110.stdout:4/896: fdatasync d4/d8/d17/d23/d4c/d6d/d3c/ff1 0 2024-09-16T02:06:23.889 INFO:tasks.workunit.client.0.smithi110.stdout:3/952: dwrite d8/d48/d5b/d92/dc7/d1b/d36/d57/f13e [0,4194304] 0 2024-09-16T02:06:23.891 INFO:tasks.workunit.client.0.smithi110.stdout:8/810: dwrite d3/fb9 [0,4194304] 0 2024-09-16T02:06:23.894 INFO:tasks.workunit.client.0.smithi110.stdout:3/953: unlink d8/d48/d5b/d6a/def/c126 0 2024-09-16T02:06:23.897 INFO:tasks.workunit.client.0.smithi110.stdout:8/811: symlink d3/d2b/d27/da7/d1a/dfd/l116 0 2024-09-16T02:06:23.899 INFO:tasks.workunit.client.0.smithi110.stdout:3/954: dread d8/fd1 [0,4194304] 0 2024-09-16T02:06:23.905 INFO:tasks.workunit.client.0.smithi110.stdout:3/955: dwrite d8/d48/d5b/d92/dc7/d1b/fa2 [0,4194304] 0 2024-09-16T02:06:23.907 INFO:tasks.workunit.client.0.smithi110.stdout:3/956: getdents d8/d48/d5b/d92/dc7/d1b/d3a/d43/d114 0 2024-09-16T02:06:23.920 INFO:tasks.workunit.client.0.smithi110.stdout:3/957: dwrite d8/d48/d5b/d92/dc7/d1b/f12a [4194304,4194304] 0 2024-09-16T02:06:23.922 INFO:tasks.workunit.client.0.smithi110.stdout:3/958: dread - d8/d48/d7c/d87/da9/fcc zero size 2024-09-16T02:06:23.925 INFO:tasks.workunit.client.0.smithi110.stdout:3/959: write d8/d29/dbd/f7a [1174966,2325] 0 2024-09-16T02:06:23.928 INFO:tasks.workunit.client.0.smithi110.stdout:3/960: creat d8/d48/d5b/d92/dc7/d1b/d36/d57/d64/f149 x:0 0 0 2024-09-16T02:06:23.932 INFO:tasks.workunit.client.0.smithi110.stdout:3/961: rename d8/d48/d5b/d92/dc7/d1b/d36/d83/c122 to d8/d48/d5b/d6a/d75/d88/d13a/c14a 0 2024-09-16T02:06:23.935 INFO:tasks.workunit.client.0.smithi110.stdout:3/962: dread d8/d48/d5b/d92/dc7/d1b/fa2 [0,4194304] 0 2024-09-16T02:06:23.945 INFO:tasks.workunit.client.0.smithi110.stdout:3/963: rename d8/d48/d5b/d92 to d8/d48/d5b/d6a/d75/d88/d11c/d14b 0 2024-09-16T02:06:23.950 INFO:tasks.workunit.client.0.smithi110.stdout:3/964: link d8/d48/c89 d8/d48/d5b/d6a/d75/d88/d13a/c14c 0 2024-09-16T02:06:24.081 INFO:tasks.workunit.client.0.smithi110.stdout:9/987: sync 2024-09-16T02:06:24.096 INFO:tasks.workunit.client.0.smithi110.stdout:9/988: dread d1/dd/d6a/de7/ffb [0,4194304] 0 2024-09-16T02:06:24.157 INFO:tasks.workunit.client.0.smithi110.stdout:9/989: mkdir d1/d5/d148 0 2024-09-16T02:06:24.159 INFO:tasks.workunit.client.0.smithi110.stdout:9/990: truncate d1/d5/d20/d55/fab 2539748 0 2024-09-16T02:06:24.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/991: unlink d1/dd/d6a/d6c/d6f/d79/de/d1f/f48 0 2024-09-16T02:06:24.163 INFO:tasks.workunit.client.0.smithi110.stdout:9/992: fsync d1/dd/d6a/d6c/d75/f12a 0 2024-09-16T02:06:24.165 INFO:tasks.workunit.client.0.smithi110.stdout:9/993: fdatasync d1/dd/d6a/de7/ffb 0 2024-09-16T02:06:24.167 INFO:tasks.workunit.client.0.smithi110.stdout:9/994: fsync d1/dd/d6a/d6c/d6f/f7e 0 2024-09-16T02:06:24.171 INFO:tasks.workunit.client.0.smithi110.stdout:9/995: dread d1/dd/d6a/d6c/d75/d8c/f41 [0,4194304] 0 2024-09-16T02:06:24.173 INFO:tasks.workunit.client.0.smithi110.stdout:9/996: fdatasync d1/dd/d6a/d6c/d6f/d79/de/d94/f100 0 2024-09-16T02:06:24.177 INFO:tasks.workunit.client.0.smithi110.stdout:9/997: chown d1/dd/d6a/d6c/d6f/d79/de/d1f/d103/f122 119460 1 2024-09-16T02:06:24.179 INFO:tasks.workunit.client.0.smithi110.stdout:9/998: dread d1/d5/d20/d55/f78 [0,4194304] 0 2024-09-16T02:06:24.180 INFO:tasks.workunit.client.0.smithi110.stdout:9/999: chown d1/d1b/d23/f105 37726966 1 2024-09-16T02:06:24.283 INFO:tasks.workunit.client.0.smithi110.stdout:6/973: sync 2024-09-16T02:06:24.314 INFO:tasks.workunit.client.0.smithi110.stdout:6/974: symlink d0/d29/d2a/l12e 0 2024-09-16T02:06:24.316 INFO:tasks.workunit.client.0.smithi110.stdout:6/975: creat d0/d2/d57/da0/f12f x:0 0 0 2024-09-16T02:06:24.317 INFO:tasks.workunit.client.0.smithi110.stdout:6/976: fdatasync d0/d2/d5/d84/f80 0 2024-09-16T02:06:24.418 INFO:tasks.workunit.client.0.smithi110.stdout:6/977: mknod d0/d2/d5/c130 0 2024-09-16T02:06:24.418 INFO:tasks.workunit.client.0.smithi110.stdout:6/978: chown d0/d2/d18 58 1 2024-09-16T02:06:24.419 INFO:tasks.workunit.client.0.smithi110.stdout:6/979: chown d0/d29/d2a/d2f/d34/d10e 6296106 1 2024-09-16T02:06:24.423 INFO:tasks.workunit.client.0.smithi110.stdout:6/980: dread d0/d2/d5/d84/d16/f33 [0,4194304] 0 2024-09-16T02:06:24.426 INFO:tasks.workunit.client.0.smithi110.stdout:6/981: dread d0/fc7 [0,4194304] 0 2024-09-16T02:06:24.436 INFO:tasks.workunit.client.0.smithi110.stdout:6/982: dwrite d0/d29/d2a/f10d [0,4194304] 0 2024-09-16T02:06:24.437 INFO:tasks.workunit.client.0.smithi110.stdout:0/995: sync 2024-09-16T02:06:24.439 INFO:tasks.workunit.client.0.smithi110.stdout:6/983: fsync d0/d2/d57/d75/df0/fb6 0 2024-09-16T02:06:24.440 INFO:tasks.workunit.client.0.smithi110.stdout:6/984: dread - d0/d2/d57/d75/df0/fa8 zero size 2024-09-16T02:06:24.443 INFO:tasks.workunit.client.0.smithi110.stdout:6/985: symlink d0/dd2/l131 0 2024-09-16T02:06:24.444 INFO:tasks.workunit.client.0.smithi110.stdout:6/986: creat d0/d2/d5/d1e/d48/d113/f132 x:0 0 0 2024-09-16T02:06:24.444 INFO:tasks.workunit.client.0.smithi110.stdout:0/996: write d3/d4/dc/d14/d7e/d81/d89/fb0 [2523904,129505] 0 2024-09-16T02:06:24.445 INFO:tasks.workunit.client.0.smithi110.stdout:6/987: chown d0/d29/f32 394923 1 2024-09-16T02:06:24.446 INFO:tasks.workunit.client.0.smithi110.stdout:6/988: fsync d0/d2/d57/d75/f90 0 2024-09-16T02:06:24.448 INFO:tasks.workunit.client.0.smithi110.stdout:0/997: mknod d3/d4/dc/d10/dbd/c144 0 2024-09-16T02:06:24.451 INFO:tasks.workunit.client.0.smithi110.stdout:6/989: symlink d0/d2/l133 0 2024-09-16T02:06:24.453 INFO:tasks.workunit.client.0.smithi110.stdout:0/998: mkdir d3/d4/df2/df3/d145 0 2024-09-16T02:06:24.458 INFO:tasks.workunit.client.0.smithi110.stdout:6/990: mkdir d0/d2/d5/db8/dd1/d134 0 2024-09-16T02:06:24.459 INFO:tasks.workunit.client.0.smithi110.stdout:0/999: dwrite d3/d6/d43/d55/d59/f9c [0,4194304] 0 2024-09-16T02:06:24.460 INFO:tasks.workunit.client.0.smithi110.stdout:6/991: fsync d0/d2/d5/d94/fc9 0 2024-09-16T02:06:24.464 INFO:tasks.workunit.client.0.smithi110.stdout:6/992: fdatasync d0/d2/d5/d1e/fb5 0 2024-09-16T02:06:24.464 INFO:tasks.workunit.client.0.smithi110.stdout:6/993: stat d0/d2/d18/lcf 0 2024-09-16T02:06:24.473 INFO:tasks.workunit.client.0.smithi110.stdout:4/897: sync 2024-09-16T02:06:24.473 INFO:tasks.workunit.client.0.smithi110.stdout:7/837: sync 2024-09-16T02:06:24.479 INFO:tasks.workunit.client.0.smithi110.stdout:7/838: creat d3/d15/d38/d4f/d10/d76/dd6/de8/dec/dfe/f107 x:0 0 0 2024-09-16T02:06:24.482 INFO:tasks.workunit.client.0.smithi110.stdout:7/839: dread d3/d15/d3a/fd3 [0,4194304] 0 2024-09-16T02:06:24.489 INFO:tasks.workunit.client.0.smithi110.stdout:6/994: write d0/d2/d5/f88 [2699375,117797] 0 2024-09-16T02:06:24.490 INFO:tasks.workunit.client.0.smithi110.stdout:6/995: write d0/d2/d57/d75/f90 [1366086,106147] 0 2024-09-16T02:06:24.493 INFO:tasks.workunit.client.0.smithi110.stdout:7/840: getdents d3/d15/d38/d4f 0 2024-09-16T02:06:24.494 INFO:tasks.workunit.client.0.smithi110.stdout:6/996: chown d0/d2/d57/d114/l12c 295 1 2024-09-16T02:06:24.495 INFO:tasks.workunit.client.0.smithi110.stdout:4/898: dread d4/d8/d17/d23/d4c/d6d/f64 [0,4194304] 0 2024-09-16T02:06:24.496 INFO:tasks.workunit.client.0.smithi110.stdout:6/997: dread - d0/d2/d5/d1e/d48/d113/f118 zero size 2024-09-16T02:06:24.498 INFO:tasks.workunit.client.0.smithi110.stdout:6/998: stat d0/d2/d57/d7a/f86 0 2024-09-16T02:06:24.498 INFO:tasks.workunit.client.0.smithi110.stdout:7/841: dread d3/d15/d38/d4f/d10/d11/d3e/dd5/f95 [0,4194304] 0 2024-09-16T02:06:24.501 INFO:tasks.workunit.client.0.smithi110.stdout:4/899: creat d4/d8/d31/d6f/d93/f125 x:0 0 0 2024-09-16T02:06:24.501 INFO:tasks.workunit.client.0.smithi110.stdout:4/900: stat d4/d8/d31/d6f/fae 0 2024-09-16T02:06:24.508 INFO:tasks.workunit.client.0.smithi110.stdout:7/842: rmdir d3/d15/d38 39 2024-09-16T02:06:24.510 INFO:tasks.workunit.client.0.smithi110.stdout:6/999: symlink d0/d2/d5/d94/dba/dde/l135 0 2024-09-16T02:06:24.513 INFO:tasks.workunit.client.0.smithi110.stdout:4/901: mknod d4/d8/d17/d23/d4c/d6d/d3c/d3d/c126 0 2024-09-16T02:06:24.513 INFO:tasks.workunit.client.0.smithi110.stdout:7/843: dwrite d3/d15/d44/fbb [0,4194304] 0 2024-09-16T02:06:24.518 INFO:tasks.workunit.client.0.smithi110.stdout:7/844: mknod d3/d62/c108 0 2024-09-16T02:06:24.519 INFO:tasks.workunit.client.0.smithi110.stdout:4/902: mkdir d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127 0 2024-09-16T02:06:24.522 INFO:tasks.workunit.client.0.smithi110.stdout:7/845: dread - d3/d15/d38/fff zero size 2024-09-16T02:06:24.523 INFO:tasks.workunit.client.0.smithi110.stdout:4/903: mkdir d4/d8/d17/d23/d61/d103/d128 0 2024-09-16T02:06:24.529 INFO:tasks.workunit.client.0.smithi110.stdout:7/846: dwrite d3/d15/d38/d4f/d10/d7d/fab [0,4194304] 0 2024-09-16T02:06:24.532 INFO:tasks.workunit.client.0.smithi110.stdout:7/847: symlink d3/d15/d38/d4f/d10/de2/l109 0 2024-09-16T02:06:24.535 INFO:tasks.workunit.client.0.smithi110.stdout:7/848: rename d3/d15/d38/d4f/d10/d11/d3e/dc5/f106 to d3/d15/d38/d4f/d10/d11/d3e/dc5/f10a 0 2024-09-16T02:06:24.539 INFO:tasks.workunit.client.0.smithi110.stdout:7/849: mkdir d3/d15/d38/d4f/d10/d11/d3e/dc5/d10b 0 2024-09-16T02:06:24.541 INFO:tasks.workunit.client.0.smithi110.stdout:4/904: rmdir d4/d8 39 2024-09-16T02:06:24.542 INFO:tasks.workunit.client.0.smithi110.stdout:7/850: creat d3/d15/d38/d4f/d10/d7d/da2/f10c x:0 0 0 2024-09-16T02:06:24.543 INFO:tasks.workunit.client.0.smithi110.stdout:7/851: readlink d3/d15/d38/d4f/l66 0 2024-09-16T02:06:24.543 INFO:tasks.workunit.client.0.smithi110.stdout:7/852: write d3/d7a/f91 [1382272,20236] 0 2024-09-16T02:06:24.545 INFO:tasks.workunit.client.0.smithi110.stdout:8/812: sync 2024-09-16T02:06:24.545 INFO:tasks.workunit.client.0.smithi110.stdout:3/965: sync 2024-09-16T02:06:24.547 INFO:tasks.workunit.client.0.smithi110.stdout:3/966: chown d8/d48/d5b/d6a/d75/d88/d11c/d14b/dd8/d120 465 1 2024-09-16T02:06:24.551 INFO:tasks.workunit.client.0.smithi110.stdout:8/813: rename d3/d2b/d27/da7/d1a/d36/d60/da1 to d3/d2b/d27/d45/d66/d6b/d8d/d117 0 2024-09-16T02:06:24.552 INFO:tasks.workunit.client.0.smithi110.stdout:7/853: dwrite d3/d15/d38/d4f/d10/d11/d3e/dd5/fa7 [0,4194304] 0 2024-09-16T02:06:24.554 INFO:tasks.workunit.client.0.smithi110.stdout:7/854: dread - d3/d15/fe4 zero size 2024-09-16T02:06:24.556 INFO:tasks.workunit.client.0.smithi110.stdout:3/967: fdatasync d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/fa2 0 2024-09-16T02:06:24.557 INFO:tasks.workunit.client.0.smithi110.stdout:3/968: write d8/d48/d5b/d6a/d75/feb [1942448,6681] 0 2024-09-16T02:06:24.561 INFO:tasks.workunit.client.0.smithi110.stdout:7/855: creat d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/f10d x:0 0 0 2024-09-16T02:06:24.564 INFO:tasks.workunit.client.0.smithi110.stdout:3/969: mkdir d8/d48/d5b/d6a/d75/d88/d11c/d14b/d14d 0 2024-09-16T02:06:24.564 INFO:tasks.workunit.client.0.smithi110.stdout:4/905: write d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fce [594537,86290] 0 2024-09-16T02:06:24.567 INFO:tasks.workunit.client.0.smithi110.stdout:7/856: mkdir d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/db5/d10e 0 2024-09-16T02:06:24.569 INFO:tasks.workunit.client.0.smithi110.stdout:3/970: creat d8/d48/d5b/d6a/d75/da8/f14e x:0 0 0 2024-09-16T02:06:24.574 INFO:tasks.workunit.client.0.smithi110.stdout:8/814: write d3/d2b/d27/da7/d1a/d36/d60/fef [936113,11819] 0 2024-09-16T02:06:24.574 INFO:tasks.workunit.client.0.smithi110.stdout:7/857: dwrite d3/d15/d38/d4f/d10/d11/d73/f93 [0,4194304] 0 2024-09-16T02:06:24.576 INFO:tasks.workunit.client.0.smithi110.stdout:3/971: mknod d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d36/d83/d108/c14f 0 2024-09-16T02:06:24.577 INFO:tasks.workunit.client.0.smithi110.stdout:3/972: chown d8/d29/l123 4 1 2024-09-16T02:06:24.585 INFO:tasks.workunit.client.0.smithi110.stdout:7/858: dwrite d3/d15/d38/d4f/d10/fea [0,4194304] 0 2024-09-16T02:06:24.589 INFO:tasks.workunit.client.0.smithi110.stdout:4/906: dread d4/d8/d17/d23/d4c/f5b [0,4194304] 0 2024-09-16T02:06:24.590 INFO:tasks.workunit.client.0.smithi110.stdout:3/973: dwrite d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d36/f37 [0,4194304] 0 2024-09-16T02:06:24.591 INFO:tasks.workunit.client.0.smithi110.stdout:8/815: dread d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/fae [0,4194304] 0 2024-09-16T02:06:24.598 INFO:tasks.workunit.client.0.smithi110.stdout:4/907: rename d4/d8/d31/d73 to d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127/d129 0 2024-09-16T02:06:24.609 INFO:tasks.workunit.client.0.smithi110.stdout:4/908: unlink d4/d8/d17/d23/d4c/d6d/d3c/f5c 0 2024-09-16T02:06:24.611 INFO:tasks.workunit.client.0.smithi110.stdout:4/909: fdatasync d4/d8/d17/d23/d4c/d6d/f7e 0 2024-09-16T02:06:24.612 INFO:tasks.workunit.client.0.smithi110.stdout:4/910: fdatasync d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 0 2024-09-16T02:06:24.613 INFO:tasks.workunit.client.0.smithi110.stdout:4/911: write d4/d8/d17/d23/d4c/d6d/d3c/d3d/f60 [704656,16120] 0 2024-09-16T02:06:24.614 INFO:tasks.workunit.client.0.smithi110.stdout:4/912: dread - d4/d8/d31/d80/dfc/fc8 zero size 2024-09-16T02:06:24.616 INFO:tasks.workunit.client.0.smithi110.stdout:4/913: write d4/db4/ff2 [209730,44477] 0 2024-09-16T02:06:24.619 INFO:tasks.workunit.client.0.smithi110.stdout:4/914: symlink d4/d8/d17/d23/d61/d103/l12a 0 2024-09-16T02:06:24.621 INFO:tasks.workunit.client.0.smithi110.stdout:8/816: dread d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f91 [0,4194304] 0 2024-09-16T02:06:24.622 INFO:tasks.workunit.client.0.smithi110.stdout:4/915: creat d4/dd6/f12b x:0 0 0 2024-09-16T02:06:24.625 INFO:tasks.workunit.client.0.smithi110.stdout:8/817: mknod d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/c118 0 2024-09-16T02:06:24.626 INFO:tasks.workunit.client.0.smithi110.stdout:4/916: mknod d4/d8/d17/d23/d4c/d6d/d4f/da9/c12c 0 2024-09-16T02:06:24.631 INFO:tasks.workunit.client.0.smithi110.stdout:8/818: dread d3/d2b/d27/da7/d1a/fd4 [0,4194304] 0 2024-09-16T02:06:24.632 INFO:tasks.workunit.client.0.smithi110.stdout:7/859: dwrite d3/d15/d38/d4f/d10/d11/f3f [0,4194304] 0 2024-09-16T02:06:24.634 INFO:tasks.workunit.client.0.smithi110.stdout:8/819: chown d3/d2b/d27/da7/d1a/dfd 1536 1 2024-09-16T02:06:24.636 INFO:tasks.workunit.client.0.smithi110.stdout:3/974: dwrite d8/f6b [0,4194304] 0 2024-09-16T02:06:24.652 INFO:tasks.workunit.client.0.smithi110.stdout:3/975: dread d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d3a/d43/da5/f6c [0,4194304] 0 2024-09-16T02:06:24.659 INFO:tasks.workunit.client.0.smithi110.stdout:3/976: unlink d8/d48/d5b/d6a/d75/da8/cf6 0 2024-09-16T02:06:24.661 INFO:tasks.workunit.client.0.smithi110.stdout:8/820: creat d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/dd9/f119 x:0 0 0 2024-09-16T02:06:24.663 INFO:tasks.workunit.client.0.smithi110.stdout:4/917: getdents d4/d8/d17/d23/d4c/d6d/d4f 0 2024-09-16T02:06:24.666 INFO:tasks.workunit.client.0.smithi110.stdout:8/821: dread - d3/d2b/d27/da7/d1a/d36/d60/ff6 zero size 2024-09-16T02:06:24.672 INFO:tasks.workunit.client.0.smithi110.stdout:8/822: creat d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f11a x:0 0 0 2024-09-16T02:06:24.675 INFO:tasks.workunit.client.0.smithi110.stdout:3/977: link d8/d29/dbd/dc6/lf4 d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d36/d83/d108/d129/l150 0 2024-09-16T02:06:24.679 INFO:tasks.workunit.client.0.smithi110.stdout:4/918: creat d4/d8/d17/d23/d4c/d6d/d3c/f12d x:0 0 0 2024-09-16T02:06:24.681 INFO:tasks.workunit.client.0.smithi110.stdout:3/978: mkdir d8/d48/d7c/d87/d151 0 2024-09-16T02:06:24.685 INFO:tasks.workunit.client.0.smithi110.stdout:4/919: dwrite d4/db4/fcd [0,4194304] 0 2024-09-16T02:06:24.689 INFO:tasks.workunit.client.0.smithi110.stdout:7/860: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/f70 [0,4194304] 0 2024-09-16T02:06:24.690 INFO:tasks.workunit.client.0.smithi110.stdout:7/861: stat d3/d15/d38/d4f/fe 0 2024-09-16T02:06:24.698 INFO:tasks.workunit.client.0.smithi110.stdout:3/979: link d8/d48/d5b/ff1 d8/f152 0 2024-09-16T02:06:24.698 INFO:tasks.workunit.client.0.smithi110.stdout:3/980: chown d8/f51 769512753 1 2024-09-16T02:06:24.700 INFO:tasks.workunit.client.0.smithi110.stdout:3/981: chown d8/d48/d5b/d6a/d75/d88/d11c/d14b/dd8 244309 1 2024-09-16T02:06:24.705 INFO:tasks.workunit.client.0.smithi110.stdout:3/982: unlink d8/d29/f96 0 2024-09-16T02:06:24.705 INFO:tasks.workunit.client.0.smithi110.stdout:4/920: link d4/d8/d31/l8f d4/d8/d17/d23/d61/l12e 0 2024-09-16T02:06:24.711 INFO:tasks.workunit.client.0.smithi110.stdout:4/921: creat d4/db4/dd0/f12f x:0 0 0 2024-09-16T02:06:24.711 INFO:tasks.workunit.client.0.smithi110.stdout:3/983: dwrite d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/fcf [4194304,4194304] 0 2024-09-16T02:06:24.711 INFO:tasks.workunit.client.0.smithi110.stdout:4/922: chown d4/d8/d17 0 1 2024-09-16T02:06:24.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/984: chown d8/d48/d5b/d6a/d75/d88/d11c/d14b/dd8 70049617 1 2024-09-16T02:06:24.713 INFO:tasks.workunit.client.0.smithi110.stdout:3/985: readlink d8/l86 0 2024-09-16T02:06:24.714 INFO:tasks.workunit.client.0.smithi110.stdout:4/923: readlink d4/d8/d31/d80/d18/lb3 0 2024-09-16T02:06:24.716 INFO:tasks.workunit.client.0.smithi110.stdout:4/924: symlink d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/l130 0 2024-09-16T02:06:24.717 INFO:tasks.workunit.client.0.smithi110.stdout:3/986: mkdir d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d36/d57/d97/d153 0 2024-09-16T02:06:24.728 INFO:tasks.workunit.client.0.smithi110.stdout:8/823: dwrite d3/d2b/d27/f46 [0,4194304] 0 2024-09-16T02:06:24.731 INFO:tasks.workunit.client.0.smithi110.stdout:8/824: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/fae [1861857,9323] 0 2024-09-16T02:06:24.732 INFO:tasks.workunit.client.0.smithi110.stdout:8/825: stat d3/d2b/d27/da7/d1a/d6c/c101 0 2024-09-16T02:06:24.735 INFO:tasks.workunit.client.0.smithi110.stdout:8/826: symlink d3/d2b/d27/d45/d66/d6b/l11b 0 2024-09-16T02:06:24.739 INFO:tasks.workunit.client.0.smithi110.stdout:8/827: unlink d3/d2b/d27/d45/d66/fdd 0 2024-09-16T02:06:24.743 INFO:tasks.workunit.client.0.smithi110.stdout:8/828: mknod d3/d2b/d27/da7/d1a/d36/d60/d62/c11c 0 2024-09-16T02:06:24.745 INFO:tasks.workunit.client.0.smithi110.stdout:8/829: unlink d3/d2b/d27/d45/d66/d6b/d8d/ce4 0 2024-09-16T02:06:24.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/862: write d3/d62/fb9 [1619129,16560] 0 2024-09-16T02:06:24.748 INFO:tasks.workunit.client.0.smithi110.stdout:8/830: creat d3/d2b/d27/da7/d8f/f11d x:0 0 0 2024-09-16T02:06:24.749 INFO:tasks.workunit.client.0.smithi110.stdout:4/925: dread d4/d8/d17/d23/f74 [0,4194304] 0 2024-09-16T02:06:24.749 INFO:tasks.workunit.client.0.smithi110.stdout:7/863: stat d3/d15/d38/d4f/d10/d11/d3e/dd5/f82 0 2024-09-16T02:06:24.752 INFO:tasks.workunit.client.0.smithi110.stdout:8/831: symlink d3/d2b/d27/d45/d86/l11e 0 2024-09-16T02:06:24.755 INFO:tasks.workunit.client.0.smithi110.stdout:7/864: rename d3/f13 to d3/d15/d38/d4f/d10/d11/d3e/df7/f10f 0 2024-09-16T02:06:24.762 INFO:tasks.workunit.client.0.smithi110.stdout:7/865: symlink d3/d15/d38/d4f/l110 0 2024-09-16T02:06:24.767 INFO:tasks.workunit.client.0.smithi110.stdout:4/926: getdents d4/db4/dd0 0 2024-09-16T02:06:24.768 INFO:tasks.workunit.client.0.smithi110.stdout:8/832: link d3/d2b/d27/ca4 d3/d2b/d27/da7/d1a/c11f 0 2024-09-16T02:06:24.771 INFO:tasks.workunit.client.0.smithi110.stdout:8/833: mknod d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/c120 0 2024-09-16T02:06:24.772 INFO:tasks.workunit.client.0.smithi110.stdout:4/927: rename d4/db4/dd0/f12f to d4/d8/f131 0 2024-09-16T02:06:24.774 INFO:tasks.workunit.client.0.smithi110.stdout:8/834: symlink d3/d2b/d27/d45/d66/d109/l121 0 2024-09-16T02:06:24.775 INFO:tasks.workunit.client.0.smithi110.stdout:4/928: symlink d4/d8/d17/d23/d4c/d6d/d4f/l132 0 2024-09-16T02:06:24.776 INFO:tasks.workunit.client.0.smithi110.stdout:8/835: chown d3/d2b/c18 296460 1 2024-09-16T02:06:24.777 INFO:tasks.workunit.client.0.smithi110.stdout:3/987: write d8/d48/d5b/d6a/d75/d88/d11c/d14b/fed [375461,79913] 0 2024-09-16T02:06:24.778 INFO:tasks.workunit.client.0.smithi110.stdout:4/929: dread - d4/d8/d17/d23/d4c/d6d/f95 zero size 2024-09-16T02:06:24.780 INFO:tasks.workunit.client.0.smithi110.stdout:8/836: rename d3/cd5 to d3/d2b/d27/d45/d86/c122 0 2024-09-16T02:06:24.781 INFO:tasks.workunit.client.0.smithi110.stdout:4/930: fsync d4/d8/d17/d23/f4a 0 2024-09-16T02:06:24.782 INFO:tasks.workunit.client.0.smithi110.stdout:4/931: read - d4/d8/d17/d23/d4c/d6d/d3c/f12d zero size 2024-09-16T02:06:24.785 INFO:tasks.workunit.client.0.smithi110.stdout:3/988: dread d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d3a/d43/fa0 [0,4194304] 0 2024-09-16T02:06:24.787 INFO:tasks.workunit.client.0.smithi110.stdout:8/837: dwrite d3/d2b/d27/da7/d1a/f5d [0,4194304] 0 2024-09-16T02:06:24.787 INFO:tasks.workunit.client.0.smithi110.stdout:4/932: link d4/d8/d31/f39 d4/d8/d31/d6f/d93/f133 0 2024-09-16T02:06:24.792 INFO:tasks.workunit.client.0.smithi110.stdout:3/989: unlink d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d36/la3 0 2024-09-16T02:06:24.795 INFO:tasks.workunit.client.0.smithi110.stdout:3/990: fsync d8/d48/d7c/d87/f12b 0 2024-09-16T02:06:24.796 INFO:tasks.workunit.client.0.smithi110.stdout:8/838: dwrite d3/d2b/d27/d45/d66/d6b/d8d/f9a [0,4194304] 0 2024-09-16T02:06:24.801 INFO:tasks.workunit.client.0.smithi110.stdout:3/991: dread d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d36/d57/f13e [0,4194304] 0 2024-09-16T02:06:24.802 INFO:tasks.workunit.client.0.smithi110.stdout:8/839: mkdir d3/d2b/d27/da7/d1a/d36/d123 0 2024-09-16T02:06:24.811 INFO:tasks.workunit.client.0.smithi110.stdout:3/992: getdents d8/d48/d7c/d87/da9 0 2024-09-16T02:06:24.820 INFO:tasks.workunit.client.0.smithi110.stdout:3/993: link d8/d48/d5b/d6a/d75/d88/dac/c105 d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/c154 0 2024-09-16T02:06:24.824 INFO:tasks.workunit.client.0.smithi110.stdout:3/994: creat d8/d29/dbd/f155 x:0 0 0 2024-09-16T02:06:24.831 INFO:tasks.workunit.client.0.smithi110.stdout:7/866: write d3/f19 [462468,17244] 0 2024-09-16T02:06:24.834 INFO:tasks.workunit.client.0.smithi110.stdout:4/933: dread d4/d8/d17/d23/d4c/da5/fe2 [0,4194304] 0 2024-09-16T02:06:24.839 INFO:tasks.workunit.client.0.smithi110.stdout:4/934: unlink d4/d8/d31/d80/d18/c1a 0 2024-09-16T02:06:24.841 INFO:tasks.workunit.client.0.smithi110.stdout:4/935: chown d4/d8/d17/d23/d4c/d6d/f99 3421 1 2024-09-16T02:06:24.850 INFO:tasks.workunit.client.0.smithi110.stdout:7/867: dwrite d3/d15/d38/d4f/d10/d76/dd6/de8/ff0 [0,4194304] 0 2024-09-16T02:06:24.852 INFO:tasks.workunit.client.0.smithi110.stdout:4/936: dwrite d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/fd2 [0,4194304] 0 2024-09-16T02:06:24.852 INFO:tasks.workunit.client.0.smithi110.stdout:7/868: rename d3/d62/d65 to d3/d62/d65/d111 22 2024-09-16T02:06:24.855 INFO:tasks.workunit.client.0.smithi110.stdout:4/937: chown d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127/d129 7591 1 2024-09-16T02:06:24.856 INFO:tasks.workunit.client.0.smithi110.stdout:7/869: chown d3/d15/d38/d4f/d10/d11/d3e/dc5/cfb 0 1 2024-09-16T02:06:24.857 INFO:tasks.workunit.client.0.smithi110.stdout:7/870: write d3/d15/d3a/fed [806557,4619] 0 2024-09-16T02:06:24.858 INFO:tasks.workunit.client.0.smithi110.stdout:7/871: readlink d3/d15/d38/d4f/d10/de2/l109 0 2024-09-16T02:06:24.861 INFO:tasks.workunit.client.0.smithi110.stdout:4/938: symlink d4/d8/d17/d23/d4c/da5/d106/l134 0 2024-09-16T02:06:24.862 INFO:tasks.workunit.client.0.smithi110.stdout:7/872: mkdir d3/d7a/d112 0 2024-09-16T02:06:24.863 INFO:tasks.workunit.client.0.smithi110.stdout:4/939: truncate d4/fc 2411451 0 2024-09-16T02:06:24.864 INFO:tasks.workunit.client.0.smithi110.stdout:8/840: write d3/d2b/d27/da7/d1a/d36/d60/d62/fa0 [2973883,28865] 0 2024-09-16T02:06:24.866 INFO:tasks.workunit.client.0.smithi110.stdout:4/940: stat d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127/d129/dd5/f100 0 2024-09-16T02:06:24.869 INFO:tasks.workunit.client.0.smithi110.stdout:7/873: rename d3/d15/d38/d4f/d10/d11/d73/df5 to d3/d62/d65/d113 0 2024-09-16T02:06:24.874 INFO:tasks.workunit.client.0.smithi110.stdout:4/941: mknod d4/d8/d31/d80/dfc/c135 0 2024-09-16T02:06:24.879 INFO:tasks.workunit.client.0.smithi110.stdout:8/841: getdents d3/d2b/d65/d7f 0 2024-09-16T02:06:24.880 INFO:tasks.workunit.client.0.smithi110.stdout:7/874: creat d3/d15/d38/d4f/d10/d11/d3e/dd5/da6/f114 x:0 0 0 2024-09-16T02:06:24.882 INFO:tasks.workunit.client.0.smithi110.stdout:7/875: rename d3/d15/d38/d4f/d10 to d3/d15/d38/d4f/d10/d11/d3e/d40/d115 22 2024-09-16T02:06:24.882 INFO:tasks.workunit.client.0.smithi110.stdout:4/942: mknod d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127/d129/c136 0 2024-09-16T02:06:24.884 INFO:tasks.workunit.client.0.smithi110.stdout:8/842: rmdir d3/d2b/d27/d45/d66/d109 39 2024-09-16T02:06:24.885 INFO:tasks.workunit.client.0.smithi110.stdout:8/843: readlink d3/d2b/d27/da7/ld1 0 2024-09-16T02:06:24.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/943: dwrite d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127/d129/dd5/f112 [0,4194304] 0 2024-09-16T02:06:24.892 INFO:tasks.workunit.client.0.smithi110.stdout:4/944: chown d4/d8/d17/d23/d4c/d6d/d3c/d3d/c126 15567 1 2024-09-16T02:06:24.898 INFO:tasks.workunit.client.0.smithi110.stdout:4/945: truncate d4/f86 4192494 0 2024-09-16T02:06:24.899 INFO:tasks.workunit.client.0.smithi110.stdout:7/876: dread d3/d15/d38/d4f/d10/de2/fe5 [0,4194304] 0 2024-09-16T02:06:24.900 INFO:tasks.workunit.client.0.smithi110.stdout:4/946: chown d4/db4/d55/fde 161940483 1 2024-09-16T02:06:24.902 INFO:tasks.workunit.client.0.smithi110.stdout:7/877: read - d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/ff6 zero size 2024-09-16T02:06:24.903 INFO:tasks.workunit.client.0.smithi110.stdout:8/844: dwrite d3/d2b/d27/d45/d66/d6b/fb0 [0,4194304] 0 2024-09-16T02:06:24.906 INFO:tasks.workunit.client.0.smithi110.stdout:7/878: symlink d3/d62/d65/d113/l116 0 2024-09-16T02:06:24.913 INFO:tasks.workunit.client.0.smithi110.stdout:8/845: symlink d3/d2b/d27/da7/d1a/l124 0 2024-09-16T02:06:24.914 INFO:tasks.workunit.client.0.smithi110.stdout:4/947: write d4/d8/d17/d23/d4c/da5/fe2 [1998015,105700] 0 2024-09-16T02:06:24.919 INFO:tasks.workunit.client.0.smithi110.stdout:8/846: creat d3/d2b/d27/d45/d66/f125 x:0 0 0 2024-09-16T02:06:24.922 INFO:tasks.workunit.client.0.smithi110.stdout:8/847: unlink d3/d2b/d27/d45/d86/le8 0 2024-09-16T02:06:24.923 INFO:tasks.workunit.client.0.smithi110.stdout:8/848: chown d3/d2b/d27/da7/d1a/d6c/ff3 102853 1 2024-09-16T02:06:24.923 INFO:tasks.workunit.client.0.smithi110.stdout:8/849: chown d3/d2b/d27/f105 21 1 2024-09-16T02:06:24.924 INFO:tasks.workunit.client.0.smithi110.stdout:4/948: getdents d4/d8/d17/d23/d4c/da5/db2 0 2024-09-16T02:06:24.924 INFO:tasks.workunit.client.0.smithi110.stdout:8/850: chown d3/d2b/d27/d45/d86/c106 0 1 2024-09-16T02:06:24.926 INFO:tasks.workunit.client.0.smithi110.stdout:4/949: mknod d4/d8/d17/d23/d4c/d6d/d4f/da9/c137 0 2024-09-16T02:06:24.930 INFO:tasks.workunit.client.0.smithi110.stdout:8/851: dwrite d3/d2b/d27/f46 [0,4194304] 0 2024-09-16T02:06:24.932 INFO:tasks.workunit.client.0.smithi110.stdout:4/950: mknod d4/d8/d17/d23/d4c/d6d/d3c/c138 0 2024-09-16T02:06:24.937 INFO:tasks.workunit.client.0.smithi110.stdout:8/852: rename d3/d2b/d27/da7/d1a/d36/d60/d62/l54 to d3/d2b/d27/d45/l126 0 2024-09-16T02:06:24.940 INFO:tasks.workunit.client.0.smithi110.stdout:4/951: rename d4/d8/d17/d23/f74 to d4/d8/d17/d23/d4c/da5/db2/f139 0 2024-09-16T02:06:24.944 INFO:tasks.workunit.client.0.smithi110.stdout:4/952: stat d4/d8/d17/d23/l45 0 2024-09-16T02:06:24.950 INFO:tasks.workunit.client.0.smithi110.stdout:4/953: getdents d4/db4/dd0 0 2024-09-16T02:06:24.952 INFO:tasks.workunit.client.0.smithi110.stdout:4/954: creat d4/d8/d17/d6b/f13a x:0 0 0 2024-09-16T02:06:24.955 INFO:tasks.workunit.client.0.smithi110.stdout:4/955: mkdir d4/d8/d31/d80/d13b 0 2024-09-16T02:06:24.955 INFO:tasks.workunit.client.0.smithi110.stdout:8/853: rmdir d3/d2b/d27/d45/d66 39 2024-09-16T02:06:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:24 smithi110 ceph-mon[27634]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 45 MiB/s rd, 93 MiB/s wr, 314 op/s 2024-09-16T02:06:24.957 INFO:tasks.workunit.client.0.smithi110.stdout:8/854: chown d3/d2b/d27/d45/l55 6 1 2024-09-16T02:06:24.975 INFO:tasks.workunit.client.0.smithi110.stdout:4/956: truncate f3 2921941 0 2024-09-16T02:06:24.976 INFO:tasks.workunit.client.0.smithi110.stdout:8/855: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/d98/f107 [870908,99163] 0 2024-09-16T02:06:24.977 INFO:tasks.workunit.client.0.smithi110.stdout:4/957: creat d4/d8/d17/d23/d35/f13c x:0 0 0 2024-09-16T02:06:24.979 INFO:tasks.workunit.client.0.smithi110.stdout:4/958: symlink d4/d8/d17/d6b/d98/l13d 0 2024-09-16T02:06:24.980 INFO:tasks.workunit.client.0.smithi110.stdout:4/959: fsync d4/d8/d17/d23/d4c/da5/fe2 0 2024-09-16T02:06:24.980 INFO:tasks.workunit.client.0.smithi110.stdout:8/856: truncate d3/d2b/d27/d45/d66/d6b/fab 466501 0 2024-09-16T02:06:24.982 INFO:tasks.workunit.client.0.smithi110.stdout:8/857: stat d3/d2b/d27/da7/d1a/d36/d60/fb2 0 2024-09-16T02:06:24.982 INFO:tasks.workunit.client.0.smithi110.stdout:8/858: readlink d3/lec 0 2024-09-16T02:06:24.983 INFO:tasks.workunit.client.0.smithi110.stdout:8/859: readlink d3/d2b/d27/d45/d86/l11e 0 2024-09-16T02:06:24.983 INFO:tasks.workunit.client.0.smithi110.stdout:4/960: symlink d4/d8/d17/d23/d61/d103/d128/l13e 0 2024-09-16T02:06:24.989 INFO:tasks.workunit.client.0.smithi110.stdout:8/860: dwrite d3/d2b/d27/d45/dce/f104 [0,4194304] 0 2024-09-16T02:06:24.998 INFO:tasks.workunit.client.0.smithi110.stdout:4/961: write d4/d8/d31/d80/d18/f4d [1576847,71515] 0 2024-09-16T02:06:24.998 INFO:tasks.workunit.client.0.smithi110.stdout:8/861: link d3/d2b/d27/da7/c21 d3/d2b/c127 0 2024-09-16T02:06:25.001 INFO:tasks.workunit.client.0.smithi110.stdout:8/862: unlink d3/d2b/d27/f105 0 2024-09-16T02:06:25.012 INFO:tasks.workunit.client.0.smithi110.stdout:8/863: dread d3/d2b/d27/d45/dce/f104 [0,4194304] 0 2024-09-16T02:06:25.018 INFO:tasks.workunit.client.0.smithi110.stdout:4/962: dwrite d4/d8/d17/d23/d4c/d6d/d4f/fb7 [0,4194304] 0 2024-09-16T02:06:25.082 INFO:tasks.workunit.client.0.smithi110.stdout:4/963: mkdir d4/db4/d13f 0 2024-09-16T02:06:25.086 INFO:tasks.workunit.client.0.smithi110.stdout:4/964: truncate d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/ffb 812827 0 2024-09-16T02:06:25.087 INFO:tasks.workunit.client.0.smithi110.stdout:4/965: chown d4/d8/l20 3 1 2024-09-16T02:06:25.089 INFO:tasks.workunit.client.0.smithi110.stdout:4/966: write d4/d8/d17/d23/d4c/f10b [1390022,4317] 0 2024-09-16T02:06:25.090 INFO:tasks.workunit.client.0.smithi110.stdout:4/967: write d4/d8/d17/d23/d4c/d6d/d3c/f11b [969017,93859] 0 2024-09-16T02:06:25.117 INFO:tasks.workunit.client.0.smithi110.stdout:8/864: dwrite d3/f99 [0,4194304] 0 2024-09-16T02:06:25.126 INFO:tasks.workunit.client.0.smithi110.stdout:8/865: rename d3/d2b/d27/da7/d1a/d36/d60/c10a to d3/d2b/d27/da7/d1a/d36/c128 0 2024-09-16T02:06:25.128 INFO:tasks.workunit.client.0.smithi110.stdout:8/866: mkdir d3/d2b/d27/d45/d66/d6b/d8d/d129 0 2024-09-16T02:06:25.129 INFO:tasks.workunit.client.0.smithi110.stdout:8/867: stat d3/d2b/d27/d45/d66/d6b/cda 0 2024-09-16T02:06:25.136 INFO:tasks.workunit.client.0.smithi110.stdout:8/868: dwrite d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/dd9/f119 [0,4194304] 0 2024-09-16T02:06:25.140 INFO:tasks.workunit.client.0.smithi110.stdout:8/869: mkdir d3/d2b/d27/d45/d66/d6b/d8d/d12a 0 2024-09-16T02:06:25.143 INFO:tasks.workunit.client.0.smithi110.stdout:8/870: read - d3/d2b/d65/fe2 zero size 2024-09-16T02:06:25.147 INFO:tasks.workunit.client.0.smithi110.stdout:8/871: symlink d3/d2b/d27/d45/d66/l12b 0 2024-09-16T02:06:25.148 INFO:tasks.workunit.client.0.smithi110.stdout:8/872: readlink d3/d2b/d27/da7/d1a/d36/lca 0 2024-09-16T02:06:25.151 INFO:tasks.workunit.client.0.smithi110.stdout:8/873: rmdir d3/d2b/d27/da7/dc7 39 2024-09-16T02:06:25.153 INFO:tasks.workunit.client.0.smithi110.stdout:8/874: unlink d3/d2b/d27/da7/d8f/ff8 0 2024-09-16T02:06:25.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:24 smithi165 ceph-mon[34621]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 45 MiB/s rd, 93 MiB/s wr, 314 op/s 2024-09-16T02:06:25.801 INFO:tasks.workunit.client.0.smithi110.stdout:3/995: sync 2024-09-16T02:06:25.802 INFO:tasks.workunit.client.0.smithi110.stdout:3/996: chown d8/d48/d7c/d87/d12c/f10e 48 1 2024-09-16T02:06:25.806 INFO:tasks.workunit.client.0.smithi110.stdout:3/997: fdatasync d8/d48/d5b/d6a/d75/d88/d11c/d14b/dc7/d1b/d3a/d43/f11a 0 2024-09-16T02:06:25.813 INFO:tasks.workunit.client.0.smithi110.stdout:3/998: readlink d8/d29/dbd/l144 0 2024-09-16T02:06:25.817 INFO:tasks.workunit.client.0.smithi110.stdout:3/999: mkdir d8/d29/dbd/dc6/d156 0 2024-09-16T02:06:25.860 INFO:tasks.workunit.client.0.smithi110.stdout:8/875: sync 2024-09-16T02:06:25.860 INFO:tasks.workunit.client.0.smithi110.stdout:7/879: sync 2024-09-16T02:06:25.860 INFO:tasks.workunit.client.0.smithi110.stdout:4/968: sync 2024-09-16T02:06:25.862 INFO:tasks.workunit.client.0.smithi110.stdout:4/969: symlink d4/d8/d31/d5d/d84/l140 0 2024-09-16T02:06:25.864 INFO:tasks.workunit.client.0.smithi110.stdout:8/876: creat d3/d2b/d27/da7/d1a/d36/d60/d83/f12c x:0 0 0 2024-09-16T02:06:25.869 INFO:tasks.workunit.client.0.smithi110.stdout:7/880: link d3/f32 d3/d15/d38/d4f/d10/d11/f117 0 2024-09-16T02:06:25.872 INFO:tasks.workunit.client.0.smithi110.stdout:4/970: creat d4/d8/d31/f141 x:0 0 0 2024-09-16T02:06:25.872 INFO:tasks.workunit.client.0.smithi110.stdout:4/971: chown d4/d8/f67 30 1 2024-09-16T02:06:25.874 INFO:tasks.workunit.client.0.smithi110.stdout:7/881: dread - d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/db5/fc9 zero size 2024-09-16T02:06:25.878 INFO:tasks.workunit.client.0.smithi110.stdout:8/877: link d3/d2b/d27/da7/d1a/d36/c128 d3/d2b/d27/da7/d1a/d36/c12d 0 2024-09-16T02:06:25.881 INFO:tasks.workunit.client.0.smithi110.stdout:4/972: link d4/d8/d17/d23/d4c/da5/fe2 d4/d8/d31/d80/dfc/f142 0 2024-09-16T02:06:25.881 INFO:tasks.workunit.client.0.smithi110.stdout:4/973: chown d4/d8/d17/d23/d4c/d6d/d3c/d3d 90 1 2024-09-16T02:06:25.882 INFO:tasks.workunit.client.0.smithi110.stdout:4/974: chown d4/db4/lc0 496430891 1 2024-09-16T02:06:25.883 INFO:tasks.workunit.client.0.smithi110.stdout:4/975: dread - d4/d8/d17/d23/d4c/d6d/f11c zero size 2024-09-16T02:06:25.889 INFO:tasks.workunit.client.0.smithi110.stdout:4/976: dwrite d4/d8/d17/d23/d4c/da5/db2/dc4/fd7 [0,4194304] 0 2024-09-16T02:06:25.893 INFO:tasks.workunit.client.0.smithi110.stdout:8/878: dread d3/d2b/d27/da7/d1a/fa2 [0,4194304] 0 2024-09-16T02:06:25.893 INFO:tasks.workunit.client.0.smithi110.stdout:4/977: getdents d4/d8/d17/d23/d4c/d6d/d3c/d109 0 2024-09-16T02:06:25.894 INFO:tasks.workunit.client.0.smithi110.stdout:8/879: chown d3/d2b/d27/da7/c114 450 1 2024-09-16T02:06:25.895 INFO:tasks.workunit.client.0.smithi110.stdout:4/978: dread - d4/d8/d17/d23/d4c/d6d/d3c/f12d zero size 2024-09-16T02:06:25.899 INFO:tasks.workunit.client.0.smithi110.stdout:4/979: dread d4/d8/d17/d23/d4c/d6d/f64 [0,4194304] 0 2024-09-16T02:06:25.905 INFO:tasks.workunit.client.0.smithi110.stdout:4/980: getdents d4/d8/d31/d80/d90 0 2024-09-16T02:06:25.907 INFO:tasks.workunit.client.0.smithi110.stdout:4/981: truncate d4/d8/d17/d23/d4c/d6d/d7f/f115 275275 0 2024-09-16T02:06:25.910 INFO:tasks.workunit.client.0.smithi110.stdout:4/982: symlink d4/d8/d17/d23/d4c/d6d/d4f/da9/dad/d127/d129/dd5/l143 0 2024-09-16T02:06:25.918 INFO:tasks.workunit.client.0.smithi110.stdout:4/983: write d4/d8/d17/d23/d4c/d6d/d4f/fa2 [824677,66160] 0 2024-09-16T02:06:25.920 INFO:tasks.workunit.client.0.smithi110.stdout:8/880: dwrite d3/d2b/d27/d45/fc0 [0,4194304] 0 2024-09-16T02:06:25.923 INFO:tasks.workunit.client.0.smithi110.stdout:4/984: truncate d4/db4/fd9 733069 0 2024-09-16T02:06:25.928 INFO:tasks.workunit.client.0.smithi110.stdout:4/985: creat d4/db4/d123/f144 x:0 0 0 2024-09-16T02:06:25.932 INFO:tasks.workunit.client.0.smithi110.stdout:8/881: dwrite d3/d2b/d27/da7/d1a/d36/d60/d62/fc5 [0,4194304] 0 2024-09-16T02:06:25.937 INFO:tasks.workunit.client.0.smithi110.stdout:4/986: dwrite d4/d8/d17/d23/d61/d103/f108 [4194304,4194304] 0 2024-09-16T02:06:25.939 INFO:tasks.workunit.client.0.smithi110.stdout:8/882: mknod d3/d2b/d27/da7/dc7/c12e 0 2024-09-16T02:06:25.941 INFO:tasks.workunit.client.0.smithi110.stdout:4/987: creat d4/db4/d55/f145 x:0 0 0 2024-09-16T02:06:25.942 INFO:tasks.workunit.client.0.smithi110.stdout:8/883: mkdir d3/d2b/d27/da7/d1a/d36/d60/d62/d12f 0 2024-09-16T02:06:25.944 INFO:tasks.workunit.client.0.smithi110.stdout:4/988: creat d4/dd6/def/f146 x:0 0 0 2024-09-16T02:06:25.970 INFO:tasks.workunit.client.0.smithi110.stdout:8/884: dwrite d3/d2b/d27/da7/fcf [0,4194304] 0 2024-09-16T02:06:25.970 INFO:tasks.workunit.client.0.smithi110.stdout:4/989: dwrite d4/d8/d17/d23/d35/f4b [0,4194304] 0 2024-09-16T02:06:25.972 INFO:tasks.workunit.client.0.smithi110.stdout:8/885: read d3/d2b/d27/da7/fcf [2961110,124205] 0 2024-09-16T02:06:25.973 INFO:tasks.workunit.client.0.smithi110.stdout:4/990: chown d4/d8/d17/d23/d4c/d6d/d3c 763 1 2024-09-16T02:06:25.975 INFO:tasks.workunit.client.0.smithi110.stdout:8/886: chown d3/d31/f50 144 1 2024-09-16T02:06:25.976 INFO:tasks.workunit.client.0.smithi110.stdout:4/991: symlink d4/d8/d17/d23/d4c/l147 0 2024-09-16T02:06:25.978 INFO:tasks.workunit.client.0.smithi110.stdout:8/887: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/fae [1096901,107772] 0 2024-09-16T02:06:25.978 INFO:tasks.workunit.client.0.smithi110.stdout:4/992: read d4/d8/d31/d80/d18/f94 [553837,12051] 0 2024-09-16T02:06:25.980 INFO:tasks.workunit.client.0.smithi110.stdout:4/993: fdatasync d4/d8/d17/d23/d35/f13c 0 2024-09-16T02:06:25.982 INFO:tasks.workunit.client.0.smithi110.stdout:4/994: fdatasync d4/d8/d17/d23/d4c/d6d/f11c 0 2024-09-16T02:06:25.983 INFO:tasks.workunit.client.0.smithi110.stdout:8/888: mknod d3/d2b/d27/da7/d1a/dfd/dff/c130 0 2024-09-16T02:06:25.986 INFO:tasks.workunit.client.0.smithi110.stdout:8/889: mkdir d3/d2b/d65/d7f/d131 0 2024-09-16T02:06:25.990 INFO:tasks.workunit.client.0.smithi110.stdout:8/890: symlink d3/d2b/d27/da7/d1a/d36/l132 0 2024-09-16T02:06:25.995 INFO:tasks.workunit.client.0.smithi110.stdout:8/891: dread d3/d2b/d27/da7/d1a/d6c/ff3 [0,4194304] 0 2024-09-16T02:06:26.000 INFO:tasks.workunit.client.0.smithi110.stdout:4/995: dread d4/fc [0,4194304] 0 2024-09-16T02:06:26.001 INFO:tasks.workunit.client.0.smithi110.stdout:8/892: link d3/d2b/d27/da7/d1a/d36/c12d d3/d2b/d65/d7f/d131/c133 0 2024-09-16T02:06:26.002 INFO:tasks.workunit.client.0.smithi110.stdout:4/996: read d4/d8/d17/d23/d4c/d6d/f3a [1875284,75296] 0 2024-09-16T02:06:26.006 INFO:tasks.workunit.client.0.smithi110.stdout:8/893: rename d3/d31/l92 to d3/d2b/d27/d45/d66/d6b/d8d/l134 0 2024-09-16T02:06:26.009 INFO:tasks.workunit.client.0.smithi110.stdout:4/997: getdents d4/d8/d31/d6f 0 2024-09-16T02:06:26.014 INFO:tasks.workunit.client.0.smithi110.stdout:4/998: mknod d4/dd6/c148 0 2024-09-16T02:06:26.015 INFO:tasks.workunit.client.0.smithi110.stdout:8/894: getdents d3 0 2024-09-16T02:06:26.037 INFO:tasks.workunit.client.0.smithi110.stdout:8/895: chown d3/d2b/d27/da7/d1a/c11f 21 1 2024-09-16T02:06:26.038 INFO:tasks.workunit.client.0.smithi110.stdout:4/999: symlink d4/d8/d17/d23/d4c/d6d/dc6/l149 0 2024-09-16T02:06:26.038 INFO:tasks.workunit.client.0.smithi110.stdout:8/896: symlink d3/d2b/d27/da7/d1a/d36/d60/d83/l135 0 2024-09-16T02:06:26.039 INFO:tasks.workunit.client.0.smithi110.stdout:8/897: chown d3/d2b/d27/l41 0 1 2024-09-16T02:06:26.040 INFO:tasks.workunit.client.0.smithi110.stdout:8/898: chown d3/d2b/d27/da7/d1a/d36/d60/f81 12674732 1 2024-09-16T02:06:26.043 INFO:tasks.workunit.client.0.smithi110.stdout:8/899: rename c0 to d3/d2b/d27/da7/d1a/d36/d60/d62/c136 0 2024-09-16T02:06:26.044 INFO:tasks.workunit.client.0.smithi110.stdout:8/900: write d3/d2b/d27/da7/d1a/f5d [753655,77777] 0 2024-09-16T02:06:26.049 INFO:tasks.workunit.client.0.smithi110.stdout:8/901: getdents d3/d2b/d27/d45/d66/d6b/d8d/d12a 0 2024-09-16T02:06:26.063 INFO:tasks.workunit.client.0.smithi110.stdout:8/902: dwrite d3/d2b/f52 [0,4194304] 0 2024-09-16T02:06:26.070 INFO:tasks.workunit.client.0.smithi110.stdout:8/903: rename d3/d2b/d27/da7/d1a/de9/c110 to d3/d2b/d27/da7/d1a/d36/c137 0 2024-09-16T02:06:26.071 INFO:tasks.workunit.client.0.smithi110.stdout:8/904: chown d3/d2b/d27/d45/dce 3857741 1 2024-09-16T02:06:26.073 INFO:tasks.workunit.client.0.smithi110.stdout:8/905: mknod d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/c138 0 2024-09-16T02:06:26.074 INFO:tasks.workunit.client.0.smithi110.stdout:8/906: write d3/d2b/d27/d45/d66/d6b/f113 [586923,105615] 0 2024-09-16T02:06:26.079 INFO:tasks.workunit.client.0.smithi110.stdout:8/907: rmdir d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/dc6/dd3 0 2024-09-16T02:06:26.081 INFO:tasks.workunit.client.0.smithi110.stdout:8/908: fdatasync d3/d2b/d27/da7/d1a/d36/d60/f64 0 2024-09-16T02:06:26.093 INFO:tasks.workunit.client.0.smithi110.stdout:8/909: write d3/d2b/d65/fbe [940448,65120] 0 2024-09-16T02:06:26.099 INFO:tasks.workunit.client.0.smithi110.stdout:8/910: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/f69 [82388,57880] 0 2024-09-16T02:06:26.100 INFO:tasks.workunit.client.0.smithi110.stdout:8/911: stat d3/d2b/d27/f67 0 2024-09-16T02:06:26.106 INFO:tasks.workunit.client.0.smithi110.stdout:8/912: link d3/d2b/d27/da7/d1a/d36/c128 d3/d2b/d27/d45/d66/d109/c139 0 2024-09-16T02:06:26.108 INFO:tasks.workunit.client.0.smithi110.stdout:8/913: unlink d3/d2b/d27/da7/ld1 0 2024-09-16T02:06:26.110 INFO:tasks.workunit.client.0.smithi110.stdout:8/914: symlink d3/d2b/d27/da7/d1a/d6c/l13a 0 2024-09-16T02:06:26.118 INFO:tasks.workunit.client.0.smithi110.stdout:8/915: dwrite d3/d2b/d27/da7/d1a/d36/d60/d62/fc3 [4194304,4194304] 0 2024-09-16T02:06:26.119 INFO:tasks.workunit.client.0.smithi110.stdout:8/916: stat d3/d31/c32 0 2024-09-16T02:06:26.120 INFO:tasks.workunit.client.0.smithi110.stdout:8/917: readlink d3/d2b/d27/d45/l55 0 2024-09-16T02:06:26.121 INFO:tasks.workunit.client.0.smithi110.stdout:8/918: write d3/d2b/d27/d45/fe7 [8393341,59055] 0 2024-09-16T02:06:26.126 INFO:tasks.workunit.client.0.smithi110.stdout:8/919: link d3/d2b/d27/da7/d1a/d36/d60/d62/fa0 d3/d2b/d27/d45/dce/f13b 0 2024-09-16T02:06:26.131 INFO:tasks.workunit.client.0.smithi110.stdout:8/920: unlink d3/d2b/c74 0 2024-09-16T02:06:26.131 INFO:tasks.workunit.client.0.smithi110.stdout:8/921: chown d3/d2b/d27/da7/d8f 657932962 1 2024-09-16T02:06:26.137 INFO:tasks.workunit.client.0.smithi110.stdout:8/922: dwrite d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f93 [0,4194304] 0 2024-09-16T02:06:26.140 INFO:tasks.workunit.client.0.smithi110.stdout:8/923: creat d3/d2b/d65/f13c x:0 0 0 2024-09-16T02:06:26.144 INFO:tasks.workunit.client.0.smithi110.stdout:8/924: mknod d3/d2b/d65/d7f/c13d 0 2024-09-16T02:06:26.148 INFO:tasks.workunit.client.0.smithi110.stdout:7/882: sync 2024-09-16T02:06:26.155 INFO:tasks.workunit.client.0.smithi110.stdout:7/883: dwrite d3/d15/fe4 [0,4194304] 0 2024-09-16T02:06:26.158 INFO:tasks.workunit.client.0.smithi110.stdout:8/925: dwrite d3/d31/f50 [0,4194304] 0 2024-09-16T02:06:26.159 INFO:tasks.workunit.client.0.smithi110.stdout:7/884: mknod d3/d62/c118 0 2024-09-16T02:06:26.161 INFO:tasks.workunit.client.0.smithi110.stdout:7/885: dread - d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/ff6 zero size 2024-09-16T02:06:26.169 INFO:tasks.workunit.client.0.smithi110.stdout:8/926: symlink d3/d2b/d27/d45/d66/d6b/d8d/d117/db5/l13e 0 2024-09-16T02:06:26.174 INFO:tasks.workunit.client.0.smithi110.stdout:8/927: getdents d3/d2b/d27/da7/d1a/dfd 0 2024-09-16T02:06:26.663 INFO:tasks.workunit.client.0.smithi110.stdout:7/886: sync 2024-09-16T02:06:26.663 INFO:tasks.workunit.client.0.smithi110.stdout:8/928: sync 2024-09-16T02:06:26.668 INFO:tasks.workunit.client.0.smithi110.stdout:7/887: creat d3/d15/d38/d4f/d10/d76/dd6/de8/dec/f119 x:0 0 0 2024-09-16T02:06:26.670 INFO:tasks.workunit.client.0.smithi110.stdout:8/929: dwrite d3/d2b/d27/da7/d1a/f5d [4194304,4194304] 0 2024-09-16T02:06:26.676 INFO:tasks.workunit.client.0.smithi110.stdout:7/888: dwrite d3/d15/d38/d4f/d10/d11/f68 [0,4194304] 0 2024-09-16T02:06:26.678 INFO:tasks.workunit.client.0.smithi110.stdout:8/930: read d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f90 [7212304,42200] 0 2024-09-16T02:06:26.683 INFO:tasks.workunit.client.0.smithi110.stdout:7/889: creat d3/d15/d38/d4f/d10/d11/d3e/dd5/d101/f11a x:0 0 0 2024-09-16T02:06:26.685 INFO:tasks.workunit.client.0.smithi110.stdout:8/931: rename d3/d2b/d27/f4d to d3/d2b/d27/d45/d66/d6b/f13f 0 2024-09-16T02:06:26.688 INFO:tasks.workunit.client.0.smithi110.stdout:7/890: rename d3/d62/fb9 to d3/d15/d38/d4f/d10/d11/d3e/dd5/da6/f11b 0 2024-09-16T02:06:26.689 INFO:tasks.workunit.client.0.smithi110.stdout:8/932: mknod d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/c140 0 2024-09-16T02:06:26.690 INFO:tasks.workunit.client.0.smithi110.stdout:8/933: readlink d3/d31/l3f 0 2024-09-16T02:06:26.695 INFO:tasks.workunit.client.0.smithi110.stdout:8/934: creat d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f141 x:0 0 0 2024-09-16T02:06:26.697 INFO:tasks.workunit.client.0.smithi110.stdout:8/935: mknod d3/d2b/d27/d3a/c142 0 2024-09-16T02:06:26.698 INFO:tasks.workunit.client.0.smithi110.stdout:7/891: dwrite d3/d15/d3a/fd3 [0,4194304] 0 2024-09-16T02:06:26.699 INFO:tasks.workunit.client.0.smithi110.stdout:8/936: write d3/d2b/d27/da7/d8f/ffe [541409,25476] 0 2024-09-16T02:06:26.700 INFO:tasks.workunit.client.0.smithi110.stdout:7/892: dread - d3/d15/d38/d4f/d10/d11/d3e/dc5/f10a zero size 2024-09-16T02:06:26.914 INFO:tasks.workunit.client.0.smithi110.stdout:7/893: sync 2024-09-16T02:06:26.914 INFO:tasks.workunit.client.0.smithi110.stdout:8/937: sync 2024-09-16T02:06:26.914 INFO:tasks.workunit.client.0.smithi110.stdout:7/894: readlink d3/d62/d65/d113/l116 0 2024-09-16T02:06:26.918 INFO:tasks.workunit.client.0.smithi110.stdout:7/895: mknod d3/d15/d3a/d80/df4/c11c 0 2024-09-16T02:06:26.919 INFO:tasks.workunit.client.0.smithi110.stdout:8/938: dread d3/d2b/f4a [0,4194304] 0 2024-09-16T02:06:26.920 INFO:tasks.workunit.client.0.smithi110.stdout:7/896: dread - d3/d15/d38/d4f/d10/d11/d3e/d40/fbe zero size 2024-09-16T02:06:26.922 INFO:tasks.workunit.client.0.smithi110.stdout:7/897: write d3/d15/d38/d4f/d10/d11/d3e/dd5/da6/f11b [3170791,99312] 0 2024-09-16T02:06:26.923 INFO:tasks.workunit.client.0.smithi110.stdout:7/898: dread - d3/d15/d38/d4f/d10/d7d/da2/f10c zero size 2024-09-16T02:06:26.930 INFO:tasks.workunit.client.0.smithi110.stdout:7/899: dwrite d3/d15/d38/d4f/d10/de2/fe5 [0,4194304] 0 2024-09-16T02:06:26.943 INFO:tasks.workunit.client.0.smithi110.stdout:7/900: dwrite d3/d15/d38/d4f/d10/d2c/f85 [0,4194304] 0 2024-09-16T02:06:26.948 INFO:tasks.workunit.client.0.smithi110.stdout:7/901: write d3/f26 [1789687,78514] 0 2024-09-16T02:06:26.951 INFO:tasks.workunit.client.0.smithi110.stdout:7/902: creat d3/d7a/df1/f11d x:0 0 0 2024-09-16T02:06:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:26 smithi110 ceph-mon[27634]: pgmap v37: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 54 MiB/s rd, 107 MiB/s wr, 383 op/s 2024-09-16T02:06:26.958 INFO:tasks.workunit.client.0.smithi110.stdout:7/903: dwrite d3/d15/d38/d4f/fd [4194304,4194304] 0 2024-09-16T02:06:26.991 INFO:tasks.workunit.client.0.smithi110.stdout:7/904: dread d3/d15/d38/d4f/d10/d11/d3e/df7/f10f [0,4194304] 0 2024-09-16T02:06:26.995 INFO:tasks.workunit.client.0.smithi110.stdout:7/905: dread d3/d15/d38/d4f/d10/d2c/f85 [0,4194304] 0 2024-09-16T02:06:27.005 INFO:tasks.workunit.client.0.smithi110.stdout:7/906: dwrite d3/d15/d3a/fc6 [0,4194304] 0 2024-09-16T02:06:27.026 INFO:tasks.workunit.client.0.smithi110.stdout:7/907: dwrite d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f92 [0,4194304] 0 2024-09-16T02:06:27.072 INFO:tasks.workunit.client.0.smithi110.stdout:7/908: creat d3/d15/d38/d4f/d10/d11/d8f/d9b/d103/f11e x:0 0 0 2024-09-16T02:06:27.073 INFO:tasks.workunit.client.0.smithi110.stdout:7/909: write d3/d15/d38/f3b [1250082,45320] 0 2024-09-16T02:06:27.076 INFO:tasks.workunit.client.0.smithi110.stdout:7/910: mkdir d3/d15/d38/d4f/d10/d76/d88/d11f 0 2024-09-16T02:06:27.089 INFO:tasks.workunit.client.0.smithi110.stdout:7/911: write d3/d15/d38/d4f/fe [1584020,30661] 0 2024-09-16T02:06:27.094 INFO:tasks.workunit.client.0.smithi110.stdout:7/912: write d3/d15/d38/d4f/d10/d11/f5f [509568,110184] 0 2024-09-16T02:06:27.098 INFO:tasks.workunit.client.0.smithi110.stdout:7/913: write d3/d15/d38/d4f/d10/d11/d3e/d40/d50/f83 [3820976,55072] 0 2024-09-16T02:06:27.099 INFO:tasks.workunit.client.0.smithi110.stdout:7/914: read d3/d15/d38/d4f/d10/fea [849258,81598] 0 2024-09-16T02:06:27.101 INFO:tasks.workunit.client.0.smithi110.stdout:7/915: rmdir d3/d15/d38/d4f/d10/dd9 39 2024-09-16T02:06:27.104 INFO:tasks.workunit.client.0.smithi110.stdout:7/916: mkdir d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/db5/d10e/d120 0 2024-09-16T02:06:27.107 INFO:tasks.workunit.client.0.smithi110.stdout:7/917: mknod d3/d15/d38/d4f/d10/d76/d88/d11f/c121 0 2024-09-16T02:06:27.114 INFO:tasks.workunit.client.0.smithi110.stdout:7/918: write d3/d15/d38/d4f/d10/d11/d3e/d40/f99 [1032779,3372] 0 2024-09-16T02:06:27.117 INFO:tasks.workunit.client.0.smithi110.stdout:7/919: dread d3/d15/d38/d4f/d10/d11/d73/f93 [0,4194304] 0 2024-09-16T02:06:27.120 INFO:tasks.workunit.client.0.smithi110.stdout:7/920: unlink d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/ff6 0 2024-09-16T02:06:27.124 INFO:tasks.workunit.client.0.smithi110.stdout:7/921: dwrite d3/f90 [0,4194304] 0 2024-09-16T02:06:27.125 INFO:tasks.workunit.client.0.smithi110.stdout:7/922: readlink d3/d7a/la8 0 2024-09-16T02:06:27.127 INFO:tasks.workunit.client.0.smithi110.stdout:7/923: mknod d3/d15/d38/d4f/d10/d76/def/c122 0 2024-09-16T02:06:27.130 INFO:tasks.workunit.client.0.smithi110.stdout:7/924: write d3/d15/d38/d4f/d10/d76/dd6/de8/dec/dfe/f107 [909937,35127] 0 2024-09-16T02:06:27.131 INFO:tasks.workunit.client.0.smithi110.stdout:7/925: dread - d3/d15/d38/d4f/d10/d11/d3e/dd5/db7/f10d zero size 2024-09-16T02:06:27.131 INFO:tasks.workunit.client.0.smithi110.stdout:7/926: chown d3/ca0 90471609 1 2024-09-16T02:06:27.137 INFO:tasks.workunit.client.0.smithi110.stdout:7/927: dwrite d3/f26 [0,4194304] 0 2024-09-16T02:06:27.141 INFO:tasks.workunit.client.0.smithi110.stdout:7/928: creat d3/d15/d38/d4f/d10/d7d/f123 x:0 0 0 2024-09-16T02:06:27.145 INFO:tasks.workunit.client.0.smithi110.stdout:7/929: dread d3/f26 [0,4194304] 0 2024-09-16T02:06:27.151 INFO:tasks.workunit.client.0.smithi110.stdout:7/930: rename d3/d62/d65/d113 to d3/d15/d38/d124 0 2024-09-16T02:06:27.153 INFO:tasks.workunit.client.0.smithi110.stdout:7/931: dread - d3/d15/d38/d4f/d10/d76/fcb zero size 2024-09-16T02:06:27.154 INFO:tasks.workunit.client.0.smithi110.stdout:7/932: stat d3/d15/d38/d4f/d10/d11/d73/f93 0 2024-09-16T02:06:27.155 INFO:tasks.workunit.client.0.smithi110.stdout:7/933: symlink d3/d15/d3a/d80/df4/l125 0 2024-09-16T02:06:27.157 INFO:tasks.workunit.client.0.smithi110.stdout:7/934: fdatasync d3/d15/d38/d4f/d10/d11/d3e/f42 0 2024-09-16T02:06:27.161 INFO:tasks.workunit.client.0.smithi110.stdout:7/935: rename d3/d15/d38/d4f/d10/d11/d8f/d9b/d103/f11e to d3/d15/d38/d4f/d10/d11/d3e/d40/d50/d7e/db5/d10e/d120/f126 0 2024-09-16T02:06:27.169 INFO:tasks.workunit.client.0.smithi110.stdout:7/936: rename d3/d15/d38/d4f/d10/d11 to d3/d15/d38/d4f/d10/d127 0 2024-09-16T02:06:27.174 INFO:tasks.workunit.client.0.smithi110.stdout:8/939: sync 2024-09-16T02:06:27.175 INFO:tasks.workunit.client.0.smithi110.stdout:7/937: dwrite d3/d15/d38/d4f/d10/d127/d3e/d40/f70 [0,4194304] 0 2024-09-16T02:06:27.179 INFO:tasks.workunit.client.0.smithi110.stdout:7/938: creat d3/d15/d38/d4f/d10/d127/d3e/dd5/da6/f128 x:0 0 0 2024-09-16T02:06:27.189 INFO:tasks.workunit.client.0.smithi110.stdout:8/940: write d3/f2a [4525738,131013] 0 2024-09-16T02:06:27.189 INFO:tasks.workunit.client.0.smithi110.stdout:7/939: link d3/d15/d38/d4f/ca9 d3/d62/c129 0 2024-09-16T02:06:27.191 INFO:tasks.workunit.client.0.smithi110.stdout:8/941: dread - d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f11a zero size 2024-09-16T02:06:27.192 INFO:tasks.workunit.client.0.smithi110.stdout:8/942: stat d3/d2b/d27/d3a/c142 0 2024-09-16T02:06:27.195 INFO:tasks.workunit.client.0.smithi110.stdout:8/943: mkdir d3/d2b/d65/d143 0 2024-09-16T02:06:27.196 INFO:tasks.workunit.client.0.smithi110.stdout:7/940: dwrite d3/d15/d38/d4f/d10/d127/f68 [4194304,4194304] 0 2024-09-16T02:06:27.198 INFO:tasks.workunit.client.0.smithi110.stdout:7/941: read - d3/d15/d38/d4f/d10/d127/d3e/d40/fbe zero size 2024-09-16T02:06:27.199 INFO:tasks.workunit.client.0.smithi110.stdout:7/942: write d3/d15/d38/d4f/d10/d127/f3f [598291,57831] 0 2024-09-16T02:06:27.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:26 smithi165 ceph-mon[34621]: pgmap v37: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 54 MiB/s rd, 107 MiB/s wr, 383 op/s 2024-09-16T02:06:27.202 INFO:tasks.workunit.client.0.smithi110.stdout:8/944: fdatasync d3/d2b/d27/d45/dce/f112 0 2024-09-16T02:06:27.204 INFO:tasks.workunit.client.0.smithi110.stdout:8/945: chown d3/d2b/d27/da7/d1a/d36/c8c 388403 1 2024-09-16T02:06:27.205 INFO:tasks.workunit.client.0.smithi110.stdout:7/943: dread d3/d15/d38/d4f/d10/f29 [0,4194304] 0 2024-09-16T02:06:27.205 INFO:tasks.workunit.client.0.smithi110.stdout:8/946: chown d3/lc 63 1 2024-09-16T02:06:27.206 INFO:tasks.workunit.client.0.smithi110.stdout:8/947: write d3/d2b/d27/da7/d8f/ffe [2902785,59767] 0 2024-09-16T02:06:27.207 INFO:tasks.workunit.client.0.smithi110.stdout:7/944: chown d3/d15/d38/d4f/d10/d127/c20 105289018 1 2024-09-16T02:06:27.212 INFO:tasks.workunit.client.0.smithi110.stdout:8/948: mkdir d3/d2b/d27/da7/d1a/dfd/d144 0 2024-09-16T02:06:27.223 INFO:tasks.workunit.client.0.smithi110.stdout:8/949: link d3/d2b/d27/da7/d1a/d36/d60/f64 d3/d2b/d27/da7/d8f/f145 0 2024-09-16T02:06:27.227 INFO:tasks.workunit.client.0.smithi110.stdout:8/950: creat d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/d98/f146 x:0 0 0 2024-09-16T02:06:27.228 INFO:tasks.workunit.client.0.smithi110.stdout:7/945: dwrite d3/d15/d38/d4f/d2e/f4c [0,4194304] 0 2024-09-16T02:06:27.232 INFO:tasks.workunit.client.0.smithi110.stdout:7/946: symlink d3/d15/d38/d4f/d10/d76/l12a 0 2024-09-16T02:06:27.233 INFO:tasks.workunit.client.0.smithi110.stdout:8/951: getdents d3/d2b/d65/d143 0 2024-09-16T02:06:27.237 INFO:tasks.workunit.client.0.smithi110.stdout:7/947: symlink d3/d15/d38/d4f/d10/d76/dd6/l12b 0 2024-09-16T02:06:27.239 INFO:tasks.workunit.client.0.smithi110.stdout:8/952: mknod d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/c147 0 2024-09-16T02:06:27.239 INFO:tasks.workunit.client.0.smithi110.stdout:7/948: write d3/d15/d38/d4f/d10/d127/d3e/d40/fca [2876427,95894] 0 2024-09-16T02:06:27.243 INFO:tasks.workunit.client.0.smithi110.stdout:7/949: symlink d3/d15/d3a/d80/df4/l12c 0 2024-09-16T02:06:27.246 INFO:tasks.workunit.client.0.smithi110.stdout:7/950: creat d3/d15/d38/d4f/d10/d127/d3e/d40/d50/d7e/f12d x:0 0 0 2024-09-16T02:06:27.246 INFO:tasks.workunit.client.0.smithi110.stdout:7/951: chown d3 21460465 1 2024-09-16T02:06:27.247 INFO:tasks.workunit.client.0.smithi110.stdout:7/952: read - d3/d7a/fac zero size 2024-09-16T02:06:27.249 INFO:tasks.workunit.client.0.smithi110.stdout:7/953: write d3/d15/d38/d4f/d2e/f4c [3202906,38222] 0 2024-09-16T02:06:27.252 INFO:tasks.workunit.client.0.smithi110.stdout:7/954: mkdir d3/d15/d38/d4f/d10/d76/dd6/de8/dec/d12e 0 2024-09-16T02:06:27.257 INFO:tasks.workunit.client.0.smithi110.stdout:8/953: dwrite d3/d31/f9f [0,4194304] 0 2024-09-16T02:06:27.263 INFO:tasks.workunit.client.0.smithi110.stdout:8/954: mkdir d3/d2b/d27/da7/d1a/d36/d148 0 2024-09-16T02:06:27.268 INFO:tasks.workunit.client.0.smithi110.stdout:8/955: symlink d3/d2b/d27/d45/dce/dde/l149 0 2024-09-16T02:06:27.270 INFO:tasks.workunit.client.0.smithi110.stdout:8/956: dread - d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f11a zero size 2024-09-16T02:06:27.273 INFO:tasks.workunit.client.0.smithi110.stdout:8/957: mknod d3/d2b/d27/d45/d66/d6b/d8d/c14a 0 2024-09-16T02:06:27.298 INFO:tasks.workunit.client.0.smithi110.stdout:8/958: dwrite d3/d2b/d27/da7/f5c [0,4194304] 0 2024-09-16T02:06:27.302 INFO:tasks.workunit.client.0.smithi110.stdout:8/959: creat d3/d2b/d27/d45/d66/f14b x:0 0 0 2024-09-16T02:06:27.316 INFO:tasks.workunit.client.0.smithi110.stdout:8/960: dread d3/d2b/d27/da7/d1a/d36/d60/f64 [0,4194304] 0 2024-09-16T02:06:27.320 INFO:tasks.workunit.client.0.smithi110.stdout:8/961: dread d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/d98/f107 [0,4194304] 0 2024-09-16T02:06:27.321 INFO:tasks.workunit.client.0.smithi110.stdout:8/962: stat d3/d2b/d27/da7/d1a/d36/d60/ff6 0 2024-09-16T02:06:27.322 INFO:tasks.workunit.client.0.smithi110.stdout:8/963: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/fae [2873419,61550] 0 2024-09-16T02:06:27.337 INFO:tasks.workunit.client.0.smithi110.stdout:8/964: dread d3/f3c [0,4194304] 0 2024-09-16T02:06:27.339 INFO:tasks.workunit.client.0.smithi110.stdout:8/965: mkdir d3/d2b/d27/d45/d66/d14c 0 2024-09-16T02:06:27.343 INFO:tasks.workunit.client.0.smithi110.stdout:8/966: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/fb3 [2428045,114089] 0 2024-09-16T02:06:27.345 INFO:tasks.workunit.client.0.smithi110.stdout:8/967: dread d3/d2b/d27/da7/d1a/d6c/ff3 [0,4194304] 0 2024-09-16T02:06:27.351 INFO:tasks.workunit.client.0.smithi110.stdout:8/968: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/d98/fb1 [980537,58257] 0 2024-09-16T02:06:27.353 INFO:tasks.workunit.client.0.smithi110.stdout:8/969: symlink d3/d2b/d27/d45/d66/d6b/d8d/l14d 0 2024-09-16T02:06:27.356 INFO:tasks.workunit.client.0.smithi110.stdout:8/970: dread d3/d2b/d27/f46 [0,4194304] 0 2024-09-16T02:06:27.359 INFO:tasks.workunit.client.0.smithi110.stdout:8/971: symlink d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/l14e 0 2024-09-16T02:06:27.363 INFO:tasks.workunit.client.0.smithi110.stdout:8/972: link d3/d2b/d27/da7/d1a/d36/c78 d3/d2b/d27/da7/c14f 0 2024-09-16T02:06:27.363 INFO:tasks.workunit.client.0.smithi110.stdout:8/973: chown d3/d2b/d27/d45/dce/dde 61 1 2024-09-16T02:06:27.371 INFO:tasks.workunit.client.0.smithi110.stdout:8/974: write d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f90 [7052524,11287] 0 2024-09-16T02:06:27.375 INFO:tasks.workunit.client.0.smithi110.stdout:8/975: creat d3/d2b/d27/da7/d1a/f150 x:0 0 0 2024-09-16T02:06:27.376 INFO:tasks.workunit.client.0.smithi110.stdout:8/976: write d3/d2b/d27/da7/d8f/f11d [31512,62940] 0 2024-09-16T02:06:27.378 INFO:tasks.workunit.client.0.smithi110.stdout:8/977: mkdir d3/d2b/d27/da7/d8f/d151 0 2024-09-16T02:06:27.379 INFO:tasks.workunit.client.0.smithi110.stdout:8/978: chown d3/d2b/d27/d45/d66/f125 139307092 1 2024-09-16T02:06:27.389 INFO:tasks.workunit.client.0.smithi110.stdout:8/979: dwrite d3/f9 [4194304,4194304] 0 2024-09-16T02:06:27.395 INFO:tasks.workunit.client.0.smithi110.stdout:8/980: symlink d3/d2b/d27/da7/d1a/d36/d60/l152 0 2024-09-16T02:06:27.399 INFO:tasks.workunit.client.0.smithi110.stdout:8/981: mkdir d3/d2b/d27/da7/d1a/d36/d153 0 2024-09-16T02:06:27.402 INFO:tasks.workunit.client.0.smithi110.stdout:8/982: mknod d3/d2b/d27/d45/c154 0 2024-09-16T02:06:27.405 INFO:tasks.workunit.client.0.smithi110.stdout:8/983: rmdir d3/d2b/d27/da7/d1a/d36/d153 0 2024-09-16T02:06:27.407 INFO:tasks.workunit.client.0.smithi110.stdout:8/984: rename d3/d2b/d27/da7/d1a/de9/l2c to d3/d2b/d65/l155 0 2024-09-16T02:06:27.409 INFO:tasks.workunit.client.0.smithi110.stdout:8/985: mknod d3/d2b/d27/d45/dce/c156 0 2024-09-16T02:06:27.410 INFO:tasks.workunit.client.0.smithi110.stdout:8/986: truncate d3/d2b/d65/fe2 1020032 0 2024-09-16T02:06:27.424 INFO:tasks.workunit.client.0.smithi110.stdout:8/987: dread d3/d2b/d27/da7/d1a/d36/d60/d62/fc3 [0,4194304] 0 2024-09-16T02:06:27.430 INFO:tasks.workunit.client.0.smithi110.stdout:8/988: dwrite d3/d2b/d27/da7/d1a/fa2 [4194304,4194304] 0 2024-09-16T02:06:27.435 INFO:tasks.workunit.client.0.smithi110.stdout:8/989: rename d3/c35 to d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/dd9/c157 0 2024-09-16T02:06:27.445 INFO:tasks.workunit.client.0.smithi110.stdout:8/990: creat d3/d2b/d27/da7/d8f/f158 x:0 0 0 2024-09-16T02:06:27.451 INFO:tasks.workunit.client.0.smithi110.stdout:8/991: link d3/d2b/d27/f67 d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/d98/f159 0 2024-09-16T02:06:27.452 INFO:tasks.workunit.client.0.smithi110.stdout:8/992: chown d3/d2b/d27/da7/d1a/d36/c42 9713137 1 2024-09-16T02:06:27.460 INFO:tasks.workunit.client.0.smithi110.stdout:8/993: write d3/d2b/d27/d45/d66/d6b/d8d/d117/ff7 [986751,23578] 0 2024-09-16T02:06:27.465 INFO:tasks.workunit.client.0.smithi110.stdout:8/994: dwrite d3/d2b/d27/da7/dc7/ff0 [0,4194304] 0 2024-09-16T02:06:27.470 INFO:tasks.workunit.client.0.smithi110.stdout:8/995: creat d3/d2b/d27/d45/d66/d6b/d8d/d117/f15a x:0 0 0 2024-09-16T02:06:27.479 INFO:tasks.workunit.client.0.smithi110.stdout:8/996: write d3/d31/fc2 [735123,17476] 0 2024-09-16T02:06:27.483 INFO:tasks.workunit.client.0.smithi110.stdout:8/997: getdents d3/d2b/d27/da7/d1a/dfd 0 2024-09-16T02:06:27.489 INFO:tasks.workunit.client.0.smithi110.stdout:8/998: dwrite d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8/ddc/f90 [4194304,4194304] 0 2024-09-16T02:06:27.495 INFO:tasks.workunit.client.0.smithi110.stdout:8/999: getdents d3/d2b/d27/d45/d66/d6b/d8d/d117/dbd/da8 0 2024-09-16T02:06:27.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/955: sync 2024-09-16T02:06:27.747 INFO:tasks.workunit.client.0.smithi110.stdout:7/956: stat d3/d15/d38/l74 0 2024-09-16T02:06:27.752 INFO:tasks.workunit.client.0.smithi110.stdout:7/957: write d3/d15/d38/d4f/d10/d127/d3e/dc5/f10a [9831,15487] 0 2024-09-16T02:06:27.771 INFO:tasks.workunit.client.0.smithi110.stdout:7/958: dread d3/d15/d38/d4f/d10/d127/f75 [4194304,4194304] 0 2024-09-16T02:06:27.774 INFO:tasks.workunit.client.0.smithi110.stdout:7/959: symlink d3/d15/d44/l12f 0 2024-09-16T02:06:27.775 INFO:tasks.workunit.client.0.smithi110.stdout:7/960: fdatasync d3/d15/d38/d4f/fe 0 2024-09-16T02:06:27.778 INFO:tasks.workunit.client.0.smithi110.stdout:7/961: mknod d3/d15/d38/d4f/d10/d127/d3e/df7/c130 0 2024-09-16T02:06:27.778 INFO:tasks.workunit.client.0.smithi110.stdout:7/962: stat d3/d15/d3a 0 2024-09-16T02:06:27.780 INFO:tasks.workunit.client.0.smithi110.stdout:7/963: symlink d3/d15/d3a/d80/l131 0 2024-09-16T02:06:27.782 INFO:tasks.workunit.client.0.smithi110.stdout:7/964: creat d3/d15/d38/d4f/d10/d76/d88/d11f/f132 x:0 0 0 2024-09-16T02:06:27.783 INFO:tasks.workunit.client.0.smithi110.stdout:7/965: readlink d3/d15/d3a/l9c 0 2024-09-16T02:06:27.793 INFO:tasks.workunit.client.0.smithi110.stdout:7/966: dread d3/d15/d38/d4f/d10/d127/d3e/f42 [0,4194304] 0 2024-09-16T02:06:27.796 INFO:tasks.workunit.client.0.smithi110.stdout:7/967: creat d3/d15/d38/d4f/d10/d127/d3e/dd5/db7/f133 x:0 0 0 2024-09-16T02:06:27.799 INFO:tasks.workunit.client.0.smithi110.stdout:7/968: fsync d3/d15/d38/d4f/d10/f30 0 2024-09-16T02:06:27.805 INFO:tasks.workunit.client.0.smithi110.stdout:7/969: dwrite d3/d15/d38/d4f/fe [4194304,4194304] 0 2024-09-16T02:06:27.813 INFO:tasks.workunit.client.0.smithi110.stdout:7/970: link d3/d15/d38/d4f/d10/f30 d3/d15/f134 0 2024-09-16T02:06:27.813 INFO:tasks.workunit.client.0.smithi110.stdout:7/971: chown d3/d15/d38/d4f/d10/d127/d3e/d40/f99 31066780 1 2024-09-16T02:06:27.815 INFO:tasks.workunit.client.0.smithi110.stdout:7/972: mkdir d3/d15/d38/d4f/d10/d127/d8f/d135 0 2024-09-16T02:06:27.816 INFO:tasks.workunit.client.0.smithi110.stdout:7/973: symlink d3/d7a/df1/l136 0 2024-09-16T02:06:27.834 INFO:tasks.workunit.client.0.smithi110.stdout:7/974: dread d3/d15/d38/d4f/d10/f39 [0,4194304] 0 2024-09-16T02:06:27.836 INFO:tasks.workunit.client.0.smithi110.stdout:7/975: creat d3/d15/d38/d4f/d10/d7d/da2/f137 x:0 0 0 2024-09-16T02:06:27.839 INFO:tasks.workunit.client.0.smithi110.stdout:7/976: getdents d3/d15/d38/d4f/d2e 0 2024-09-16T02:06:27.841 INFO:tasks.workunit.client.0.smithi110.stdout:7/977: truncate d3/d15/d38/d4f/d10/d127/f75 4246572 0 2024-09-16T02:06:27.844 INFO:tasks.workunit.client.0.smithi110.stdout:7/978: symlink d3/d15/d38/d4f/d10/d127/d3e/dd5/da6/l138 0 2024-09-16T02:06:27.845 INFO:tasks.workunit.client.0.smithi110.stdout:7/979: dread - d3/d15/d38/d4f/d10/d7d/da2/f10c zero size 2024-09-16T02:06:27.846 INFO:tasks.workunit.client.0.smithi110.stdout:7/980: creat d3/d15/d38/d4f/d10/d76/f139 x:0 0 0 2024-09-16T02:06:27.849 INFO:tasks.workunit.client.0.smithi110.stdout:7/981: truncate d3/d15/d38/d4f/d10/d76/fcb 560609 0 2024-09-16T02:06:27.868 INFO:tasks.workunit.client.0.smithi110.stdout:7/982: dread d3/d15/d38/d4f/d10/d127/d3e/dd5/fa7 [0,4194304] 0 2024-09-16T02:06:27.873 INFO:tasks.workunit.client.0.smithi110.stdout:7/983: fsync d3/d15/d38/d4f/d10/d2c/f85 0 2024-09-16T02:06:27.873 INFO:tasks.workunit.client.0.smithi110.stdout:7/984: fsync d3/d15/d38/d4f/d10/f6d 0 2024-09-16T02:06:28.344 INFO:tasks.workunit.client.0.smithi110.stdout:7/985: sync 2024-09-16T02:06:28.358 INFO:tasks.workunit.client.0.smithi110.stdout:7/986: truncate d3/d15/f134 4484236 0 2024-09-16T02:06:28.364 INFO:tasks.workunit.client.0.smithi110.stdout:7/987: dread - d3/d7a/fe0 zero size 2024-09-16T02:06:28.373 INFO:tasks.workunit.client.0.smithi110.stdout:7/988: mknod d3/d15/d38/d4f/d10/d76/dd6/de8/dec/d12e/c13a 0 2024-09-16T02:06:28.390 INFO:tasks.workunit.client.0.smithi110.stdout:7/989: dread d3/d15/d3a/d80/f9d [0,4194304] 0 2024-09-16T02:06:28.392 INFO:tasks.workunit.client.0.smithi110.stdout:7/990: dread - d3/d62/d65/f9e zero size 2024-09-16T02:06:28.394 INFO:tasks.workunit.client.0.smithi110.stdout:7/991: fsync d3/d15/d38/d4f/d10/d76/f139 0 2024-09-16T02:06:28.416 INFO:tasks.workunit.client.0.smithi110.stdout:7/992: rename d3/d15/d38/d4f/d10/d127/d3e/dd5/ffa to d3/d15/d38/d4f/d10/d127/d3e/d40/d50/f13b 0 2024-09-16T02:06:28.458 INFO:tasks.workunit.client.0.smithi110.stdout:7/993: truncate d3/f19 2570684 0 2024-09-16T02:06:28.461 INFO:tasks.workunit.client.0.smithi110.stdout:7/994: dread d3/d15/d38/d4f/d10/d127/d3e/dd5/f95 [0,4194304] 0 2024-09-16T02:06:28.463 INFO:tasks.workunit.client.0.smithi110.stdout:7/995: write d3/d15/d38/d4f/d10/d76/f139 [416431,67596] 0 2024-09-16T02:06:28.463 INFO:tasks.workunit.client.0.smithi110.stdout:7/996: chown d3/d15/d3a/d80/df4 8494 1 2024-09-16T02:06:28.468 INFO:tasks.workunit.client.0.smithi110.stdout:7/997: mknod d3/d15/ddf/c13c 0 2024-09-16T02:06:28.469 INFO:tasks.workunit.client.0.smithi110.stdout:7/998: chown d3/d62/d65/dc1/lbf 1805338539 1 2024-09-16T02:06:28.484 INFO:tasks.workunit.client.0.smithi110.stdout:7/999: dread d3/d15/d38/d4f/d10/d127/d3e/dd5/f82 [0,4194304] 0 2024-09-16T02:06:28.489 INFO:tasks.workunit.client.0.smithi110.stderr:+ rm -rf -- ./tmp.wsFuqpKAq6 2024-09-16T02:06:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:28 smithi110 ceph-mon[27634]: pgmap v38: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 39 MiB/s rd, 78 MiB/s wr, 273 op/s 2024-09-16T02:06:29.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:28 smithi165 ceph-mon[34621]: pgmap v38: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 39 MiB/s rd, 78 MiB/s wr, 273 op/s 2024-09-16T02:06:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:30 smithi110 ceph-mon[27634]: pgmap v39: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 49 MiB/s rd, 101 MiB/s wr, 363 op/s 2024-09-16T02:06:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:30 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:30 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:31.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:30 smithi165 ceph-mon[34621]: pgmap v39: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 49 MiB/s rd, 101 MiB/s wr, 363 op/s 2024-09-16T02:06:31.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:30 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:31.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:30 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:31.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:31 smithi110 ceph-mon[27634]: Reconfiguring grafana.smithi110 (dependencies changed)... 2024-09-16T02:06:31.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:31 smithi110 ceph-mon[27634]: Reconfiguring daemon grafana.smithi110 on smithi110 2024-09-16T02:06:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:31 smithi165 ceph-mon[34621]: Reconfiguring grafana.smithi110 (dependencies changed)... 2024-09-16T02:06:32.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:31 smithi165 ceph-mon[34621]: Reconfiguring daemon grafana.smithi110 on smithi110 2024-09-16T02:06:32.890 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:32 smithi110 ceph-mon[27634]: pgmap v40: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 28 MiB/s rd, 57 MiB/s wr, 223 op/s 2024-09-16T02:06:33.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:32 smithi165 ceph-mon[34621]: pgmap v40: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 28 MiB/s rd, 57 MiB/s wr, 223 op/s 2024-09-16T02:06:33.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:33 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:34.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:33 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:34.953 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:34 smithi110 ceph-mon[27634]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 28 MiB/s rd, 57 MiB/s wr, 238 op/s 2024-09-16T02:06:35.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:34 smithi165 ceph-mon[34621]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 28 MiB/s rd, 57 MiB/s wr, 238 op/s 2024-09-16T02:06:36.135 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:35 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:36.136 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:35 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:36.136 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:35 smithi110 ceph-mon[27634]: Reconfiguring prometheus.smithi110 (dependencies changed)... 2024-09-16T02:06:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:35 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:36.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:35 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:36.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:35 smithi165 ceph-mon[34621]: Reconfiguring prometheus.smithi110 (dependencies changed)... 2024-09-16T02:06:37.006 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:36 smithi110 ceph-mon[27634]: Deploying daemon prometheus.smithi110 on smithi110 2024-09-16T02:06:37.007 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:36 smithi110 ceph-mon[27634]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 24 MiB/s rd, 49 MiB/s wr, 233 op/s 2024-09-16T02:06:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:36 smithi165 ceph-mon[34621]: Deploying daemon prometheus.smithi110 on smithi110 2024-09-16T02:06:37.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:36 smithi165 ceph-mon[34621]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 24 MiB/s rd, 49 MiB/s wr, 233 op/s 2024-09-16T02:06:38.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:38 smithi110 ceph-mon[27634]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 11 MiB/s rd, 24 MiB/s wr, 150 op/s 2024-09-16T02:06:39.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:38 smithi165 ceph-mon[34621]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 11 MiB/s rd, 24 MiB/s wr, 150 op/s 2024-09-16T02:06:40.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:40 smithi110 ceph-mon[27634]: pgmap v44: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 25 MiB/s wr, 221 op/s 2024-09-16T02:06:41.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:40 smithi165 ceph-mon[34621]: pgmap v44: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 25 MiB/s wr, 221 op/s 2024-09-16T02:06:42.541 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:42 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:42.541 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:42 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:42.541 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:42 smithi165 ceph-mon[34621]: Reconfiguring node-exporter.smithi165 (dependencies changed)... 2024-09-16T02:06:42.541 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:42 smithi165 ceph-mon[34621]: Deploying daemon node-exporter.smithi165 on smithi165 2024-09-16T02:06:42.541 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:42 smithi165 ceph-mon[34621]: pgmap v45: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 132 op/s 2024-09-16T02:06:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:42 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:42 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:42 smithi110 ceph-mon[27634]: Reconfiguring node-exporter.smithi165 (dependencies changed)... 2024-09-16T02:06:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:42 smithi110 ceph-mon[27634]: Deploying daemon node-exporter.smithi165 on smithi165 2024-09-16T02:06:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:42 smithi110 ceph-mon[27634]: pgmap v45: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 132 op/s 2024-09-16T02:06:43.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 -- 172.21.15.110:0/1003892441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fd820 msgr2=0x7ff2380fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 --2- 172.21.15.110:0/1003892441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fd820 0x7ff2380fdc90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff2280048d0 tx=0x7ff228009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 -- 172.21.15.110:0/1003892441 shutdown_connections 2024-09-16T02:06:43.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 --2- 172.21.15.110:0/1003892441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fd820 0x7ff2380fdc90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 --2- 172.21.15.110:0/1003892441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fc550 0x7ff2380fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 -- 172.21.15.110:0/1003892441 >> 172.21.15.110:0/1003892441 conn(0x7ff2380f7d30 msgr2=0x7ff2380fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.232+0000 7ff23c944640 1 -- 172.21.15.110:0/1003892441 shutdown_connections 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.233+0000 7ff23c944640 1 -- 172.21.15.110:0/1003892441 wait complete. 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.233+0000 7ff23c944640 1 Processor -- start 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.233+0000 7ff23c944640 1 -- start start 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.233+0000 7ff23c944640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 0x7ff238102df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.233+0000 7ff23c944640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fd820 0x7ff238103330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23c944640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381039c0 con 0x7ff2380fc550 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23c944640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381041f0 con 0x7ff2380fd820 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 0x7ff238102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 0x7ff238102df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54714/0 (socket says 172.21.15.110:54714) 2024-09-16T02:06:43.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23659c640 1 -- 172.21.15.110:0/1664106916 learned_addr learned my addr 172.21.15.110:0/1664106916 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff235d9b640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fd820 0x7ff238103330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23659c640 1 -- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fd820 msgr2=0x7ff238103330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.234+0000 7ff23659c640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fd820 0x7ff238103330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.235+0000 7ff23659c640 1 -- 172.21.15.110:0/1664106916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228005040 con 0x7ff2380fc550 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.235+0000 7ff235d9b640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fd820 0x7ff238103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.235+0000 7ff23659c640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 0x7ff238102df0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff23000bb30 tx=0x7ff230009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.235+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2300092e0 con 0x7ff2380fc550 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.235+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff238104470 con 0x7ff2380fc550 2024-09-16T02:06:43.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.235+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff238104a10 con 0x7ff2380fc550 2024-09-16T02:06:43.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.237+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff23000ce50 con 0x7ff2380fc550 2024-09-16T02:06:43.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.237+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2380fb9b0 con 0x7ff2380fc550 2024-09-16T02:06:43.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.237+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2300092e0 con 0x7ff2380fc550 2024-09-16T02:06:43.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.237+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff230012070 con 0x7ff2380fc550 2024-09-16T02:06:43.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.238+0000 7ff22effd640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff22406e780 0x7ff224070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.238+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff23005f970 con 0x7ff2380fc550 2024-09-16T02:06:43.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.239+0000 7ff235d9b640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff22406e780 0x7ff224070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.239+0000 7ff235d9b640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff22406e780 0x7ff224070c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff228009ac0 tx=0x7ff228035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:43.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.243+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff230092060 con 0x7ff2380fc550 2024-09-16T02:06:43.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.466+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff238104e70 con 0x7ff22406e780 2024-09-16T02:06:43.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.468+0000 7ff22effd640 1 -- 172.21.15.110:0/1664106916 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff238104e70 con 0x7ff22406e780 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff22406e780 msgr2=0x7ff224070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff22406e780 0x7ff224070c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff228009ac0 tx=0x7ff228035040 comp rx=0 tx=0).stop 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 msgr2=0x7ff238102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 0x7ff238102df0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff23000bb30 tx=0x7ff230009840 comp rx=0 tx=0).stop 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 shutdown_connections 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff22406e780 0x7ff224070c30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2380fd820 0x7ff238103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 --2- 172.21.15.110:0/1664106916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2380fc550 0x7ff238102df0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 >> 172.21.15.110:0/1664106916 conn(0x7ff2380f7d30 msgr2=0x7ff2380f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:43.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 shutdown_connections 2024-09-16T02:06:43.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.471+0000 7ff23c944640 1 -- 172.21.15.110:0/1664106916 wait complete. 2024-09-16T02:06:43.482 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:06:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 -- 172.21.15.110:0/840396755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 msgr2=0x7f62180fc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 --2- 172.21.15.110:0/840396755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 0x7f62180fc850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f620c0048d0 tx=0x7f620c009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 -- 172.21.15.110:0/840396755 shutdown_connections 2024-09-16T02:06:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 --2- 172.21.15.110:0/840396755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 0x7f62180fc850 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 --2- 172.21.15.110:0/840396755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f62180fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 -- 172.21.15.110:0/840396755 >> 172.21.15.110:0/840396755 conn(0x7f62180f63a0 msgr2=0x7f62180f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:43.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 -- 172.21.15.110:0/840396755 shutdown_connections 2024-09-16T02:06:43.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 -- 172.21.15.110:0/840396755 wait complete. 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.574+0000 7f621cb2b640 1 Processor -- start 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621cb2b640 1 -- start start 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621cb2b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f621810bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621cb2b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 0x7f621810c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621cb2b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621810cb30 con 0x7f62180fc3e0 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621cb2b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621810d300 con 0x7f62180fba90 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f6215d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 0x7f621810c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f621810bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f621810bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:37674/0 (socket says 172.21.15.110:37674) 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621659c640 1 -- 172.21.15.110:0/1495929538 learned_addr learned my addr 172.21.15.110:0/1495929538 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621659c640 1 -- 172.21.15.110:0/1495929538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 msgr2=0x7f621810c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621659c640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 0x7f621810c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.575+0000 7f621659c640 1 -- 172.21.15.110:0/1495929538 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c005040 con 0x7f62180fba90 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.576+0000 7f621659c640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f621810bfa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f620800c830 tx=0x7f6208004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.576+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f620800a850 con 0x7f62180fba90 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.576+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f620800ae50 con 0x7f62180fba90 2024-09-16T02:06:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.576+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621810d590 con 0x7f62180fba90 2024-09-16T02:06:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.576+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621810db30 con 0x7f62180fba90 2024-09-16T02:06:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.576+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62080113a0 con 0x7f62180fba90 2024-09-16T02:06:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.577+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f620800a9b0 con 0x7f62180fba90 2024-09-16T02:06:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.577+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62180fa040 con 0x7f62180fba90 2024-09-16T02:06:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.578+0000 7f6206ffd640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f620006e6e0 0x7f6200070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.578+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f620808df10 con 0x7f62180fba90 2024-09-16T02:06:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.578+0000 7f6215d9b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f620006e6e0 0x7f6200070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.579+0000 7f6215d9b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f620006e6e0 0x7f6200070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f621810bd50 tx=0x7f620c035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:43.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.582+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6208057950 con 0x7f62180fba90 2024-09-16T02:06:43.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.804+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f621810de90 con 0x7f620006e6e0 2024-09-16T02:06:43.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.805+0000 7f6206ffd640 1 -- 172.21.15.110:0/1495929538 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f621810de90 con 0x7f620006e6e0 2024-09-16T02:06:43.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f620006e6e0 msgr2=0x7f6200070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f620006e6e0 0x7f6200070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f621810bd50 tx=0x7f620c035040 comp rx=0 tx=0).stop 2024-09-16T02:06:43.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 msgr2=0x7f621810bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f621810bfa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f620800c830 tx=0x7f6208004430 comp rx=0 tx=0).stop 2024-09-16T02:06:43.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 shutdown_connections 2024-09-16T02:06:43.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f620006e6e0 0x7f6200070b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62180fc3e0 0x7f621810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 --2- 172.21.15.110:0/1495929538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62180fba90 0x7f621810bfa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 >> 172.21.15.110:0/1495929538 conn(0x7f62180f63a0 msgr2=0x7f62180f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:43.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 shutdown_connections 2024-09-16T02:06:43.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.808+0000 7f621cb2b640 1 -- 172.21.15.110:0/1495929538 wait complete. 2024-09-16T02:06:43.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 -- 172.21.15.110:0/2711259137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fb420 msgr2=0x7f2f200fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 --2- 172.21.15.110:0/2711259137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fb420 0x7f2f200fb830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f100048d0 tx=0x7f2f10009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 -- 172.21.15.110:0/2711259137 shutdown_connections 2024-09-16T02:06:43.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 --2- 172.21.15.110:0/2711259137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fc6f0 0x7f2f200fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 --2- 172.21.15.110:0/2711259137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fb420 0x7f2f200fb830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 -- 172.21.15.110:0/2711259137 >> 172.21.15.110:0/2711259137 conn(0x7f2f200f6c00 msgr2=0x7f2f200f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:43.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.915+0000 7f2f26913640 1 -- 172.21.15.110:0/2711259137 shutdown_connections 2024-09-16T02:06:43.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.916+0000 7f2f26913640 1 -- 172.21.15.110:0/2711259137 wait complete. 2024-09-16T02:06:43.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.916+0000 7f2f26913640 1 Processor -- start 2024-09-16T02:06:43.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.916+0000 7f2f26913640 1 -- start start 2024-09-16T02:06:43.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f26913640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fb420 0x7f2f20113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f26913640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 0x7f2f20113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f26913640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201141e0 con 0x7f2f200fb420 2024-09-16T02:06:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f26913640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20114a00 con 0x7f2f200fc6f0 2024-09-16T02:06:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 0x7f2f20113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 0x7f2f20113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:37680/0 (socket says 172.21.15.110:37680) 2024-09-16T02:06:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1f7fe640 1 -- 172.21.15.110:0/3173713428 learned_addr learned my addr 172.21.15.110:0/3173713428 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1ffff640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fb420 0x7f2f20113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1f7fe640 1 -- 172.21.15.110:0/3173713428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fb420 msgr2=0x7f2f20113650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1f7fe640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fb420 0x7f2f20113650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.917+0000 7f2f1f7fe640 1 -- 172.21.15.110:0/3173713428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10005040 con 0x7f2f200fc6f0 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f1ffff640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fb420 0x7f2f20113650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f1f7fe640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 0x7f2f20113b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400eb70 tx=0x7f2f1400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f14007c30 con 0x7f2f200fc6f0 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f1400f040 con 0x7f2f200fc6f0 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20114c30 con 0x7f2f200fc6f0 2024-09-16T02:06:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f14009550 con 0x7f2f200fc6f0 2024-09-16T02:06:43.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.918+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f201151d0 con 0x7f2f200fc6f0 2024-09-16T02:06:43.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.920+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f200fa880 con 0x7f2f200fc6f0 2024-09-16T02:06:43.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.920+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f2f140096b0 con 0x7f2f200fc6f0 2024-09-16T02:06:43.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.921+0000 7f2f1cff9640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f2f0806e6e0 0x7f2f08070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:43.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.921+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f2f1408dac0 con 0x7f2f200fc6f0 2024-09-16T02:06:43.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.921+0000 7f2f1ffff640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f2f0806e6e0 0x7f2f08070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:43.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.922+0000 7f2f1ffff640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f2f0806e6e0 0x7f2f08070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b020 tx=0x7f2f10009da0 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:43.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:43.926+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2f14050670 con 0x7f2f200fc6f0 2024-09-16T02:06:44.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.178+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f20115440 con 0x7f2f0806e6e0 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.187+0000 7f2f1cff9640 1 -- 172.21.15.110:0/3173713428 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2f20115440 con 0x7f2f0806e6e0 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 starting - - - - 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (8m) 71s ago 8m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (8m) 75s ago 8m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 starting - - - - 2024-09-16T02:06:44.188 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (3m) 71s ago 3m 138M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (3m) 71s ago 3m 149M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (3m) 75s ago 3m 14.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (3m) 75s ago 3m 11.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:9283,8765,8443 running (9m) 71s ago 9m 207M - 17.2.7-1633-g6d025bc2 33ed8dba3996 093819b4fc7f 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (97s) 75s ago 7m 482M - 19.1.1-326-g8921c8ef f1455bd0219c 059ca54552a6 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (9m) 71s ago 10m 49.0M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (7m) 75s ago 7m 38.1M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 starting - - - - 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 starting - - - - 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (7m) 71s ago 7m 78.4M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (6m) 71s ago 6m 79.0M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (6m) 71s ago 6m 71.6M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:06:44.189 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (5m) 75s ago 5m 79.4M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:06:44.190 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (5m) 75s ago 5m 72.5M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:06:44.190 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (4m) 75s ago 4m 76.1M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:06:44.190 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 starting - - - - 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f2f0806e6e0 msgr2=0x7f2f08070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f2f0806e6e0 0x7f2f08070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b020 tx=0x7f2f10009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 msgr2=0x7f2f20113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 0x7f2f20113b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400eb70 tx=0x7f2f1400b040 comp rx=0 tx=0).stop 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 shutdown_connections 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f2f0806e6e0 0x7f2f08070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f200fc6f0 0x7f2f20113b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 --2- 172.21.15.110:0/3173713428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f200fb420 0x7f2f20113650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 >> 172.21.15.110:0/3173713428 conn(0x7f2f200f6c00 msgr2=0x7f2f20065f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:44.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 shutdown_connections 2024-09-16T02:06:44.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.190+0000 7f2f26913640 1 -- 172.21.15.110:0/3173713428 wait complete. 2024-09-16T02:06:44.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.290+0000 7ff0054bd640 1 -- 172.21.15.110:0/1496051650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 msgr2=0x7ff000108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.290+0000 7ff0054bd640 1 --2- 172.21.15.110:0/1496051650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000108730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feff0004810 tx=0x7feff0009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.291+0000 7ff0054bd640 1 -- 172.21.15.110:0/1496051650 shutdown_connections 2024-09-16T02:06:44.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.291+0000 7ff0054bd640 1 --2- 172.21.15.110:0/1496051650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000108730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.291+0000 7ff0054bd640 1 --2- 172.21.15.110:0/1496051650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 0x7ff00006e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.291+0000 7ff0054bd640 1 -- 172.21.15.110:0/1496051650 >> 172.21.15.110:0/1496051650 conn(0x7ff000069b00 msgr2=0x7ff00006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:44.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.291+0000 7ff0054bd640 1 -- 172.21.15.110:0/1496051650 shutdown_connections 2024-09-16T02:06:44.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.291+0000 7ff0054bd640 1 -- 172.21.15.110:0/1496051650 wait complete. 2024-09-16T02:06:44.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.292+0000 7ff0054bd640 1 Processor -- start 2024-09-16T02:06:44.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.292+0000 7ff0054bd640 1 -- start start 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7ff0054bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 0x7ff0001135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7ff0054bd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7ff0054bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff000114130 con 0x7ff00006dee0 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7ff0054bd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0001149f0 con 0x7ff00006e8c0 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7feffe7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7feffeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 0x7ff0001135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7feffeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 0x7ff0001135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54776/0 (socket says 172.21.15.110:54776) 2024-09-16T02:06:44.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.293+0000 7feffeffd640 1 -- 172.21.15.110:0/3665760045 learned_addr learned my addr 172.21.15.110:0/3665760045 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:44.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feffe7fc640 1 -- 172.21.15.110:0/3665760045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 msgr2=0x7ff0001135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feffe7fc640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 0x7ff0001135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feffe7fc640 1 -- 172.21.15.110:0/3665760045 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0005040 con 0x7ff00006e8c0 2024-09-16T02:06:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feffe7fc640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000113b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feff00047e0 tx=0x7feff0009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff0033c20 con 0x7ff00006e8c0 2024-09-16T02:06:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feff0033d80 con 0x7ff00006e8c0 2024-09-16T02:06:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff0034640 con 0x7ff00006e8c0 2024-09-16T02:06:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.295+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff000114c70 con 0x7ff00006e8c0 2024-09-16T02:06:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.296+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff000115040 con 0x7ff00006e8c0 2024-09-16T02:06:44.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.297+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00006d650 con 0x7ff00006e8c0 2024-09-16T02:06:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.299+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7feff0031020 con 0x7ff00006e8c0 2024-09-16T02:06:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.299+0000 7feff77fe640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fefec06e800 0x7fefec070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.299+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7feff00ae0f0 con 0x7ff00006e8c0 2024-09-16T02:06:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.300+0000 7feffeffd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fefec06e800 0x7fefec070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:44.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.302+0000 7feffeffd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fefec06e800 0x7fefec070cb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff0001133a0 tx=0x7fefe800b040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:44.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.306+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7feff0077b30 con 0x7ff00006e8c0 2024-09-16T02:06:44.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.713+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff00004b720 con 0x7ff00006e8c0 2024-09-16T02:06:44.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.714+0000 7feff77fe640 1 -- 172.21.15.110:0/3665760045 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7feff007b1f0 con 0x7ff00006e8c0 2024-09-16T02:06:44.715 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 1, 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:06:44.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:06:44.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:06:44.717 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:06:44.717 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 13, 2024-09-16T02:06:44.717 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:06:44.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:06:44.717 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fefec06e800 msgr2=0x7fefec070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fefec06e800 0x7fefec070cb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff0001133a0 tx=0x7fefe800b040 comp rx=0 tx=0).stop 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 msgr2=0x7ff000113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000113b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feff00047e0 tx=0x7feff0009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 shutdown_connections 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fefec06e800 0x7fefec070cb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff00006e8c0 0x7ff000113b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 --2- 172.21.15.110:0/3665760045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff00006dee0 0x7ff0001135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.716+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 >> 172.21.15.110:0/3665760045 conn(0x7ff000069b00 msgr2=0x7ff000106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:44.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.717+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 shutdown_connections 2024-09-16T02:06:44.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.717+0000 7ff0054bd640 1 -- 172.21.15.110:0/3665760045 wait complete. 2024-09-16T02:06:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.822+0000 7f90fd215640 1 -- 172.21.15.110:0/2464997552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fc520 msgr2=0x7f90f80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.822+0000 7f90fd215640 1 --2- 172.21.15.110:0/2464997552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fc520 0x7f90f80fc930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90e80048d0 tx=0x7f90e8009da0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.823+0000 7f90fd215640 1 -- 172.21.15.110:0/2464997552 shutdown_connections 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.823+0000 7f90fd215640 1 --2- 172.21.15.110:0/2464997552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f80fd7f0 0x7f90f80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.823+0000 7f90fd215640 1 --2- 172.21.15.110:0/2464997552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fc520 0x7f90f80fc930 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.823+0000 7f90fd215640 1 -- 172.21.15.110:0/2464997552 >> 172.21.15.110:0/2464997552 conn(0x7f90f80f7ce0 msgr2=0x7f90f80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.823+0000 7f90fd215640 1 -- 172.21.15.110:0/2464997552 shutdown_connections 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.823+0000 7f90fd215640 1 -- 172.21.15.110:0/2464997552 wait complete. 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90fd215640 1 Processor -- start 2024-09-16T02:06:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90fd215640 1 -- start start 2024-09-16T02:06:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90fd215640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f80fc520 0x7f90f8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90fd215640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 0x7f90f806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90fd215640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f806fff0 con 0x7f90f80fd7f0 2024-09-16T02:06:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90fd215640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8070130 con 0x7f90f80fc520 2024-09-16T02:06:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 0x7f90f806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:44.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 0x7f90f806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54794/0 (socket says 172.21.15.110:54794) 2024-09-16T02:06:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 -- 172.21.15.110:0/2461790077 learned_addr learned my addr 172.21.15.110:0/2461790077 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:06:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90f6d9d640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f80fc520 0x7f90f8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 -- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f80fc520 msgr2=0x7f90f8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f80fc520 0x7f90f8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 -- 172.21.15.110:0/2461790077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8005040 con 0x7f90f80fd7f0 2024-09-16T02:06:44.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.824+0000 7f90effff640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 0x7f90f806fa60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90e000eb70 tx=0x7f90e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.825+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e0007c30 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.825+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90e000f040 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.825+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e0009550 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.825+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f80703b0 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.825+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f81150d0 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.826+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f80fb980 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.826+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f90e00096b0 con 0x7f90f80fd7f0 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.827+0000 7f90ef7fe640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f90e406e6e0 0x7f90e4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:06:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.827+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f90e008dac0 con 0x7f90f80fd7f0 2024-09-16T02:06:44.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.827+0000 7f90f6d9d640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f90e406e6e0 0x7f90e4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:06:44.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.828+0000 7f90f6d9d640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f90e406e6e0 0x7f90e4070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e8035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:06:44.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:44.832+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f90e0050670 con 0x7f90f80fd7f0 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: pgmap v46: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:06:44.911 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:44 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:06:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: pgmap v46: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-09-16T02:06:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T02:06:44.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:06:44.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:06:44.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:44 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:06:45.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.143+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90f8101c50 con 0x7f90e406e6e0 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.147+0000 7f90ef7fe640 1 -- 172.21.15.110:0/2461790077 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f90f8101c50 con 0x7f90e406e6e0 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [], 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "1/2 daemons upgraded", 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mgr daemons", 2024-09-16T02:06:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:06:45.149 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:06:45.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f90e406e6e0 msgr2=0x7f90e4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f90e406e6e0 0x7f90e4070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e8035040 comp rx=0 tx=0).stop 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 msgr2=0x7f90f806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 0x7f90f806fa60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90e000eb70 tx=0x7f90e000b040 comp rx=0 tx=0).stop 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 shutdown_connections 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f90e406e6e0 0x7f90e4070b90 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e8035040 comp rx=0 tx=0).stop 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90f80fd7f0 0x7f90f806fa60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 --2- 172.21.15.110:0/2461790077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f80fc520 0x7f90f8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:06:45.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.150+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 >> 172.21.15.110:0/2461790077 conn(0x7f90f80f7ce0 msgr2=0x7f90f80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:06:45.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.151+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 shutdown_connections 2024-09-16T02:06:45.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:06:45.151+0000 7f90fd215640 1 -- 172.21.15.110:0/2461790077 wait complete. 2024-09-16T02:06:45.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T02:06:45.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:06:45.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:06:45.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: Upgrade: Need to upgrade myself (mgr.smithi165.afwhot) 2024-09-16T02:06:45.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: Upgrade: Need to upgrade myself (mgr.smithi165.afwhot) 2024-09-16T02:06:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:45 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3665760045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:06:45.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T02:06:45.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:06:45.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:06:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: Upgrade: Need to upgrade myself (mgr.smithi165.afwhot) 2024-09-16T02:06:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: Upgrade: Need to upgrade myself (mgr.smithi165.afwhot) 2024-09-16T02:06:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:45 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3665760045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:06:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: pgmap v47: 65 pgs: 65 active+clean; 926 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 187 op/s 2024-09-16T02:06:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: Upgrade: Updating mgr.smithi110.hfirap 2024-09-16T02:06:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:06:46.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:06:46.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:06:46.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:06:46.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:46 smithi165 ceph-mon[34621]: Deploying daemon mgr.smithi110.hfirap on smithi110 2024-09-16T02:06:47.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: pgmap v47: 65 pgs: 65 active+clean; 926 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 187 op/s 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: Upgrade: Updating mgr.smithi110.hfirap 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:06:47.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:46 smithi110 ceph-mon[27634]: Deploying daemon mgr.smithi110.hfirap on smithi110 2024-09-16T02:06:47.376 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T02:06:47.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T02:06:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:48 smithi110 ceph-mon[27634]: pgmap v48: 65 pgs: 65 active+clean; 926 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 142 op/s 2024-09-16T02:06:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:48 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:49.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:48 smithi165 ceph-mon[34621]: pgmap v48: 65 pgs: 65 active+clean; 926 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 142 op/s 2024-09-16T02:06:49.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:48 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:06:50.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:49 smithi165 ceph-mon[34621]: mgrmap e26: smithi165.afwhot(active, since 91s), standbys: smithi110.hfirap 2024-09-16T02:06:50.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:49 smithi110 ceph-mon[27634]: mgrmap e26: smithi165.afwhot(active, since 91s), standbys: smithi110.hfirap 2024-09-16T02:06:51.035 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:50 smithi110 ceph-mon[27634]: pgmap v49: 65 pgs: 65 active+clean; 437 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 210 op/s 2024-09-16T02:06:51.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:50 smithi165 ceph-mon[34621]: pgmap v49: 65 pgs: 65 active+clean; 437 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 210 op/s 2024-09-16T02:06:53.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:52 smithi165 ceph-mon[34621]: pgmap v50: 65 pgs: 65 active+clean; 437 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-16T02:06:53.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:52 smithi110 ceph-mon[27634]: pgmap v50: 65 pgs: 65 active+clean; 437 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-09-16T02:06:55.100 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:54 smithi110 ceph-mon[27634]: pgmap v51: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 188 op/s 2024-09-16T02:06:55.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:54 smithi165 ceph-mon[34621]: pgmap v51: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 188 op/s 2024-09-16T02:06:56.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:56 smithi165 ceph-mon[34621]: pgmap v52: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 194 op/s 2024-09-16T02:06:56.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:56 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:56.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:56 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:56.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:56 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:06:57.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:56 smithi110 ceph-mon[27634]: pgmap v52: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 194 op/s 2024-09-16T02:06:57.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:56 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:57.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:56 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:06:57.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:56 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:06:58.924 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:06:58 smithi110 ceph-mon[27634]: pgmap v53: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-09-16T02:06:59.084 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:06:58 smithi165 ceph-mon[34621]: pgmap v53: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-09-16T02:07:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:00 smithi165 ceph-mon[34621]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 185 op/s 2024-09-16T02:07:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:00 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:00 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:01.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:00 smithi110 ceph-mon[27634]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 185 op/s 2024-09-16T02:07:01.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:00 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:01.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:00 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:01 smithi165 ceph-mon[34621]: Standby manager daemon smithi110.hfirap restarted 2024-09-16T02:07:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:01 smithi165 ceph-mon[34621]: Standby manager daemon smithi110.hfirap started 2024-09-16T02:07:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:01 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/crt"}]: dispatch 2024-09-16T02:07:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:01 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:07:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:01 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/key"}]: dispatch 2024-09-16T02:07:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:01 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:07:02.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:01 smithi110 ceph-mon[27634]: Standby manager daemon smithi110.hfirap restarted 2024-09-16T02:07:02.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:01 smithi110 ceph-mon[27634]: Standby manager daemon smithi110.hfirap started 2024-09-16T02:07:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:01 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/crt"}]: dispatch 2024-09-16T02:07:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:01 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:07:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:01 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi110.hfirap/key"}]: dispatch 2024-09-16T02:07:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:01 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:07:03.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:02 smithi165 ceph-mon[34621]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2024-09-16T02:07:03.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:02 smithi165 ceph-mon[34621]: mgrmap e27: smithi165.afwhot(active, since 104s), standbys: smithi110.hfirap 2024-09-16T02:07:03.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:02 smithi110 ceph-mon[27634]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2024-09-16T02:07:03.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:02 smithi110 ceph-mon[27634]: mgrmap e27: smithi165.afwhot(active, since 104s), standbys: smithi110.hfirap 2024-09-16T02:07:04.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:03 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:04.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:03 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:05.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:04 smithi165 ceph-mon[34621]: pgmap v56: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 154 op/s 2024-09-16T02:07:05.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:04 smithi110 ceph-mon[27634]: pgmap v56: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 154 op/s 2024-09-16T02:07:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:06 smithi110 ceph-mon[27634]: pgmap v57: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 118 op/s 2024-09-16T02:07:07.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:06 smithi165 ceph-mon[34621]: pgmap v57: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 118 op/s 2024-09-16T02:07:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:08 smithi110 ceph-mon[27634]: pgmap v58: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-09-16T02:07:09.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:08 smithi165 ceph-mon[34621]: pgmap v58: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 98 op/s 2024-09-16T02:07:11.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:10 smithi165 ceph-mon[34621]: pgmap v59: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 221 op/s 2024-09-16T02:07:11.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:10 smithi110 ceph-mon[27634]: pgmap v59: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 221 op/s 2024-09-16T02:07:13.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:12 smithi165 ceph-mon[34621]: pgmap v60: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 173 op/s 2024-09-16T02:07:13.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:12 smithi110 ceph-mon[27634]: pgmap v60: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 173 op/s 2024-09-16T02:07:15.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:14 smithi165 ceph-mon[34621]: pgmap v61: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-16T02:07:15.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:14 smithi110 ceph-mon[27634]: pgmap v61: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 369 op/s 2024-09-16T02:07:15.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/3653108741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 msgr2=0x7f7e380fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/3653108741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e380fdf80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e280048d0 tx=0x7f7e28009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/3653108741 shutdown_connections 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/3653108741 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 0x7f7e380fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/3653108741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e380fdf80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/3653108741 >> 172.21.15.110:0/3653108741 conn(0x7f7e380f6390 msgr2=0x7f7e380f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/3653108741 shutdown_connections 2024-09-16T02:07:15.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.267+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/3653108741 wait complete. 2024-09-16T02:07:15.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3d0cd640 1 Processor -- start 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3d0cd640 1 -- start start 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3d0cd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e3810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3d0cd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 0x7f7e3810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3d0cd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3810dc50 con 0x7f7e380fdb70 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3d0cd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3810e420 con 0x7f7e380fe4c0 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 0x7f7e3810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 0x7f7e3810d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:37040/0 (socket says 172.21.15.110:37040) 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e3659c640 1 -- 172.21.15.110:0/4225302786 learned_addr learned my addr 172.21.15.110:0/4225302786 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.268+0000 7f7e36d9d640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e3810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e36d9d640 1 -- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 msgr2=0x7f7e3810d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e36d9d640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 0x7f7e3810d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e36d9d640 1 -- 172.21.15.110:0/4225302786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28005040 con 0x7f7e380fdb70 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e36d9d640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e3810d0c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7e2802a530 tx=0x7f7e28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e28038070 con 0x7f7e380fdb70 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e28004290 con 0x7f7e380fdb70 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e28032610 con 0x7f7e380fdb70 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.269+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3810e650 con 0x7f7e380fdb70 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.270+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3810eba0 con 0x7f7e380fdb70 2024-09-16T02:07:15.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.271+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e380fa010 con 0x7f7e380fdb70 2024-09-16T02:07:15.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.272+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f7e28030020 con 0x7f7e380fdb70 2024-09-16T02:07:15.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.272+0000 7f7e1f7fe640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f7e2006de30 0x7f7e200702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:15.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.273+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7e280ad7a0 con 0x7f7e380fdb70 2024-09-16T02:07:15.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.273+0000 7f7e3659c640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f7e2006de30 0x7f7e200702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:15.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.273+0000 7f7e3659c640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f7e2006de30 0x7f7e200702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7e3810ce70 tx=0x7f7e2c00b040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:15.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.277+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7e28077340 con 0x7f7e380fdb70 2024-09-16T02:07:15.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.557+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e3810f040 con 0x7f7e2006de30 2024-09-16T02:07:15.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.559+0000 7f7e1f7fe640 1 -- 172.21.15.110:0/4225302786 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f7e3810f040 con 0x7f7e2006de30 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f7e2006de30 msgr2=0x7f7e200702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f7e2006de30 0x7f7e200702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7e3810ce70 tx=0x7f7e2c00b040 comp rx=0 tx=0).stop 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 msgr2=0x7f7e3810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e3810d0c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7e2802a530 tx=0x7f7e28009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 shutdown_connections 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f7e2006de30 0x7f7e200702e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e380fe4c0 0x7f7e3810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 --2- 172.21.15.110:0/4225302786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e380fdb70 0x7f7e3810d0c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.562+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 >> 172.21.15.110:0/4225302786 conn(0x7f7e380f6390 msgr2=0x7f7e380f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:15.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.563+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 shutdown_connections 2024-09-16T02:07:15.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.563+0000 7f7e3d0cd640 1 -- 172.21.15.110:0/4225302786 wait complete. 2024-09-16T02:07:15.576 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:07:15.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 -- 172.21.15.110:0/3053233468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 msgr2=0x7ff6180fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 --2- 172.21.15.110:0/3053233468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff6180fc930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff6080048d0 tx=0x7ff608009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 -- 172.21.15.110:0/3053233468 shutdown_connections 2024-09-16T02:07:15.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 --2- 172.21.15.110:0/3053233468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6180fd7f0 0x7ff6180fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 --2- 172.21.15.110:0/3053233468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff6180fc930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 -- 172.21.15.110:0/3053233468 >> 172.21.15.110:0/3053233468 conn(0x7ff6180f7ce0 msgr2=0x7ff6180fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:15.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 -- 172.21.15.110:0/3053233468 shutdown_connections 2024-09-16T02:07:15.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.674+0000 7ff61de3d640 1 -- 172.21.15.110:0/3053233468 wait complete. 2024-09-16T02:07:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff61de3d640 1 Processor -- start 2024-09-16T02:07:15.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff61de3d640 1 -- start start 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff61de3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff61810f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff61de3d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6180fd7f0 0x7ff61810f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff61de3d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61810fe80 con 0x7ff6180fc520 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff61de3d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6181106a0 con 0x7ff6180fd7f0 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff6177fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff61810f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff6177fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff61810f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41996/0 (socket says 172.21.15.110:41996) 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff6177fe640 1 -- 172.21.15.110:0/424758810 learned_addr learned my addr 172.21.15.110:0/424758810 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.675+0000 7ff616ffd640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6180fd7f0 0x7ff61810f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff6177fe640 1 -- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6180fd7f0 msgr2=0x7ff61810f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff6177fe640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6180fd7f0 0x7ff61810f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff6177fe640 1 -- 172.21.15.110:0/424758810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608005040 con 0x7ff6180fc520 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff6177fe640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff61810f2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff6080048a0 tx=0x7ff608009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:15.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff608038070 con 0x7ff6180fc520 2024-09-16T02:07:15.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6181108d0 con 0x7ff6180fc520 2024-09-16T02:07:15.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff618110e70 con 0x7ff6180fc520 2024-09-16T02:07:15.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff608004290 con 0x7ff6180fc520 2024-09-16T02:07:15.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.676+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff608033420 con 0x7ff6180fc520 2024-09-16T02:07:15.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.677+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff604005210 con 0x7ff6180fc520 2024-09-16T02:07:15.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.678+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7ff608030020 con 0x7ff6180fc520 2024-09-16T02:07:15.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.679+0000 7ff5fffff640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff60006dea0 0x7ff600070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:15.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.679+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff6080ad640 con 0x7ff6180fc520 2024-09-16T02:07:15.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.679+0000 7ff616ffd640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff60006dea0 0x7ff600070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:15.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.679+0000 7ff616ffd640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff60006dea0 0x7ff600070350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff61810f0a0 tx=0x7ff60c00b040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:15.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.684+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff608077260 con 0x7ff6180fc520 2024-09-16T02:07:15.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.984+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff604000bc0 con 0x7ff60006dea0 2024-09-16T02:07:15.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.985+0000 7ff5fffff640 1 -- 172.21.15.110:0/424758810 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7ff604000bc0 con 0x7ff60006dea0 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff60006dea0 msgr2=0x7ff600070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff60006dea0 0x7ff600070350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff61810f0a0 tx=0x7ff60c00b040 comp rx=0 tx=0).stop 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 msgr2=0x7ff61810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff61810f2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff6080048a0 tx=0x7ff608009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 shutdown_connections 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7ff60006dea0 0x7ff600070350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6180fd7f0 0x7ff61810f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 --2- 172.21.15.110:0/424758810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6180fc520 0x7ff61810f2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.987+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 >> 172.21.15.110:0/424758810 conn(0x7ff6180f7ce0 msgr2=0x7ff6180f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:15.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.988+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 shutdown_connections 2024-09-16T02:07:15.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:15.988+0000 7ff61de3d640 1 -- 172.21.15.110:0/424758810 wait complete. 2024-09-16T02:07:16.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 -- 172.21.15.110:0/130328557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fb430 msgr2=0x7fc9600fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 --2- 172.21.15.110:0/130328557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fb430 0x7fc9600fb840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0048d0 tx=0x7fc95c009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 -- 172.21.15.110:0/130328557 shutdown_connections 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 --2- 172.21.15.110:0/130328557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9600fc700 0x7fc9600fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 --2- 172.21.15.110:0/130328557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fb430 0x7fc9600fb840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 -- 172.21.15.110:0/130328557 >> 172.21.15.110:0/130328557 conn(0x7fc9600f6c10 msgr2=0x7fc9600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 -- 172.21.15.110:0/130328557 shutdown_connections 2024-09-16T02:07:16.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.093+0000 7fc96775a640 1 -- 172.21.15.110:0/130328557 wait complete. 2024-09-16T02:07:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc96775a640 1 Processor -- start 2024-09-16T02:07:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc96775a640 1 -- start start 2024-09-16T02:07:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc96775a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9600fb430 0x7fc9600ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc96775a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 0x7fc9600fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc96775a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600fe060 con 0x7fc9600fc700 2024-09-16T02:07:16.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc96775a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600fe1a0 con 0x7fc9600fb430 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.094+0000 7fc964cf5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 0x7fc9600fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc964cf5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 0x7fc9600fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42008/0 (socket says 172.21.15.110:42008) 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc964cf5640 1 -- 172.21.15.110:0/3703817122 learned_addr learned my addr 172.21.15.110:0/3703817122 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc9654f6640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9600fb430 0x7fc9600ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc964cf5640 1 -- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9600fb430 msgr2=0x7fc9600ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc964cf5640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9600fb430 0x7fc9600ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc964cf5640 1 -- 172.21.15.110:0/3703817122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c005040 con 0x7fc9600fc700 2024-09-16T02:07:16.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.095+0000 7fc964cf5640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 0x7fc9600fda40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc95400b560 tx=0x7fc9540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.096+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc95400f6f0 con 0x7fc9600fc700 2024-09-16T02:07:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.096+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc95400fcf0 con 0x7fc9600fc700 2024-09-16T02:07:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.096+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600fe480 con 0x7fc9600fc700 2024-09-16T02:07:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.096+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc954011e70 con 0x7fc9600fc700 2024-09-16T02:07:16.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.096+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc960115150 con 0x7fc9600fc700 2024-09-16T02:07:16.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.098+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9600fa890 con 0x7fc9600fc700 2024-09-16T02:07:16.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.098+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fc954011620 con 0x7fc9600fc700 2024-09-16T02:07:16.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.099+0000 7fc951ffb640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc94c06def0 0x7fc94c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.099+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc95405aa80 con 0x7fc9600fc700 2024-09-16T02:07:16.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.099+0000 7fc9654f6640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc94c06def0 0x7fc94c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.101+0000 7fc9654f6640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc94c06def0 0x7fc94c0703a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ff300 tx=0x7fc95c035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:16.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.108+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc954092060 con 0x7fc9600fc700 2024-09-16T02:07:16.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.388+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc96005db50 con 0x7fc94c06def0 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.397+0000 7fc951ffb640 1 -- 172.21.15.110:0/3703817122 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc96005db50 con 0x7fc94c06def0 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (47s) 0s ago 9m 15.5M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (9m) 0s ago 9m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (8m) 16s ago 8m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (42s) 0s ago 8m 77.3M - 9.4.7 954c08fa6188 0e985c4cf35f 2024-09-16T02:07:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (3m) 0s ago 3m 263M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (4m) 0s ago 4m 241M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (3m) 16s ago 3m 15.5M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (4m) 16s ago 4m 12.4M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (24s) 0s ago 10m 123M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (2m) 16s ago 8m 502M - 19.1.1-326-g8921c8ef f1455bd0219c 059ca54552a6 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (10m) 0s ago 10m 47.4M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (8m) 16s ago 8m 40.7M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (87s) 0s ago 9m 9.77M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (32s) 16s ago 8m 8044k - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (7m) 0s ago 7m 179M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (7m) 0s ago 7m 187M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (6m) 0s ago 6m 155M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:07:16.400 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (6m) 16s ago 6m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:07:16.401 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (5m) 16s ago 5m 182M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:07:16.401 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (5m) 16s ago 5m 170M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:07:16.401 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (35s) 0s ago 8m 40.3M - 2.43.0 a07b618ecd1d fc289a7f653e 2024-09-16T02:07:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc94c06def0 msgr2=0x7fc94c0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc94c06def0 0x7fc94c0703a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ff300 tx=0x7fc95c035040 comp rx=0 tx=0).stop 2024-09-16T02:07:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 msgr2=0x7fc9600fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 0x7fc9600fda40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc95400b560 tx=0x7fc9540090f0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 shutdown_connections 2024-09-16T02:07:16.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7fc94c06def0 0x7fc94c0703a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9600fc700 0x7fc9600fda40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 --2- 172.21.15.110:0/3703817122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9600fb430 0x7fc9600ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 >> 172.21.15.110:0/3703817122 conn(0x7fc9600f6c10 msgr2=0x7fc960065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 shutdown_connections 2024-09-16T02:07:16.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.400+0000 7fc96775a640 1 -- 172.21.15.110:0/3703817122 wait complete. 2024-09-16T02:07:16.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.496+0000 7f3a56ffd640 1 -- 172.21.15.110:0/984562253 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4c032610 con 0x7f3a580fc550 2024-09-16T02:07:16.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 -- 172.21.15.110:0/984562253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 msgr2=0x7f3a580fc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/984562253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a580fc9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0048d0 tx=0x7f3a4c009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 -- 172.21.15.110:0/984562253 shutdown_connections 2024-09-16T02:07:16.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/984562253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a580fc9c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/984562253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 0x7f3a580fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 -- 172.21.15.110:0/984562253 >> 172.21.15.110:0/984562253 conn(0x7f3a580f6a40 msgr2=0x7f3a580f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:16.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 -- 172.21.15.110:0/984562253 shutdown_connections 2024-09-16T02:07:16.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.497+0000 7f3a5d79f640 1 -- 172.21.15.110:0/984562253 wait complete. 2024-09-16T02:07:16.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a5d79f640 1 Processor -- start 2024-09-16T02:07:16.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a5d79f640 1 -- start start 2024-09-16T02:07:16.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a5d79f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 0x7f3a5810ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a5d79f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a5810b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a5d79f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5810bfb0 con 0x7f3a580fc550 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a5d79f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5810c120 con 0x7f3a580fb280 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a577fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a5810b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a577fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a5810b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42024/0 (socket says 172.21.15.110:42024) 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a577fe640 1 -- 172.21.15.110:0/1762350300 learned_addr learned my addr 172.21.15.110:0/1762350300 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.498+0000 7f3a57fff640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 0x7f3a5810ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a57fff640 1 -- 172.21.15.110:0/1762350300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 msgr2=0x7f3a5810b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a57fff640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a5810b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a57fff640 1 -- 172.21.15.110:0/1762350300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c005040 con 0x7f3a580fb280 2024-09-16T02:07:16.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a577fe640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a5810b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:07:16.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a57fff640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 0x7f3a5810ad40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800eb40 tx=0x7f3a4800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:16.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a48007c30 con 0x7f3a580fb280 2024-09-16T02:07:16.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5810c3a0 con 0x7f3a580fb280 2024-09-16T02:07:16.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a4800f040 con 0x7f3a580fb280 2024-09-16T02:07:16.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a480094b0 con 0x7f3a580fb280 2024-09-16T02:07:16.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.499+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5810c940 con 0x7f3a580fb280 2024-09-16T02:07:16.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.500+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a58103550 con 0x7f3a580fb280 2024-09-16T02:07:16.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.501+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f3a48009610 con 0x7f3a580fb280 2024-09-16T02:07:16.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.501+0000 7f3a54ff9640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f3a40072230 0x7f3a400746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.502+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3a4808d2a0 con 0x7f3a580fb280 2024-09-16T02:07:16.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.502+0000 7f3a577fe640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f3a40072230 0x7f3a400746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.502+0000 7f3a577fe640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f3a40072230 0x7f3a400746e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a5810aaf0 tx=0x7f3a4c035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.506+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3a48056ec0 con 0x7f3a580fb280 2024-09-16T02:07:16.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.827+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a5804b720 con 0x7f3a580fb280 2024-09-16T02:07:16.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.828+0000 7f3a54ff9640 1 -- 172.21.15.110:0/1762350300 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f3a4805a580 con 0x7f3a580fb280 2024-09-16T02:07:16.830 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:07:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:07:16.830 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:07:16.831 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 12, 2024-09-16T02:07:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:07:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:07:16.832 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:07:16.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f3a40072230 msgr2=0x7f3a400746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f3a40072230 0x7f3a400746e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a5810aaf0 tx=0x7f3a4c035040 comp rx=0 tx=0).stop 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 msgr2=0x7f3a5810ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 0x7f3a5810ad40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800eb40 tx=0x7f3a4800b040 comp rx=0 tx=0).stop 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 shutdown_connections 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f3a40072230 0x7f3a400746e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a580fc550 0x7f3a5810b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 --2- 172.21.15.110:0/1762350300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a580fb280 0x7f3a5810ad40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 >> 172.21.15.110:0/1762350300 conn(0x7f3a580f6a40 msgr2=0x7f3a580f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 shutdown_connections 2024-09-16T02:07:16.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.831+0000 7f3a5d79f640 1 -- 172.21.15.110:0/1762350300 wait complete. 2024-09-16T02:07:16.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 -- 172.21.15.110:0/2197740561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fc6f0 msgr2=0x7f79680fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 --2- 172.21.15.110:0/2197740561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fc6f0 0x7f79680fcb60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79540048d0 tx=0x7f7954009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 -- 172.21.15.110:0/2197740561 shutdown_connections 2024-09-16T02:07:16.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 --2- 172.21.15.110:0/2197740561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fc6f0 0x7f79680fcb60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 --2- 172.21.15.110:0/2197740561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fb420 0x7f79680fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 -- 172.21.15.110:0/2197740561 >> 172.21.15.110:0/2197740561 conn(0x7f79680f6c00 msgr2=0x7f79680f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:16.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 -- 172.21.15.110:0/2197740561 shutdown_connections 2024-09-16T02:07:16.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.939+0000 7f796ee40640 1 -- 172.21.15.110:0/2197740561 wait complete. 2024-09-16T02:07:16.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796ee40640 1 Processor -- start 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796ee40640 1 -- start start 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796ee40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 0x7f796810bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796ee40640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fc6f0 0x7f796810c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796ee40640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796810cb00 con 0x7f79680fb420 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796ee40640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796810d320 con 0x7f79680fc6f0 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796cbdc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 0x7f796810bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796cbdc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 0x7f796810bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42050/0 (socket says 172.21.15.110:42050) 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f796cbdc640 1 -- 172.21.15.110:0/920587830 learned_addr learned my addr 172.21.15.110:0/920587830 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:16.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.940+0000 7f7967fff640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fc6f0 0x7f796810c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f796cbdc640 1 -- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fc6f0 msgr2=0x7f796810c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:16.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f796cbdc640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fc6f0 0x7f796810c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:16.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f796cbdc640 1 -- 172.21.15.110:0/920587830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954005040 con 0x7f79680fb420 2024-09-16T02:07:16.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f7967fff640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fc6f0 0x7f796810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f796cbdc640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 0x7f796810bf70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f795c00eb70 tx=0x7f795c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c007c30 con 0x7f79680fb420 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796810d550 con 0x7f79680fb420 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f795c00f040 con 0x7f79680fb420 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.941+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796810daf0 con 0x7f79680fb420 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.942+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795c0093e0 con 0x7f79680fb420 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.943+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79680fa880 con 0x7f79680fb420 2024-09-16T02:07:16.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.943+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f795c00c6a0 con 0x7f79680fb420 2024-09-16T02:07:16.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.944+0000 7f79657fa640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f795806de30 0x7f79580702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:16.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.944+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f795c08d360 con 0x7f79680fb420 2024-09-16T02:07:16.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.944+0000 7f7967fff640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f795806de30 0x7f79580702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:16.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.945+0000 7f7967fff640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f795806de30 0x7f79580702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f796810bd20 tx=0x7f7954035040 comp rx=0 tx=0).ready entity=mgr.24293 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:16.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:16.949+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f795c056e60 con 0x7f79680fb420 2024-09-16T02:07:17.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:16 smithi165 ceph-mon[34621]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:17.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:16 smithi165 ceph-mon[34621]: pgmap v62: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 408 op/s 2024-09-16T02:07:17.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:16 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:17.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:16 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:17.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:16 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1762350300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:07:17.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:16 smithi110 ceph-mon[27634]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:17.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:16 smithi110 ceph-mon[27634]: pgmap v62: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 408 op/s 2024-09-16T02:07:17.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:16 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:17.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:16 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:17.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:16 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1762350300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:07:17.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.274+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 --> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f796810de90 con 0x7f795806de30 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.275+0000 7f79657fa640 1 -- 172.21.15.110:0/920587830 <== mgr.24293 v2:172.21.15.165:6828/1935931447 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f796810de90 con 0x7f795806de30 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:07:17.277 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:07:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T02:07:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mgr daemons", 2024-09-16T02:07:17.278 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:07:17.278 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:07:17.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f795806de30 msgr2=0x7f79580702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:17.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f795806de30 0x7f79580702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f796810bd20 tx=0x7f7954035040 comp rx=0 tx=0).stop 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 msgr2=0x7f796810bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 0x7f796810bf70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f795c00eb70 tx=0x7f795c00b040 comp rx=0 tx=0).stop 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 shutdown_connections 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:6828/1935931447,v1:172.21.15.165:6829/1935931447] conn(0x7f795806de30 0x7f79580702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79680fc6f0 0x7f796810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 --2- 172.21.15.110:0/920587830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79680fb420 0x7f796810bf70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:17.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.277+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 >> 172.21.15.110:0/920587830 conn(0x7f79680f6c00 msgr2=0x7f79680f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:17.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.278+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 shutdown_connections 2024-09-16T02:07:17.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:17.278+0000 7f796ee40640 1 -- 172.21.15.110:0/920587830 wait complete. 2024-09-16T02:07:17.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:17 smithi110 ceph-mon[27634]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:17 smithi110 ceph-mon[27634]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:17 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:17 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:17 smithi165 ceph-mon[34621]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:17 smithi165 ceph-mon[34621]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:17 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:17 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:18 smithi110 ceph-mon[27634]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:18 smithi110 ceph-mon[27634]: pgmap v63: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 395 op/s 2024-09-16T02:07:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:18 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:19.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:18 smithi165 ceph-mon[34621]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:19.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:18 smithi165 ceph-mon[34621]: pgmap v63: 65 pgs: 65 active+clean; 303 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 395 op/s 2024-09-16T02:07:19.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:18 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:21.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:20 smithi165 ceph-mon[34621]: pgmap v64: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 576 op/s 2024-09-16T02:07:21.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:20 smithi110 ceph-mon[27634]: pgmap v64: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 576 op/s 2024-09-16T02:07:23.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:22 smithi165 ceph-mon[34621]: pgmap v65: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 453 op/s 2024-09-16T02:07:23.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:22 smithi110 ceph-mon[27634]: pgmap v65: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 453 op/s 2024-09-16T02:07:24.535 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-16T02:07:24.535 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-16T02:07:24.832 DEBUG:teuthology.parallel:result is None 2024-09-16T02:07:25.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:24 smithi165 ceph-mon[34621]: pgmap v66: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 562 op/s 2024-09-16T02:07:25.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:24 smithi110 ceph-mon[27634]: pgmap v66: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 562 op/s 2024-09-16T02:07:26.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:26 smithi110 ceph-mon[27634]: pgmap v67: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-09-16T02:07:27.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:26 smithi165 ceph-mon[34621]: pgmap v67: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-09-16T02:07:29.124 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:28 smithi165 ceph-mon[34621]: pgmap v68: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-09-16T02:07:29.131 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:28 smithi110 ceph-mon[27634]: pgmap v68: 65 pgs: 65 active+clean; 289 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:30.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr fail", "who": "smithi165.afwhot"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr fail", "who": "smithi165.afwhot"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: Activating manager daemon smithi110.hfirap 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: osdmap e46: 6 total, 6 up, 6 in 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd='[{"prefix": "mgr fail", "who": "smithi165.afwhot"}]': finished 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: mgrmap e28: smithi110.hfirap(active, starting, since 0.00751255s) 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:07:30.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: Manager daemon smithi110.hfirap is now available 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:30.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:07:30.204 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:29 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T02:07:30.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:30.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:30.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:07:30.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:07:30.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 172.21.15.165:0/62994021' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr fail", "who": "smithi165.afwhot"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "mgr fail", "who": "smithi165.afwhot"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: Activating manager daemon smithi110.hfirap 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: osdmap e46: 6 total, 6 up, 6 in 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.24293 ' entity='mgr.smithi165.afwhot' cmd='[{"prefix": "mgr fail", "who": "smithi165.afwhot"}]': finished 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: mgrmap e28: smithi110.hfirap(active, starting, since 0.00751255s) 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:07:30.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: Manager daemon smithi110.hfirap is now available 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:30.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:30.210 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:07:30.210 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:29 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T02:07:31.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:31 smithi110 ceph-mon[27634]: mgrmap e29: smithi110.hfirap(active, since 1.00982s) 2024-09-16T02:07:31.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:31 smithi110 ceph-mon[27634]: pgmap v3: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:07:31.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:31 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:31.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:31 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:31.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:31 smithi165 ceph-mon[34621]: mgrmap e29: smithi110.hfirap(active, since 1.00982s) 2024-09-16T02:07:31.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:31 smithi165 ceph-mon[34621]: pgmap v3: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:07:31.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:31 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:31.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:31 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:32.398 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:32 smithi165 ceph-mon[34621]: pgmap v4: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:07:32.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:32 smithi110 ceph-mon[27634]: pgmap v4: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:07:33.287 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: [16/Sep/2024:02:07:31] ENGINE Bus STARTING 2024-09-16T02:07:33.287 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: [16/Sep/2024:02:07:31] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T02:07:33.287 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: [16/Sep/2024:02:07:31] ENGINE Error in HTTPServer.serve 2024-09-16T02:07:33.287 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Traceback (most recent call last): 2024-09-16T02:07:33.287 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T02:07:33.287 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._run(expiration_interval) 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s = self.context.wrap_socket( 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: return self.sslsocket_class._create( 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T02:07:33.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self.do_handshake() 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._sslobj.do_handshake() 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: [16/Sep/2024:02:07:31] ENGINE Serving on http://172.21.15.110:8765 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: [16/Sep/2024:02:07:31] ENGINE Bus STARTED 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: mgrmap e30: smithi110.hfirap(active, since 3s) 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:33.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:33 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: [16/Sep/2024:02:07:31] ENGINE Bus STARTING 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: [16/Sep/2024:02:07:31] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: [16/Sep/2024:02:07:31] ENGINE Error in HTTPServer.serve 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Traceback (most recent call last): 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._run(expiration_interval) 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T02:07:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s = self.context.wrap_socket( 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: return self.sslsocket_class._create( 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self.do_handshake() 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._sslobj.do_handshake() 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: [16/Sep/2024:02:07:31] ENGINE Serving on http://172.21.15.110:8765 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: [16/Sep/2024:02:07:31] ENGINE Bus STARTED 2024-09-16T02:07:33.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: mgrmap e30: smithi110.hfirap(active, since 3s) 2024-09-16T02:07:33.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:33.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:33 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:34.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:34 smithi165 ceph-mon[34621]: pgmap v5: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:07:34.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:34 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:34.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:34 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:34.454 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:34 smithi110 ceph-mon[27634]: pgmap v5: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:07:34.455 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:34 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:34.455 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:34 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:35 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:07:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:35 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:07:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:35 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:07:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:35 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:07:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:35 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:07:35.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:35 smithi110 ceph-mon[27634]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:07:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:35 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:07:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:35 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:07:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:35 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:07:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:35 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/314851909' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:07:36.293 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:36 smithi110 ceph-mon[27634]: pgmap v6: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-09-16T02:07:36.293 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:36 smithi110 ceph-mon[27634]: mgrmap e31: smithi110.hfirap(active, since 6s), standbys: smithi165.afwhot 2024-09-16T02:07:36.294 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:36 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T02:07:36.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:36 smithi165 ceph-mon[34621]: pgmap v6: 65 pgs: 65 active+clean; 288 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-09-16T02:07:36.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:36 smithi165 ceph-mon[34621]: mgrmap e31: smithi110.hfirap(active, since 6s), standbys: smithi165.afwhot 2024-09-16T02:07:36.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:36 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T02:07:38.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:38 smithi165 ceph-mon[34621]: pgmap v7: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 977 KiB/s rd, 895 KiB/s wr, 164 op/s 2024-09-16T02:07:38.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:38 smithi110 ceph-mon[27634]: pgmap v7: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 977 KiB/s rd, 895 KiB/s wr, 164 op/s 2024-09-16T02:07:39.094 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-16T02:07:39.094 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T02:07:39.432 DEBUG:teuthology.parallel:result is None 2024-09-16T02:07:39.432 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T02:07:39.469 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T02:07:39.469 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-16T02:07:39.504 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-16T02:07:39.505 DEBUG:teuthology.parallel:result is None 2024-09-16T02:07:40.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:39 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:39 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:39 smithi165 ceph-mon[34621]: pgmap v8: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 760 KiB/s rd, 696 KiB/s wr, 127 op/s 2024-09-16T02:07:40.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:39 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:39 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:39 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:39 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:39 smithi110 ceph-mon[27634]: pgmap v8: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 760 KiB/s rd, 696 KiB/s wr, 127 op/s 2024-09-16T02:07:40.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:39 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:40.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:39 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:41.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:41 smithi165 ceph-mon[34621]: pgmap v9: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 199 op/s 2024-09-16T02:07:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:41 smithi110 ceph-mon[27634]: pgmap v9: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 199 op/s 2024-09-16T02:07:43.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:43 smithi165 ceph-mon[34621]: pgmap v10: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 990 KiB/s wr, 182 op/s 2024-09-16T02:07:43.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:43 smithi110 ceph-mon[27634]: pgmap v10: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 990 KiB/s wr, 182 op/s 2024-09-16T02:07:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:44 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:44.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:44 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:07:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:07:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:07:45.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: pgmap v11: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 187 op/s 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:45 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:07:45.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: pgmap v11: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 187 op/s 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:45.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:45 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:46 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:07:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:46 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:07:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:46 smithi165 ceph-mon[34621]: Reconfiguring prometheus.smithi110 (dependencies changed)... 2024-09-16T02:07:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:46 smithi165 ceph-mon[34621]: Reconfiguring daemon prometheus.smithi110 on smithi110 2024-09-16T02:07:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:46 smithi110 ceph-mon[27634]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:07:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:46 smithi110 ceph-mon[27634]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:07:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:46 smithi110 ceph-mon[27634]: Reconfiguring prometheus.smithi110 (dependencies changed)... 2024-09-16T02:07:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:46 smithi110 ceph-mon[27634]: Reconfiguring daemon prometheus.smithi110 on smithi110 2024-09-16T02:07:47.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.374+0000 7fb521829640 1 -- 172.21.15.110:0/3493498491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fd820 msgr2=0x7fb51c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.374+0000 7fb521829640 1 --2- 172.21.15.110:0/3493498491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fd820 0x7fb51c0fdc90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb5040048d0 tx=0x7fb504009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.374+0000 7fb521829640 1 -- 172.21.15.110:0/3493498491 shutdown_connections 2024-09-16T02:07:47.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.374+0000 7fb521829640 1 --2- 172.21.15.110:0/3493498491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fd820 0x7fb51c0fdc90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.374+0000 7fb521829640 1 --2- 172.21.15.110:0/3493498491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c0fc550 0x7fb51c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.374+0000 7fb521829640 1 -- 172.21.15.110:0/3493498491 >> 172.21.15.110:0/3493498491 conn(0x7fb51c0f7d30 msgr2=0x7fb51c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:47.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 -- 172.21.15.110:0/3493498491 shutdown_connections 2024-09-16T02:07:47.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 -- 172.21.15.110:0/3493498491 wait complete. 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 Processor -- start 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 -- start start 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 0x7fb51c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c0fd820 0x7fb51c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c10e490 con 0x7fb51c0fc550 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.375+0000 7fb521829640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c10e600 con 0x7fb51c0fd820 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 0x7fb51c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 0x7fb51c10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32784/0 (socket says 172.21.15.110:32784) 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 -- 172.21.15.110:0/3415959576 learned_addr learned my addr 172.21.15.110:0/3415959576 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb513fff640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c0fd820 0x7fb51c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 -- 172.21.15.110:0/3415959576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c0fd820 msgr2=0x7fb51c10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c0fd820 0x7fb51c10d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 -- 172.21.15.110:0/3415959576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504005040 con 0x7fb51c0fc550 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb51affd640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 0x7fb51c10d0e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00b790 tx=0x7fb50c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50c00c700 con 0x7fb51c0fc550 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb50c00cd00 con 0x7fb51c0fc550 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c10e880 con 0x7fb51c0fc550 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50c015e70 con 0x7fb51c0fc550 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.376+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c10eda0 con 0x7fb51c0fc550 2024-09-16T02:07:47.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.378+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51c1057e0 con 0x7fb51c0fc550 2024-09-16T02:07:47.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.378+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fb50c012070 con 0x7fb51c0fc550 2024-09-16T02:07:47.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.378+0000 7fb5137fe640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb50806df60 0x7fb508070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.379+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb50c08d340 con 0x7fb51c0fc550 2024-09-16T02:07:47.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.379+0000 7fb513fff640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb50806df60 0x7fb508070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.379+0000 7fb513fff640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb50806df60 0x7fb508070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb51c10ce90 tx=0x7fb50403b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:47.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.383+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb50c056ca0 con 0x7fb51c0fc550 2024-09-16T02:07:47.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.566+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb51c10f020 con 0x7fb50806df60 2024-09-16T02:07:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.567+0000 7fb5137fe640 1 -- 172.21.15.110:0/3415959576 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fb51c10f020 con 0x7fb50806df60 2024-09-16T02:07:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb50806df60 msgr2=0x7fb508070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb50806df60 0x7fb508070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb51c10ce90 tx=0x7fb50403b040 comp rx=0 tx=0).stop 2024-09-16T02:07:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 msgr2=0x7fb51c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 0x7fb51c10d0e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00b790 tx=0x7fb50c0091d0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 shutdown_connections 2024-09-16T02:07:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb50806df60 0x7fb508070410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c0fd820 0x7fb51c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 --2- 172.21.15.110:0/3415959576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb51c0fc550 0x7fb51c10d0e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.569+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 >> 172.21.15.110:0/3415959576 conn(0x7fb51c0f7d30 msgr2=0x7fb51c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:47.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.570+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 shutdown_connections 2024-09-16T02:07:47.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.570+0000 7fb521829640 1 -- 172.21.15.110:0/3415959576 wait complete. 2024-09-16T02:07:47.580 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:07:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.649+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1431316480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fd820 msgr2=0x7f97b40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.649+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1431316480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fd820 0x7f97b40fdc90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f97a40048d0 tx=0x7f97a4009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1431316480 shutdown_connections 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1431316480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fd820 0x7f97b40fdc90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1431316480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b40fc550 0x7f97b40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1431316480 >> 172.21.15.110:0/1431316480 conn(0x7f97b40f7d30 msgr2=0x7f97b40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1431316480 shutdown_connections 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1431316480 wait complete. 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 Processor -- start 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- start start 2024-09-16T02:07:47.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 0x7f97b4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b40fd820 0x7f97b406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b406fff0 con 0x7f97b40fc550 2024-09-16T02:07:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97bc6a2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4070130 con 0x7f97b40fd820 2024-09-16T02:07:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.650+0000 7f97ba43e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 0x7f97b4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97ba43e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 0x7f97b4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32796/0 (socket says 172.21.15.110:32796) 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97ba43e640 1 -- 172.21.15.110:0/1025225051 learned_addr learned my addr 172.21.15.110:0/1025225051 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97b9c3d640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b40fd820 0x7f97b406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97ba43e640 1 -- 172.21.15.110:0/1025225051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b40fd820 msgr2=0x7f97b406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97ba43e640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b40fd820 0x7f97b406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97ba43e640 1 -- 172.21.15.110:0/1025225051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4005040 con 0x7f97b40fc550 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97ba43e640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 0x7f97b4071570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f97b0002a50 tx=0x7f97b0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b0007c30 con 0x7f97b40fc550 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b4070410 con 0x7f97b40fc550 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f97b000f040 con 0x7f97b40fc550 2024-09-16T02:07:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b000dad0 con 0x7f97b40fc550 2024-09-16T02:07:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.651+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41150b0 con 0x7f97b40fc550 2024-09-16T02:07:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.652+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b404b720 con 0x7f97b40fc550 2024-09-16T02:07:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.653+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f97b000dc30 con 0x7f97b40fc550 2024-09-16T02:07:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.653+0000 7f97aaffd640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f97a006df60 0x7f97a0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.654+0000 7f97b9c3d640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f97a006df60 0x7f97a0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.654+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f97b008d8a0 con 0x7f97b40fc550 2024-09-16T02:07:47.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.654+0000 7f97b9c3d640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f97a006df60 0x7f97a0070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f97a400b020 tx=0x7f97a4035040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.658+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f97b0057070 con 0x7f97b40fc550 2024-09-16T02:07:47.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:47 smithi165 ceph-mon[34621]: pgmap v12: 65 pgs: 65 active+clean; 260 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 559 KiB/s rd, 512 KiB/s wr, 136 op/s 2024-09-16T02:07:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.843+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97b4101c30 con 0x7f97a006df60 2024-09-16T02:07:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.844+0000 7f97aaffd640 1 -- 172.21.15.110:0/1025225051 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f97b4101c30 con 0x7f97a006df60 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f97a006df60 msgr2=0x7f97a0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f97a006df60 0x7f97a0070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f97a400b020 tx=0x7f97a4035040 comp rx=0 tx=0).stop 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 msgr2=0x7f97b4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 0x7f97b4071570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f97b0002a50 tx=0x7f97b0004600 comp rx=0 tx=0).stop 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 shutdown_connections 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f97a006df60 0x7f97a0070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b40fd820 0x7f97b406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 --2- 172.21.15.110:0/1025225051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97b40fc550 0x7f97b4071570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 >> 172.21.15.110:0/1025225051 conn(0x7f97b40f7d30 msgr2=0x7f97b40f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:47.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.846+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 shutdown_connections 2024-09-16T02:07:47.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.847+0000 7f97bc6a2640 1 -- 172.21.15.110:0/1025225051 wait complete. 2024-09-16T02:07:47.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 -- 172.21.15.110:0/2368506544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000fe740 msgr2=0x7f7c000feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 --2- 172.21.15.110:0/2368506544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000fe740 0x7f7c000feb50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00048d0 tx=0x7f7bf0009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.929 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:47 smithi110 ceph-mon[27634]: pgmap v12: 65 pgs: 65 active+clean; 260 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 559 KiB/s rd, 512 KiB/s wr, 136 op/s 2024-09-16T02:07:47.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 -- 172.21.15.110:0/2368506544 shutdown_connections 2024-09-16T02:07:47.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 --2- 172.21.15.110:0/2368506544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c000ffa10 0x7f7c000ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 --2- 172.21.15.110:0/2368506544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000fe740 0x7f7c000feb50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 -- 172.21.15.110:0/2368506544 >> 172.21.15.110:0/2368506544 conn(0x7f7c000fa060 msgr2=0x7f7c000fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 -- 172.21.15.110:0/2368506544 shutdown_connections 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.927+0000 7f7c066ee640 1 -- 172.21.15.110:0/2368506544 wait complete. 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7c066ee640 1 Processor -- start 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7c066ee640 1 -- start start 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7c066ee640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c000fe740 0x7f7c0010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7c066ee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 0x7f7c0010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7c066ee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0010fdf0 con 0x7f7c000ffa10 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7c066ee640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00110610 con 0x7f7c000fe740 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 0x7f7c0010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 0x7f7c0010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32818/0 (socket says 172.21.15.110:32818) 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bff7fe640 1 -- 172.21.15.110:0/1549817759 learned_addr learned my addr 172.21.15.110:0/1549817759 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bfffff640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c000fe740 0x7f7c0010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bff7fe640 1 -- 172.21.15.110:0/1549817759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c000fe740 msgr2=0x7f7c0010f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bff7fe640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c000fe740 0x7f7c0010f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.928+0000 7f7bff7fe640 1 -- 172.21.15.110:0/1549817759 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0005040 con 0x7f7c000ffa10 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.929+0000 7f7bff7fe640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 0x7f7c0010f7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400eb70 tx=0x7f7bf400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.929+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf4007c30 con 0x7f7c000ffa10 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.929+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c00110840 con 0x7f7c000ffa10 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.929+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bf400f040 con 0x7f7c000ffa10 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.929+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf400ca60 con 0x7f7c000ffa10 2024-09-16T02:07:47.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.929+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c00110de0 con 0x7f7c000ffa10 2024-09-16T02:07:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.930+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c000fdba0 con 0x7f7c000ffa10 2024-09-16T02:07:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.931+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f7bf400cbc0 con 0x7f7c000ffa10 2024-09-16T02:07:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.931+0000 7f7bfcff9640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f7be806df60 0x7f7be8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.931+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f7bf408d5f0 con 0x7f7c000ffa10 2024-09-16T02:07:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.931+0000 7f7bfffff640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f7be806df60 0x7f7be8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.932+0000 7f7bfffff640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f7be806df60 0x7f7be8070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0004540 tx=0x7f7bf0035040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:47.935+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7bf4056e70 con 0x7f7c000ffa10 2024-09-16T02:07:48.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.113+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c00111140 con 0x7f7be806df60 2024-09-16T02:07:48.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.122+0000 7f7bfcff9640 1 -- 172.21.15.110:0/1549817759 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7c00111140 con 0x7f7be806df60 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (78s) 9s ago 9m 15.5M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (9m) 9s ago 9m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (9m) 15s ago 9m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (73s) 9s ago 9m 77.9M - 9.4.7 954c08fa6188 0e985c4cf35f 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (4m) 9s ago 4m 172M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (4m) 9s ago 4m 193M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (4m) 15s ago 4m 15.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:07:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (4m) 15s ago 4m 12.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (56s) 9s ago 10m 472M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283 running (2m) 15s ago 8m 99.3M - 19.1.1-326-g8921c8ef f1455bd0219c 059ca54552a6 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (10m) 9s ago 11m 51.0M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (8m) 15s ago 8m 42.0M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (118s) 9s ago 9m 10.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (64s) 15s ago 9m 8925k - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (8m) 9s ago 8m 205M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (7m) 9s ago 7m 211M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (7m) 9s ago 7m 177M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (6m) 15s ago 6m 239M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (6m) 15s ago 6m 205M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (6m) 15s ago 6m 189M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:07:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (67s) 9s ago 9m 47.0M - 2.43.0 a07b618ecd1d fc289a7f653e 2024-09-16T02:07:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f7be806df60 msgr2=0x7f7be8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f7be806df60 0x7f7be8070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0004540 tx=0x7f7bf0035040 comp rx=0 tx=0).stop 2024-09-16T02:07:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 msgr2=0x7f7c0010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 0x7f7c0010f7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400eb70 tx=0x7f7bf400b040 comp rx=0 tx=0).stop 2024-09-16T02:07:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 shutdown_connections 2024-09-16T02:07:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f7be806df60 0x7f7be8070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c000ffa10 0x7f7c0010f7a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 --2- 172.21.15.110:0/1549817759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c000fe740 0x7f7c0010f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.124+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 >> 172.21.15.110:0/1549817759 conn(0x7f7c000fa060 msgr2=0x7f7c000fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.125+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 shutdown_connections 2024-09-16T02:07:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.125+0000 7f7c066ee640 1 -- 172.21.15.110:0/1549817759 wait complete. 2024-09-16T02:07:48.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1304042946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fa970 msgr2=0x7fa5d80fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1304042946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fa970 0x7fa5d80fad80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80048d0 tx=0x7fa5c8009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1304042946 shutdown_connections 2024-09-16T02:07:48.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1304042946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d80fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1304042946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fa970 0x7fa5d80fad80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1304042946 >> 172.21.15.110:0/1304042946 conn(0x7fa5d80f63b0 msgr2=0x7fa5d80f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:48.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1304042946 shutdown_connections 2024-09-16T02:07:48.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.205+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1304042946 wait complete. 2024-09-16T02:07:48.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5dd4fd640 1 Processor -- start 2024-09-16T02:07:48.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5dd4fd640 1 -- start start 2024-09-16T02:07:48.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5dd4fd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fa970 0x7fa5d810d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:48.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5dd4fd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d810d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5dd4fd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d810e6f0 con 0x7fa5d80fb2c0 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5dd4fd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d810e860 con 0x7fa5d80fa970 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5d67fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d810d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5d6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fa970 0x7fa5d810d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5d67fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d810d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32832/0 (socket says 172.21.15.110:32832) 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.206+0000 7fa5d67fc640 1 -- 172.21.15.110:0/1792844727 learned_addr learned my addr 172.21.15.110:0/1792844727 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5d6ffd640 1 -- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 msgr2=0x7fa5d810d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5d6ffd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d810d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5d6ffd640 1 -- 172.21.15.110:0/1792844727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c8005040 con 0x7fa5d80fa970 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5d67fc640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5d6ffd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fa970 0x7fa5d810d340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8003080 tx=0x7fa5c8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5c8038070 con 0x7fa5d80fa970 2024-09-16T02:07:48.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d810eae0 con 0x7fa5d80fa970 2024-09-16T02:07:48.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5c802abd0 con 0x7fa5d80fa970 2024-09-16T02:07:48.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5c803e670 con 0x7fa5d80fa970 2024-09-16T02:07:48.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.207+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d810f000 con 0x7fa5d80fa970 2024-09-16T02:07:48.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.208+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d8105a50 con 0x7fa5d80fa970 2024-09-16T02:07:48.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.209+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fa5c8030020 con 0x7fa5d80fa970 2024-09-16T02:07:48.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.209+0000 7fa5bf7fe640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fa5c006df60 0x7fa5c0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:48.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.209+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa5c80ada90 con 0x7fa5d80fa970 2024-09-16T02:07:48.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.209+0000 7fa5d67fc640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fa5c006df60 0x7fa5c0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:48.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.209+0000 7fa5d67fc640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fa5c006df60 0x7fa5c0070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa5d810d0f0 tx=0x7fa5cc0091a0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:48.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.213+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa5c80774a0 con 0x7fa5d80fa970 2024-09-16T02:07:48.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.445+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5d804b720 con 0x7fa5d80fa970 2024-09-16T02:07:48.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.446+0000 7fa5bf7fe640 1 -- 172.21.15.110:0/1792844727 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fa5c807ab60 con 0x7fa5d80fa970 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:07:48.448 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:07:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:07:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:07:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 12, 2024-09-16T02:07:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:07:48.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:07:48.449 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fa5c006df60 msgr2=0x7fa5c0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fa5c006df60 0x7fa5c0070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa5d810d0f0 tx=0x7fa5cc0091a0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fa970 msgr2=0x7fa5d810d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fa970 0x7fa5d810d340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8003080 tx=0x7fa5c8009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 shutdown_connections 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fa5c006df60 0x7fa5c0070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5d80fb2c0 0x7fa5d810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 --2- 172.21.15.110:0/1792844727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5d80fa970 0x7fa5d810d340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 >> 172.21.15.110:0/1792844727 conn(0x7fa5d80f63b0 msgr2=0x7fa5d80f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:48.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 shutdown_connections 2024-09-16T02:07:48.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.449+0000 7fa5dd4fd640 1 -- 172.21.15.110:0/1792844727 wait complete. 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 -- 172.21.15.110:0/3052177985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fb450 msgr2=0x7f2b200fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 --2- 172.21.15.110:0/3052177985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fb450 0x7f2b200fb860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2b100048d0 tx=0x7f2b10009da0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 -- 172.21.15.110:0/3052177985 shutdown_connections 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 --2- 172.21.15.110:0/3052177985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b200fc720 0x7f2b200fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 --2- 172.21.15.110:0/3052177985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fb450 0x7f2b200fb860 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 -- 172.21.15.110:0/3052177985 >> 172.21.15.110:0/3052177985 conn(0x7f2b200f6c10 msgr2=0x7f2b200f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 -- 172.21.15.110:0/3052177985 shutdown_connections 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 -- 172.21.15.110:0/3052177985 wait complete. 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 Processor -- start 2024-09-16T02:07:48.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.528+0000 7f2b2766d640 1 -- start start 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b2766d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b200fb450 0x7f2b201121f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b2766d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 0x7f2b20114740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b2766d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2010dca0 con 0x7f2b200fc720 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b2766d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b200666c0 con 0x7f2b200fb450 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 0x7f2b20114740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 0x7f2b20114740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32854/0 (socket says 172.21.15.110:32854) 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 -- 172.21.15.110:0/640490553 learned_addr learned my addr 172.21.15.110:0/640490553 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b25409640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b200fb450 0x7f2b201121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 -- 172.21.15.110:0/640490553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b200fb450 msgr2=0x7f2b201121f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b200fb450 0x7f2b201121f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 -- 172.21.15.110:0/640490553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10005040 con 0x7f2b200fc720 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b24c08640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 0x7f2b20114740 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c810 tx=0x7f2b1c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1c00a7a0 con 0x7f2b200fc720 2024-09-16T02:07:48.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b1c00ada0 con 0x7f2b200fc720 2024-09-16T02:07:48.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b200669a0 con 0x7f2b200fc720 2024-09-16T02:07:48.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.529+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b1c011380 con 0x7f2b200fc720 2024-09-16T02:07:48.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.530+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b20115060 con 0x7f2b200fc720 2024-09-16T02:07:48.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.531+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b200fa8b0 con 0x7f2b200fc720 2024-09-16T02:07:48.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.531+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f2b1c0127d0 con 0x7f2b200fc720 2024-09-16T02:07:48.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.532+0000 7f2b15ffb640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f2b0c06df60 0x7f2b0c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:07:48.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.532+0000 7f2b25409640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f2b0c06df60 0x7f2b0c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:07:48.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.532+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f2b1c08de20 con 0x7f2b200fc720 2024-09-16T02:07:48.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.532+0000 7f2b25409640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f2b0c06df60 0x7f2b0c070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000c00 tx=0x7f2b10035040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:07:48.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.536+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2b1c05b230 con 0x7f2b200fc720 2024-09-16T02:07:48.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.723+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b20100bd0 con 0x7f2b0c06df60 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.725+0000 7f2b15ffb640 1 -- 172.21.15.110:0/640490553 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f2b20100bd0 con 0x7f2b0c06df60 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:07:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:07:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:07:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T02:07:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "", 2024-09-16T02:07:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:07:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:07:48.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f2b0c06df60 msgr2=0x7f2b0c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f2b0c06df60 0x7f2b0c070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000c00 tx=0x7f2b10035040 comp rx=0 tx=0).stop 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 msgr2=0x7f2b20114740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 0x7f2b20114740 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c810 tx=0x7f2b1c0043c0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 shutdown_connections 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f2b0c06df60 0x7f2b0c070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b200fc720 0x7f2b20114740 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 --2- 172.21.15.110:0/640490553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b200fb450 0x7f2b201121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 >> 172.21.15.110:0/640490553 conn(0x7f2b200f6c10 msgr2=0x7f2b200f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 shutdown_connections 2024-09-16T02:07:48.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:07:48.727+0000 7f2b2766d640 1 -- 172.21.15.110:0/640490553 wait complete. 2024-09-16T02:07:48.874 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:48 smithi110 ceph-mon[27634]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:48.875 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:48 smithi110 ceph-mon[27634]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:48.875 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:48 smithi110 ceph-mon[27634]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:48.875 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:48 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1792844727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:07:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:48 smithi165 ceph-mon[34621]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:48 smithi165 ceph-mon[34621]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:48 smithi165 ceph-mon[34621]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:48 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1792844727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:07:49.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:49 smithi110 ceph-mon[27634]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:49.880 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:49 smithi110 ceph-mon[27634]: pgmap v13: 65 pgs: 65 active+clean; 260 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 530 KiB/s rd, 500 KiB/s wr, 100 op/s 2024-09-16T02:07:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:49 smithi165 ceph-mon[34621]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:07:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:49 smithi165 ceph-mon[34621]: pgmap v13: 65 pgs: 65 active+clean; 260 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 530 KiB/s rd, 500 KiB/s wr, 100 op/s 2024-09-16T02:07:51.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:51 smithi165 ceph-mon[34621]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 531 KiB/s rd, 500 KiB/s wr, 102 op/s 2024-09-16T02:07:51.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:51 smithi110 ceph-mon[27634]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 531 KiB/s rd, 500 KiB/s wr, 102 op/s 2024-09-16T02:07:52.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:52 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:52.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:52 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:52.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:52 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:07:52.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:52 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:07:52.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:52 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:52 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:52 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:52 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:07:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:52 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T02:07:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:52 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:53.788 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:53 smithi165 ceph-mon[34621]: Upgrade: Updating mgr.smithi165.afwhot 2024-09-16T02:07:53.789 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:53 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:07:53.789 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:53 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:07:53.789 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:53 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:07:53.789 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:53 smithi165 ceph-mon[34621]: Deploying daemon mgr.smithi165.afwhot on smithi165 2024-09-16T02:07:53.789 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:53 smithi165 ceph-mon[34621]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-16T02:07:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:53 smithi110 ceph-mon[27634]: Upgrade: Updating mgr.smithi165.afwhot 2024-09-16T02:07:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:53 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:07:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:53 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:07:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:53 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:07:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:53 smithi110 ceph-mon[27634]: Deploying daemon mgr.smithi165.afwhot on smithi165 2024-09-16T02:07:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:53 smithi110 ceph-mon[27634]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-16T02:07:55.396 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:55 smithi165 ceph-mon[34621]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-16T02:07:55.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:55 smithi110 ceph-mon[27634]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-16T02:07:57.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:57 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:57.661 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:57 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:57.661 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:57 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:57.661 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:57 smithi165 ceph-mon[34621]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-16T02:07:57.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:57 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:57.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:57 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:07:57.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:57 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:07:57.946 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:57 smithi110 ceph-mon[27634]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-16T02:07:59.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:07:59 smithi165 ceph-mon[34621]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-16T02:07:59.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:07:59 smithi110 ceph-mon[27634]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-16T02:08:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:00 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:00 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:00 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:00.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:00 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:00.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:00 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:00.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:00 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:01.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:01 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:01.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:01 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:01.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:01 smithi110 ceph-mon[27634]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-16T02:08:01.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:01 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:01.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:01 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:01.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:01 smithi165 ceph-mon[34621]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-16T02:08:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot restarted 2024-09-16T02:08:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:08:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:08:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:08:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:08:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:02 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:08:02.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: Standby manager daemon smithi165.afwhot restarted 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:08:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:02 smithi110 ceph-mon[27634]: from='mgr.? 172.21.15.165:0/3756299752' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:08:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: mgrmap e32: smithi110.hfirap(active, since 33s), standbys: smithi165.afwhot 2024-09-16T02:08:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.hfirap"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.hfirap"}]': finished 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.afwhot"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.afwhot"}]': finished 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:03 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:03.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: mgrmap e32: smithi110.hfirap(active, since 33s), standbys: smithi165.afwhot 2024-09-16T02:08:03.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:03.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:03.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.hfirap"}]: dispatch 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi110.hfirap"}]': finished 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.afwhot"}]: dispatch 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.afwhot"}]': finished 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:03.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:03 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all mgr 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all rgw 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all iscsi 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all nfs 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all nvmeof 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all node-exporter 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all prometheus 2024-09-16T02:08:04.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:04 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all alertmanager 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all mgr 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all rgw 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all iscsi 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all nfs 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all nvmeof 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all node-exporter 2024-09-16T02:08:04.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all prometheus 2024-09-16T02:08:04.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:04.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:04 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all alertmanager 2024-09-16T02:08:05.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:05 smithi165 ceph-mon[34621]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:06.218 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:05 smithi110 ceph-mon[27634]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:06 smithi165 ceph-mon[34621]: Upgrade: Updating grafana.smithi110 2024-09-16T02:08:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:06 smithi165 ceph-mon[34621]: Deploying daemon grafana.smithi110 on smithi110 2024-09-16T02:08:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:06 smithi110 ceph-mon[27634]: Upgrade: Updating grafana.smithi110 2024-09-16T02:08:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:06 smithi110 ceph-mon[27634]: Deploying daemon grafana.smithi110 on smithi110 2024-09-16T02:08:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:07 smithi165 ceph-mon[34621]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:07.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:07 smithi110 ceph-mon[27634]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:09.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:09 smithi165 ceph-mon[34621]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:09.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:09 smithi110 ceph-mon[27634]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:11 smithi110 ceph-mon[27634]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:11.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:11 smithi165 ceph-mon[34621]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:13 smithi110 ceph-mon[27634]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:13.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:13 smithi165 ceph-mon[34621]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:14.451 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:14 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:14 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:15.599 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:15 smithi110 ceph-mon[27634]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:15.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:15 smithi165 ceph-mon[34621]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:17 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:17 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:18.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:17 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:18.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:17 smithi165 ceph-mon[34621]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:17 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:17 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:17 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:17 smithi110 ceph-mon[27634]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 -- 172.21.15.110:0/1096601403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 msgr2=0x7fb6380ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/1096601403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb6380ff1c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6280048d0 tx=0x7fb628009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 -- 172.21.15.110:0/1096601403 shutdown_connections 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/1096601403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6380ff700 0x7fb638101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/1096601403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb6380ff1c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 -- 172.21.15.110:0/1096601403 >> 172.21.15.110:0/1096601403 conn(0x7fb6380f6c10 msgr2=0x7fb6380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 -- 172.21.15.110:0/1096601403 shutdown_connections 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 -- 172.21.15.110:0/1096601403 wait complete. 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.808+0000 7fb63dc0c640 1 Processor -- start 2024-09-16T02:08:18.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb63dc0c640 1 -- start start 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb63dc0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb63810f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb63dc0c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6380ff700 0x7fb63810f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb63dc0c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63810fec0 con 0x7fb638065bc0 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb63dc0c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638110690 con 0x7fb6380ff700 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb6377fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb63810f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb6377fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb63810f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40510/0 (socket says 172.21.15.110:40510) 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb6377fe640 1 -- 172.21.15.110:0/2408793613 learned_addr learned my addr 172.21.15.110:0/2408793613 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb6377fe640 1 -- 172.21.15.110:0/2408793613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6380ff700 msgr2=0x7fb63810f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:18.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb636ffd640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6380ff700 0x7fb63810f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb6377fe640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6380ff700 0x7fb63810f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.809+0000 7fb6377fe640 1 -- 172.21.15.110:0/2408793613 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628005040 con 0x7fb638065bc0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.810+0000 7fb6377fe640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb63810f330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6280048a0 tx=0x7fb628009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.810+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb628038070 con 0x7fb638065bc0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.810+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6381108c0 con 0x7fb638065bc0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.810+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb62802abd0 con 0x7fb638065bc0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.810+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb628033640 con 0x7fb638065bc0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.810+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb638110e60 con 0x7fb638065bc0 2024-09-16T02:08:18.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.811+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6380fa890 con 0x7fb638065bc0 2024-09-16T02:08:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.811+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fb628030020 con 0x7fb638065bc0 2024-09-16T02:08:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.812+0000 7fb61ffff640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb62006df60 0x7fb620070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.812+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb6280adc80 con 0x7fb638065bc0 2024-09-16T02:08:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.812+0000 7fb636ffd640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb62006df60 0x7fb620070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:18.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.812+0000 7fb636ffd640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb62006df60 0x7fb620070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb63810f0e0 tx=0x7fb62c009040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:18.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:18.816+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb628077560 con 0x7fb638065bc0 2024-09-16T02:08:19.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.014+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb638104fe0 con 0x7fb62006df60 2024-09-16T02:08:19.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.016+0000 7fb61ffff640 1 -- 172.21.15.110:0/2408793613 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fb638104fe0 con 0x7fb62006df60 2024-09-16T02:08:19.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb62006df60 msgr2=0x7fb620070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb62006df60 0x7fb620070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb63810f0e0 tx=0x7fb62c009040 comp rx=0 tx=0).stop 2024-09-16T02:08:19.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 msgr2=0x7fb63810f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb63810f330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6280048a0 tx=0x7fb628009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 shutdown_connections 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb62006df60 0x7fb620070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6380ff700 0x7fb63810f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 --2- 172.21.15.110:0/2408793613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb638065bc0 0x7fb63810f330 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6280048a0 tx=0x7fb628009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.018+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 >> 172.21.15.110:0/2408793613 conn(0x7fb6380f6c10 msgr2=0x7fb6380fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.019+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 shutdown_connections 2024-09-16T02:08:19.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.019+0000 7fb63dc0c640 1 -- 172.21.15.110:0/2408793613 wait complete. 2024-09-16T02:08:19.029 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:08:19.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 -- 172.21.15.110:0/3747714833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fb430 msgr2=0x7f57b80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 --2- 172.21.15.110:0/3747714833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fb430 0x7f57b80fb840 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009c50 tx=0x7f57b0004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 -- 172.21.15.110:0/3747714833 shutdown_connections 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 --2- 172.21.15.110:0/3747714833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57b80fc700 0x7f57b80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 --2- 172.21.15.110:0/3747714833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fb430 0x7f57b80fb840 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 -- 172.21.15.110:0/3747714833 >> 172.21.15.110:0/3747714833 conn(0x7f57b80f6c10 msgr2=0x7f57b80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 -- 172.21.15.110:0/3747714833 shutdown_connections 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.101+0000 7f57bcddc640 1 -- 172.21.15.110:0/3747714833 wait complete. 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57bcddc640 1 Processor -- start 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57bcddc640 1 -- start start 2024-09-16T02:08:19.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57bcddc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57b80fb430 0x7f57b810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57bcddc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 0x7f57b8112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57bcddc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8065cf0 con 0x7f57b80fc700 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57bcddc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8065e60 con 0x7f57b80fb430 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57b5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 0x7f57b8112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57b5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 0x7f57b8112370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40534/0 (socket says 172.21.15.110:40534) 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.102+0000 7f57b5d9b640 1 -- 172.21.15.110:0/1325543260 learned_addr learned my addr 172.21.15.110:0/1325543260 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57b659c640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57b80fb430 0x7f57b810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57b5d9b640 1 -- 172.21.15.110:0/1325543260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57b80fb430 msgr2=0x7f57b810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57b5d9b640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57b80fb430 0x7f57b810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57b5d9b640 1 -- 172.21.15.110:0/1325543260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00098b0 con 0x7f57b80fc700 2024-09-16T02:08:19.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57b5d9b640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 0x7f57b8112370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f57a000b790 tx=0x7f57a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:19.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a000c700 con 0x7f57b80fc700 2024-09-16T02:08:19.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f57a000cd00 con 0x7f57b80fc700 2024-09-16T02:08:19.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8112970 con 0x7f57b80fc700 2024-09-16T02:08:19.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a0015e70 con 0x7f57b80fc700 2024-09-16T02:08:19.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.103+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8112e60 con 0x7f57b80fc700 2024-09-16T02:08:19.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.104+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b80fa890 con 0x7f57b80fc700 2024-09-16T02:08:19.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.105+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f57a0012070 con 0x7f57b80fc700 2024-09-16T02:08:19.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.105+0000 7f57aeffd640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f57a406df60 0x7f57a4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.106+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f57a008d430 con 0x7f57b80fc700 2024-09-16T02:08:19.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.106+0000 7f57b659c640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f57a406df60 0x7f57a4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.106+0000 7f57b659c640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f57a406df60 0x7f57a4070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f57b0000f80 tx=0x7f57b0004d10 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:19.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.113+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f57a0056d10 con 0x7f57b80fc700 2024-09-16T02:08:19.288 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:19 smithi110 ceph-mon[27634]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:19.288 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:19 smithi110 ceph-mon[27634]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:19.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.314+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b8100b20 con 0x7f57a406df60 2024-09-16T02:08:19.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.315+0000 7f57aeffd640 1 -- 172.21.15.110:0/1325543260 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f57b8100b20 con 0x7f57a406df60 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f57a406df60 msgr2=0x7f57a4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f57a406df60 0x7f57a4070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f57b0000f80 tx=0x7f57b0004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 msgr2=0x7f57b8112370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 0x7f57b8112370 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f57a000b790 tx=0x7f57a00091d0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 shutdown_connections 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f57a406df60 0x7f57a4070410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b80fc700 0x7f57b8112370 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 --2- 172.21.15.110:0/1325543260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57b80fb430 0x7f57b810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.317+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 >> 172.21.15.110:0/1325543260 conn(0x7f57b80f6c10 msgr2=0x7f57b80f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.318+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 shutdown_connections 2024-09-16T02:08:19.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.318+0000 7f57bcddc640 1 -- 172.21.15.110:0/1325543260 wait complete. 2024-09-16T02:08:19.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 -- 172.21.15.110:0/3059059547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 msgr2=0x7f0e5c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 --2- 172.21.15.110:0/3059059547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c0fcb90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009c50 tx=0x7f0e4c004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 -- 172.21.15.110:0/3059059547 shutdown_connections 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 --2- 172.21.15.110:0/3059059547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c0fcb90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 --2- 172.21.15.110:0/3059059547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e5c0fb450 0x7f0e5c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 -- 172.21.15.110:0/3059059547 >> 172.21.15.110:0/3059059547 conn(0x7f0e5c0f6c10 msgr2=0x7f0e5c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 -- 172.21.15.110:0/3059059547 shutdown_connections 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 -- 172.21.15.110:0/3059059547 wait complete. 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 Processor -- start 2024-09-16T02:08:19.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.396+0000 7f0e63117640 1 -- start start 2024-09-16T02:08:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e63117640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e5c0fb450 0x7f0e5c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e63117640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c1122a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e63117640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0667b0 con 0x7f0e5c0fc720 2024-09-16T02:08:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e63117640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c066920 con 0x7f0e5c0fb450 2024-09-16T02:08:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c1122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c1122a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40552/0 (socket says 172.21.15.110:40552) 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 -- 172.21.15.110:0/2246810951 learned_addr learned my addr 172.21.15.110:0/2246810951 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e60eb3640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e5c0fb450 0x7f0e5c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 -- 172.21.15.110:0/2246810951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e5c0fb450 msgr2=0x7f0e5c10fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e5c0fb450 0x7f0e5c10fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 -- 172.21.15.110:0/2246810951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0098b0 con 0x7f0e5c0fc720 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e5bfff640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c1122a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c004a30 tx=0x7f0e4c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c032850 con 0x7f0e5c0fc720 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.397+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e4c009710 con 0x7f0e5c0fc720 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.398+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c112840 con 0x7f0e5c0fc720 2024-09-16T02:08:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.398+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c03dc20 con 0x7f0e5c0fc720 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.398+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c112db0 con 0x7f0e5c0fc720 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.399+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c0fa8b0 con 0x7f0e5c0fc720 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.399+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f0e4c02f030 con 0x7f0e5c0fc720 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.399+0000 7f0e597fa640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f0e4806df60 0x7f0e48070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.400+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0e4c0af060 con 0x7f0e5c0fc720 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.400+0000 7f0e60eb3640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f0e4806df60 0x7f0e48070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.400+0000 7f0e60eb3640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f0e4806df60 0x7f0e48070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e540041d0 tx=0x7f0e54004330 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:19.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.404+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0e4c078830 con 0x7f0e5c0fc720 2024-09-16T02:08:19.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.583+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e5c100ac0 con 0x7f0e4806df60 2024-09-16T02:08:19.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.592+0000 7f0e597fa640 1 -- 172.21.15.110:0/2246810951 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0e5c100ac0 con 0x7f0e4806df60 2024-09-16T02:08:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:08:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (110s) 18s ago 10m 15.5M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:08:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (10m) 18s ago 10m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:08:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (9m) 19s ago 9m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:08:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 starting - - - - 2024-09-16T02:08:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (5m) 18s ago 5m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:08:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (5m) 18s ago 5m 155M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:08:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (4m) 19s ago 4m 15.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:08:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (5m) 19s ago 5m 12.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:08:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (87s) 18s ago 11m 489M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:08:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (23s) 19s ago 9m 64.1M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (11m) 18s ago 11m 52.2M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (9m) 19s ago 9m 42.7M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (2m) 18s ago 10m 10.1M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (96s) 19s ago 9m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (8m) 18s ago 8m 210M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (8m) 18s ago 8m 217M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:08:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (7m) 18s ago 7m 182M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:08:19.598 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (7m) 19s ago 7m 240M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:08:19.598 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (6m) 19s ago 6m 208M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:08:19.598 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (6m) 19s ago 6m 193M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:08:19.598 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (28s) 18s ago 9m 43.1M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f0e4806df60 msgr2=0x7f0e48070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f0e4806df60 0x7f0e48070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e540041d0 tx=0x7f0e54004330 comp rx=0 tx=0).stop 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 msgr2=0x7f0e5c1122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c1122a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c004a30 tx=0x7f0e4c004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 shutdown_connections 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f0e4806df60 0x7f0e48070410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e5c0fc720 0x7f0e5c1122a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 --2- 172.21.15.110:0/2246810951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e5c0fb450 0x7f0e5c10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 >> 172.21.15.110:0/2246810951 conn(0x7f0e5c0f6c10 msgr2=0x7f0e5c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 shutdown_connections 2024-09-16T02:08:19.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.594+0000 7f0e63117640 1 -- 172.21.15.110:0/2246810951 wait complete. 2024-09-16T02:08:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.672+0000 7efcf74e2640 1 -- 172.21.15.110:0/3002495620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fb3d0 msgr2=0x7efcf00fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.672+0000 7efcf74e2640 1 --2- 172.21.15.110:0/3002495620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fb3d0 0x7efcf00fb7e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efce80048d0 tx=0x7efce8009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- 172.21.15.110:0/3002495620 shutdown_connections 2024-09-16T02:08:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 --2- 172.21.15.110:0/3002495620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf00fc6a0 0x7efcf00fcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 --2- 172.21.15.110:0/3002495620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fb3d0 0x7efcf00fb7e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- 172.21.15.110:0/3002495620 >> 172.21.15.110:0/3002495620 conn(0x7efcf00f6b90 msgr2=0x7efcf00f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- 172.21.15.110:0/3002495620 shutdown_connections 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- 172.21.15.110:0/3002495620 wait complete. 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 Processor -- start 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- start start 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf00fb3d0 0x7efcf010fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 0x7efcf0112280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00665e0 con 0x7efcf00fc6a0 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf74e2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0066750 con 0x7efcf00fb3d0 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf4a7d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 0x7efcf0112280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf4a7d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 0x7efcf0112280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40566/0 (socket says 172.21.15.110:40566) 2024-09-16T02:08:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.673+0000 7efcf4a7d640 1 -- 172.21.15.110:0/1778256929 learned_addr learned my addr 172.21.15.110:0/1778256929 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf527e640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf00fb3d0 0x7efcf010fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf4a7d640 1 -- 172.21.15.110:0/1778256929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf00fb3d0 msgr2=0x7efcf010fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf4a7d640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf00fb3d0 0x7efcf010fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf4a7d640 1 -- 172.21.15.110:0/1778256929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8005040 con 0x7efcf00fc6a0 2024-09-16T02:08:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf4a7d640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 0x7efcf0112280 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efce400cae0 tx=0x7efce4007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce400ab00 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efce400ac60 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf01127c0 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce40115e0 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.674+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf0112d60 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.675+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf005ed70 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.676+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7efce40129e0 con 0x7efcf00fc6a0 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.676+0000 7efcedffb640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7efcd806df60 0x7efcd8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.676+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7efce408e120 con 0x7efcf00fc6a0 2024-09-16T02:08:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.676+0000 7efcf527e640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7efcd806df60 0x7efcd8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.677+0000 7efcf527e640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7efcd806df60 0x7efcd8070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efce8007ac0 tx=0x7efce8035040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.680+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7efce4057a80 con 0x7efcf00fc6a0 2024-09-16T02:08:19.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:19 smithi165 ceph-mon[34621]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:19.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:19 smithi165 ceph-mon[34621]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:19.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.921+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efcf0103dd0 con 0x7efcf00fc6a0 2024-09-16T02:08:19.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.922+0000 7efcedffb640 1 -- 172.21.15.110:0/1778256929 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7efce405b140 con 0x7efcf00fc6a0 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:08:19.925 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 12, 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:08:19.926 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7efcd806df60 msgr2=0x7efcd8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7efcd806df60 0x7efcd8070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efce8007ac0 tx=0x7efce8035040 comp rx=0 tx=0).stop 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 msgr2=0x7efcf0112280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 0x7efcf0112280 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efce400cae0 tx=0x7efce4007e50 comp rx=0 tx=0).stop 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 shutdown_connections 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7efcd806df60 0x7efcd8070410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcf00fc6a0 0x7efcf0112280 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 --2- 172.21.15.110:0/1778256929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcf00fb3d0 0x7efcf010fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 >> 172.21.15.110:0/1778256929 conn(0x7efcf00f6b90 msgr2=0x7efcf00f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:19.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 shutdown_connections 2024-09-16T02:08:19.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:19.924+0000 7efcf74e2640 1 -- 172.21.15.110:0/1778256929 wait complete. 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 -- 172.21.15.110:0/2710520713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 msgr2=0x7fad540fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2710520713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad540fcb70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fad480048d0 tx=0x7fad48009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 -- 172.21.15.110:0/2710520713 shutdown_connections 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2710520713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad540fcb70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2710520713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad540fb430 0x7fad540fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 -- 172.21.15.110:0/2710520713 >> 172.21.15.110:0/2710520713 conn(0x7fad540f6c10 msgr2=0x7fad540f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 -- 172.21.15.110:0/2710520713 shutdown_connections 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.004+0000 7fad5a59a640 1 -- 172.21.15.110:0/2710520713 wait complete. 2024-09-16T02:08:20.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad5a59a640 1 Processor -- start 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad5a59a640 1 -- start start 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad5a59a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad540fb430 0x7fad5410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad5a59a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad541122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad5a59a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad54065c80 con 0x7fad540fc700 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad5a59a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad54065df0 con 0x7fad540fb430 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad537fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad541122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad537fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad541122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40590/0 (socket says 172.21.15.110:40590) 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad537fe640 1 -- 172.21.15.110:0/2328305387 learned_addr learned my addr 172.21.15.110:0/2328305387 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:20.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad53fff640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad540fb430 0x7fad5410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad537fe640 1 -- 172.21.15.110:0/2328305387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad540fb430 msgr2=0x7fad5410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.005+0000 7fad537fe640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad540fb430 0x7fad5410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad537fe640 1 -- 172.21.15.110:0/2328305387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48005040 con 0x7fad540fc700 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad537fe640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad541122f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad480043d0 tx=0x7fad48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad48038070 con 0x7fad540fc700 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54112830 con 0x7fad540fc700 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fad4802ae90 con 0x7fad540fc700 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad4803e670 con 0x7fad540fc700 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.006+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad54112dd0 con 0x7fad540fc700 2024-09-16T02:08:20.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.007+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad540fa890 con 0x7fad540fc700 2024-09-16T02:08:20.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.007+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fad48030020 con 0x7fad540fc700 2024-09-16T02:08:20.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.008+0000 7fad50ff9640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fad3c06df60 0x7fad3c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:20.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.008+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fad480adad0 con 0x7fad540fc700 2024-09-16T02:08:20.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.008+0000 7fad53fff640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fad3c06df60 0x7fad3c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:20.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.008+0000 7fad53fff640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fad3c06df60 0x7fad3c070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad54065970 tx=0x7fad4400b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:20.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.012+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fad48077460 con 0x7fad540fc700 2024-09-16T02:08:20.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.210+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad54100b10 con 0x7fad3c06df60 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.212+0000 7fad50ff9640 1 -- 172.21.15.110:0/2328305387 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fad54100b10 con 0x7fad3c06df60 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:08:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T02:08:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading grafana daemons", 2024-09-16T02:08:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:08:20.215 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:08:20.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fad3c06df60 msgr2=0x7fad3c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:20.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fad3c06df60 0x7fad3c070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad54065970 tx=0x7fad4400b040 comp rx=0 tx=0).stop 2024-09-16T02:08:20.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 msgr2=0x7fad541122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:20.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad541122f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad480043d0 tx=0x7fad48009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 shutdown_connections 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fad3c06df60 0x7fad3c070410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad540fc700 0x7fad541122f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 --2- 172.21.15.110:0/2328305387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad540fb430 0x7fad5410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 >> 172.21.15.110:0/2328305387 conn(0x7fad540f6c10 msgr2=0x7fad540f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 shutdown_connections 2024-09-16T02:08:20.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:20.214+0000 7fad5a59a640 1 -- 172.21.15.110:0/2328305387 wait complete. 2024-09-16T02:08:20.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:20 smithi110 ceph-mon[27634]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:20.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:20 smithi110 ceph-mon[27634]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:20.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:20 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1778256929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:20.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:20 smithi165 ceph-mon[34621]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:20.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:20 smithi165 ceph-mon[34621]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:20.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:20 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1778256929' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:21.546 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:21 smithi110 ceph-mon[27634]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:21.546 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:21 smithi110 ceph-mon[27634]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:21.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:21 smithi165 ceph-mon[34621]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:21.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:21 smithi165 ceph-mon[34621]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:23.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:23 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:23 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:23 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:23 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.485 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:23 smithi110 ceph-mon[27634]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:23 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:23 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:23 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:23 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:23 smithi165 ceph-mon[34621]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:25.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:25 smithi110 ceph-mon[27634]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:25 smithi165 ceph-mon[34621]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:27.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:27.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T02:08:27.455 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T02:08:27.456 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T02:08:27.457 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:27.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:27 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:27.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:27.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:08:27.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:27.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.461 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.461 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.461 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.461 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.461 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T02:08:27.462 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.463 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.464 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:27.465 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:08:27.466 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:08:27.466 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:08:27.466 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:27 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:28.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:28 smithi165 ceph-mon[34621]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:08:28.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:28 smithi165 ceph-mon[34621]: Upgrade: Finalizing container_image settings 2024-09-16T02:08:28.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:28 smithi165 ceph-mon[34621]: Upgrade: Complete! 2024-09-16T02:08:28.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:28 smithi165 ceph-mon[34621]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:28.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:28 smithi110 ceph-mon[27634]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T02:08:28.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:28 smithi110 ceph-mon[27634]: Upgrade: Finalizing container_image settings 2024-09-16T02:08:28.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:28 smithi110 ceph-mon[27634]: Upgrade: Complete! 2024-09-16T02:08:28.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:28 smithi110 ceph-mon[27634]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:29.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:29 smithi110 ceph-mon[27634]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:29.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:29 smithi165 ceph-mon[34621]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:30.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:30 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:30.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:30 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:30 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:30 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:08:31.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:31 smithi165 ceph-mon[34621]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:31.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:31 smithi110 ceph-mon[27634]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:33.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:33 smithi110 ceph-mon[27634]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:33 smithi165 ceph-mon[34621]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:35 smithi110 ceph-mon[27634]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:35.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:35 smithi165 ceph-mon[34621]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:37.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:37 smithi110 ceph-mon[27634]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:37.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:37 smithi165 ceph-mon[34621]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:39.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:39 smithi110 ceph-mon[27634]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:39.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:39 smithi165 ceph-mon[34621]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:41.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:41 smithi110 ceph-mon[27634]: pgmap v39: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:41.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:41 smithi165 ceph-mon[34621]: pgmap v39: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:43.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:43 smithi110 ceph-mon[27634]: pgmap v40: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:43 smithi165 ceph-mon[34621]: pgmap v40: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:44 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:44.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:44 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:08:45.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:45 smithi165 ceph-mon[34621]: pgmap v41: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:45.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:45 smithi110 ceph-mon[27634]: pgmap v41: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:47.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:47 smithi110 ceph-mon[27634]: pgmap v42: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:47.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:47 smithi165 ceph-mon[34621]: pgmap v42: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:49.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:49 smithi110 ceph-mon[27634]: pgmap v43: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:49.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:49 smithi165 ceph-mon[34621]: pgmap v43: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.307+0000 7f880953e640 1 -- 172.21.15.110:0/1380700236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fd820 msgr2=0x7f88040fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.307+0000 7f880953e640 1 --2- 172.21.15.110:0/1380700236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fd820 0x7f88040fdc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0048d0 tx=0x7f87ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- 172.21.15.110:0/1380700236 shutdown_connections 2024-09-16T02:08:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 --2- 172.21.15.110:0/1380700236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fd820 0x7f88040fdc90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 --2- 172.21.15.110:0/1380700236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fc550 0x7f88040fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- 172.21.15.110:0/1380700236 >> 172.21.15.110:0/1380700236 conn(0x7f88040f7d30 msgr2=0x7f88040fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- 172.21.15.110:0/1380700236 shutdown_connections 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- 172.21.15.110:0/1380700236 wait complete. 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 Processor -- start 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- start start 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 0x7f8804071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fd820 0x7f880406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880406fff0 con 0x7f88040fc550 2024-09-16T02:08:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f880953e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804070130 con 0x7f88040fd820 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.308+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 0x7f8804071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 0x7f8804071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39156/0 (socket says 172.21.15.110:39156) 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f8802ffd640 1 -- 172.21.15.110:0/778496322 learned_addr learned my addr 172.21.15.110:0/778496322 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f87fbfff640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fd820 0x7f880406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f8802ffd640 1 -- 172.21.15.110:0/778496322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fd820 msgr2=0x7f880406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f8802ffd640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fd820 0x7f880406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f8802ffd640 1 -- 172.21.15.110:0/778496322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec005040 con 0x7f88040fc550 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f8802ffd640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 0x7f8804071570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f87f4002a50 tx=0x7f87f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4007c30 con 0x7f88040fc550 2024-09-16T02:08:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87f400f040 con 0x7f88040fc550 2024-09-16T02:08:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f400da10 con 0x7f88040fc550 2024-09-16T02:08:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8804070410 con 0x7f88040fc550 2024-09-16T02:08:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.309+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8804115100 con 0x7f88040fc550 2024-09-16T02:08:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.310+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88040fb9b0 con 0x7f88040fc550 2024-09-16T02:08:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.311+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f87f400dbb0 con 0x7f88040fc550 2024-09-16T02:08:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.311+0000 7f87fb7fe640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f87f006df60 0x7f87f0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.312+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f87f408d130 con 0x7f88040fc550 2024-09-16T02:08:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.312+0000 7f87fbfff640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f87f006df60 0x7f87f0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.312+0000 7f87fbfff640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f87f006df60 0x7f87f0070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b020 tx=0x7f87ec035040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:50.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.316+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f87f4056a30 con 0x7f88040fc550 2024-09-16T02:08:50.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.498+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8804101c40 con 0x7f87f006df60 2024-09-16T02:08:50.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.499+0000 7f87fb7fe640 1 -- 172.21.15.110:0/778496322 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8804101c40 con 0x7f87f006df60 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f87f006df60 msgr2=0x7f87f0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f87f006df60 0x7f87f0070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b020 tx=0x7f87ec035040 comp rx=0 tx=0).stop 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 msgr2=0x7f8804071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 0x7f8804071570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f87f4002a50 tx=0x7f87f4004600 comp rx=0 tx=0).stop 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 shutdown_connections 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f87f006df60 0x7f87f0070410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88040fd820 0x7f880406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 --2- 172.21.15.110:0/778496322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88040fc550 0x7f8804071570 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 >> 172.21.15.110:0/778496322 conn(0x7f88040f7d30 msgr2=0x7f88040f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:50.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.501+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 shutdown_connections 2024-09-16T02:08:50.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:50.502+0000 7f880953e640 1 -- 172.21.15.110:0/778496322 wait complete. 2024-09-16T02:08:51.320 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:51 smithi110 ceph-mon[27634]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:51.320 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:51 smithi110 ceph-mon[27634]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:51.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-16T02:08:51.644 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:08:51.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:51 smithi165 ceph-mon[34621]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:08:51.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:51 smithi165 ceph-mon[34621]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:53.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- 172.21.15.110:0/2432953206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102560 msgr2=0x7f82e8102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:53.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 --2- 172.21.15.110:0/2432953206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102560 0x7f82e8102930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009c50 tx=0x7f82d8004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:53.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- 172.21.15.110:0/2432953206 shutdown_connections 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 --2- 172.21.15.110:0/2432953206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102f00 0x7f82e80fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 --2- 172.21.15.110:0/2432953206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102560 0x7f82e8102930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- 172.21.15.110:0/2432953206 >> 172.21.15.110:0/2432953206 conn(0x7f82e80f8100 msgr2=0x7f82e80fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- 172.21.15.110:0/2432953206 shutdown_connections 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- 172.21.15.110:0/2432953206 wait complete. 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 Processor -- start 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- start start 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102560 0x7f82e8113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 0x7f82e81137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:53.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8113e30 con 0x7f82e8102f00 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.230+0000 7f82edd20640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e810d1e0 con 0x7f82e8102560 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 0x7f82e81137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 0x7f82e81137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39174/0 (socket says 172.21.15.110:39174) 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 -- 172.21.15.110:0/1800134785 learned_addr learned my addr 172.21.15.110:0/1800134785 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e77fe640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102560 0x7f82e8113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 -- 172.21.15.110:0/1800134785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102560 msgr2=0x7f82e8113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102560 0x7f82e8113260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 -- 172.21.15.110:0/1800134785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80098b0 con 0x7f82e8102f00 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e77fe640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102560 0x7f82e8113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82e6ffd640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 0x7f82e81137a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f82d000b540 tx=0x7f82d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d000f6f0 con 0x7f82e8102f00 2024-09-16T02:08:53.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82d000fcf0 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e810d4c0 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d00103a0 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.231+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e810d9e0 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.232+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e80fdce0 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.233+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f82d000f850 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.233+0000 7f82dffff640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82d406df60 0x7f82d4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.233+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f82d008d8a0 con 0x7f82e8102f00 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.233+0000 7f82e77fe640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82d406df60 0x7f82d4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.234+0000 7f82e77fe640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82d406df60 0x7f82d4070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82d8004a30 tx=0x7f82d8004d10 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:53.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.238+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f82d0057200 con 0x7f82e8102f00 2024-09-16T02:08:53.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:53 smithi110 ceph-mon[27634]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:53.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.471+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f82e8109670 con 0x7f82e8102f00 2024-09-16T02:08:53.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.471+0000 7f82dffff640 1 -- 172.21.15.110:0/1800134785 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f82d005a8c0 con 0x7f82e8102f00 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82d406df60 msgr2=0x7f82d4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82d406df60 0x7f82d4070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82d8004a30 tx=0x7f82d8004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 msgr2=0x7f82e81137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 0x7f82e81137a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f82d000b540 tx=0x7f82d00091a0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 shutdown_connections 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82d406df60 0x7f82d4070410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82e8102f00 0x7f82e81137a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 --2- 172.21.15.110:0/1800134785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e8102560 0x7f82e8113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 >> 172.21.15.110:0/1800134785 conn(0x7f82e80f8100 msgr2=0x7f82e80f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 shutdown_connections 2024-09-16T02:08:53.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:53.473+0000 7f82edd20640 1 -- 172.21.15.110:0/1800134785 wait complete. 2024-09-16T02:08:53.483 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:08:53.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:53 smithi165 ceph-mon[34621]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:54.251 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-16T02:08:54.514 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:08:54.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:54 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1800134785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:54.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:54 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1800134785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:55.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:55 smithi110 ceph-mon[27634]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:55.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:55 smithi165 ceph-mon[34621]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:08:56.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 -- 172.21.15.110:0/3680443846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 msgr2=0x7f8048102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:56.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 --2- 172.21.15.110:0/3680443846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048102900 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8038009c50 tx=0x7f8038004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:56.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 -- 172.21.15.110:0/3680443846 shutdown_connections 2024-09-16T02:08:56.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 --2- 172.21.15.110:0/3680443846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 0x7f80480fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:56.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 --2- 172.21.15.110:0/3680443846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048102900 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:56.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 -- 172.21.15.110:0/3680443846 >> 172.21.15.110:0/3680443846 conn(0x7f80480f80f0 msgr2=0x7f80480fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 -- 172.21.15.110:0/3680443846 shutdown_connections 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.314+0000 7f804cc9c640 1 -- 172.21.15.110:0/3680443846 wait complete. 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804cc9c640 1 Processor -- start 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804cc9c640 1 -- start start 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804cc9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804cc9c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 0x7f8048113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804cc9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8048113d50 con 0x7f8048102530 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804cc9c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804810d190 con 0x7f8048102ed0 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39192/0 (socket says 172.21.15.110:39192) 2024-09-16T02:08:56.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 -- 172.21.15.110:0/1741053657 learned_addr learned my addr 172.21.15.110:0/1741053657 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f8045d9b640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 0x7f8048113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 -- 172.21.15.110:0/1741053657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 msgr2=0x7f8048113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 0x7f8048113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 -- 172.21.15.110:0/1741053657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380098b0 con 0x7f8048102530 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f8045d9b640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 0x7f8048113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.315+0000 7f804659c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048113210 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8038004a30 tx=0x7f8038004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.316+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8038009690 con 0x7f8048102530 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.316+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8038032b10 con 0x7f8048102530 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.316+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804810d410 con 0x7f8048102530 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.316+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803803daa0 con 0x7f8048102530 2024-09-16T02:08:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.316+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804810d9b0 con 0x7f8048102530 2024-09-16T02:08:56.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.317+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80480fdcb0 con 0x7f8048102530 2024-09-16T02:08:56.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.317+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f803802f030 con 0x7f8048102530 2024-09-16T02:08:56.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.318+0000 7f8036ffd640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f803006df60 0x7f8030070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:56.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.318+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f80380aeb40 con 0x7f8048102530 2024-09-16T02:08:56.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.318+0000 7f8045d9b640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f803006df60 0x7f8030070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.318+0000 7f8045d9b640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f803006df60 0x7f8030070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f804810ead0 tx=0x7f803c009040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:56.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.322+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8038078310 con 0x7f8048102530 2024-09-16T02:08:56.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.555+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8048109610 con 0x7f8048102530 2024-09-16T02:08:56.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.555+0000 7f8036ffd640 1 -- 172.21.15.110:0/1741053657 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f803807b9d0 con 0x7f8048102530 2024-09-16T02:08:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f803006df60 msgr2=0x7f8030070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f803006df60 0x7f8030070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f804810ead0 tx=0x7f803c009040 comp rx=0 tx=0).stop 2024-09-16T02:08:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 msgr2=0x7f8048113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048113210 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8038004a30 tx=0x7f8038004d10 comp rx=0 tx=0).stop 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 shutdown_connections 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f803006df60 0x7f8030070410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8048102ed0 0x7f8048113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 --2- 172.21.15.110:0/1741053657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8048102530 0x7f8048113210 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 >> 172.21.15.110:0/1741053657 conn(0x7f80480f80f0 msgr2=0x7f80480f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 shutdown_connections 2024-09-16T02:08:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:56.558+0000 7f804cc9c640 1 -- 172.21.15.110:0/1741053657 wait complete. 2024-09-16T02:08:56.567 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)" 2024-09-16T02:08:56.933 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:56 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1741053657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:56 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1741053657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:08:57.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-16T02:08:57.623 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:08:57.878 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:57 smithi110 ceph-mon[27634]: pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:57.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:57 smithi165 ceph-mon[34621]: pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:59.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 -- 172.21.15.110:0/2609176162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 msgr2=0x7f653c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 --2- 172.21.15.110:0/2609176162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c0fb910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f65240048d0 tx=0x7f6524009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 -- 172.21.15.110:0/2609176162 shutdown_connections 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 --2- 172.21.15.110:0/2609176162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c0fb910 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 --2- 172.21.15.110:0/2609176162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 0x7f653c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 -- 172.21.15.110:0/2609176162 >> 172.21.15.110:0/2609176162 conn(0x7f653c0f7060 msgr2=0x7f653c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 -- 172.21.15.110:0/2609176162 shutdown_connections 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.388+0000 7f65417a1640 1 -- 172.21.15.110:0/2609176162 wait complete. 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f65417a1640 1 Processor -- start 2024-09-16T02:08:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f65417a1640 1 -- start start 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f65417a1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c10e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f65417a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 0x7f653c10e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f65417a1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c10edb0 con 0x7f653c0fb4a0 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f65417a1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c10ef20 con 0x7f653c1014e0 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c10e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c10e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39214/0 (socket says 172.21.15.110:39214) 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 -- 172.21.15.110:0/326685499 learned_addr learned my addr 172.21.15.110:0/326685499 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f6533fff640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 0x7f653c10e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 -- 172.21.15.110:0/326685499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 msgr2=0x7f653c10e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:59.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 0x7f653c10e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 -- 172.21.15.110:0/326685499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524005040 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f6533fff640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 0x7f653c10e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.389+0000 7f653affd640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c10e330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f652c00b790 tx=0x7f652c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.390+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652c00c700 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.390+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c117260 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.390+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f652c00cd00 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.390+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652c013370 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.390+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c117780 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.391+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c0fcbe0 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.391+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 32) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f652c012070 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.391+0000 7f65337fe640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f652806df60 0x7f6528070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.392+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f652c08d550 con 0x7f653c0fb4a0 2024-09-16T02:08:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.392+0000 7f6533fff640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f652806df60 0x7f6528070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:08:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.392+0000 7f6533fff640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f652806df60 0x7f6528070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f652400b020 tx=0x7f6524009da0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:08:59.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.396+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f652c056e30 con 0x7f653c0fb4a0 2024-09-16T02:08:59.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:08:59 smithi110 ceph-mon[27634]: pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:08:59.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.630+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f653c0fac60 con 0x7f653c0fb4a0 2024-09-16T02:08:59.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.630+0000 7f65337fe640 1 -- 172.21.15.110:0/326685499 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f652c05a4f0 con 0x7f653c0fb4a0 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.632+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f652806df60 msgr2=0x7f6528070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.632+0000 7f65417a1640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f652806df60 0x7f6528070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f652400b020 tx=0x7f6524009da0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.632+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 msgr2=0x7f653c10e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.632+0000 7f65417a1640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c10e330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f652c00b790 tx=0x7f652c0091d0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 shutdown_connections 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f652806df60 0x7f6528070410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f653c1014e0 0x7f653c10e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 --2- 172.21.15.110:0/326685499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c0fb4a0 0x7f653c10e330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:08:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 >> 172.21.15.110:0/326685499 conn(0x7f653c0f7060 msgr2=0x7f653c0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:08:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 shutdown_connections 2024-09-16T02:08:59.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:08:59.633+0000 7f65417a1640 1 -- 172.21.15.110:0/326685499 wait complete. 2024-09-16T02:08:59.643 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:08:59.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:08:59 smithi165 ceph-mon[34621]: pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:00.349 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:00 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:00.349 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:00 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/326685499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:00.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-16T02:09:00.620 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:00.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:00 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:00.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:00 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/326685499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:01.381 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:01 smithi110 ceph-mon[27634]: mgrmap e33: smithi110.hfirap(active, since 91s), standbys: smithi165.afwhot 2024-09-16T02:09:01.381 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:01 smithi110 ceph-mon[27634]: pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:09:01.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:01 smithi165 ceph-mon[34621]: mgrmap e33: smithi110.hfirap(active, since 91s), standbys: smithi165.afwhot 2024-09-16T02:09:01.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:01 smithi165 ceph-mon[34621]: pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:09:02.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 -- 172.21.15.110:0/691824825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fb810 msgr2=0x7fb1780fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:02.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 --2- 172.21.15.110:0/691824825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fb810 0x7fb1780fbbe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb1740048d0 tx=0x7fb174009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:02.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 -- 172.21.15.110:0/691824825 shutdown_connections 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 --2- 172.21.15.110:0/691824825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fcf80 0x7fb1780fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 --2- 172.21.15.110:0/691824825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fb810 0x7fb1780fbbe0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 -- 172.21.15.110:0/691824825 >> 172.21.15.110:0/691824825 conn(0x7fb1780723b0 msgr2=0x7fb1780727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 -- 172.21.15.110:0/691824825 shutdown_connections 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.236+0000 7fb18023f640 1 -- 172.21.15.110:0/691824825 wait complete. 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb18023f640 1 Processor -- start 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb18023f640 1 -- start start 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb18023f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fb810 0x7fb1781153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb18023f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 0x7fb1781158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb18023f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178115ef0 con 0x7fb1780fcf80 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb18023f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178116060 con 0x7fb1780fb810 2024-09-16T02:09:02.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17d7da640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 0x7fb1781158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17d7da640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 0x7fb1781158f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37552/0 (socket says 172.21.15.110:37552) 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17d7da640 1 -- 172.21.15.110:0/1548667286 learned_addr learned my addr 172.21.15.110:0/1548667286 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17dfdb640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fb810 0x7fb1781153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17d7da640 1 -- 172.21.15.110:0/1548667286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fb810 msgr2=0x7fb1781153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17d7da640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fb810 0x7fb1781153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17d7da640 1 -- 172.21.15.110:0/1548667286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174005040 con 0x7fb1780fcf80 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.237+0000 7fb17dfdb640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fb810 0x7fb1781153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.238+0000 7fb17d7da640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 0x7fb1781158f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00c830 tx=0x7fb16c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.238+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb16c00a850 con 0x7fb1780fcf80 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.238+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17810f4e0 con 0x7fb1780fcf80 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.238+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb16c00ae50 con 0x7fb1780fcf80 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.238+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb16c0113a0 con 0x7fb1780fcf80 2024-09-16T02:09:02.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.238+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17810fa80 con 0x7fb1780fcf80 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.239+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1780fcbc0 con 0x7fb1780fcf80 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.239+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fb16c00a9b0 con 0x7fb1780fcf80 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.240+0000 7fb16a7fc640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb16406de30 0x7fb1640702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.240+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb16c08da10 con 0x7fb1780fcf80 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.240+0000 7fb17dfdb640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb16406de30 0x7fb1640702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.240+0000 7fb17dfdb640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb16406de30 0x7fb1640702e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb17400b020 tx=0x7fb174009da0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.244+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb16c0573e0 con 0x7fb1780fcf80 2024-09-16T02:09:02.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:02.426+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}) v1 -- 0x7fb17804b720 con 0x7fb16406de30 2024-09-16T02:09:03.437 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:03 smithi110 ceph-mon[27634]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:03.437 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:03 smithi110 ceph-mon[27634]: pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:09:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:03 smithi165 ceph-mon[34621]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:03 smithi165 ceph-mon[34621]: pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:09:04.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.355+0000 7fb16a7fc640 1 -- 172.21.15.110:0/1548667286 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7fb17804b720 con 0x7fb16406de30 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb16406de30 msgr2=0x7fb1640702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb16406de30 0x7fb1640702e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb17400b020 tx=0x7fb174009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 msgr2=0x7fb1781158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 0x7fb1781158f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00c830 tx=0x7fb16c004430 comp rx=0 tx=0).stop 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 shutdown_connections 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb16406de30 0x7fb1640702e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1780fcf80 0x7fb1781158f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 --2- 172.21.15.110:0/1548667286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1780fb810 0x7fb1781153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 >> 172.21.15.110:0/1548667286 conn(0x7fb1780723b0 msgr2=0x7fb1780651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:04.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 shutdown_connections 2024-09-16T02:09:04.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:04.357+0000 7fb18023f640 1 -- 172.21.15.110:0/1548667286 wait complete. 2024-09-16T02:09:04.368 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:09:05.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch ps' 2024-09-16T02:09:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:05.422 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:05 smithi110 ceph-mon[27634]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:09:05.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:05 smithi165 ceph-mon[34621]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:09:06.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 -- 172.21.15.110:0/4165768035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 msgr2=0x7f54e0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 --2- 172.21.15.110:0/4165768035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0101890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0048d0 tx=0x7f54dc009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 -- 172.21.15.110:0/4165768035 shutdown_connections 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 --2- 172.21.15.110:0/4165768035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54e00fb480 0x7f54e00fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 --2- 172.21.15.110:0/4165768035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0101890 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 -- 172.21.15.110:0/4165768035 >> 172.21.15.110:0/4165768035 conn(0x7f54e00f7000 msgr2=0x7f54e00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 -- 172.21.15.110:0/4165768035 shutdown_connections 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.826+0000 7f54e834f640 1 -- 172.21.15.110:0/4165768035 wait complete. 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e834f640 1 Processor -- start 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e834f640 1 -- start start 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e834f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54e00fb480 0x7f54e01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e834f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:06.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e834f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e0113d10 con 0x7f54e01014c0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e834f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e010d150 con 0x7f54e00fb480 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e58ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e58ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37568/0 (socket says 172.21.15.110:37568) 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e58ea640 1 -- 172.21.15.110:0/1236524756 learned_addr learned my addr 172.21.15.110:0/1236524756 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.827+0000 7f54e60eb640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54e00fb480 0x7f54e01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54e58ea640 1 -- 172.21.15.110:0/1236524756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54e00fb480 msgr2=0x7f54e01131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54e58ea640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54e00fb480 0x7f54e01131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54e58ea640 1 -- 172.21.15.110:0/1236524756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc005040 con 0x7f54e01014c0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54e58ea640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0113710 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f54d000c790 tx=0x7f54d00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d000a7a0 con 0x7f54e01014c0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54d000ada0 con 0x7f54e01014c0 2024-09-16T02:09:06.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e010d430 con 0x7f54e01014c0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d00113a0 con 0x7f54e01014c0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.828+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e010d9d0 con 0x7f54e01014c0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.829+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e00fcbc0 con 0x7f54e01014c0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.830+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f54d000a900 con 0x7f54e01014c0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.830+0000 7f54d6ffd640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f54cc06de30 0x7f54cc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.830+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f54d008d870 con 0x7f54e01014c0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.830+0000 7f54e60eb640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f54cc06de30 0x7f54cc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:06.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.831+0000 7f54e60eb640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f54cc06de30 0x7f54cc0702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009ac0 tx=0x7f54dc035040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:06.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:06.835+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f54d00572e0 con 0x7f54e01014c0 2024-09-16T02:09:07.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.007+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f54e0108460 con 0x7f54cc06de30 2024-09-16T02:09:07.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.016+0000 7f54d6ffd640 1 -- 172.21.15.110:0/1236524756 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f54e0108460 con 0x7f54cc06de30 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (2m) 44s ago 11m 15.5M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (11m) 44s ago 11m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (10m) 67s ago 10m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (50s) 44s ago 10m 46.1M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (5m) 44s ago 5m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (5m) 44s ago 5m 156M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:09:07.019 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (5m) 67s ago 5m 15.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (5m) 67s ago 5m 12.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (2m) 44s ago 12m 498M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (70s) 67s ago 10m 64.1M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (12m) 44s ago 12m 53.6M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (10m) 67s ago 10m 42.7M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (3m) 44s ago 11m 17.5M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (2m) 67s ago 10m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (9m) 44s ago 9m 211M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (9m) 44s ago 9m 217M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (8m) 44s ago 8m 182M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (8m) 67s ago 8m 240M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:09:07.020 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (7m) 67s ago 7m 208M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:09:07.021 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (7m) 67s ago 7m 193M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:09:07.021 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (75s) 44s ago 10m 50.6M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:09:07.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f54cc06de30 msgr2=0x7f54cc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:07.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f54cc06de30 0x7f54cc0702e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009ac0 tx=0x7f54dc035040 comp rx=0 tx=0).stop 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 msgr2=0x7f54e0113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0113710 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f54d000c790 tx=0x7f54d00043c0 comp rx=0 tx=0).stop 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 shutdown_connections 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f54cc06de30 0x7f54cc0702e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e01014c0 0x7f54e0113710 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 --2- 172.21.15.110:0/1236524756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54e00fb480 0x7f54e01131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.018+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 >> 172.21.15.110:0/1236524756 conn(0x7f54e00f7000 msgr2=0x7f54e00f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.019+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 shutdown_connections 2024-09-16T02:09:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:07.019+0000 7f54e834f640 1 -- 172.21.15.110:0/1236524756 wait complete. 2024-09-16T02:09:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:07 smithi110 ceph-mon[27634]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:07 smithi110 ceph-mon[27634]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:09:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:07 smithi165 ceph-mon[34621]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:07 smithi165 ceph-mon[34621]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:09:07.711 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T02:09:07.712 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:09:07.712 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-16T02:09:07.955 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:09.399 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:09 smithi110 ceph-mon[27634]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:09:09.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 -- 172.21.15.110:0/4194805457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 msgr2=0x7fb2fc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:09.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 --2- 172.21.15.110:0/4194805457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc0fc5b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0048d0 tx=0x7fb2ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 -- 172.21.15.110:0/4194805457 shutdown_connections 2024-09-16T02:09:09.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 --2- 172.21.15.110:0/4194805457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc0fc5b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 --2- 172.21.15.110:0/4194805457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2fc102550 0x7fb2fc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 -- 172.21.15.110:0/4194805457 >> 172.21.15.110:0/4194805457 conn(0x7fb2fc0f80f0 msgr2=0x7fb2fc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 -- 172.21.15.110:0/4194805457 shutdown_connections 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.593+0000 7fb302de9640 1 -- 172.21.15.110:0/4194805457 wait complete. 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb302de9640 1 Processor -- start 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb302de9640 1 -- start start 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb302de9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2fc102550 0x7fb2fc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb302de9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb302de9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc071850 con 0x7fb2fc102ef0 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb302de9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0719c0 con 0x7fb2fc102550 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb2f3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb2f3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37594/0 (socket says 172.21.15.110:37594) 2024-09-16T02:09:09.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.594+0000 7fb2f3fff640 1 -- 172.21.15.110:0/748047298 learned_addr learned my addr 172.21.15.110:0/748047298 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb300b85640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2fc102550 0x7fb2fc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f3fff640 1 -- 172.21.15.110:0/748047298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2fc102550 msgr2=0x7fb2fc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f3fff640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2fc102550 0x7fb2fc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f3fff640 1 -- 172.21.15.110:0/748047298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec005040 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f3fff640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc06ff50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec003080 tx=0x7fb2ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ec038070 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc070580 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2ec009760 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ec033420 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.595+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc11e0a0 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.596+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc0fdcd0 con 0x7fb2fc102ef0 2024-09-16T02:09:09.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.596+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fb2ec030020 con 0x7fb2fc102ef0 2024-09-16T02:09:09.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.597+0000 7fb2f17fa640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb2e406de30 0x7fb2e40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:09.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.597+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb2ec0ad3e0 con 0x7fb2fc102ef0 2024-09-16T02:09:09.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.597+0000 7fb300b85640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb2e406de30 0x7fb2e40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:09.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.598+0000 7fb300b85640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb2e406de30 0x7fb2e40702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006fd0 tx=0x7fb2f8008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:09.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.601+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb2ec076dd0 con 0x7fb2fc102ef0 2024-09-16T02:09:09.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:09 smithi165 ceph-mon[34621]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:09:09.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.766+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fb2fc0fbd50 con 0x7fb2fc102ef0 2024-09-16T02:09:09.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.771+0000 7fb2f17fa640 1 -- 172.21.15.110:0/748047298 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb2ec07a490 con 0x7fb2fc102ef0 2024-09-16T02:09:09.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb2e406de30 msgr2=0x7fb2e40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb2e406de30 0x7fb2e40702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006fd0 tx=0x7fb2f8008040 comp rx=0 tx=0).stop 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 msgr2=0x7fb2fc06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc06ff50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec003080 tx=0x7fb2ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 shutdown_connections 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fb2e406de30 0x7fb2e40702e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc102ef0 0x7fb2fc06ff50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 --2- 172.21.15.110:0/748047298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2fc102550 0x7fb2fc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 >> 172.21.15.110:0/748047298 conn(0x7fb2fc0f80f0 msgr2=0x7fb2fc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 shutdown_connections 2024-09-16T02:09:09.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:09.773+0000 7fb302de9640 1 -- 172.21.15.110:0/748047298 wait complete. 2024-09-16T02:09:10.497 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T02:09:10.497 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:09:10.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-16T02:09:10.744 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:11.026 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/748047298' entity='client.admin' 2024-09-16T02:09:11.027 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:11.027 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:11.027 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:11.027 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:11.027 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:11.028 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:10 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:11.206 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/748047298' entity='client.admin' 2024-09-16T02:09:11.206 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:11.207 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:11.207 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:11.207 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:11.207 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:11.207 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:10 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:12.052 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:11 smithi110 ceph-mon[27634]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:09:12.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:11 smithi165 ceph-mon[34621]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:09:12.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 -- 172.21.15.110:0/2708153252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102ed0 msgr2=0x7fdaac0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 --2- 172.21.15.110:0/2708153252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102ed0 0x7fdaac0fc590 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0048d0 tx=0x7fda9c009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 -- 172.21.15.110:0/2708153252 shutdown_connections 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 --2- 172.21.15.110:0/2708153252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102ed0 0x7fdaac0fc590 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 --2- 172.21.15.110:0/2708153252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102530 0x7fdaac102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 -- 172.21.15.110:0/2708153252 >> 172.21.15.110:0/2708153252 conn(0x7fdaac0f8110 msgr2=0x7fdaac0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 -- 172.21.15.110:0/2708153252 shutdown_connections 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.367+0000 7fdab41c2640 1 -- 172.21.15.110:0/2708153252 wait complete. 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab41c2640 1 Processor -- start 2024-09-16T02:09:12.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab41c2640 1 -- start start 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab41c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 0x7fdaac113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab41c2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ed0 0x7fdaac1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab41c2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac113e60 con 0x7fdaac102530 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab41c2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac10d210 con 0x7fdaac102ed0 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab1f5e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 0x7fdaac113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab1f5e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 0x7fdaac113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59030/0 (socket says 172.21.15.110:59030) 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab1f5e640 1 -- 172.21.15.110:0/4289287381 learned_addr learned my addr 172.21.15.110:0/4289287381 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.368+0000 7fdab175d640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ed0 0x7fdaac1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab1f5e640 1 -- 172.21.15.110:0/4289287381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ed0 msgr2=0x7fdaac1137d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab1f5e640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ed0 0x7fdaac1137d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab1f5e640 1 -- 172.21.15.110:0/4289287381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c005040 con 0x7fdaac102530 2024-09-16T02:09:12.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab175d640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ed0 0x7fdaac1137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:09:12.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab1f5e640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 0x7fdaac113290 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800b790 tx=0x7fdaa80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:12.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa800c700 con 0x7fdaac102530 2024-09-16T02:09:12.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdaa800cd00 con 0x7fdaac102530 2024-09-16T02:09:12.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac10d4f0 con 0x7fdaac102530 2024-09-16T02:09:12.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa8015e70 con 0x7fdaac102530 2024-09-16T02:09:12.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.369+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac10da10 con 0x7fdaac102530 2024-09-16T02:09:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.370+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac0fdcb0 con 0x7fdaac102530 2024-09-16T02:09:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.370+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fdaa8012070 con 0x7fdaac102530 2024-09-16T02:09:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.371+0000 7fdaa27fc640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fda9806de30 0x7fda980702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.371+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fdaa808d270 con 0x7fdaac102530 2024-09-16T02:09:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.371+0000 7fdab175d640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fda9806de30 0x7fda980702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.371+0000 7fdab175d640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fda9806de30 0x7fda980702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdaac10eb50 tx=0x7fda9c009da0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:12.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.375+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdaa8056ce0 con 0x7fdaac102530 2024-09-16T02:09:12.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.540+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fdaac04b7b0 con 0x7fdaac102530 2024-09-16T02:09:12.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.540+0000 7fdaa27fc640 1 -- 172.21.15.110:0/4289287381 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7fdaa805a3a0 con 0x7fdaac102530 2024-09-16T02:09:12.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fda9806de30 msgr2=0x7fda980702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fda9806de30 0x7fda980702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdaac10eb50 tx=0x7fda9c009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 msgr2=0x7fdaac113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 0x7fdaac113290 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800b790 tx=0x7fdaa80091d0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 shutdown_connections 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fda9806de30 0x7fda980702e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ed0 0x7fdaac1137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 --2- 172.21.15.110:0/4289287381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdaac102530 0x7fdaac113290 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 >> 172.21.15.110:0/4289287381 conn(0x7fdaac0f8110 msgr2=0x7fdaac0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 shutdown_connections 2024-09-16T02:09:12.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:12.542+0000 7fdab41c2640 1 -- 172.21.15.110:0/4289287381 wait complete. 2024-09-16T02:09:13.194 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-16T02:09:13.442 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:13.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:13 smithi110 ceph-mon[27634]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:13.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:13 smithi165 ceph-mon[34621]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:14.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:14 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:14 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 -- 172.21.15.110:0/2626829245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 msgr2=0x7f43501018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 --2- 172.21.15.110:0/2626829245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f43501018b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f434c0048d0 tx=0x7f434c009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 -- 172.21.15.110:0/2626829245 shutdown_connections 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 --2- 172.21.15.110:0/2626829245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43500fb4a0 0x7f43500fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 --2- 172.21.15.110:0/2626829245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f43501018b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 -- 172.21.15.110:0/2626829245 >> 172.21.15.110:0/2626829245 conn(0x7f43500f7060 msgr2=0x7f43500f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 -- 172.21.15.110:0/2626829245 shutdown_connections 2024-09-16T02:09:15.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.014+0000 7f4357b04640 1 -- 172.21.15.110:0/2626829245 wait complete. 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f4357b04640 1 Processor -- start 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f4357b04640 1 -- start start 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f4357b04640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43500fb4a0 0x7f435010e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f4357b04640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f435010e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f4357b04640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435010ec60 con 0x7f43501014e0 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f4357b04640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435010edd0 con 0x7f43500fb4a0 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f435010e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f435010e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59038/0 (socket says 172.21.15.110:59038) 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 -- 172.21.15.110:0/1616507383 learned_addr learned my addr 172.21.15.110:0/1616507383 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 -- 172.21.15.110:0/1616507383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43500fb4a0 msgr2=0x7f435010e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43500fb4a0 0x7f435010e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 -- 172.21.15.110:0/1616507383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c005040 con 0x7f43501014e0 2024-09-16T02:09:15.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.015+0000 7f435509f640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f435010e660 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f434000c830 tx=0x7f4340004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.016+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434000a850 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.016+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f434000ae50 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.016+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43400113a0 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.016+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4350117190 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.016+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4350117680 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.017+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43500fcbe0 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.017+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f4340012400 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.018+0000 7f43467fc640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f433c06de30 0x7f433c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.018+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f434008d9a0 con 0x7f43501014e0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.018+0000 7f43558a0640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f433c06de30 0x7f433c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.018+0000 7f43558a0640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f433c06de30 0x7f433c0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f434c0043d0 tx=0x7f434c009da0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:15.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.022+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4340057410 con 0x7f43501014e0 2024-09-16T02:09:15.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.189+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f43501084f0 con 0x7f43501014e0 2024-09-16T02:09:15.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.190+0000 7f43467fc640 1 -- 172.21.15.110:0/1616507383 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f434005aad0 con 0x7f43501014e0 2024-09-16T02:09:15.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f433c06de30 msgr2=0x7f433c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:15.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f433c06de30 0x7f433c0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f434c0043d0 tx=0x7f434c009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 msgr2=0x7f435010e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f435010e660 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f434000c830 tx=0x7f4340004430 comp rx=0 tx=0).stop 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 shutdown_connections 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f433c06de30 0x7f433c0702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43501014e0 0x7f435010e660 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 --2- 172.21.15.110:0/1616507383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43500fb4a0 0x7f435010e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 >> 172.21.15.110:0/1616507383 conn(0x7f43500f7060 msgr2=0x7f43500f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 shutdown_connections 2024-09-16T02:09:15.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:15.192+0000 7f4357b04640 1 -- 172.21.15.110:0/1616507383 wait complete. 2024-09-16T02:09:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:15 smithi110 ceph-mon[27634]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:15.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:15 smithi165 ceph-mon[34621]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:15.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-16T02:09:16.086 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:17.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:17 smithi165 ceph-mon[34621]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:09:17.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:17 smithi110 ceph-mon[27634]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 -- 172.21.15.110:0/3184829960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c80fabd0 msgr2=0x7fe1c80fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/3184829960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c80fabd0 0x7fe1c80fb040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80048d0 tx=0x7fe1b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 -- 172.21.15.110:0/3184829960 shutdown_connections 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/3184829960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c80fabd0 0x7fe1c80fb040 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/3184829960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1c8102680 0x7fe1c8102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 -- 172.21.15.110:0/3184829960 >> 172.21.15.110:0/3184829960 conn(0x7fe1c8071ac0 msgr2=0x7fe1c8071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 -- 172.21.15.110:0/3184829960 shutdown_connections 2024-09-16T02:09:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.721+0000 7fe1cef6a640 1 -- 172.21.15.110:0/3184829960 wait complete. 2024-09-16T02:09:17.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1cef6a640 1 Processor -- start 2024-09-16T02:09:17.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1cef6a640 1 -- start start 2024-09-16T02:09:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1cef6a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1c80fabd0 0x7fe1c8113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1cef6a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 0x7fe1c81137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1cef6a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8113dc0 con 0x7fe1c8102680 2024-09-16T02:09:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1cef6a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c810d200 con 0x7fe1c80fabd0 2024-09-16T02:09:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 0x7fe1c81137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 0x7fe1c81137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59068/0 (socket says 172.21.15.110:59068) 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1bffff640 1 -- 172.21.15.110:0/4235932181 learned_addr learned my addr 172.21.15.110:0/4235932181 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1ccd06640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1c80fabd0 0x7fe1c8113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1bffff640 1 -- 172.21.15.110:0/4235932181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1c80fabd0 msgr2=0x7fe1c8113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1bffff640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1c80fabd0 0x7fe1c8113280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.722+0000 7fe1bffff640 1 -- 172.21.15.110:0/4235932181 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8005040 con 0x7fe1c8102680 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.723+0000 7fe1bffff640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 0x7fe1c81137c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8000c00 tx=0x7fe1b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.723+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b8038070 con 0x7fe1c8102680 2024-09-16T02:09:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.723+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1b802ade0 con 0x7fe1c8102680 2024-09-16T02:09:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.723+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b802c7b0 con 0x7fe1c8102680 2024-09-16T02:09:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.723+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c810d480 con 0x7fe1c8102680 2024-09-16T02:09:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.723+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c810d9c0 con 0x7fe1c8102680 2024-09-16T02:09:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.724+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c80725d0 con 0x7fe1c8102680 2024-09-16T02:09:17.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.725+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fe1b8030020 con 0x7fe1c8102680 2024-09-16T02:09:17.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.725+0000 7fe1bd7fa640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe1b006de30 0x7fe1b00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:17.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.725+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fe1b80adad0 con 0x7fe1c8102680 2024-09-16T02:09:17.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.725+0000 7fe1ccd06640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe1b006de30 0x7fe1b00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:17.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.726+0000 7fe1ccd06640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe1b006de30 0x7fe1b00702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009af0 tx=0x7fe1c400b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:17.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.729+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe1b8077540 con 0x7fe1c8102680 2024-09-16T02:09:17.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.896+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fe1c810e8f0 con 0x7fe1c8102680 2024-09-16T02:09:17.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.896+0000 7fe1bd7fa640 1 -- 172.21.15.110:0/4235932181 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe1b807ac00 con 0x7fe1c8102680 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe1b006de30 msgr2=0x7fe1b00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe1b006de30 0x7fe1b00702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009af0 tx=0x7fe1c400b040 comp rx=0 tx=0).stop 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 msgr2=0x7fe1c81137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 0x7fe1c81137c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8000c00 tx=0x7fe1b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 shutdown_connections 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe1b006de30 0x7fe1b00702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1c8102680 0x7fe1c81137c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 --2- 172.21.15.110:0/4235932181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1c80fabd0 0x7fe1c8113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:17.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.898+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 >> 172.21.15.110:0/4235932181 conn(0x7fe1c8071ac0 msgr2=0x7fe1c8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:17.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.899+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 shutdown_connections 2024-09-16T02:09:17.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:17.899+0000 7fe1cef6a640 1 -- 172.21.15.110:0/4235932181 wait complete. 2024-09-16T02:09:18.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-16T02:09:18.894 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:19.341 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:19 smithi110 ceph-mon[27634]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:09:19.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:19 smithi165 ceph-mon[34621]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 -- 172.21.15.110:0/517901040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102ef0 msgr2=0x7f09c00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 --2- 172.21.15.110:0/517901040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102ef0 0x7f09c00fc5b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009c50 tx=0x7f09b0004d10 comp rx=0 tx=0).stop 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 -- 172.21.15.110:0/517901040 shutdown_connections 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 --2- 172.21.15.110:0/517901040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102ef0 0x7f09c00fc5b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 --2- 172.21.15.110:0/517901040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c0102550 0x7f09c0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 -- 172.21.15.110:0/517901040 >> 172.21.15.110:0/517901040 conn(0x7f09c00f80f0 msgr2=0x7f09c00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 -- 172.21.15.110:0/517901040 shutdown_connections 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.451+0000 7f09c71b9640 1 -- 172.21.15.110:0/517901040 wait complete. 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c71b9640 1 Processor -- start 2024-09-16T02:09:20.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c71b9640 1 -- start start 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c71b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 0x7f09c0113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c71b9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c0102ef0 0x7f09c0113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c71b9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c01140b0 con 0x7f09c0102550 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c71b9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c010d4c0 con 0x7f09c0102ef0 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c4f55640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 0x7f09c0113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c4f55640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 0x7f09c0113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37674/0 (socket says 172.21.15.110:37674) 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.452+0000 7f09c4f55640 1 -- 172.21.15.110:0/2993366488 learned_addr learned my addr 172.21.15.110:0/2993366488 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09bffff640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c0102ef0 0x7f09c0113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09c4f55640 1 -- 172.21.15.110:0/2993366488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c0102ef0 msgr2=0x7f09c0113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09c4f55640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c0102ef0 0x7f09c0113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09c4f55640 1 -- 172.21.15.110:0/2993366488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00098b0 con 0x7f09c0102550 2024-09-16T02:09:20.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09c4f55640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 0x7f09c0113520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f09a800c790 tx=0x7f09a80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a800a820 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c010d7a0 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f09a800ae20 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09a80113a0 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.453+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c010dd10 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.454+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00fdcd0 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.454+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f09a8012400 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.455+0000 7f09bd7fa640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f09ac06de30 0x7f09ac0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.455+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f09a808d910 con 0x7f09c0102550 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.455+0000 7f09bffff640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f09ac06de30 0x7f09ac0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.455+0000 7f09bffff640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f09ac06de30 0x7f09ac0702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009c20 tx=0x7f09b0004d10 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:20.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.459+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f09a8057380 con 0x7f09c0102550 2024-09-16T02:09:20.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.641+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}) v1 -- 0x7f09c004b750 con 0x7f09ac06de30 2024-09-16T02:09:20.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.647+0000 7f09bd7fa640 1 -- 172.21.15.110:0/2993366488 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f09c004b750 con 0x7f09ac06de30 2024-09-16T02:09:20.649 INFO:teuthology.orchestra.run.smithi110.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:09:20.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.649+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f09ac06de30 msgr2=0x7f09ac0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:20.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.649+0000 7f09c71b9640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f09ac06de30 0x7f09ac0702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009c20 tx=0x7f09b0004d10 comp rx=0 tx=0).stop 2024-09-16T02:09:20.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.649+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 msgr2=0x7f09c0113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:20.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.649+0000 7f09c71b9640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 0x7f09c0113520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f09a800c790 tx=0x7f09a80043c0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 shutdown_connections 2024-09-16T02:09:20.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f09ac06de30 0x7f09ac0702e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c0102ef0 0x7f09c0113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 --2- 172.21.15.110:0/2993366488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09c0102550 0x7f09c0113520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:20.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 >> 172.21.15.110:0/2993366488 conn(0x7f09c00f80f0 msgr2=0x7f09c00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:20.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 shutdown_connections 2024-09-16T02:09:20.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:20.650+0000 7f09c71b9640 1 -- 172.21.15.110:0/2993366488 wait complete. 2024-09-16T02:09:21.351 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T02:09:21.352 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:09:21.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-16T02:09:21.620 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:09:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:09:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:21.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:21.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:21.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:21.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:09:21.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:21 smithi165 ceph-mon[34621]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T02:09:21.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:21 smithi110 ceph-mon[27634]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:23.350 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:23 smithi110 ceph-mon[27634]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:09:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:23 smithi165 ceph-mon[34621]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- 172.21.15.110:0/2280107167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 msgr2=0x7fca10102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 --2- 172.21.15.110:0/2280107167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10102900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fca000048d0 tx=0x7fca00009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- 172.21.15.110:0/2280107167 shutdown_connections 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 --2- 172.21.15.110:0/2280107167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca10102ed0 0x7fca100fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 --2- 172.21.15.110:0/2280107167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10102900 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- 172.21.15.110:0/2280107167 >> 172.21.15.110:0/2280107167 conn(0x7fca100f80f0 msgr2=0x7fca100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:24.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- 172.21.15.110:0/2280107167 shutdown_connections 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- 172.21.15.110:0/2280107167 wait complete. 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 Processor -- start 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- start start 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca10102ed0 0x7fca10113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10113d50 con 0x7fca10102530 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.509+0000 7fca14e70640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1010d190 con 0x7fca10102ed0 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37686/0 (socket says 172.21.15.110:37686) 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 -- 172.21.15.110:0/4255807767 learned_addr learned my addr 172.21.15.110:0/4255807767 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0dd9b640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca10102ed0 0x7fca10113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 -- 172.21.15.110:0/4255807767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca10102ed0 msgr2=0x7fca10113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:24.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca10102ed0 0x7fca10113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 -- 172.21.15.110:0/4255807767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00005040 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca0e59c640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10113210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fca00000c00 tx=0x7fca00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca00038070 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca0002ade0 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0002c7e0 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1010d410 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.510+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1010d950 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.512+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca100fdcb0 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.512+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fca00030020 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.512+0000 7fc9feffd640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fc9f806de30 0x7fc9f80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.513+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fca000ad340 con 0x7fca10102530 2024-09-16T02:09:24.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.513+0000 7fca0dd9b640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fc9f806de30 0x7fc9f80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:24.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.513+0000 7fca0dd9b640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fc9f806de30 0x7fc9f80702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca1010ead0 tx=0x7fca0400b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:24.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.521+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fca00076e60 con 0x7fca10102530 2024-09-16T02:09:24.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.748+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca1004b720 con 0x7fc9f806de30 2024-09-16T02:09:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.749+0000 7fc9feffd640 1 -- 172.21.15.110:0/4255807767 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fca1004b720 con 0x7fc9f806de30 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fc9f806de30 msgr2=0x7fc9f80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fc9f806de30 0x7fc9f80702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca1010ead0 tx=0x7fca0400b040 comp rx=0 tx=0).stop 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 msgr2=0x7fca10113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10113210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fca00000c00 tx=0x7fca00009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 shutdown_connections 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fc9f806de30 0x7fc9f80702e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca10102ed0 0x7fca10113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 --2- 172.21.15.110:0/4255807767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca10102530 0x7fca10113210 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 >> 172.21.15.110:0/4255807767 conn(0x7fca100f80f0 msgr2=0x7fca100f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:24.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 shutdown_connections 2024-09-16T02:09:24.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.751+0000 7fca14e70640 1 -- 172.21.15.110:0/4255807767 wait complete. 2024-09-16T02:09:24.762 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 -- 172.21.15.110:0/3478237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 msgr2=0x7f27600fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 --2- 172.21.15.110:0/3478237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f27600fc590 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f27480048d0 tx=0x7f2748009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 -- 172.21.15.110:0/3478237244 shutdown_connections 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 --2- 172.21.15.110:0/3478237244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f27600fc590 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 --2- 172.21.15.110:0/3478237244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2760102530 0x7f2760102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 -- 172.21.15.110:0/3478237244 >> 172.21.15.110:0/3478237244 conn(0x7f27600f80f0 msgr2=0x7f27600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:24.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 -- 172.21.15.110:0/3478237244 shutdown_connections 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 -- 172.21.15.110:0/3478237244 wait complete. 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 Processor -- start 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 -- start start 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.835+0000 7f2764fcd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2760102530 0x7f27601131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2764fcd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f2760113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2764fcd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2760113d30 con 0x7f2760102ed0 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2764fcd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010d170 con 0x7f2760102530 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f2760113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f2760113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37704/0 (socket says 172.21.15.110:37704) 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 -- 172.21.15.110:0/2435562458 learned_addr learned my addr 172.21.15.110:0/2435562458 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275e59c640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2760102530 0x7f27601131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 -- 172.21.15.110:0/2435562458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2760102530 msgr2=0x7f27601131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:24.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2760102530 0x7f27601131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:24.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 -- 172.21.15.110:0/2435562458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748005040 con 0x7f2760102ed0 2024-09-16T02:09:24.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f275dd9b640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f2760113730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f27480043d0 tx=0x7f2748009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2748038070 con 0x7f2760102ed0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f27480096e0 con 0x7f2760102ed0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276010d3f0 con 0x7f2760102ed0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274802c8a0 con 0x7f2760102ed0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.836+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276010d930 con 0x7f2760102ed0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.838+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600fdcb0 con 0x7f2760102ed0 2024-09-16T02:09:24.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.838+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f2748030020 con 0x7f2760102ed0 2024-09-16T02:09:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.839+0000 7f2756ffd640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f274c06de30 0x7f274c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.839+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f27480ad440 con 0x7f2760102ed0 2024-09-16T02:09:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.839+0000 7f275e59c640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f274c06de30 0x7f274c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.840+0000 7f275e59c640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f274c06de30 0x7f274c0702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2758004ed0 tx=0x7f275800b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:24.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:24.844+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2748076f60 con 0x7f2760102ed0 2024-09-16T02:09:25.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.040+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2760109560 con 0x7f274c06de30 2024-09-16T02:09:25.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.041+0000 7f2756ffd640 1 -- 172.21.15.110:0/2435562458 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2760109560 con 0x7f274c06de30 2024-09-16T02:09:25.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f274c06de30 msgr2=0x7f274c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f274c06de30 0x7f274c0702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2758004ed0 tx=0x7f275800b040 comp rx=0 tx=0).stop 2024-09-16T02:09:25.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 msgr2=0x7f2760113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f2760113730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f27480043d0 tx=0x7f2748009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 shutdown_connections 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f274c06de30 0x7f274c0702e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2760102ed0 0x7f2760113730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 --2- 172.21.15.110:0/2435562458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2760102530 0x7f27601131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 >> 172.21.15.110:0/2435562458 conn(0x7f27600f80f0 msgr2=0x7f27600f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 shutdown_connections 2024-09-16T02:09:25.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.044+0000 7f2764fcd640 1 -- 172.21.15.110:0/2435562458 wait complete. 2024-09-16T02:09:25.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 -- 172.21.15.110:0/1548526326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 msgr2=0x7f8308102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 --2- 172.21.15.110:0/1548526326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f8308102940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f83040048d0 tx=0x7f8304009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 -- 172.21.15.110:0/1548526326 shutdown_connections 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 --2- 172.21.15.110:0/1548526326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8308102f10 0x7f83080fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 --2- 172.21.15.110:0/1548526326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f8308102940 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 -- 172.21.15.110:0/1548526326 >> 172.21.15.110:0/1548526326 conn(0x7f83080f8110 msgr2=0x7f83080fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 -- 172.21.15.110:0/1548526326 shutdown_connections 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.129+0000 7f830f637640 1 -- 172.21.15.110:0/1548526326 wait complete. 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.130+0000 7f830f637640 1 Processor -- start 2024-09-16T02:09:25.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.130+0000 7f830f637640 1 -- start start 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830f637640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f83081153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830f637640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8308102f10 0x7f8308115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830f637640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308115f20 con 0x7f8308102570 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830f637640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308116090 con 0x7f8308102f10 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f83081153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f83081153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37734/0 (socket says 172.21.15.110:37734) 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 -- 172.21.15.110:0/2470983227 learned_addr learned my addr 172.21.15.110:0/2470983227 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:25.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830cbd2640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8308102f10 0x7f8308115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 -- 172.21.15.110:0/2470983227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8308102f10 msgr2=0x7f8308115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8308102f10 0x7f8308115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 -- 172.21.15.110:0/2470983227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8304005040 con 0x7f8308102570 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830d3d3640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f83081153e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8304000c00 tx=0x7f8304009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8304038070 con 0x7f8308102570 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.131+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830810f4b0 con 0x7f8308102570 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.132+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f830402ade0 con 0x7f8308102570 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.132+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830402c7e0 con 0x7f8308102570 2024-09-16T02:09:25.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.132+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830810f9f0 con 0x7f8308102570 2024-09-16T02:09:25.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.133+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83080fdcf0 con 0x7f8308102570 2024-09-16T02:09:25.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.134+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f8304030020 con 0x7f8308102570 2024-09-16T02:09:25.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.134+0000 7f82fdffb640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82f406de30 0x7f82f40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.135+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f83040ad3e0 con 0x7f8308102570 2024-09-16T02:09:25.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.135+0000 7f830cbd2640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82f406de30 0x7f82f40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.135+0000 7f830cbd2640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82f406de30 0x7f82f40702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8308110ce0 tx=0x7f82f800b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:25.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.143+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8304076e80 con 0x7f8308102570 2024-09-16T02:09:25.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.322+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8308110a90 con 0x7f82f406de30 2024-09-16T02:09:25.333 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (2m) 63s ago 11m 15.5M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (11m) 63s ago 11m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (10m) 85s ago 10m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (68s) 63s ago 11m 46.1M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (6m) 63s ago 6m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (6m) 63s ago 6m 156M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (6m) 85s ago 6m 15.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (6m) 85s ago 6m 12.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (2m) 63s ago 12m 498M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (89s) 85s ago 10m 64.1M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:09:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (12m) 63s ago 12m 53.6M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 95d341f5a176 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (10m) 85s ago 10m 42.7M 2048M 17.2.7-1633-g6d025bc2 33ed8dba3996 7775d3c0d742 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (3m) 63s ago 11m 17.5M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (2m) 85s ago 10m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (9m) 63s ago 9m 211M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (9m) 63s ago 9m 217M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (8m) 63s ago 8m 182M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (8m) 85s ago 8m 240M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:09:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (8m) 85s ago 8m 208M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:09:25.336 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (7m) 85s ago 7m 193M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:09:25.336 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (94s) 63s ago 10m 50.6M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:09:25.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.332+0000 7f82fdffb640 1 -- 172.21.15.110:0/2470983227 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8308110a90 con 0x7f82f406de30 2024-09-16T02:09:25.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82f406de30 msgr2=0x7f82f40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82f406de30 0x7f82f40702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8308110ce0 tx=0x7f82f800b040 comp rx=0 tx=0).stop 2024-09-16T02:09:25.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 msgr2=0x7f83081153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f83081153e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8304000c00 tx=0x7f8304009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 shutdown_connections 2024-09-16T02:09:25.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f82f406de30 0x7f82f40702e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8308102f10 0x7f8308115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.335+0000 7f830f637640 1 --2- 172.21.15.110:0/2470983227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8308102570 0x7f83081153e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.336+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 >> 172.21.15.110:0/2470983227 conn(0x7f83080f8110 msgr2=0x7f830806fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.336+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 shutdown_connections 2024-09-16T02:09:25.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.336+0000 7f830f637640 1 -- 172.21.15.110:0/2470983227 wait complete. 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 -- 172.21.15.110:0/549463561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 msgr2=0x7ff8441018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 --2- 172.21.15.110:0/549463561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff8441018a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8340048d0 tx=0x7ff834009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 -- 172.21.15.110:0/549463561 shutdown_connections 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 --2- 172.21.15.110:0/549463561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8440fb490 0x7ff8440fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 --2- 172.21.15.110:0/549463561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff8441018a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 -- 172.21.15.110:0/549463561 >> 172.21.15.110:0/549463561 conn(0x7ff8440f7050 msgr2=0x7ff8440f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 -- 172.21.15.110:0/549463561 shutdown_connections 2024-09-16T02:09:25.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.415+0000 7ff84968b640 1 -- 172.21.15.110:0/549463561 wait complete. 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: Upgrade: Target is version 19.1.1-326-g8921c8ef (squid) 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, digests ['quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80'] 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: Upgrade: Setting container_image for all mgr 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T02:09:25.418 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:25.419 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:25.419 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:25 smithi110 ceph-mon[27634]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:25.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff84968b640 1 Processor -- start 2024-09-16T02:09:25.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff84968b640 1 -- start start 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff84968b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8440fb490 0x7ff8441131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff84968b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff844113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff84968b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844113d20 con 0x7ff8441014d0 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff84968b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84410d160 con 0x7ff8440fb490 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff8427fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff844113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff8427fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff844113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37752/0 (socket says 172.21.15.110:37752) 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff8427fc640 1 -- 172.21.15.110:0/268329270 learned_addr learned my addr 172.21.15.110:0/268329270 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff8427fc640 1 -- 172.21.15.110:0/268329270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8440fb490 msgr2=0x7ff8441131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff842ffd640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8440fb490 0x7ff8441131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff8427fc640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8440fb490 0x7ff8441131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.416+0000 7ff8427fc640 1 -- 172.21.15.110:0/268329270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834005040 con 0x7ff8441014d0 2024-09-16T02:09:25.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.417+0000 7ff8427fc640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff844113720 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff83800eb70 tx=0x7ff83800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.417+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff838007c30 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.417+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84410d3e0 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.417+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff83800f040 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.417+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8380094e0 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.417+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84410d980 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.418+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8440fcbd0 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.418+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7ff838009660 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.419+0000 7ff82b7fe640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7ff82c06de30 0x7ff82c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.419+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7ff83808d4a0 con 0x7ff8441014d0 2024-09-16T02:09:25.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.419+0000 7ff842ffd640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7ff82c06de30 0x7ff82c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.420+0000 7ff842ffd640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7ff82c06de30 0x7ff82c0702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff834004540 tx=0x7ff834009da0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:25.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.424+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff838056e90 con 0x7ff8441014d0 2024-09-16T02:09:25.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.665+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff844108470 con 0x7ff8441014d0 2024-09-16T02:09:25.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.665+0000 7ff82b7fe640 1 -- 172.21.15.110:0/268329270 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7ff83805a550 con 0x7ff8441014d0 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:09:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 12, 2024-09-16T02:09:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:09:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:09:25.668 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:09:25.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7ff82c06de30 msgr2=0x7ff82c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7ff82c06de30 0x7ff82c0702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff834004540 tx=0x7ff834009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 msgr2=0x7ff844113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff844113720 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff83800eb70 tx=0x7ff83800b040 comp rx=0 tx=0).stop 2024-09-16T02:09:25.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 shutdown_connections 2024-09-16T02:09:25.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7ff82c06de30 0x7ff82c0702e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8441014d0 0x7ff844113720 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 --2- 172.21.15.110:0/268329270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8440fb490 0x7ff8441131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 >> 172.21.15.110:0/268329270 conn(0x7ff8440f7050 msgr2=0x7ff844065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 shutdown_connections 2024-09-16T02:09:25.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.667+0000 7ff84968b640 1 -- 172.21.15.110:0/268329270 wait complete. 2024-09-16T02:09:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: Upgrade: Target is version 19.1.1-326-g8921c8ef (squid) 2024-09-16T02:09:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, digests ['quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80'] 2024-09-16T02:09:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: Upgrade: Setting container_image for all mgr 2024-09-16T02:09:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T02:09:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:25.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:25 smithi165 ceph-mon[34621]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:25.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 -- 172.21.15.110:0/3810727683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f8070340 msgr2=0x7f05f8108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 --2- 172.21.15.110:0/3810727683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f8070340 0x7f05f8108910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0048d0 tx=0x7f05ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 -- 172.21.15.110:0/3810727683 shutdown_connections 2024-09-16T02:09:25.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 --2- 172.21.15.110:0/3810727683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f8070340 0x7f05f8108910 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 --2- 172.21.15.110:0/3810727683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f806fa30 0x7f05f806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 -- 172.21.15.110:0/3810727683 >> 172.21.15.110:0/3810727683 conn(0x7f05f80f80f0 msgr2=0x7f05f80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 -- 172.21.15.110:0/3810727683 shutdown_connections 2024-09-16T02:09:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.745+0000 7f05fde47640 1 -- 172.21.15.110:0/3810727683 wait complete. 2024-09-16T02:09:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.746+0000 7f05fde47640 1 Processor -- start 2024-09-16T02:09:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.746+0000 7f05fde47640 1 -- start start 2024-09-16T02:09:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.746+0000 7f05fde47640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 0x7f05f81157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.746+0000 7f05fde47640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f8070340 0x7f05f8115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.746+0000 7f05fde47640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8116340 con 0x7f05f806fa30 2024-09-16T02:09:25.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.746+0000 7f05fde47640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f810f750 con 0x7f05f8070340 2024-09-16T02:09:25.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 0x7f05f81157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 0x7f05f81157b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37770/0 (socket says 172.21.15.110:37770) 2024-09-16T02:09:25.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 -- 172.21.15.110:0/3577503469 learned_addr learned my addr 172.21.15.110:0/3577503469 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 -- 172.21.15.110:0/3577503469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f8070340 msgr2=0x7f05f8115cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f6ffd640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f8070340 0x7f05f8115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f8070340 0x7f05f8115cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 -- 172.21.15.110:0/3577503469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec005040 con 0x7f05f806fa30 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f6ffd640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f8070340 0x7f05f8115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05f77fe640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 0x7f05f81157b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c810 tx=0x7f05e80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:25.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e800a820 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f810fa30 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05e800ae20 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e80115c0 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.747+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f810ff50 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.748+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f8071170 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.749+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f05e8012840 con 0x7f05f806fa30 2024-09-16T02:09:25.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.749+0000 7f05dffff640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f05e006de30 0x7f05e00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.749+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f05e808dd30 con 0x7f05f806fa30 2024-09-16T02:09:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.749+0000 7f05f6ffd640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f05e006de30 0x7f05e00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.750+0000 7f05f6ffd640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f05e006de30 0x7f05e00702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00b020 tx=0x7f05ec009da0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:25.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.753+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f05e805b250 con 0x7f05f806fa30 2024-09-16T02:09:25.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.972+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f05f80fbd50 con 0x7f05f806fa30 2024-09-16T02:09:25.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.972+0000 7f05dffff640 1 -- 172.21.15.110:0/3577503469 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1839 (secure 0 0 0) 0x7f05e805ade0 con 0x7f05f806fa30 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:09:25.974 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:09:25.975 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:09:25.976 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:25.976 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:09:25.976 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:09:25.976 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:09:25.976 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:09:25.977 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:09:25.977 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:09:25.977 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:09:25.977 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:09:25.977 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:09:25.978 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:09:25.978 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:09:25.978 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:25.978 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:25.978 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:25.978 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:25.979 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:09:25.979 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:25.979 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:25.979 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:25.980 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:09:25.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f05e006de30 msgr2=0x7f05e00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f05e006de30 0x7f05e00702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00b020 tx=0x7f05ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 msgr2=0x7f05f81157b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:25.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 0x7f05f81157b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c810 tx=0x7f05e80043c0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 shutdown_connections 2024-09-16T02:09:25.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7f05e006de30 0x7f05e00702e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05f8070340 0x7f05f8115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 --2- 172.21.15.110:0/3577503469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05f806fa30 0x7f05f81157b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:25.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 >> 172.21.15.110:0/3577503469 conn(0x7f05f80f80f0 msgr2=0x7f05f80f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:25.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 shutdown_connections 2024-09-16T02:09:25.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:25.974+0000 7f05fde47640 1 -- 172.21.15.110:0/3577503469 wait complete. 2024-09-16T02:09:26.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 -- 172.21.15.110:0/2091717083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 msgr2=0x7feeb80fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 --2- 172.21.15.110:0/2091717083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb80fc5c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7feea80048d0 tx=0x7feea8009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 -- 172.21.15.110:0/2091717083 shutdown_connections 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 --2- 172.21.15.110:0/2091717083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb80fc5c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 --2- 172.21.15.110:0/2091717083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 0x7feeb8102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 -- 172.21.15.110:0/2091717083 >> 172.21.15.110:0/2091717083 conn(0x7feeb80f8120 msgr2=0x7feeb80fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.059+0000 7feec0263640 1 -- 172.21.15.110:0/2091717083 shutdown_connections 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 -- 172.21.15.110:0/2091717083 wait complete. 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 Processor -- start 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 -- start start 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 0x7feeb8113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb8113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8113d40 con 0x7feeb8102f00 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feec0263640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb810d180 con 0x7feeb8102560 2024-09-16T02:09:26.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.060+0000 7feebd7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb8113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebd7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb8113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37788/0 (socket says 172.21.15.110:37788) 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebd7fe640 1 -- 172.21.15.110:0/4144341537 learned_addr learned my addr 172.21.15.110:0/4144341537 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebdfff640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 0x7feeb8113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebd7fe640 1 -- 172.21.15.110:0/4144341537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 msgr2=0x7feeb8113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebd7fe640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 0x7feeb8113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebd7fe640 1 -- 172.21.15.110:0/4144341537 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8005040 con 0x7feeb8102f00 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebdfff640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 0x7feeb8113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feebd7fe640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb8113740 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feea802a530 tx=0x7feea8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea8038070 con 0x7feeb8102f00 2024-09-16T02:09:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb810d400 con 0x7feeb8102f00 2024-09-16T02:09:26.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feea802ade0 con 0x7feeb8102f00 2024-09-16T02:09:26.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea802c7a0 con 0x7feeb8102f00 2024-09-16T02:09:26.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.061+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb810d940 con 0x7feeb8102f00 2024-09-16T02:09:26.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.062+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb80fdce0 con 0x7feeb8102f00 2024-09-16T02:09:26.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.063+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7feea8030020 con 0x7feeb8102f00 2024-09-16T02:09:26.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.063+0000 7feeae7fc640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7feea406de30 0x7feea40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:26.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.063+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7feea80adb90 con 0x7feeb8102f00 2024-09-16T02:09:26.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.064+0000 7feebdfff640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7feea406de30 0x7feea40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:26.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.064+0000 7feebdfff640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7feea406de30 0x7feea40702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feeb4004fd0 tx=0x7feeb400b040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:26.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.068+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7feea8077580 con 0x7feeb8102f00 2024-09-16T02:09:26.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.266+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 --> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feeb8109590 con 0x7feea406de30 2024-09-16T02:09:26.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.267+0000 7feeae7fc640 1 -- 172.21.15.110:0/4144341537 <== mgr.14638 v2:172.21.15.110:6800/3922987002 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7feeb8109590 con 0x7feea406de30 2024-09-16T02:09:26.269 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:09:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:09:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:09:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "2/21 daemons upgraded", 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mon daemons", 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:09:26.270 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:09:26.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7feea406de30 msgr2=0x7feea40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7feea406de30 0x7feea40702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feeb4004fd0 tx=0x7feeb400b040 comp rx=0 tx=0).stop 2024-09-16T02:09:26.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 msgr2=0x7feeb8113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb8113740 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feea802a530 tx=0x7feea8009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 shutdown_connections 2024-09-16T02:09:26.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7feea406de30 0x7feea40702e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb8102f00 0x7feeb8113740 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 --2- 172.21.15.110:0/4144341537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feeb8102560 0x7feeb8113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 >> 172.21.15.110:0/4144341537 conn(0x7feeb80f8120 msgr2=0x7feeb80f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:26.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 shutdown_connections 2024-09-16T02:09:26.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.270+0000 7feec0263640 1 -- 172.21.15.110:0/4144341537 wait complete. 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 -- 172.21.15.110:0/2362747425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc0fb4a0 msgr2=0x7fe6cc0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/2362747425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc0fb4a0 0x7fe6cc0fb910 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00048d0 tx=0x7fe6c0009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 -- 172.21.15.110:0/2362747425 shutdown_connections 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/2362747425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc0fb4a0 0x7fe6cc0fb910 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/2362747425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 -- 172.21.15.110:0/2362747425 >> 172.21.15.110:0/2362747425 conn(0x7fe6cc0f7060 msgr2=0x7fe6cc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 -- 172.21.15.110:0/2362747425 shutdown_connections 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 -- 172.21.15.110:0/2362747425 wait complete. 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 Processor -- start 2024-09-16T02:09:26.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.349+0000 7fe6d0b76640 1 -- start start 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6d0b76640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6cc0fb4a0 0x7fe6cc10e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6d0b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc10e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6d0b76640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc10ee10 con 0x7fe6cc1014e0 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6d0b76640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc10ef80 con 0x7fe6cc0fb4a0 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc10e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc10e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37812/0 (socket says 172.21.15.110:37812) 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 -- 172.21.15.110:0/1715792564 learned_addr learned my addr 172.21.15.110:0/1715792564 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6ca59c640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6cc0fb4a0 0x7fe6cc10e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 -- 172.21.15.110:0/1715792564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6cc0fb4a0 msgr2=0x7fe6cc10e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6cc0fb4a0 0x7fe6cc10e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 -- 172.21.15.110:0/1715792564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0005040 con 0x7fe6cc1014e0 2024-09-16T02:09:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6c9d9b640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc10e730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0003080 tx=0x7fe6c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6c0038070 con 0x7fe6cc1014e0 2024-09-16T02:09:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6c00097e0 con 0x7fe6cc1014e0 2024-09-16T02:09:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.350+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc117260 con 0x7fe6cc1014e0 2024-09-16T02:09:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.351+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6c003d420 con 0x7fe6cc1014e0 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.351+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc1176d0 con 0x7fe6cc1014e0 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.351+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc0fcbe0 con 0x7fe6cc1014e0 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.352+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 33) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fe6c0030020 con 0x7fe6cc1014e0 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.352+0000 7fe6baffd640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe6b406de30 0x7fe6b40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.353+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fe6c00adc30 con 0x7fe6cc1014e0 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.353+0000 7fe6ca59c640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe6b406de30 0x7fe6b40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.353+0000 7fe6ca59c640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe6b406de30 0x7fe6b40702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc006fd0 tx=0x7fe6bc008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:26.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.357+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe6c00776a0 con 0x7fe6cc1014e0 2024-09-16T02:09:26.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:26.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/268329270' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:26.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: Upgrade: Updating mon.smithi110 2024-09-16T02:09:26.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:26.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:09:26.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:09:26.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:26.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: Deploying daemon mon.smithi110 on smithi110 2024-09-16T02:09:26.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:26 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/3577503469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:09:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.597+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe6cc0fac60 con 0x7fe6cc1014e0 2024-09-16T02:09:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.597+0000 7fe6baffd640 1 -- 172.21.15.110:0/1715792564 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe6c007ad60 con 0x7fe6cc1014e0 2024-09-16T02:09:26.599 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:26.599 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe6b406de30 msgr2=0x7fe6b40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe6b406de30 0x7fe6b40702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc006fd0 tx=0x7fe6bc008040 comp rx=0 tx=0).stop 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 msgr2=0x7fe6cc10e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc10e730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0003080 tx=0x7fe6c0009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 shutdown_connections 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:6800/3922987002,v1:172.21.15.110:6801/3922987002] conn(0x7fe6b406de30 0x7fe6b40702e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6cc1014e0 0x7fe6cc10e730 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.599+0000 7fe6d0b76640 1 --2- 172.21.15.110:0/1715792564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6cc0fb4a0 0x7fe6cc10e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:26.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.600+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 >> 172.21.15.110:0/1715792564 conn(0x7fe6cc0f7060 msgr2=0x7fe6cc0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:26.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.600+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 shutdown_connections 2024-09-16T02:09:26.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:26.600+0000 7fe6d0b76640 1 -- 172.21.15.110:0/1715792564 wait complete. 2024-09-16T02:09:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/268329270' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: Upgrade: Updating mon.smithi110 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: Deploying daemon mon.smithi110 on smithi110 2024-09-16T02:09:26.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:26 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/3577503469' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:09:27.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 ceph-mon[27634]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:27.604 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 ceph-mon[27634]: from='client.? 172.21.15.110:0/1715792564' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:09:27.604 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 ceph-mon[27634]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:27.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:27 smithi165 ceph-mon[34621]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:27.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:27 smithi165 ceph-mon[34621]: from='client.? 172.21.15.110:0/1715792564' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:09:27.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:27 smithi165 ceph-mon[34621]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:27.870 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 systemd[1]: Stopping Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:09:28.142 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[27629]: 2024-09-16T02:09:27.868+0000 7fc837a1d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi110 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:09:28.142 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[27629]: 2024-09-16T02:09:27.868+0000 7fc837a1d640 -1 mon.smithi110@0(leader) e2 *** Got Signal Terminated *** 2024-09-16T02:09:28.143 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:27 smithi110 podman[98045]: 2024-09-16 02:09:27.91974929 +0000 UTC m=+0.173371299 container died 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-6d025bc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T02:09:28.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 podman[98045]: 2024-09-16 02:09:28.309814529 +0000 UTC m=+0.563436539 container cleanup 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-6d025bc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T02:09:28.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 bash[98045]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110 2024-09-16T02:09:28.937 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 podman[98059]: 2024-09-16 02:09:28.578148236 +0000 UTC m=+0.662663555 container remove 95d341f5a176a34357e92dd2b68a1b206262ab00e16f91a9a869802cb8037ab2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-6d025bc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:09:28.937 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service: Deactivated successfully. 2024-09-16T02:09:28.937 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 systemd[1]: Stopped Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:09:28.937 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service: Consumed 11.143s CPU time. 2024-09-16T02:09:29.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:28 smithi110 systemd[1]: Starting Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:09:29.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 podman[98196]: 2024-09-16 02:09:29.044367055 +0000 UTC m=+0.015413777 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:09:29.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 podman[98196]: 2024-09-16 02:09:29.145617634 +0000 UTC m=+0.116664355 container create fdcdc064e607437657aa9949a0f1ea656716d9986665077c5637feabe305da07 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 podman[98196]: 2024-09-16 02:09:29.417254284 +0000 UTC m=+0.388301006 container init fdcdc064e607437657aa9949a0f1ea656716d9986665077c5637feabe305da07 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 podman[98196]: 2024-09-16 02:09:29.420588824 +0000 UTC m=+0.391635552 container start fdcdc064e607437657aa9949a0f1ea656716d9986665077c5637feabe305da07 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: pidfile_write: ignore empty --pid-file 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: load: jerasure load: lrc 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: RocksDB version: 7.9.2 2024-09-16T02:09:29.502 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Git sha 0 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: DB SUMMARY 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: DB Session ID: DOH9L58FMW1BGBGYSGC0 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: CURRENT file: CURRENT 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1173 Bytes 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi110/store.db dir, Total Num: 1, files: 000033.sst 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi110/store.db: 000031.log size: 570151 ; 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.error_if_exists: 0 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.create_if_missing: 0 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.paranoid_checks: 1 2024-09-16T02:09:29.503 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T02:09:29.504 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T02:09:29.504 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T02:09:29.504 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.env: 0x5648bb277940 2024-09-16T02:09:29.504 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T02:09:29.504 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.info_log: 0x5648bcb398c0 2024-09-16T02:09:29.504 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T02:09:29.505 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.statistics: (nil) 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.use_fsync: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_log_file_size: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.allow_fallocate: 1 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.use_direct_reads: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T02:09:29.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.db_log_dir: 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.wal_dir: 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.write_buffer_manager: 0x5648bcb48dc0 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T02:09:29.507 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.unordered_write: 0 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.row_cache: None 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.wal_filter: None 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T02:09:29.508 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.two_write_queues: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.wal_compression: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.atomic_flush: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.log_readahead_size: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T02:09:29.509 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_background_jobs: 2 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_background_compactions: -1 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_subcompactions: 1 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_open_files: -1 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T02:09:29.510 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_background_flushes: -1 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Compression algorithms supported: 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kZSTD supported: 0 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kXpressCompression supported: 0 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kBZip2Compression supported: 0 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kLZ4Compression supported: 1 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kZlibCompression supported: 1 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: kSnappyCompression supported: 1 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi110/store.db/MANIFEST-000015 2024-09-16T02:09:29.511 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.merge_operator: 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_filter: None 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5648bcb39520) 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: cache_index_and_filter_blocks: 1 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: pin_top_level_index_and_filter: 1 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_type: 0 2024-09-16T02:09:29.512 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_block_index_type: 0 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_shortening: 1 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: checksum: 4 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: no_block_cache: 0 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache: 0x5648bcb2d1f0 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_name: BinnedLRUCache 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_options: 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: capacity : 536870912 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: num_shard_bits : 4 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: strict_capacity_limit : 0 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: high_pri_pool_ratio: 0.000 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_cache_compressed: (nil) 2024-09-16T02:09:29.513 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: persistent_cache: (nil) 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_size: 4096 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_size_deviation: 10 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_restart_interval: 16 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: index_block_restart_interval: 1 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: metadata_block_size: 4096 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: partition_filters: 0 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: use_delta_encoding: 1 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: filter_policy: bloomfilter 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: whole_key_filtering: 1 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: verify_compression: 0 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: read_amp_bytes_per_bit: 0 2024-09-16T02:09:29.514 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: format_version: 5 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: enable_index_compression: 1 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: block_align: 0 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_auto_readahead_size: 262144 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: prepopulate_block_cache: 0 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: initial_auto_readahead_size: 8192 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression: NoCompression 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.num_levels: 7 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T02:09:29.515 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T02:09:29.516 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T02:09:29.517 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T02:09:29.518 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.inplace_update_support: 0 2024-09-16T02:09:29.519 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.bloom_locality: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.max_successive_merges: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.ttl: 2592000 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T02:09:29.520 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.enable_blob_files: false 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.min_blob_size: 0 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi110/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12051, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T02:09:29.521 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a5e326a4-e354-4437-8b2d-acbe1ede8657 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726452569446988, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726452569449878, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 561686, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12045, "largest_seqno": 12584, "table_properties": {"data_size": 558445, "index_size": 1561, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 5546, "raw_average_key_size": 23, "raw_value_size": 553165, "raw_average_value_size": 2304, "num_data_blocks": 70, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726452569, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a5e326a4-e354-4437-8b2d-acbe1ede8657", "db_session_id": "DOH9L58FMW1BGBGYSGC0", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726452569449979, "job": 1, "event": "recovery_finished"} 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi110/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5648bcb5ae00 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: DB pointer 0x5648bcc56000 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** DB Stats ** 2024-09-16T02:09:29.522 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: L0 1/0 548.52 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 296.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: L6 1/0 6.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Sum 2/0 7.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 296.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 296.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-16T02:09:29.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 296.3 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T02:09:29.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Cumulative compaction: 0.00 GB write, 103.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Interval compaction: 0.00 GB write, 103.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Block cache BinnedLRUCache@0x5648bcb2d1f0#2 capacity: 512.00 MB usage: 2.55 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.72 KB,0.000137091%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: starting mon.smithi110 rank 0 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi110 fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???) e2 preinit fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).mds e16 new map 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).mds e16 print_map 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: e16 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:09:29.525 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: legacy client fscid: 1 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Filesystem 'cephfs' (1) 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: fs_name cephfs 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: epoch 15 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: tableserver 0 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: root 0 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: session_timeout 60 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: session_autoclose 300 2024-09-16T02:09:29.526 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_file_size 1099511627776 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_xattr_size 65536 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: required_client_features {} 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: last_failure 0 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: last_failure_osd_epoch 0 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: max_mds 1 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: in 0 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: up {0=14444} 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: failed 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: damaged 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: stopped 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: data_pools [3] 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: metadata_pool 2 2024-09-16T02:09:29.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: inline_data enabled 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: balancer 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: bal_rank_mask -1 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: standby_count_wanted 1 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: qdb_cluster leader: 0 members: 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Standby daemons: 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:29.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: [mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 ceph-mon[98215]: mon.smithi110@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 bash[98196]: fdcdc064e607437657aa9949a0f1ea656716d9986665077c5637feabe305da07 2024-09-16T02:09:29.529 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:29 smithi110 systemd[1]: Started Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:09:32.639 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:09:32.639 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:09:32.639 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: mon.smithi110 calling monitor election 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: mon.smithi110 is new leader, mons smithi110,smithi165 in quorum (ranks 0,1) 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: monmap epoch 2 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: last_changed 2024-09-16T01:58:56.483407+0000 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: created 2024-09-16T01:56:33.980045+0000 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: min_mon_release 17 (quincy) 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: election_strategy: 1 2024-09-16T02:09:32.640 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: osdmap e46: 6 total, 6 up, 6 in 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: mgrmap e33: smithi110.hfirap(active, since 2m), standbys: smithi165.afwhot 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: from='mgr.14638 ' entity='' 2024-09-16T02:09:32.641 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:32 smithi110 ceph-mon[98215]: mgrmap e34: smithi110.hfirap(active, since 2m), standbys: smithi165.afwhot 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: from='mgr.14638 172.21.15.110:0/2293434924' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: mon.smithi110 calling monitor election 2024-09-16T02:09:32.849 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: mon.smithi110 is new leader, mons smithi110,smithi165 in quorum (ranks 0,1) 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: monmap epoch 2 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: last_changed 2024-09-16T01:58:56.483407+0000 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: created 2024-09-16T01:56:33.980045+0000 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: min_mon_release 17 (quincy) 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: election_strategy: 1 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: osdmap e46: 6 total, 6 up, 6 in 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: mgrmap e33: smithi110.hfirap(active, since 2m), standbys: smithi165.afwhot 2024-09-16T02:09:32.850 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:32.851 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:32.851 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:32.851 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: from='mgr.14638 ' entity='' 2024-09-16T02:09:32.851 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:32 smithi165 ceph-mon[34621]: mgrmap e34: smithi110.hfirap(active, since 2m), standbys: smithi165.afwhot 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: Active manager daemon smithi110.hfirap restarted 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: Activating manager daemon smithi110.hfirap 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: osdmap e47: 6 total, 6 up, 6 in 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: mgrmap e35: smithi110.hfirap(active, starting, since 0.00528026s), standbys: smithi165.afwhot 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:09:37.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot restarted 2024-09-16T02:09:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:09:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: Manager daemon smithi110.hfirap is now available 2024-09-16T02:09:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:09:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:09:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:09:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:09:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:37 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: Active manager daemon smithi110.hfirap restarted 2024-09-16T02:09:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: Activating manager daemon smithi110.hfirap 2024-09-16T02:09:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: osdmap e47: 6 total, 6 up, 6 in 2024-09-16T02:09:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: mgrmap e35: smithi110.hfirap(active, starting, since 0.00528026s), standbys: smithi165.afwhot 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi110.hfirap", "id": "smithi110.hfirap"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr metadata", "who": "smithi165.afwhot", "id": "smithi165.afwhot"}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:09:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: Standby manager daemon smithi165.afwhot restarted 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: Standby manager daemon smithi165.afwhot started 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: Manager daemon smithi110.hfirap is now available 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/crt"}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.afwhot/key"}]: dispatch 2024-09-16T02:09:37.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.? 172.21.15.165:0/3573871524' entity='mgr.smithi165.afwhot' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T02:09:37.710 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:38.555 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:38.555 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:09:38.555 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T02:09:38.555 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:38 smithi110 ceph-mon[98215]: mgrmap e36: smithi110.hfirap(active, since 1.0101s), standbys: smithi165.afwhot 2024-09-16T02:09:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:38 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:38 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/mirror_snapshot_schedule"}]: dispatch 2024-09-16T02:09:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:38 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi110.hfirap/trash_purge_schedule"}]: dispatch 2024-09-16T02:09:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:38 smithi165 ceph-mon[34621]: mgrmap e36: smithi110.hfirap(active, since 1.0101s), standbys: smithi165.afwhot 2024-09-16T02:09:39.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:39 smithi110 ceph-mon[98215]: pgmap v3: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:39.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:39 smithi165 ceph-mon[34621]: pgmap v3: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: [16/Sep/2024:02:09:38] ENGINE Bus STARTING 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: [16/Sep/2024:02:09:38] ENGINE Serving on http://172.21.15.110:8765 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: [16/Sep/2024:02:09:38] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: [16/Sep/2024:02:09:38] ENGINE Bus STARTED 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: [16/Sep/2024:02:09:38] ENGINE Error in HTTPServer.serve 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: Traceback (most recent call last): 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T02:09:40.624 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._run(expiration_interval) 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: s = self.context.wrap_socket( 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: return self.sslsocket_class._create( 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T02:09:40.625 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self.do_handshake() 2024-09-16T02:09:40.626 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T02:09:40.626 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: self._sslobj.do_handshake() 2024-09-16T02:09:40.626 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T02:09:40.626 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:40.626 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:40 smithi110 ceph-mon[98215]: mgrmap e37: smithi110.hfirap(active, since 2s), standbys: smithi165.afwhot 2024-09-16T02:09:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: [16/Sep/2024:02:09:38] ENGINE Bus STARTING 2024-09-16T02:09:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: [16/Sep/2024:02:09:38] ENGINE Serving on http://172.21.15.110:8765 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: [16/Sep/2024:02:09:38] ENGINE Serving on https://172.21.15.110:7150 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: [16/Sep/2024:02:09:38] ENGINE Bus STARTED 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: [16/Sep/2024:02:09:38] ENGINE Error in HTTPServer.serve 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Traceback (most recent call last): 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._run(expiration_interval) 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T02:09:40.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s = self.context.wrap_socket( 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: return self.sslsocket_class._create( 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self.do_handshake() 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._sslobj.do_handshake() 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:40.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:40 smithi165 ceph-mon[34621]: mgrmap e37: smithi110.hfirap(active, since 2s), standbys: smithi165.afwhot 2024-09-16T02:09:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:41 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:41 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:41 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:41.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:41 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:42 smithi165 ceph-mon[34621]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:42 smithi165 ceph-mon[34621]: mgrmap e38: smithi110.hfirap(active, since 4s), standbys: smithi165.afwhot 2024-09-16T02:09:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:42 smithi110 ceph-mon[98215]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:42 smithi110 ceph-mon[98215]: mgrmap e38: smithi110.hfirap(active, since 4s), standbys: smithi165.afwhot 2024-09-16T02:09:43.788 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.788 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.788 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.788 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:43 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:43 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:43 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:43.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:43 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:44 smithi110 ceph-mon[98215]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:44 smithi165 ceph-mon[34621]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-16T02:09:46.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:46 smithi110 ceph-mon[98215]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-16T02:09:46.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:46 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:46.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:46 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:46.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:46 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:46.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:46 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:46.771 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:46 smithi165 ceph-mon[34621]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-16T02:09:46.771 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:46 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:46.771 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:46 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:46.771 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:46 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:46.771 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:46 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: Detected new or changed devices on smithi110 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:47.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:47.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:47 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T02:09:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: Detected new or changed devices on smithi110 2024-09-16T02:09:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-16T02:09:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-16T02:09:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T02:09:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:09:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:09:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:09:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:09:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:09:48.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:09:48.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:48 smithi165 ceph-mon[34621]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: Updating smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: Updating smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T02:09:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:48 smithi110 ceph-mon[98215]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-16T02:09:50.123 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: Upgrade: Updating mon.smithi165 2024-09-16T02:09:50.123 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:50.123 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:09:50.124 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:09:50.124 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:50.124 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: Deploying daemon mon.smithi165 on smithi165 2024-09-16T02:09:50.124 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:49 smithi165 ceph-mon[34621]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: Upgrade: Updating mon.smithi165 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: Deploying daemon mon.smithi165 on smithi165 2024-09-16T02:09:50.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:49 smithi110 ceph-mon[98215]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T02:09:50.427 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:50 smithi165 systemd[1]: Stopping Ceph mon.smithi165 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:09:50.428 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:50 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165[34571]: 2024-09-16T02:09:50.364+0000 7f11b00b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi165 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:09:50.428 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:50 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165[34571]: 2024-09-16T02:09:50.364+0000 7f11b00b7640 -1 mon.smithi165@1(peon) e2 *** Got Signal Terminated *** 2024-09-16T02:09:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:50 smithi165 podman[77098]: 2024-09-16 02:09:50.426954094 +0000 UTC m=+0.161447110 container died 7775d3c0d7428a4c27dee8c5d7773307b59c1cd08a78f5a6396e2c3d2f886456 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6d025bc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T02:09:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:50 smithi165 podman[77098]: 2024-09-16 02:09:50.798567919 +0000 UTC m=+0.533060938 container cleanup 7775d3c0d7428a4c27dee8c5d7773307b59c1cd08a78f5a6396e2c3d2f886456 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6d025bc, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-16T02:09:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:50 smithi165 bash[77098]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165 2024-09-16T02:09:51.373 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 podman[77110]: 2024-09-16 02:09:51.042261874 +0000 UTC m=+0.607744418 container remove 7775d3c0d7428a4c27dee8c5d7773307b59c1cd08a78f5a6396e2c3d2f886456 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=quincy-6d025bc, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-16T02:09:51.373 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165.service: Deactivated successfully. 2024-09-16T02:09:51.373 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 systemd[1]: Stopped Ceph mon.smithi165 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:09:51.373 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165.service: Consumed 6.413s CPU time. 2024-09-16T02:09:51.670 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 systemd[1]: Starting Ceph mon.smithi165 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:09:51.670 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 podman[77239]: 2024-09-16 02:09:51.4841134 +0000 UTC m=+0.016020700 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:09:51.671 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 podman[77239]: 2024-09-16 02:09:51.585241183 +0000 UTC m=+0.117148532 container create d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T02:09:51.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 podman[77239]: 2024-09-16 02:09:51.763108266 +0000 UTC m=+0.295015563 container init d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 podman[77239]: 2024-09-16 02:09:51.766430176 +0000 UTC m=+0.298337473 container start d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: pidfile_write: ignore empty --pid-file 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: load: jerasure load: lrc 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: RocksDB version: 7.9.2 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Git sha 0 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T02:09:51.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: DB SUMMARY 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: DB Session ID: 1ZKE4WTFRDTHHX0XD2VJ 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: CURRENT file: CURRENT 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1097 Bytes 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi165/store.db dir, Total Num: 1, files: 000027.sst 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi165/store.db: 000025.log size: 3440959 ; 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.error_if_exists: 0 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.create_if_missing: 0 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.paranoid_checks: 1 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T02:09:51.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T02:09:51.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T02:09:51.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.env: 0x55ea0b984940 2024-09-16T02:09:51.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T02:09:51.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.info_log: 0x55ea0d4a38c0 2024-09-16T02:09:51.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T02:09:51.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.statistics: (nil) 2024-09-16T02:09:51.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.use_fsync: 0 2024-09-16T02:09:51.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_log_file_size: 0 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.allow_fallocate: 1 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T02:09:51.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.use_direct_reads: 0 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.db_log_dir: 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.wal_dir: 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T02:09:51.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.write_buffer_manager: 0x55ea0d4b2dc0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.unordered_write: 0 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T02:09:51.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.row_cache: None 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.wal_filter: None 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.two_write_queues: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.wal_compression: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.atomic_flush: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T02:09:51.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.log_readahead_size: 0 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_background_jobs: 2 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_background_compactions: -1 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_subcompactions: 1 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T02:09:51.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_open_files: -1 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_background_flushes: -1 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Compression algorithms supported: 2024-09-16T02:09:51.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kZSTD supported: 0 2024-09-16T02:09:51.961 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kXpressCompression supported: 0 2024-09-16T02:09:51.961 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kBZip2Compression supported: 0 2024-09-16T02:09:51.961 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T02:09:51.961 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kLZ4Compression supported: 1 2024-09-16T02:09:51.961 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kZlibCompression supported: 1 2024-09-16T02:09:51.961 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: kSnappyCompression supported: 1 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi165/store.db/MANIFEST-000009 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.merge_operator: 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_filter: None 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T02:09:51.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ea0d4a3520) 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: cache_index_and_filter_blocks: 1 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: pin_top_level_index_and_filter: 1 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: index_type: 0 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: data_block_index_type: 0 2024-09-16T02:09:51.963 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: index_shortening: 1 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: checksum: 4 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: no_block_cache: 0 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache: 0x55ea0d4971f0 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache_name: BinnedLRUCache 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache_options: 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: capacity : 536870912 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: num_shard_bits : 4 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: strict_capacity_limit : 0 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: high_pri_pool_ratio: 0.000 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache_compressed: (nil) 2024-09-16T02:09:51.964 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: persistent_cache: (nil) 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_size: 4096 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_size_deviation: 10 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_restart_interval: 16 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: index_block_restart_interval: 1 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: metadata_block_size: 4096 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: partition_filters: 0 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: use_delta_encoding: 1 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: filter_policy: bloomfilter 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: whole_key_filtering: 1 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: verify_compression: 0 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: read_amp_bytes_per_bit: 0 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: format_version: 5 2024-09-16T02:09:51.965 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: enable_index_compression: 1 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_align: 0 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_auto_readahead_size: 262144 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: prepopulate_block_cache: 0 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: initial_auto_readahead_size: 8192 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression: NoCompression 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.num_levels: 7 2024-09-16T02:09:51.966 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T02:09:51.967 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T02:09:51.968 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T02:09:51.968 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T02:09:51.968 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T02:09:51.968 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T02:09:51.969 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T02:09:51.970 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.inplace_update_support: 0 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T02:09:51.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.bloom_locality: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.max_successive_merges: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.ttl: 2592000 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.enable_blob_files: false 2024-09-16T02:09:51.972 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.min_blob_size: 0 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi165/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12354, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-16T02:09:51.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4877f76c-9bdb-4a93-81f4-24c23c437311 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726452591794060, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726452591804279, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2200602, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12351, "largest_seqno": 13422, "table_properties": {"data_size": 2195409, "index_size": 2996, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 10602, "raw_average_key_size": 23, "raw_value_size": 2185644, "raw_average_value_size": 4846, "num_data_blocks": 136, "num_entries": 451, "num_filter_entries": 451, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726452591, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4877f76c-9bdb-4a93-81f4-24c23c437311", "db_session_id": "1ZKE4WTFRDTHHX0XD2VJ", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726452591804441, "job": 1, "event": "recovery_finished"} 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi165/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ea0d4c4e00 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: DB pointer 0x55ea0d5c0000 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T02:09:51.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** DB Stats ** 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T02:09:51.975 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** Compaction Stats [default] ** 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: L0 1/0 2.10 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: L6 1/0 6.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Sum 2/0 9.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T02:09:51.976 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 604.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** Compaction Stats [default] ** 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 604.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T02:09:51.977 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative compaction: 0.00 GB write, 155.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval compaction: 0.00 GB write, 155.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Block cache BinnedLRUCache@0x55ea0d4971f0#2 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: starting mon.smithi165 rank 1 at public addrs [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] at bind addrs [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi165 fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???) e2 preinit fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).mds e16 new map 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).mds e16 print_map 2024-09-16T02:09:51.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: e16 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: legacy client fscid: 1 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Filesystem 'cephfs' (1) 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: fs_name cephfs 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: epoch 15 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: tableserver 0 2024-09-16T02:09:51.979 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: root 0 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: session_timeout 60 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: session_autoclose 300 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_file_size 1099511627776 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_xattr_size 65536 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: required_client_features {} 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: last_failure 0 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: last_failure_osd_epoch 0 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_mds 1 2024-09-16T02:09:51.980 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: in 0 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: up {0=14444} 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: failed 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: damaged 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: stopped 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: data_pools [3] 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: metadata_pool 2 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: inline_data enabled 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: balancer 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: bal_rank_mask -1 2024-09-16T02:09:51.981 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: standby_count_wanted 1 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: qdb_cluster leader: 0 members: 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Standby daemons: 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T02:09:51.982 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T02:09:51.983 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T02:09:51.983 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 ceph-mon[77258]: mon.smithi165@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-16T02:09:51.983 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 bash[77239]: d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 2024-09-16T02:09:51.983 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:51 smithi165 systemd[1]: Started Ceph mon.smithi165 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: mgrmap e38: smithi110.hfirap(active, since 14s), standbys: smithi165.afwhot 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: mon.smithi110 calling monitor election 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: mon.smithi165 calling monitor election 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:09:53.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: mon.smithi110 is new leader, mons smithi110,smithi165 in quorum (ranks 0,1) 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: monmap epoch 3 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: last_changed 2024-09-16T02:09:51.881753+0000 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: created 2024-09-16T01:56:33.980045+0000 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: min_mon_release 19 (squid) 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: election_strategy: 1 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: osdmap e47: 6 total, 6 up, 6 in 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: mgrmap e38: smithi110.hfirap(active, since 14s), standbys: smithi165.afwhot 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:53.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:53.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:53.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:53.203 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: mgrmap e38: smithi110.hfirap(active, since 14s), standbys: smithi165.afwhot 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: mon.smithi110 calling monitor election 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: mon.smithi165 calling monitor election 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi110"}]: dispatch 2024-09-16T02:09:53.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: mon.smithi110 is new leader, mons smithi110,smithi165 in quorum (ranks 0,1) 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: monmap epoch 3 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: last_changed 2024-09-16T02:09:51.881753+0000 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: created 2024-09-16T01:56:33.980045+0000 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: min_mon_release 19 (squid) 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: election_strategy: 1 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.smithi110 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: osdmap e47: 6 total, 6 up, 6 in 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: mgrmap e38: smithi110.hfirap(active, since 14s), standbys: smithi165.afwhot 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:53.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:53.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:53.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:53.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:09:53.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:09:54.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:53 smithi165 ceph-mon[77258]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T02:09:54.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:53 smithi110 ceph-mon[98215]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T02:09:55.804 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.804 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.804 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.804 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:55.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 -- 172.21.15.110:0/2963745205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102ef0 msgr2=0x7f816c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 --2- 172.21.15.110:0/2963745205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102ef0 0x7f816c0fc5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81540048d0 tx=0x7f8154009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 -- 172.21.15.110:0/2963745205 shutdown_connections 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 --2- 172.21.15.110:0/2963745205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102ef0 0x7f816c0fc5b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 --2- 172.21.15.110:0/2963745205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102550 0x7f816c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 -- 172.21.15.110:0/2963745205 >> 172.21.15.110:0/2963745205 conn(0x7f816c0f80f0 msgr2=0x7f816c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 -- 172.21.15.110:0/2963745205 shutdown_connections 2024-09-16T02:09:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.691+0000 7f81718cd640 1 -- 172.21.15.110:0/2963745205 wait complete. 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f81718cd640 1 Processor -- start 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f81718cd640 1 -- start start 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f81718cd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 0x7f816c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f81718cd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 0x7f816c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f81718cd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c070520 con 0x7f816c102550 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f81718cd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c070690 con 0x7f816c102ef0 2024-09-16T02:09:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f816affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 0x7f816c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f816affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 0x7f816c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40090/0 (socket says 172.21.15.110:40090) 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f816affd640 1 -- 172.21.15.110:0/2612094438 learned_addr learned my addr 172.21.15.110:0/2612094438 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.692+0000 7f816a7fc640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 0x7f816c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816a7fc640 1 -- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 msgr2=0x7f816c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816a7fc640 1 -- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 msgr2=0x7f816c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816a7fc640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 0x7f816c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816a7fc640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 0x7f816c06ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816affd640 1 -- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 msgr2=0x7f816c06ff50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816affd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 0x7f816c06ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816affd640 1 -- 172.21.15.110:0/2612094438 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154005040 con 0x7f816c102550 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f816affd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 0x7f816c06fa10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f815c00bbb0 tx=0x7f815c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f815c00c940 con 0x7f816c102550 2024-09-16T02:09:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c1198d0 con 0x7f816c102550 2024-09-16T02:09:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f815c0092e0 con 0x7f816c102550 2024-09-16T02:09:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f815c007640 con 0x7f816c102550 2024-09-16T02:09:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.693+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c119cc0 con 0x7f816c102550 2024-09-16T02:09:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.694+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816c0fdcd0 con 0x7f816c102550 2024-09-16T02:09:56.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.695+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f815c012070 con 0x7f816c102550 2024-09-16T02:09:56.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.695+0000 7f81637fe640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f815806e660 0x7f8158070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:56.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.695+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f815c08e350 con 0x7f816c102550 2024-09-16T02:09:56.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.695+0000 7f816a7fc640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f815806e660 0x7f8158070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:56.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.696+0000 7f816a7fc640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f815806e660 0x7f8158070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8154000c00 tx=0x7f8154009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:56 smithi165 ceph-mon[77258]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T02:09:56.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.700+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f815c057430 con 0x7f816c102550 2024-09-16T02:09:56.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:56 smithi110 ceph-mon[98215]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T02:09:56.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.886+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f816c071100 con 0x7f815806e660 2024-09-16T02:09:56.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.887+0000 7f81637fe640 1 -- 172.21.15.110:0/2612094438 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f816c071100 con 0x7f815806e660 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.889+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f815806e660 msgr2=0x7f8158070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.889+0000 7f81718cd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f815806e660 0x7f8158070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8154000c00 tx=0x7f8154009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.889+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 msgr2=0x7f816c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.889+0000 7f81718cd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 0x7f816c06fa10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f815c00bbb0 tx=0x7f815c009840 comp rx=0 tx=0).stop 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.889+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 shutdown_connections 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.889+0000 7f81718cd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f815806e660 0x7f8158070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.890+0000 7f81718cd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f816c102ef0 0x7f816c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.890+0000 7f81718cd640 1 --2- 172.21.15.110:0/2612094438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f816c102550 0x7f816c06fa10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.890+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 >> 172.21.15.110:0/2612094438 conn(0x7f816c0f80f0 msgr2=0x7f816c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:56.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.890+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 shutdown_connections 2024-09-16T02:09:56.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.890+0000 7f81718cd640 1 -- 172.21.15.110:0/2612094438 wait complete. 2024-09-16T02:09:56.899 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:09:56.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.968+0000 7f4e52323640 1 -- 172.21.15.110:0/3281552751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 msgr2=0x7f4e4c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.968+0000 7f4e52323640 1 --2- 172.21.15.110:0/3281552751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c0fc590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e400048d0 tx=0x7f4e40009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 -- 172.21.15.110:0/3281552751 shutdown_connections 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 --2- 172.21.15.110:0/3281552751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c0fc590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 --2- 172.21.15.110:0/3281552751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c102530 0x7f4e4c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 -- 172.21.15.110:0/3281552751 >> 172.21.15.110:0/3281552751 conn(0x7f4e4c0f80f0 msgr2=0x7f4e4c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 -- 172.21.15.110:0/3281552751 shutdown_connections 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 -- 172.21.15.110:0/3281552751 wait complete. 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 Processor -- start 2024-09-16T02:09:56.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.969+0000 7f4e52323640 1 -- start start 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e52323640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c102530 0x7f4e4c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e52323640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e52323640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c113d10 con 0x7f4e4c102ed0 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e52323640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c10d150 con 0x7f4e4c102530 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40104/0 (socket says 172.21.15.110:40104) 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 -- 172.21.15.110:0/3547833651 learned_addr learned my addr 172.21.15.110:0/3547833651 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4bfff640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c102530 0x7f4e4c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 -- 172.21.15.110:0/3547833651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c102530 msgr2=0x7f4e4c1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c102530 0x7f4e4c1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 -- 172.21.15.110:0/3547833651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40005040 con 0x7f4e4c102ed0 2024-09-16T02:09:56.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e4b7fe640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c113710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e400043d0 tx=0x7f4e40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:56.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e40038070 con 0x7f4e4c102ed0 2024-09-16T02:09:56.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e400096e0 con 0x7f4e4c102ed0 2024-09-16T02:09:56.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c10d3d0 con 0x7f4e4c102ed0 2024-09-16T02:09:56.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4002c8a0 con 0x7f4e4c102ed0 2024-09-16T02:09:56.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.970+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c10d910 con 0x7f4e4c102ed0 2024-09-16T02:09:56.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.971+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c0fdcb0 con 0x7f4e4c102ed0 2024-09-16T02:09:56.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.972+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f4e40030020 con 0x7f4e4c102ed0 2024-09-16T02:09:56.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.972+0000 7f4e48ff9640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4e3406e660 0x7f4e34070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:56.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.973+0000 7f4e4bfff640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4e3406e660 0x7f4e34070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:56.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.973+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f4e400ade50 con 0x7f4e4c102ed0 2024-09-16T02:09:56.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.973+0000 7f4e4bfff640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4e3406e660 0x7f4e34070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c004eb0 tx=0x7f4e3c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:56.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:56.978+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4e40077060 con 0x7f4e4c102ed0 2024-09-16T02:09:57.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.160+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e4c109540 con 0x7f4e3406e660 2024-09-16T02:09:57.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.162+0000 7f4e48ff9640 1 -- 172.21.15.110:0/3547833651 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4e4c109540 con 0x7f4e3406e660 2024-09-16T02:09:57.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4e3406e660 msgr2=0x7f4e34070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4e3406e660 0x7f4e34070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c004eb0 tx=0x7f4e3c00b040 comp rx=0 tx=0).stop 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 msgr2=0x7f4e4c113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c113710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e400043d0 tx=0x7f4e40009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 shutdown_connections 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4e3406e660 0x7f4e34070b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c102ed0 0x7f4e4c113710 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 --2- 172.21.15.110:0/3547833651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e4c102530 0x7f4e4c1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 >> 172.21.15.110:0/3547833651 conn(0x7f4e4c0f80f0 msgr2=0x7f4e4c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 shutdown_connections 2024-09-16T02:09:57.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.164+0000 7f4e52323640 1 -- 172.21.15.110:0/3547833651 wait complete. 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 -- 172.21.15.110:0/1948031617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 msgr2=0x7f5fe40fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/1948031617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe40fb0f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40048d0 tx=0x7f5fd4009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 -- 172.21.15.110:0/1948031617 shutdown_connections 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/1948031617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe40fb0f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/1948031617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe4102620 0x7f5fe41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 -- 172.21.15.110:0/1948031617 >> 172.21.15.110:0/1948031617 conn(0x7f5fe4070ce0 msgr2=0x7f5fe40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 -- 172.21.15.110:0/1948031617 shutdown_connections 2024-09-16T02:09:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.243+0000 7f5feb2aa640 1 -- 172.21.15.110:0/1948031617 wait complete. 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5feb2aa640 1 Processor -- start 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5feb2aa640 1 -- start start 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5feb2aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5feb2aa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe4102620 0x7f5fe41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5feb2aa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4113cf0 con 0x7f5fe40fac80 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5feb2aa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe410d180 con 0x7f5fe4102620 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe41131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40122/0 (socket says 172.21.15.110:40122) 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 -- 172.21.15.110:0/539620208 learned_addr learned my addr 172.21.15.110:0/539620208 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe8845640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe4102620 0x7f5fe41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 -- 172.21.15.110:0/539620208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe4102620 msgr2=0x7f5fe41136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe4102620 0x7f5fe41136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 -- 172.21.15.110:0/539620208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4005040 con 0x7f5fe40fac80 2024-09-16T02:09:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.244+0000 7f5fe9046640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe41131b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0002a80 tx=0x7f5fe0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.245+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe0007c30 con 0x7f5fe40fac80 2024-09-16T02:09:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.245+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5fe000f040 con 0x7f5fe40fac80 2024-09-16T02:09:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.245+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe410d460 con 0x7f5fe40fac80 2024-09-16T02:09:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.245+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fe000dab0 con 0x7f5fe40fac80 2024-09-16T02:09:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.245+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe410d950 con 0x7f5fe40fac80 2024-09-16T02:09:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.246+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe40657b0 con 0x7f5fe40fac80 2024-09-16T02:09:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.246+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f5fe000dc10 con 0x7f5fe40fac80 2024-09-16T02:09:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.247+0000 7f5fd9ffb640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5fd006e660 0x7f5fd0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.247+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f5fe008db70 con 0x7f5fe40fac80 2024-09-16T02:09:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.247+0000 7f5fe8845640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5fd006e660 0x7f5fd0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.247+0000 7f5fe8845640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5fd006e660 0x7f5fd0070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009ac0 tx=0x7f5fd4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:57.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.251+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5fe0056bf0 con 0x7f5fe40fac80 2024-09-16T02:09:57.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.426+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fe404b750 con 0x7f5fd006e660 2024-09-16T02:09:57.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.435+0000 7f5fd9ffb640 1 -- 172.21.15.110:0/539620208 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5fe404b750 con 0x7f5fd006e660 2024-09-16T02:09:57.436 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:09:57.436 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (3m) 14s ago 11m 25.9M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:09:57.436 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (12m) 14s ago 12m 6891k - 17.2.7-1633-g6d025bc2 33ed8dba3996 ad6aad8b6d59 2024-09-16T02:09:57.436 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (11m) 2s ago 11m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (100s) 14s ago 11m 74.7M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (6m) 14s ago 6m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (6m) 14s ago 6m 155M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (6m) 2s ago 6m 16.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (6m) 2s ago 6m 13.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (3m) 14s ago 13m 472M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (2m) 2s ago 11m 438M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (28s) 14s ago 13m 27.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (5s) 2s ago 11m 20.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (4m) 14s ago 12m 17.8M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (3m) 2s ago 11m 16.3M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:09:57.437 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (10m) 14s ago 10m 212M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:09:57.438 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (9m) 14s ago 9m 219M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:09:57.438 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (9m) 14s ago 9m 183M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:09:57.438 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (9m) 2s ago 9m 241M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:09:57.438 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (8m) 2s ago 8m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:09:57.438 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (8m) 2s ago 8m 195M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:09:57.438 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (2m) 14s ago 11m 58.9M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5fd006e660 msgr2=0x7f5fd0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5fd006e660 0x7f5fd0070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009ac0 tx=0x7f5fd4035040 comp rx=0 tx=0).stop 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 msgr2=0x7f5fe41131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe41131b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0002a80 tx=0x7f5fe0004600 comp rx=0 tx=0).stop 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 shutdown_connections 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5fd006e660 0x7f5fd0070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe4102620 0x7f5fe41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 --2- 172.21.15.110:0/539620208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40fac80 0x7f5fe41131b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 >> 172.21.15.110:0/539620208 conn(0x7f5fe4070ce0 msgr2=0x7f5fe4100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:57.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 shutdown_connections 2024-09-16T02:09:57.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.437+0000 7f5feb2aa640 1 -- 172.21.15.110:0/539620208 wait complete. 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 -- 172.21.15.110:0/2763134998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e80fb4b0 msgr2=0x7fd3e80fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2763134998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e80fb4b0 0x7fd3e80fb920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0048d0 tx=0x7fd3dc009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 -- 172.21.15.110:0/2763134998 shutdown_connections 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2763134998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e80fb4b0 0x7fd3e80fb920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2763134998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e81014f0 0x7fd3e81018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 -- 172.21.15.110:0/2763134998 >> 172.21.15.110:0/2763134998 conn(0x7fd3e80f7090 msgr2=0x7fd3e80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 -- 172.21.15.110:0/2763134998 shutdown_connections 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 -- 172.21.15.110:0/2763134998 wait complete. 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.514+0000 7fd3ef583640 1 Processor -- start 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ef583640 1 -- start start 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ef583640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e80fb4b0 0x7fd3e8113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ef583640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 0x7fd3e81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ef583640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8113cb0 con 0x7fd3e81014f0 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ef583640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8113e20 con 0x7fd3e80fb4b0 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 0x7fd3e81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 0x7fd3e81136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40142/0 (socket says 172.21.15.110:40142) 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 -- 172.21.15.110:0/2454413257 learned_addr learned my addr 172.21.15.110:0/2454413257 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ed31f640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e80fb4b0 0x7fd3e8113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 -- 172.21.15.110:0/2454413257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e80fb4b0 msgr2=0x7fd3e8113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e80fb4b0 0x7fd3e8113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 -- 172.21.15.110:0/2454413257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc005040 con 0x7fd3e81014f0 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3ecb1e640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 0x7fd3e81136b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc000c00 tx=0x7fd3dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.515+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc038070 con 0x7fd3e81014f0 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.516+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e810d240 con 0x7fd3e81014f0 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.516+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3dc02ade0 con 0x7fd3e81014f0 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.516+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc02c7e0 con 0x7fd3e81014f0 2024-09-16T02:09:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.516+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e810d700 con 0x7fd3e81014f0 2024-09-16T02:09:57.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.517+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e80fcbf0 con 0x7fd3e81014f0 2024-09-16T02:09:57.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.517+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd3dc030020 con 0x7fd3e81014f0 2024-09-16T02:09:57.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.518+0000 7fd3e5ffb640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd3d006e660 0x7fd3d0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.518+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fd3dc0ade60 con 0x7fd3e81014f0 2024-09-16T02:09:57.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.518+0000 7fd3ed31f640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd3d006e660 0x7fd3d0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.518+0000 7fd3ed31f640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd3d006e660 0x7fd3d0070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009fd0 tx=0x7fd3e000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:57.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.522+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd3dc076ff0 con 0x7fd3e81014f0 2024-09-16T02:09:57.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.752+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3e80fac90 con 0x7fd3e81014f0 2024-09-16T02:09:57.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.753+0000 7fd3e5ffb640 1 -- 172.21.15.110:0/2454413257 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7fd3dc07a6b0 con 0x7fd3e81014f0 2024-09-16T02:09:57.754 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:09:57.755 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:09:57.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:09:57.756 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:09:57.756 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 10, 2024-09-16T02:09:57.756 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T02:09:57.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:09:57.756 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd3d006e660 msgr2=0x7fd3d0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd3d006e660 0x7fd3d0070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009fd0 tx=0x7fd3e000b040 comp rx=0 tx=0).stop 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 msgr2=0x7fd3e81136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 0x7fd3e81136b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc000c00 tx=0x7fd3dc009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 shutdown_connections 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd3d006e660 0x7fd3d0070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3e81014f0 0x7fd3e81136b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 --2- 172.21.15.110:0/2454413257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e80fb4b0 0x7fd3e8113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 >> 172.21.15.110:0/2454413257 conn(0x7fd3e80f7090 msgr2=0x7fd3e8065a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 shutdown_connections 2024-09-16T02:09:57.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.755+0000 7fd3ef583640 1 -- 172.21.15.110:0/2454413257 wait complete. 2024-09-16T02:09:57.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 -- 172.21.15.110:0/1824409003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 msgr2=0x7f68040fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 --2- 172.21.15.110:0/1824409003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f68040fb8e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67f80048d0 tx=0x7f67f8009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 -- 172.21.15.110:0/1824409003 shutdown_connections 2024-09-16T02:09:57.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 --2- 172.21.15.110:0/1824409003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f68040fb8e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 --2- 172.21.15.110:0/1824409003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68041014b0 0x7f6804101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 -- 172.21.15.110:0/1824409003 >> 172.21.15.110:0/1824409003 conn(0x7f68040f7030 msgr2=0x7f68040f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:57.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 -- 172.21.15.110:0/1824409003 shutdown_connections 2024-09-16T02:09:57.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 -- 172.21.15.110:0/1824409003 wait complete. 2024-09-16T02:09:57.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 Processor -- start 2024-09-16T02:09:57.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.837+0000 7f68092b2640 1 -- start start 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f68092b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f680410e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f68092b2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68041014b0 0x7f680410e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f68092b2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680410ecd0 con 0x7f68040fb470 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f68092b2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680410ee40 con 0x7f68041014b0 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f680410e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f680410e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40174/0 (socket says 172.21.15.110:40174) 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 -- 172.21.15.110:0/4067209703 learned_addr learned my addr 172.21.15.110:0/4067209703 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f68027fc640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68041014b0 0x7f680410e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 -- 172.21.15.110:0/4067209703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68041014b0 msgr2=0x7f680410e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68041014b0 0x7f680410e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 -- 172.21.15.110:0/4067209703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8005040 con 0x7f68040fb470 2024-09-16T02:09:57.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.838+0000 7f6802ffd640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f680410e140 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67f4002a50 tx=0x7f67f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:57.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.839+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67f4007c30 con 0x7f68040fb470 2024-09-16T02:09:57.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.839+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68041171b0 con 0x7f68040fb470 2024-09-16T02:09:57.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.839+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f67f400f040 con 0x7f68040fb470 2024-09-16T02:09:57.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.839+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67f400dad0 con 0x7f68040fb470 2024-09-16T02:09:57.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.839+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68041176c0 con 0x7f68040fb470 2024-09-16T02:09:57.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.840+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040fcbb0 con 0x7f68040fb470 2024-09-16T02:09:57.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.840+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f67f400dc30 con 0x7f68040fb470 2024-09-16T02:09:57.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.840+0000 7f67eb7fe640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f67ec06e660 0x7f67ec070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:57.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.841+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f67f408e130 con 0x7f68040fb470 2024-09-16T02:09:57.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.841+0000 7f68027fc640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f67ec06e660 0x7f67ec070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:57.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.841+0000 7f68027fc640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f67ec06e660 0x7f67ec070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009ac0 tx=0x7f67f8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:57.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:57.845+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f67f4057100 con 0x7f68040fb470 2024-09-16T02:09:58.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.046+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6804065fc0 con 0x7f68040fb470 2024-09-16T02:09:58.048 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:57 smithi110 ceph-mon[98215]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.048 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:57 smithi110 ceph-mon[98215]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.048 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:57 smithi110 ceph-mon[98215]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:58.048 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:57 smithi110 ceph-mon[98215]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.048 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:57 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2454413257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.047+0000 7f67eb7fe640 1 -- 172.21.15.110:0/4067209703 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7f67f405a7c0 con 0x7f68040fb470 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:09:58.049 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:09:58.050 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:09:58.051 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:58.052 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f67ec06e660 msgr2=0x7f67ec070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f67ec06e660 0x7f67ec070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009ac0 tx=0x7f67f8035040 comp rx=0 tx=0).stop 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 msgr2=0x7f680410e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f680410e140 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67f4002a50 tx=0x7f67f4004600 comp rx=0 tx=0).stop 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 shutdown_connections 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f67ec06e660 0x7f67ec070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68041014b0 0x7f680410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 --2- 172.21.15.110:0/4067209703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040fb470 0x7f680410e140 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 >> 172.21.15.110:0/4067209703 conn(0x7f68040f7030 msgr2=0x7f68040f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:58.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 shutdown_connections 2024-09-16T02:09:58.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.050+0000 7f68092b2640 1 -- 172.21.15.110:0/4067209703 wait complete. 2024-09-16T02:09:58.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 -- 172.21.15.110:0/2097292636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 msgr2=0x7ff7a80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 --2- 172.21.15.110:0/2097292636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a80fc5b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7940048d0 tx=0x7ff794009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 -- 172.21.15.110:0/2097292636 shutdown_connections 2024-09-16T02:09:58.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 --2- 172.21.15.110:0/2097292636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a80fc5b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 --2- 172.21.15.110:0/2097292636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7a8102550 0x7ff7a8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 -- 172.21.15.110:0/2097292636 >> 172.21.15.110:0/2097292636 conn(0x7ff7a80f80f0 msgr2=0x7ff7a80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:58.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 -- 172.21.15.110:0/2097292636 shutdown_connections 2024-09-16T02:09:58.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.128+0000 7ff7af0de640 1 -- 172.21.15.110:0/2097292636 wait complete. 2024-09-16T02:09:58.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7af0de640 1 Processor -- start 2024-09-16T02:09:58.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7af0de640 1 -- start start 2024-09-16T02:09:58.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7af0de640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7a8102550 0x7ff7a81156c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:58.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7af0de640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a8115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:58.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7af0de640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8116200 con 0x7ff7a8102ef0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7af0de640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8116370 con 0x7ff7a8102550 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7a7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a8115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7a7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a8115c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40196/0 (socket says 172.21.15.110:40196) 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.129+0000 7ff7a7fff640 1 -- 172.21.15.110:0/1396706191 learned_addr learned my addr 172.21.15.110:0/1396706191 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7ace7a640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7a8102550 0x7ff7a81156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a7fff640 1 -- 172.21.15.110:0/1396706191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7a8102550 msgr2=0x7ff7a81156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a7fff640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7a8102550 0x7ff7a81156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a7fff640 1 -- 172.21.15.110:0/1396706191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794005040 con 0x7ff7a8102ef0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a7fff640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a8115c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7940043d0 tx=0x7ff794009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff794038070 con 0x7ff7a8102ef0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7940096e0 con 0x7ff7a8102ef0 2024-09-16T02:09:58.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a810f790 con 0x7ff7a8102ef0 2024-09-16T02:09:58.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff79402c8a0 con 0x7ff7a8102ef0 2024-09-16T02:09:58.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.130+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a810fcd0 con 0x7ff7a8102ef0 2024-09-16T02:09:58.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.131+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a80fdcd0 con 0x7ff7a8102ef0 2024-09-16T02:09:58.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.132+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff794030020 con 0x7ff7a8102ef0 2024-09-16T02:09:58.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.132+0000 7ff7a57fa640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff79806e660 0x7ff798070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:58.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.132+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7ff7940adfa0 con 0x7ff7a8102ef0 2024-09-16T02:09:58.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.132+0000 7ff7ace7a640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff79806e660 0x7ff798070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:58.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.133+0000 7ff7ace7a640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff79806e660 0x7ff798070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff79c007fd0 tx=0x7ff79c009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:58.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.136+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff794077080 con 0x7ff7a8102ef0 2024-09-16T02:09:58.164 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:57 smithi165 ceph-mon[77258]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.164 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:57 smithi165 ceph-mon[77258]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.164 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:57 smithi165 ceph-mon[77258]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:09:58.164 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:57 smithi165 ceph-mon[77258]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.164 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:57 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2454413257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:09:58.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.338+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7a804b720 con 0x7ff79806e660 2024-09-16T02:09:58.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.339+0000 7ff7a57fa640 1 -- 172.21.15.110:0/1396706191 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff7a804b720 con 0x7ff79806e660 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "4/21 daemons upgraded", 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mon daemons", 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:09:58.341 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:09:58.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.341+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff79806e660 msgr2=0x7ff798070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.341+0000 7ff7af0de640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff79806e660 0x7ff798070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff79c007fd0 tx=0x7ff79c009e90 comp rx=0 tx=0).stop 2024-09-16T02:09:58.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.341+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 msgr2=0x7ff7a8115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.341+0000 7ff7af0de640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a8115c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7940043d0 tx=0x7ff794009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 shutdown_connections 2024-09-16T02:09:58.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff79806e660 0x7ff798070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a8102ef0 0x7ff7a8115c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 --2- 172.21.15.110:0/1396706191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7a8102550 0x7ff7a81156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 >> 172.21.15.110:0/1396706191 conn(0x7ff7a80f80f0 msgr2=0x7ff7a806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 shutdown_connections 2024-09-16T02:09:58.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.342+0000 7ff7af0de640 1 -- 172.21.15.110:0/1396706191 wait complete. 2024-09-16T02:09:58.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.422+0000 7f1fa5481640 1 -- 172.21.15.110:0/2166152567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00fb470 msgr2=0x7f1fa00fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.422+0000 7f1fa5481640 1 --2- 172.21.15.110:0/2166152567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00fb470 0x7f1fa00fb8e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f880048d0 tx=0x7f1f88009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 -- 172.21.15.110:0/2166152567 shutdown_connections 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 --2- 172.21.15.110:0/2166152567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00fb470 0x7f1fa00fb8e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 --2- 172.21.15.110:0/2166152567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa01014b0 0x7f1fa0101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 -- 172.21.15.110:0/2166152567 >> 172.21.15.110:0/2166152567 conn(0x7f1fa00f7030 msgr2=0x7f1fa00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 -- 172.21.15.110:0/2166152567 shutdown_connections 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 -- 172.21.15.110:0/2166152567 wait complete. 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 Processor -- start 2024-09-16T02:09:58.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.423+0000 7f1fa5481640 1 -- start start 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1fa5481640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa00fb470 0x7f1fa01120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1fa5481640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 0x7f1fa0112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1fa5481640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa0112c20 con 0x7f1fa01014b0 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1fa5481640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa010c060 con 0x7f1fa00fb470 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 0x7f1fa0112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 0x7f1fa0112620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40200/0 (socket says 172.21.15.110:40200) 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 -- 172.21.15.110:0/1574446524 learned_addr learned my addr 172.21.15.110:0/1574446524 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f9effd640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa00fb470 0x7f1fa01120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 -- 172.21.15.110:0/1574446524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa00fb470 msgr2=0x7f1fa01120e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa00fb470 0x7f1fa01120e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 -- 172.21.15.110:0/1574446524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88005040 con 0x7f1fa01014b0 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f9effd640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa00fb470 0x7f1fa01120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.424+0000 7f1f97fff640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 0x7f1fa0112620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000c00 tx=0x7f1f88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.425+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f88038070 con 0x7f1fa01014b0 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.425+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f8802ade0 con 0x7f1fa01014b0 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.425+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa010c2e0 con 0x7f1fa01014b0 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.425+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f8802c7b0 con 0x7f1fa01014b0 2024-09-16T02:09:58.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.425+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa010c820 con 0x7f1fa01014b0 2024-09-16T02:09:58.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.426+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa00fcbb0 con 0x7f1fa01014b0 2024-09-16T02:09:58.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.426+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1f88030020 con 0x7f1fa01014b0 2024-09-16T02:09:58.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.427+0000 7f1f977fe640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f1f8c06e660 0x7f1f8c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:09:58.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.427+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f1f880ae550 con 0x7f1fa01014b0 2024-09-16T02:09:58.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.427+0000 7f1f9effd640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f1f8c06e660 0x7f1f8c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:09:58.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.427+0000 7f1f9effd640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f1f8c06e660 0x7f1f8c070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f90004fd0 tx=0x7f1f9000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:09:58.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.431+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1f880776b0 con 0x7f1fa01014b0 2024-09-16T02:09:58.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.680+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1fa00fac30 con 0x7f1fa01014b0 2024-09-16T02:09:58.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.681+0000 7f1f977fe640 1 -- 172.21.15.110:0/1574446524 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1f8807ad70 con 0x7f1fa01014b0 2024-09-16T02:09:58.682 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:58.682 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:09:58.683 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:09:58.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f1f8c06e660 msgr2=0x7f1f8c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f1f8c06e660 0x7f1f8c070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f90004fd0 tx=0x7f1f9000b040 comp rx=0 tx=0).stop 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 msgr2=0x7f1fa0112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 0x7f1fa0112620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000c00 tx=0x7f1f88009da0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 shutdown_connections 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f1f8c06e660 0x7f1f8c070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa01014b0 0x7f1fa0112620 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 --2- 172.21.15.110:0/1574446524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fa00fb470 0x7f1fa01120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 >> 172.21.15.110:0/1574446524 conn(0x7f1fa00f7030 msgr2=0x7f1fa00f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 shutdown_connections 2024-09-16T02:09:58.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:09:58.683+0000 7f1fa5481640 1 -- 172.21.15.110:0/1574446524 wait complete. 2024-09-16T02:09:58.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/4067209703' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:09:58.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: Detected new or changed devices on smithi165 2024-09-16T02:09:58.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:58.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:58.931 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: Reconfiguring mon.smithi110 (monmap changed)... 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: Reconfiguring daemon mon.smithi110 on smithi110 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:58.932 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:58 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1574446524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:09:59.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/4067209703' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: Detected new or changed devices on smithi165 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: Reconfiguring mon.smithi110 (monmap changed)... 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: Reconfiguring daemon mon.smithi110 on smithi110 2024-09-16T02:09:59.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:09:59.202 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:58 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1574446524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:09:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:59 smithi110 ceph-mon[98215]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:09:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:09:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:09:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:09:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:09:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:00.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:59 smithi165 ceph-mon[77258]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:00.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:00.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:00.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi110.hfirap", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:10:00.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:10:00.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:09:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:00 smithi165 ceph-mon[77258]: Reconfiguring mgr.smithi110.hfirap (monmap changed)... 2024-09-16T02:10:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:00 smithi165 ceph-mon[77258]: Reconfiguring daemon mgr.smithi110.hfirap on smithi110 2024-09-16T02:10:01.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:00 smithi165 ceph-mon[77258]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:10:01.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:00 smithi110 ceph-mon[98215]: Reconfiguring mgr.smithi110.hfirap (monmap changed)... 2024-09-16T02:10:01.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:00 smithi110 ceph-mon[98215]: Reconfiguring daemon mgr.smithi110.hfirap on smithi110 2024-09-16T02:10:01.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:00 smithi110 ceph-mon[98215]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: Reconfiguring crash.smithi110 (monmap changed)... 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:02 smithi165 ceph-mon[77258]: Reconfiguring daemon crash.smithi110 on smithi110 2024-09-16T02:10:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: Reconfiguring crash.smithi110 (monmap changed)... 2024-09-16T02:10:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:02.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:02.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:02 smithi110 ceph-mon[98215]: Reconfiguring daemon crash.smithi110 on smithi110 2024-09-16T02:10:04.017 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:04.017 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:04.018 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: Reconfiguring osd.0 (monmap changed)... 2024-09-16T02:10:04.018 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T02:10:04.018 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:04.018 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: Reconfiguring daemon osd.0 on smithi110 2024-09-16T02:10:04.018 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:03 smithi165 ceph-mon[77258]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: Reconfiguring osd.0 (monmap changed)... 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: Reconfiguring daemon osd.0 on smithi110 2024-09-16T02:10:04.129 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:03 smithi110 ceph-mon[98215]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:05.557 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:05 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:05.557 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:05 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:05.557 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:05 smithi110 ceph-mon[98215]: Reconfiguring osd.1 (monmap changed)... 2024-09-16T02:10:05.557 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:05 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T02:10:05.557 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:05 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:05.557 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:05 smithi110 ceph-mon[98215]: Reconfiguring daemon osd.1 on smithi110 2024-09-16T02:10:05.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:05 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:05.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:05 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:05.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:05 smithi165 ceph-mon[77258]: Reconfiguring osd.1 (monmap changed)... 2024-09-16T02:10:05.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:05 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T02:10:05.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:05 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:05.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:05 smithi165 ceph-mon[77258]: Reconfiguring daemon osd.1 on smithi110 2024-09-16T02:10:06.352 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:06 smithi110 ceph-mon[98215]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:06.352 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:06.352 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:06.352 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T02:10:06.352 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:06 smithi165 ceph-mon[77258]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T02:10:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:07 smithi110 ceph-mon[98215]: Reconfiguring osd.2 (monmap changed)... 2024-09-16T02:10:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:07 smithi110 ceph-mon[98215]: Reconfiguring daemon osd.2 on smithi110 2024-09-16T02:10:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:07.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:07 smithi165 ceph-mon[77258]: Reconfiguring osd.2 (monmap changed)... 2024-09-16T02:10:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:07 smithi165 ceph-mon[77258]: Reconfiguring daemon osd.2 on smithi110 2024-09-16T02:10:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:08.505 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:08 smithi110 ceph-mon[98215]: Reconfiguring mds.cephfs.smithi110.yaugxw (monmap changed)... 2024-09-16T02:10:08.505 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:08 smithi110 ceph-mon[98215]: Reconfiguring daemon mds.cephfs.smithi110.yaugxw on smithi110 2024-09-16T02:10:08.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:08 smithi110 ceph-mon[98215]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:08.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:08 smithi165 ceph-mon[77258]: Reconfiguring mds.cephfs.smithi110.yaugxw (monmap changed)... 2024-09-16T02:10:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:08 smithi165 ceph-mon[77258]: Reconfiguring daemon mds.cephfs.smithi110.yaugxw on smithi110 2024-09-16T02:10:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:08 smithi165 ceph-mon[77258]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:08.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: Reconfiguring mds.cephfs.smithi110.svegdg (monmap changed)... 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: Reconfiguring daemon mds.cephfs.smithi110.svegdg on smithi110 2024-09-16T02:10:09.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:09 smithi110 ceph-mon[98215]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: Reconfiguring mds.cephfs.smithi110.svegdg (monmap changed)... 2024-09-16T02:10:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:09.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:09.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: Reconfiguring daemon mds.cephfs.smithi110.svegdg on smithi110 2024-09-16T02:10:09.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:09 smithi165 ceph-mon[77258]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:11.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:10 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:11.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:10 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:11.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:10 smithi165 ceph-mon[77258]: Reconfiguring crash.smithi165 (monmap changed)... 2024-09-16T02:10:11.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:10 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:11.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:10 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:11.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:10 smithi165 ceph-mon[77258]: Reconfiguring daemon crash.smithi165 on smithi165 2024-09-16T02:10:11.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:10 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:11.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:10 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:11.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:10 smithi110 ceph-mon[98215]: Reconfiguring crash.smithi165 (monmap changed)... 2024-09-16T02:10:11.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:10 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:11.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:10 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:11.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:10 smithi110 ceph-mon[98215]: Reconfiguring daemon crash.smithi165 on smithi165 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: Reconfiguring mgr.smithi165.afwhot (monmap changed)... 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:12.660 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:12 smithi165 ceph-mon[77258]: Reconfiguring daemon mgr.smithi165.afwhot on smithi165 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: Reconfiguring mgr.smithi165.afwhot (monmap changed)... 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.afwhot", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T02:10:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:12.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:12 smithi110 ceph-mon[98215]: Reconfiguring daemon mgr.smithi165.afwhot on smithi165 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: Reconfiguring mon.smithi165 (monmap changed)... 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:13.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: Reconfiguring daemon mon.smithi165 on smithi165 2024-09-16T02:10:13.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:13 smithi110 ceph-mon[98215]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: Reconfiguring mon.smithi165 (monmap changed)... 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: Reconfiguring daemon mon.smithi165 on smithi165 2024-09-16T02:10:14.092 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:13 smithi165 ceph-mon[77258]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:15.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:15 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:15.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:15 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:15.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:15 smithi165 ceph-mon[77258]: Reconfiguring osd.3 (monmap changed)... 2024-09-16T02:10:15.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:15 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T02:10:15.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:15 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:15.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:15 smithi165 ceph-mon[77258]: Reconfiguring daemon osd.3 on smithi165 2024-09-16T02:10:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:15 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:15 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:15 smithi110 ceph-mon[98215]: Reconfiguring osd.3 (monmap changed)... 2024-09-16T02:10:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:15 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T02:10:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:15 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:15.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:15 smithi110 ceph-mon[98215]: Reconfiguring daemon osd.3 on smithi165 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: Reconfiguring osd.4 (monmap changed)... 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:16 smithi165 ceph-mon[77258]: Reconfiguring daemon osd.4 on smithi165 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: Reconfiguring osd.4 (monmap changed)... 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:16.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:16 smithi110 ceph-mon[98215]: Reconfiguring daemon osd.4 on smithi165 2024-09-16T02:10:18.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:18.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:18.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: Reconfiguring osd.5 (monmap changed)... 2024-09-16T02:10:18.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T02:10:18.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:18.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: Reconfiguring daemon osd.5 on smithi165 2024-09-16T02:10:18.154 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:17 smithi165 ceph-mon[77258]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: Reconfiguring osd.5 (monmap changed)... 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: Reconfiguring daemon osd.5 on smithi165 2024-09-16T02:10:18.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:17 smithi110 ceph-mon[98215]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:19.526 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:19 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:19.526 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:19 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:19.526 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:19 smithi165 ceph-mon[77258]: Reconfiguring mds.cephfs.smithi165.hskfht (monmap changed)... 2024-09-16T02:10:19.527 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:19 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:19.527 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:19 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:19.527 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:19 smithi165 ceph-mon[77258]: Reconfiguring daemon mds.cephfs.smithi165.hskfht on smithi165 2024-09-16T02:10:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:19 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:19 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:19 smithi110 ceph-mon[98215]: Reconfiguring mds.cephfs.smithi165.hskfht (monmap changed)... 2024-09-16T02:10:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:19 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:19 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:19 smithi110 ceph-mon[98215]: Reconfiguring daemon mds.cephfs.smithi165.hskfht on smithi165 2024-09-16T02:10:20.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:20 smithi110 ceph-mon[98215]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:20.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:20 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:20.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:20 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:20.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:20 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:20.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:20 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:20.623 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:20 smithi165 ceph-mon[77258]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:20.623 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:20 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:20.624 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:20 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:20.624 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:20 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:10:20.624 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:20 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: Reconfiguring mds.cephfs.smithi165.gxrypw (monmap changed)... 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: Reconfiguring daemon mds.cephfs.smithi165.gxrypw on smithi165 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]: dispatch 2024-09-16T02:10:21.523 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]': finished 2024-09-16T02:10:21.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"}]: dispatch 2024-09-16T02:10:21.524 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:21 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"}]': finished 2024-09-16T02:10:21.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: Reconfiguring mds.cephfs.smithi165.gxrypw (monmap changed)... 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: Reconfiguring daemon mds.cephfs.smithi165.gxrypw on smithi165 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]: dispatch 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi110"}]': finished 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"}]: dispatch 2024-09-16T02:10:21.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:21 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"}]': finished 2024-09-16T02:10:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:22 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all mon 2024-09-16T02:10:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:22 smithi165 ceph-mon[77258]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:22 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all mon 2024-09-16T02:10:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:22 smithi110 ceph-mon[98215]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:23.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:23.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:23 smithi110 ceph-mon[98215]: Upgrade: Updating crash.smithi110 (1/2) 2024-09-16T02:10:23.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:23.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:23.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:23.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:23 smithi110 ceph-mon[98215]: Deploying daemon crash.smithi110 on smithi110 2024-09-16T02:10:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:23 smithi165 ceph-mon[77258]: Upgrade: Updating crash.smithi110 (1/2) 2024-09-16T02:10:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:23.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi110", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:23.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:23.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:23 smithi165 ceph-mon[77258]: Deploying daemon crash.smithi110 on smithi110 2024-09-16T02:10:24.332 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:24 smithi110 ceph-mon[98215]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:24.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:24 smithi165 ceph-mon[77258]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:26.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:26 smithi165 ceph-mon[77258]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:26.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:26.538 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:26 smithi110 ceph-mon[98215]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:28.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:28 smithi110 ceph-mon[98215]: Upgrade: Updating crash.smithi165 (2/2) 2024-09-16T02:10:28.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:28 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:28.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:28 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:28.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:28 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:28.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:28 smithi110 ceph-mon[98215]: Deploying daemon crash.smithi165 on smithi165 2024-09-16T02:10:28.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:28 smithi110 ceph-mon[98215]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:28.404 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:28 smithi165 ceph-mon[77258]: Upgrade: Updating crash.smithi165 (2/2) 2024-09-16T02:10:28.404 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:28 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:28.404 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:28 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T02:10:28.404 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:28 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:28.404 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:28 smithi165 ceph-mon[77258]: Deploying daemon crash.smithi165 on smithi165 2024-09-16T02:10:28.404 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:28 smithi165 ceph-mon[77258]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:28.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 -- 172.21.15.110:0/1343831757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f60064fc0 msgr2=0x7f8f60065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:28.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 --2- 172.21.15.110:0/1343831757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f60064fc0 0x7f8f60065430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f540048d0 tx=0x7f8f54009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 -- 172.21.15.110:0/1343831757 shutdown_connections 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 --2- 172.21.15.110:0/1343831757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f60064fc0 0x7f8f60065430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 --2- 172.21.15.110:0/1343831757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f600fe460 0x7f8f600fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 -- 172.21.15.110:0/1343831757 >> 172.21.15.110:0/1343831757 conn(0x7f8f600723b0 msgr2=0x7f8f600727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 -- 172.21.15.110:0/1343831757 shutdown_connections 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 -- 172.21.15.110:0/1343831757 wait complete. 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 Processor -- start 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.765+0000 7f8f66535640 1 -- start start 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f66535640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f60064fc0 0x7f8f601131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f66535640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 0x7f8f60113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f66535640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60113d10 con 0x7f8f600fe460 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f66535640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6010d1a0 con 0x7f8f60064fc0 2024-09-16T02:10:28.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 0x7f8f60113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 0x7f8f60113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39890/0 (socket says 172.21.15.110:39890) 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 -- 172.21.15.110:0/885287375 learned_addr learned my addr 172.21.15.110:0/885287375 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5ffff640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f60064fc0 0x7f8f601131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 -- 172.21.15.110:0/885287375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f60064fc0 msgr2=0x7f8f601131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f60064fc0 0x7f8f601131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 -- 172.21.15.110:0/885287375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54005040 con 0x7f8f600fe460 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5f7fe640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 0x7f8f60113710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000c00 tx=0x7f8f54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f54038070 con 0x7f8f600fe460 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f5402ade0 con 0x7f8f600fe460 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.766+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6010d420 con 0x7f8f600fe460 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.767+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f5402c7b0 con 0x7f8f600fe460 2024-09-16T02:10:28.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.767+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6010d960 con 0x7f8f600fe460 2024-09-16T02:10:28.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.768+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8f54030020 con 0x7f8f600fe460 2024-09-16T02:10:28.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.768+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f600fdcf0 con 0x7f8f600fe460 2024-09-16T02:10:28.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.769+0000 7f8f5cff9640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f8f4806e660 0x7f8f48070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:28.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.769+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f8f540ae540 con 0x7f8f600fe460 2024-09-16T02:10:28.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.769+0000 7f8f5ffff640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f8f4806e660 0x7f8f48070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:28.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.769+0000 7f8f5ffff640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f8f4806e660 0x7f8f48070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009af0 tx=0x7f8f5000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:28.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.773+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f540776a0 con 0x7f8f600fe460 2024-09-16T02:10:28.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.990+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f6010e840 con 0x7f8f4806e660 2024-09-16T02:10:28.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.991+0000 7f8f5cff9640 1 -- 172.21.15.110:0/885287375 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f8f6010e840 con 0x7f8f4806e660 2024-09-16T02:10:28.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.993+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f8f4806e660 msgr2=0x7f8f48070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:28.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.993+0000 7f8f66535640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f8f4806e660 0x7f8f48070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009af0 tx=0x7f8f5000b040 comp rx=0 tx=0).stop 2024-09-16T02:10:28.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.993+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 msgr2=0x7f8f60113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:28.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.993+0000 7f8f66535640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 0x7f8f60113710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000c00 tx=0x7f8f54009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 shutdown_connections 2024-09-16T02:10:28.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f8f4806e660 0x7f8f48070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f600fe460 0x7f8f60113710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 --2- 172.21.15.110:0/885287375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f60064fc0 0x7f8f601131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:28.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 >> 172.21.15.110:0/885287375 conn(0x7f8f600723b0 msgr2=0x7f8f601053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:28.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 shutdown_connections 2024-09-16T02:10:28.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:28.994+0000 7f8f66535640 1 -- 172.21.15.110:0/885287375 wait complete. 2024-09-16T02:10:29.004 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:10:29.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 -- 172.21.15.110:0/642191098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 msgr2=0x7f37100fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 --2- 172.21.15.110:0/642191098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f37100fc590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37000048d0 tx=0x7f3700009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 -- 172.21.15.110:0/642191098 shutdown_connections 2024-09-16T02:10:29.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 --2- 172.21.15.110:0/642191098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f37100fc590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 --2- 172.21.15.110:0/642191098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 0x7f3710102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 -- 172.21.15.110:0/642191098 >> 172.21.15.110:0/642191098 conn(0x7f37100f80f0 msgr2=0x7f37100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 -- 172.21.15.110:0/642191098 shutdown_connections 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.074+0000 7f3717c0f640 1 -- 172.21.15.110:0/642191098 wait complete. 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f3717c0f640 1 Processor -- start 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f3717c0f640 1 -- start start 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f3717c0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 0x7f37101131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f3717c0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f3710113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f3717c0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710113d30 con 0x7f3710102ed0 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f3717c0f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371010d170 con 0x7f3710102530 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37151aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f3710113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37151aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f3710113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39912/0 (socket says 172.21.15.110:39912) 2024-09-16T02:10:29.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37151aa640 1 -- 172.21.15.110:0/1534643924 learned_addr learned my addr 172.21.15.110:0/1534643924 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37159ab640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 0x7f37101131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37151aa640 1 -- 172.21.15.110:0/1534643924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 msgr2=0x7f37101131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37151aa640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 0x7f37101131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37151aa640 1 -- 172.21.15.110:0/1534643924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700005040 con 0x7f3710102ed0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.075+0000 7f37159ab640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 0x7f37101131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.076+0000 7f37151aa640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f3710113730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37000043d0 tx=0x7f3700009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.076+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3700038070 con 0x7f3710102ed0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.076+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f37000096e0 con 0x7f3710102ed0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.076+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371010d3f0 con 0x7f3710102ed0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.076+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f370002c8a0 con 0x7f3710102ed0 2024-09-16T02:10:29.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.076+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371010d930 con 0x7f3710102ed0 2024-09-16T02:10:29.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.077+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37100fdcb0 con 0x7f3710102ed0 2024-09-16T02:10:29.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.078+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3700030020 con 0x7f3710102ed0 2024-09-16T02:10:29.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.078+0000 7f37067fc640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f36fc06e660 0x7f36fc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.079+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f37000ae350 con 0x7f3710102ed0 2024-09-16T02:10:29.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.079+0000 7f37159ab640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f36fc06e660 0x7f36fc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.079+0000 7f37159ab640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f36fc06e660 0x7f36fc070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f370c004d80 tx=0x7f370c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.082+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3700077570 con 0x7f3710102ed0 2024-09-16T02:10:29.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.280+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3710109560 con 0x7f36fc06e660 2024-09-16T02:10:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.282+0000 7f37067fc640 1 -- 172.21.15.110:0/1534643924 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f3710109560 con 0x7f36fc06e660 2024-09-16T02:10:29.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f36fc06e660 msgr2=0x7f36fc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f36fc06e660 0x7f36fc070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f370c004d80 tx=0x7f370c00b040 comp rx=0 tx=0).stop 2024-09-16T02:10:29.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 msgr2=0x7f3710113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f3710113730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37000043d0 tx=0x7f3700009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 shutdown_connections 2024-09-16T02:10:29.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f36fc06e660 0x7f36fc070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3710102ed0 0x7f3710113730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 --2- 172.21.15.110:0/1534643924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3710102530 0x7f37101131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 >> 172.21.15.110:0/1534643924 conn(0x7f37100f80f0 msgr2=0x7f37100f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 shutdown_connections 2024-09-16T02:10:29.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.284+0000 7f3717c0f640 1 -- 172.21.15.110:0/1534643924 wait complete. 2024-09-16T02:10:29.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 -- 172.21.15.110:0/1909912087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065c10 msgr2=0x7fcf140fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 --2- 172.21.15.110:0/1909912087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065c10 0x7fcf140fe0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf100048d0 tx=0x7fcf10009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 -- 172.21.15.110:0/1909912087 shutdown_connections 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 --2- 172.21.15.110:0/1909912087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065c10 0x7fcf140fe0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 --2- 172.21.15.110:0/1909912087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf14065300 0x7fcf140656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 -- 172.21.15.110:0/1909912087 >> 172.21.15.110:0/1909912087 conn(0x7fcf140723b0 msgr2=0x7fcf140727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 -- 172.21.15.110:0/1909912087 shutdown_connections 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 -- 172.21.15.110:0/1909912087 wait complete. 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.363+0000 7fcf1c653640 1 Processor -- start 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1c653640 1 -- start start 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1c653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 0x7fcf141131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1c653640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf14065c10 0x7fcf14113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1c653640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14113d10 con 0x7fcf14065300 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1c653640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1410d150 con 0x7fcf14065c10 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 0x7fcf141131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 0x7fcf141131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39934/0 (socket says 172.21.15.110:39934) 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 -- 172.21.15.110:0/3377102894 learned_addr learned my addr 172.21.15.110:0/3377102894 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 -- 172.21.15.110:0/3377102894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf14065c10 msgr2=0x7fcf14113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf14065c10 0x7fcf14113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 -- 172.21.15.110:0/3377102894 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10005040 con 0x7fcf14065300 2024-09-16T02:10:29.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf1a3ef640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 0x7fcf141131d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf08002a80 tx=0x7fcf08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.364+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf08007c30 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.365+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf0800f040 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.365+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1410d430 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.365+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf08009530 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.365+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1410d950 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.366+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf140fdce0 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.366+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fcf080096b0 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.366+0000 7fcf06ffd640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcf0006e660 0x7fcf00070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.367+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fcf0808dc20 con 0x7fcf14065300 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.367+0000 7fcf19bee640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcf0006e660 0x7fcf00070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.367+0000 7fcf19bee640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcf0006e660 0x7fcf00070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf1002a530 tx=0x7fcf10009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.371+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf08056c70 con 0x7fcf14065300 2024-09-16T02:10:29.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.543+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf1404b720 con 0x7fcf0006e660 2024-09-16T02:10:29.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.552+0000 7fcf06ffd640 1 -- 172.21.15.110:0/3377102894 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcf1404b720 con 0x7fcf0006e660 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (4m) 47s ago 12m 25.9M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 starting - - - - 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (11m) 35s ago 11m 6903k - 17.2.7-1633-g6d025bc2 33ed8dba3996 20385be54b96 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (2m) 47s ago 12m 74.7M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (7m) 47s ago 7m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (7m) 47s ago 7m 155M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (7m) 35s ago 7m 16.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (7m) 35s ago 7m 13.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (3m) 47s ago 13m 472M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:10:29.554 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (2m) 35s ago 11m 438M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (60s) 47s ago 13m 27.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (38s) 35s ago 11m 20.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (4m) 47s ago 12m 17.8M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (3m) 35s ago 11m 16.3M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (10m) 47s ago 10m 212M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 0a11c20db012 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (10m) 47s ago 10m 219M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (9m) 47s ago 9m 183M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (9m) 35s ago 9m 241M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (9m) 35s ago 9m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (8m) 35s ago 8m 195M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:10:29.555 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (2m) 47s ago 12m 58.9M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:10:29.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcf0006e660 msgr2=0x7fcf00070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcf0006e660 0x7fcf00070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf1002a530 tx=0x7fcf10009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 msgr2=0x7fcf141131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 0x7fcf141131d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf08002a80 tx=0x7fcf08004600 comp rx=0 tx=0).stop 2024-09-16T02:10:29.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 shutdown_connections 2024-09-16T02:10:29.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcf0006e660 0x7fcf00070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf14065c10 0x7fcf14113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 --2- 172.21.15.110:0/3377102894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14065300 0x7fcf141131d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 >> 172.21.15.110:0/3377102894 conn(0x7fcf140723b0 msgr2=0x7fcf140fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.554+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 shutdown_connections 2024-09-16T02:10:29.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.555+0000 7fcf1c653640 1 -- 172.21.15.110:0/3377102894 wait complete. 2024-09-16T02:10:29.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 -- 172.21.15.110:0/3046582866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 msgr2=0x7ff6300fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 --2- 172.21.15.110:0/3046582866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff6300fb910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6240048d0 tx=0x7ff624009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 -- 172.21.15.110:0/3046582866 shutdown_connections 2024-09-16T02:10:29.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 --2- 172.21.15.110:0/3046582866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff6300fb910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 --2- 172.21.15.110:0/3046582866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6301014e0 0x7ff6301018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 -- 172.21.15.110:0/3046582866 >> 172.21.15.110:0/3046582866 conn(0x7ff6300f7060 msgr2=0x7ff6300f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 -- 172.21.15.110:0/3046582866 shutdown_connections 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.631+0000 7ff636970640 1 -- 172.21.15.110:0/3046582866 wait complete. 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff636970640 1 Processor -- start 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff636970640 1 -- start start 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff636970640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff63010cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff636970640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6301014e0 0x7ff63010b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff636970640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63010d5e0 con 0x7ff6300fb4a0 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff636970640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63010d750 con 0x7ff6301014e0 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff62ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff63010cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff62ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff63010cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39948/0 (socket says 172.21.15.110:39948) 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff62ffff640 1 -- 172.21.15.110:0/2223454009 learned_addr learned my addr 172.21.15.110:0/2223454009 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.632+0000 7ff62f7fe640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6301014e0 0x7ff63010b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62ffff640 1 -- 172.21.15.110:0/2223454009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6301014e0 msgr2=0x7ff63010b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62ffff640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6301014e0 0x7ff63010b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62ffff640 1 -- 172.21.15.110:0/2223454009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624005040 con 0x7ff6300fb4a0 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62ffff640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff63010cfe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff620002a80 tx=0x7ff620004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff620007c30 con 0x7ff6300fb4a0 2024-09-16T02:10:29.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63010b660 con 0x7ff6300fb4a0 2024-09-16T02:10:29.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff62000f040 con 0x7ff6300fb4a0 2024-09-16T02:10:29.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63010bb50 con 0x7ff6300fb4a0 2024-09-16T02:10:29.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.633+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62000dab0 con 0x7ff6300fb4a0 2024-09-16T02:10:29.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.634+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6300fcbe0 con 0x7ff6300fb4a0 2024-09-16T02:10:29.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.634+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff62000dc10 con 0x7ff6300fb4a0 2024-09-16T02:10:29.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.635+0000 7ff62cff9640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff61806e660 0x7ff618070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.635+0000 7ff62f7fe640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff61806e660 0x7ff618070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.635+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7ff62008db60 con 0x7ff6300fb4a0 2024-09-16T02:10:29.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.635+0000 7ff62f7fe640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff61806e660 0x7ff618070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff624009ac0 tx=0x7ff624035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.639+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff620056be0 con 0x7ff6300fb4a0 2024-09-16T02:10:29.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.871+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff63010bdc0 con 0x7ff6300fb4a0 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.871+0000 7ff62cff9640 1 -- 172.21.15.110:0/2223454009 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7ff62005a2a0 con 0x7ff6300fb4a0 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:10:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 10, 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:10:29.874 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:10:29.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff61806e660 msgr2=0x7ff618070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff61806e660 0x7ff618070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff624009ac0 tx=0x7ff624035040 comp rx=0 tx=0).stop 2024-09-16T02:10:29.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 msgr2=0x7ff63010cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff63010cfe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff620002a80 tx=0x7ff620004600 comp rx=0 tx=0).stop 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 shutdown_connections 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff61806e660 0x7ff618070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6301014e0 0x7ff63010b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 --2- 172.21.15.110:0/2223454009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6300fb4a0 0x7ff63010cfe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 >> 172.21.15.110:0/2223454009 conn(0x7ff6300f7060 msgr2=0x7ff6300f7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.873+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 shutdown_connections 2024-09-16T02:10:29.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.874+0000 7ff636970640 1 -- 172.21.15.110:0/2223454009 wait complete. 2024-09-16T02:10:29.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 -- 172.21.15.110:0/597384093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af00fac80 msgr2=0x7f7af00fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/597384093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af00fac80 0x7f7af00fb0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0048d0 tx=0x7f7adc009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 -- 172.21.15.110:0/597384093 shutdown_connections 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/597384093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af00fac80 0x7f7af00fb0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/597384093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7af0102620 0x7f7af01029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 -- 172.21.15.110:0/597384093 >> 172.21.15.110:0/597384093 conn(0x7f7af0070ce0 msgr2=0x7f7af00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 -- 172.21.15.110:0/597384093 shutdown_connections 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.951+0000 7f7af6b7c640 1 -- 172.21.15.110:0/597384093 wait complete. 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af6b7c640 1 Processor -- start 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af6b7c640 1 -- start start 2024-09-16T02:10:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af6b7c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7af00fac80 0x7f7af01153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af6b7c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 0x7f7af01158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af6b7c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0115ee0 con 0x7f7af0102620 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af6b7c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0116050 con 0x7f7af00fac80 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7aeffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 0x7f7af01158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7aeffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 0x7f7af01158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39960/0 (socket says 172.21.15.110:39960) 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7aeffff640 1 -- 172.21.15.110:0/3942887148 learned_addr learned my addr 172.21.15.110:0/3942887148 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7af4918640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7af00fac80 0x7f7af01153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7aeffff640 1 -- 172.21.15.110:0/3942887148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7af00fac80 msgr2=0x7f7af01153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7aeffff640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7af00fac80 0x7f7af01153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:29.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.952+0000 7f7aeffff640 1 -- 172.21.15.110:0/3942887148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc005040 con 0x7f7af0102620 2024-09-16T02:10:29.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.953+0000 7f7aeffff640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 0x7f7af01158e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0043d0 tx=0x7f7adc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.953+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7adc038070 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.953+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af010f470 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.953+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7adc0096e0 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.953+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7adc03d420 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.953+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af010fa10 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.954+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af0065790 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.954+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7adc030020 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.955+0000 7f7aed7fa640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f7ae006e660 0x7f7ae0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.955+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f7adc0ae6b0 con 0x7f7af0102620 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.955+0000 7f7af4918640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f7ae006e660 0x7f7ae0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:29.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.955+0000 7f7af4918640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f7ae006e660 0x7f7ae0070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7af00652b0 tx=0x7f7ae400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:29.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:29.959+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7adc077790 con 0x7f7af0102620 2024-09-16T02:10:30.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.165+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7af0074c00 con 0x7f7af0102620 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.165+0000 7f7aed7fa640 1 -- 172.21.15.110:0/3942887148 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7f7adc07ae50 con 0x7f7af0102620 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:10:30.167 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:10:30.168 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:10:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:10:30.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f7ae006e660 msgr2=0x7f7ae0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f7ae006e660 0x7f7ae0070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7af00652b0 tx=0x7f7ae400b040 comp rx=0 tx=0).stop 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 msgr2=0x7f7af01158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 0x7f7af01158e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0043d0 tx=0x7f7adc009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 shutdown_connections 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f7ae006e660 0x7f7ae0070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0102620 0x7f7af01158e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 --2- 172.21.15.110:0/3942887148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7af00fac80 0x7f7af01153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 >> 172.21.15.110:0/3942887148 conn(0x7f7af0070ce0 msgr2=0x7f7af00f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 shutdown_connections 2024-09-16T02:10:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.168+0000 7f7af6b7c640 1 -- 172.21.15.110:0/3942887148 wait complete. 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.248+0000 7fd06c52e640 1 -- 172.21.15.110:0/2525757668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102f00 msgr2=0x7fd0640fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.248+0000 7fd06c52e640 1 --2- 172.21.15.110:0/2525757668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102f00 0x7fd0640fc5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0580048d0 tx=0x7fd058009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.248+0000 7fd06c52e640 1 -- 172.21.15.110:0/2525757668 shutdown_connections 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.248+0000 7fd06c52e640 1 --2- 172.21.15.110:0/2525757668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102f00 0x7fd0640fc5c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.248+0000 7fd06c52e640 1 --2- 172.21.15.110:0/2525757668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd064102560 0x7fd064102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.248+0000 7fd06c52e640 1 -- 172.21.15.110:0/2525757668 >> 172.21.15.110:0/2525757668 conn(0x7fd0640f8120 msgr2=0x7fd0640fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 -- 172.21.15.110:0/2525757668 shutdown_connections 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 -- 172.21.15.110:0/2525757668 wait complete. 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 Processor -- start 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 -- start start 2024-09-16T02:10:30.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 0x7fd0641131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd064102f00 0x7fd064113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd064113d20 con 0x7fd064102560 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.249+0000 7fd06c52e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06410d160 con 0x7fd064102f00 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 0x7fd0641131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 0x7fd0641131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39982/0 (socket says 172.21.15.110:39982) 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 -- 172.21.15.110:0/486358897 learned_addr learned my addr 172.21.15.110:0/486358897 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd069ac9640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd064102f00 0x7fd064113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 -- 172.21.15.110:0/486358897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd064102f00 msgr2=0x7fd064113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd064102f00 0x7fd064113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 -- 172.21.15.110:0/486358897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058005040 con 0x7fd064102560 2024-09-16T02:10:30.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06a2ca640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 0x7fd0641131e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd05400db80 tx=0x7fd054004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:30.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05400b8d0 con 0x7fd064102560 2024-09-16T02:10:30.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd05400f040 con 0x7fd064102560 2024-09-16T02:10:30.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06410d440 con 0x7fd064102560 2024-09-16T02:10:30.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd054012390 con 0x7fd064102560 2024-09-16T02:10:30.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.250+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06410d930 con 0x7fd064102560 2024-09-16T02:10:30.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.251+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0640fdce0 con 0x7fd064102560 2024-09-16T02:10:30.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.252+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd05400ba30 con 0x7fd064102560 2024-09-16T02:10:30.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.252+0000 7fd062ffd640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd04c06e660 0x7fd04c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:30.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.252+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fd05408e1e0 con 0x7fd064102560 2024-09-16T02:10:30.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.252+0000 7fd069ac9640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd04c06e660 0x7fd04c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:30.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.253+0000 7fd069ac9640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd04c06e660 0x7fd04c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0580048a0 tx=0x7fd058035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:30.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.257+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd0540571b0 con 0x7fd064102560 2024-09-16T02:10:30.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.446+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd06404b720 con 0x7fd04c06e660 2024-09-16T02:10:30.447 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:30 smithi110 ceph-mon[98215]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:30.447 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:30 smithi110 ceph-mon[98215]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:30.448 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:30 smithi110 ceph-mon[98215]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:30.448 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:30 smithi110 ceph-mon[98215]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:30.448 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:30 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2223454009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:30.448 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:30 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3942887148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:10:30.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.447+0000 7fd062ffd640 1 -- 172.21.15.110:0/486358897 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fd06404b720 con 0x7fd04c06e660 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "4/21 daemons upgraded", 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading crash daemons", 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:10:30.449 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd04c06e660 msgr2=0x7fd04c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd04c06e660 0x7fd04c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0580048a0 tx=0x7fd058035040 comp rx=0 tx=0).stop 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 msgr2=0x7fd0641131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 0x7fd0641131e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd05400db80 tx=0x7fd054004f00 comp rx=0 tx=0).stop 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 shutdown_connections 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd04c06e660 0x7fd04c070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd064102f00 0x7fd064113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 --2- 172.21.15.110:0/486358897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd064102560 0x7fd0641131e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.449+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 >> 172.21.15.110:0/486358897 conn(0x7fd0640f8120 msgr2=0x7fd0640f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.450+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 shutdown_connections 2024-09-16T02:10:30.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.450+0000 7fd06c52e640 1 -- 172.21.15.110:0/486358897 wait complete. 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 -- 172.21.15.110:0/1255949426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fb810 msgr2=0x7f29f00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 --2- 172.21.15.110:0/1255949426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fb810 0x7f29f00fbbe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29e00048d0 tx=0x7f29e0009da0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 -- 172.21.15.110:0/1255949426 shutdown_connections 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 --2- 172.21.15.110:0/1255949426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29f00fcf80 0x7f29f00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 --2- 172.21.15.110:0/1255949426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fb810 0x7f29f00fbbe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 -- 172.21.15.110:0/1255949426 >> 172.21.15.110:0/1255949426 conn(0x7f29f00723b0 msgr2=0x7f29f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:30.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 -- 172.21.15.110:0/1255949426 shutdown_connections 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 -- 172.21.15.110:0/1255949426 wait complete. 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.530+0000 7f29f6997640 1 Processor -- start 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29f6997640 1 -- start start 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29f6997640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29f00fb810 0x7f29f01131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29f6997640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 0x7f29f0113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29f6997640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0113d20 con 0x7f29f00fcf80 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29f6997640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f010d1b0 con 0x7f29f00fb810 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 0x7f29f0113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 0x7f29f0113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47196/0 (socket says 172.21.15.110:47196) 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 -- 172.21.15.110:0/1869444343 learned_addr learned my addr 172.21.15.110:0/1869444343 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:10:30.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29effff640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29f00fb810 0x7f29f01131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 -- 172.21.15.110:0/1869444343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29f00fb810 msgr2=0x7f29f01131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29f00fb810 0x7f29f01131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 -- 172.21.15.110:0/1869444343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0005040 con 0x7f29f00fcf80 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ef7fe640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 0x7f29f0113720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29e4002a50 tx=0x7f29e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.531+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e4007c30 con 0x7f29f00fcf80 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.532+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f010d490 con 0x7f29f00fcf80 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.532+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29e400f040 con 0x7f29f00fcf80 2024-09-16T02:10:30.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.532+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e400da10 con 0x7f29f00fcf80 2024-09-16T02:10:30.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.532+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f010da30 con 0x7f29f00fcf80 2024-09-16T02:10:30.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.533+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f00fcbc0 con 0x7f29f00fcf80 2024-09-16T02:10:30.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.534+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f29e400dc80 con 0x7f29f00fcf80 2024-09-16T02:10:30.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.534+0000 7f29ecff9640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f29d806e660 0x7f29d8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:10:30.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.534+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f29e408dab0 con 0x7f29f00fcf80 2024-09-16T02:10:30.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.534+0000 7f29effff640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f29d806e660 0x7f29d8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:10:30.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.535+0000 7f29effff640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f29d806e660 0x7f29d8070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009ac0 tx=0x7f29e0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:10:30.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.539+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29e4056b30 con 0x7f29f00fcf80 2024-09-16T02:10:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:30 smithi165 ceph-mon[77258]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:30 smithi165 ceph-mon[77258]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:30.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:30 smithi165 ceph-mon[77258]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:30.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:30 smithi165 ceph-mon[77258]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:30.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:30 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2223454009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:30.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:30 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3942887148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:10:30.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.806+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f29f010e880 con 0x7f29f00fcf80 2024-09-16T02:10:30.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.807+0000 7f29ecff9640 1 -- 172.21.15.110:0/1869444343 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f29e405a1f0 con 0x7f29f00fcf80 2024-09-16T02:10:30.808 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:10:30.808 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:10:30.809 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:10:30.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f29d806e660 msgr2=0x7f29d8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f29d806e660 0x7f29d8070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009ac0 tx=0x7f29e0035040 comp rx=0 tx=0).stop 2024-09-16T02:10:30.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 msgr2=0x7f29f0113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:10:30.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 0x7f29f0113720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29e4002a50 tx=0x7f29e4004600 comp rx=0 tx=0).stop 2024-09-16T02:10:30.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 shutdown_connections 2024-09-16T02:10:30.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f29d806e660 0x7f29d8070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29f00fcf80 0x7f29f0113720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 --2- 172.21.15.110:0/1869444343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29f00fb810 0x7f29f01131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:10:30.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 >> 172.21.15.110:0/1869444343 conn(0x7f29f00723b0 msgr2=0x7f29f00fa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:10:30.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 shutdown_connections 2024-09-16T02:10:30.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:10:30.809+0000 7f29f6997640 1 -- 172.21.15.110:0/1869444343 wait complete. 2024-09-16T02:10:31.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:31.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:31.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:31.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:31 smithi110 ceph-mon[98215]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:31.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:31 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1869444343' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:10:31.651 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:31.651 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:31.652 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:31.652 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:31 smithi165 ceph-mon[77258]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:10:31.652 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:31 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1869444343' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:10:32.681 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:32 smithi110 ceph-mon[98215]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:32.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:32 smithi165 ceph-mon[77258]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:34.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:34 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:34 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:34 smithi110 ceph-mon[98215]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:34.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:34 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:34 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.442 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:34 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.442 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:34 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.442 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:34 smithi165 ceph-mon[77258]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:34.442 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:34 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:34.442 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:34 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:36 smithi165 ceph-mon[77258]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:36.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.539 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.539 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.539 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:36 smithi110 ceph-mon[98215]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:36.540 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:36.540 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:37.871 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:37.871 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:37.871 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:37 smithi110 ceph-mon[98215]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:37.872 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:37 smithi165 ceph-mon[77258]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:38.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:40.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all crash 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]': finished 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"}]: dispatch 2024-09-16T02:10:40.208 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"}]': finished 2024-09-16T02:10:40.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T02:10:40.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T02:10:40.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: Upgrade: osd.0 is safe to restart 2024-09-16T02:10:40.209 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:40 smithi110 ceph-mon[98215]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:40.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all crash 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi110"}]': finished 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"}]: dispatch 2024-09-16T02:10:40.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"}]': finished 2024-09-16T02:10:40.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T02:10:40.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T02:10:40.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: Upgrade: osd.0 is safe to restart 2024-09-16T02:10:40.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:40 smithi165 ceph-mon[77258]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:41.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:41 smithi165 ceph-mon[77258]: Upgrade: Updating osd.0 2024-09-16T02:10:41.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:41 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:41.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:41 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T02:10:41.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:41 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:41.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:41 smithi165 ceph-mon[77258]: Deploying daemon osd.0 on smithi110 2024-09-16T02:10:41.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:41 smithi165 ceph-mon[77258]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:41 smithi110 ceph-mon[98215]: Upgrade: Updating osd.0 2024-09-16T02:10:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T02:10:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:41 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:41 smithi110 ceph-mon[98215]: Deploying daemon osd.0 on smithi110 2024-09-16T02:10:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:41 smithi110 ceph-mon[98215]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:10:44.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:43 smithi110 systemd[1]: Stopping Ceph osd.0 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:10:44.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:44 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[46313]: 2024-09-16T02:10:44.069+0000 7ff31c9c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:10:44.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:44 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[46313]: 2024-09-16T02:10:44.069+0000 7ff31c9c4640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-16T02:10:44.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:44 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[46313]: 2024-09-16T02:10:44.069+0000 7ff31c9c4640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:10:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:44 smithi165 ceph-mon[77258]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:44 smithi165 ceph-mon[77258]: osd.0 marked itself down and dead 2024-09-16T02:10:44.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:44 smithi110 ceph-mon[98215]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:10:44.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:44 smithi110 ceph-mon[98215]: osd.0 marked itself down and dead 2024-09-16T02:10:45.013 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:44 smithi110 podman[108772]: 2024-09-16 02:10:44.712378691 +0000 UTC m=+0.738476366 container died 0a11c20db012953b1aad7e683bb16293d03418b2c096629211eb47fff3289b31 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-6d025bc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T02:10:45.363 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 podman[108772]: 2024-09-16 02:10:45.111063985 +0000 UTC m=+1.137161656 container cleanup 0a11c20db012953b1aad7e683bb16293d03418b2c096629211eb47fff3289b31 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-6d025bc, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-16T02:10:45.363 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 bash[108772]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0 2024-09-16T02:10:45.683 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 podman[108788]: 2024-09-16 02:10:45.370893663 +0000 UTC m=+0.652371459 container remove 0a11c20db012953b1aad7e683bb16293d03418b2c096629211eb47fff3289b31 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=quincy-6d025bc, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-16T02:10:45.683 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:45 smithi110 ceph-mon[98215]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:10:45.683 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:45 smithi110 ceph-mon[98215]: osdmap e48: 6 total, 5 up, 6 in 2024-09-16T02:10:45.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:45 smithi165 ceph-mon[77258]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:10:45.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:45 smithi165 ceph-mon[77258]: osdmap e48: 6 total, 5 up, 6 in 2024-09-16T02:10:45.942 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 podman[108883]: 2024-09-16 02:10:45.585068974 +0000 UTC m=+0.016248530 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:10:45.942 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 podman[108883]: 2024-09-16 02:10:45.705567317 +0000 UTC m=+0.136746911 container create 253ede5a06f0420188d95a14b97d762e0d245c59270812ee788474ca4fdea53e (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T02:10:45.942 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 podman[108883]: 2024-09-16 02:10:45.941258782 +0000 UTC m=+0.372438330 container init 253ede5a06f0420188d95a14b97d762e0d245c59270812ee788474ca4fdea53e (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T02:10:46.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:45 smithi110 podman[108883]: 2024-09-16 02:10:45.944824574 +0000 UTC m=+0.376004124 container start 253ede5a06f0420188d95a14b97d762e0d245c59270812ee788474ca4fdea53e (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-16T02:10:46.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 podman[108883]: 2024-09-16 02:10:46.032957363 +0000 UTC m=+0.464136923 container attach 253ede5a06f0420188d95a14b97d762e0d245c59270812ee788474ca4fdea53e (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:10:46.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 podman[108883]: 2024-09-16 02:10:46.136930293 +0000 UTC m=+0.568109850 container died 253ede5a06f0420188d95a14b97d762e0d245c59270812ee788474ca4fdea53e (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T02:10:46.696 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:46 smithi110 ceph-mon[98215]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:10:46.696 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:46 smithi110 ceph-mon[98215]: osdmap e49: 6 total, 5 up, 6 in 2024-09-16T02:10:46.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:46 smithi165 ceph-mon[77258]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:10:46.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:46 smithi165 ceph-mon[77258]: osdmap e49: 6 total, 5 up, 6 in 2024-09-16T02:10:46.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 podman[108907]: 2024-09-16 02:10:46.695133108 +0000 UTC m=+0.548907620 container remove 253ede5a06f0420188d95a14b97d762e0d245c59270812ee788474ca4fdea53e (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-16T02:10:46.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-16T02:10:46.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 systemd[1]: Stopped Ceph osd.0 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:10:46.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.0.service: Consumed 49.781s CPU time. 2024-09-16T02:10:46.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:46 smithi110 systemd[1]: Starting Ceph osd.0 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:10:47.457 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 podman[109007]: 2024-09-16 02:10:47.039365579 +0000 UTC m=+0.015896103 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:10:47.457 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 podman[109007]: 2024-09-16 02:10:47.146707011 +0000 UTC m=+0.123237527 container create c53a0f8e2a46153f5941dd0c0740afbc46f27a45f36f5e6ac690a5646517e09f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-16T02:10:47.457 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 podman[109007]: 2024-09-16 02:10:47.382541463 +0000 UTC m=+0.359071978 container init c53a0f8e2a46153f5941dd0c0740afbc46f27a45f36f5e6ac690a5646517e09f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T02:10:47.457 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 podman[109007]: 2024-09-16 02:10:47.386084317 +0000 UTC m=+0.362614839 container start c53a0f8e2a46153f5941dd0c0740afbc46f27a45f36f5e6ac690a5646517e09f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T02:10:47.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 podman[109007]: 2024-09-16 02:10:47.490862606 +0000 UTC m=+0.467393127 container attach c53a0f8e2a46153f5941dd0c0740afbc46f27a45f36f5e6ac690a5646517e09f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-16T02:10:47.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:10:47.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 bash[109007]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:10:47.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:10:47.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:47 smithi110 bash[109007]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:10:48.536 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-mon[98215]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:10:48.536 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T02:10:48.536 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T02:10:48.536 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T02:10:48.536 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T02:10:48.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:48 smithi165 ceph-mon[77258]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:10:48.854 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T02:10:48.854 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T02:10:48.854 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T02:10:48.854 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T02:10:48.854 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-16T02:10:48.855 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-16T02:10:48.855 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T02:10:48.855 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T02:10:48.855 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate[109022]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-16T02:10:48.855 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 bash[109007]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-16T02:10:48.855 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:48 smithi110 podman[109007]: 2024-09-16 02:10:48.563156025 +0000 UTC m=+1.539686557 container died c53a0f8e2a46153f5941dd0c0740afbc46f27a45f36f5e6ac690a5646517e09f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-16T02:10:49.425 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 podman[109168]: 2024-09-16 02:10:49.136245255 +0000 UTC m=+0.567280534 container remove c53a0f8e2a46153f5941dd0c0740afbc46f27a45f36f5e6ac690a5646517e09f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-16T02:10:49.425 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 podman[109226]: 2024-09-16 02:10:49.246059115 +0000 UTC m=+0.016649614 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:10:49.425 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 podman[109226]: 2024-09-16 02:10:49.378922441 +0000 UTC m=+0.149512972 container create 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:10:49.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:49 smithi165 ceph-mon[77258]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-09-16T02:10:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:49 smithi110 ceph-mon[98215]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-09-16T02:10:49.707 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 podman[109226]: 2024-09-16 02:10:49.6486937 +0000 UTC m=+0.419284186 container init 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-16T02:10:49.707 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 podman[109226]: 2024-09-16 02:10:49.651831148 +0000 UTC m=+0.422421634 container start 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-16T02:10:49.707 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 ceph-osd[109244]: -- 172.21.15.110:0/3535630200 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55755b2761e0 con 0x55755b260000 2024-09-16T02:10:50.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 bash[109226]: 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac 2024-09-16T02:10:50.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:49 smithi110 systemd[1]: Started Ceph osd.0 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:10:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:50 smithi165 ceph-mon[77258]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:50 smithi110 ceph-mon[98215]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:51.927 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:51 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[109240]: 2024-09-16T02:10:51.528+0000 7f0d0802c640 -1 Falling back to public interface 2024-09-16T02:10:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:52 smithi165 ceph-mon[77258]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:52 smithi110 ceph-mon[98215]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:10:54.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:54 smithi165 ceph-mon[77258]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:54.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:54 smithi110 ceph-mon[98215]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:56.169 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.169 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.170 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:55 smithi110 ceph-mon[98215]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:56.170 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.170 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:55 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:55 smithi165 ceph-mon[77258]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:56.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:56.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:55 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:57.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:57 smithi110 ceph-mon[98215]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T02:10:57.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:57 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[109240]: 2024-09-16T02:10:57.094+0000 7f0d0802c640 -1 osd.0 47 log_to_monitors true 2024-09-16T02:10:57.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:57 smithi165 ceph-mon[77258]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T02:10:58.086 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:10:57 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[109240]: 2024-09-16T02:10:57.825+0000 7f0cfbdbe640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:10:58.370 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:58 smithi110 ceph-mon[98215]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T02:10:58.371 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:58 smithi110 ceph-mon[98215]: osdmap e50: 6 total, 5 up, 6 in 2024-09-16T02:10:58.371 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:58 smithi110 ceph-mon[98215]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:10:58.371 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:58 smithi110 ceph-mon[98215]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:58.371 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:58 smithi110 ceph-mon[98215]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' 2024-09-16T02:10:58.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:58 smithi165 ceph-mon[77258]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T02:10:58.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:58 smithi165 ceph-mon[77258]: osdmap e50: 6 total, 5 up, 6 in 2024-09-16T02:10:58.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:58 smithi165 ceph-mon[77258]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:10:58.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:58 smithi165 ceph-mon[77258]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:10:58.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:58 smithi165 ceph-mon[77258]: from='osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438]' entity='osd.0' 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438] boot 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: osdmap e51: 6 total, 6 up, 6 in 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:59.357 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:59.358 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:59.358 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:59.358 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:59.358 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:10:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:10:59.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: osd.0 [v2:172.21.15.110:6802/3083066438,v1:172.21.15.110:6803/3083066438] boot 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: osdmap e51: 6 total, 6 up, 6 in 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:59.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:59.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:10:59.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:10:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:00.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:00 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:00.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:00 smithi165 ceph-mon[77258]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-16T02:11:00.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:00 smithi165 ceph-mon[77258]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:11:00.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:00 smithi165 ceph-mon[77258]: osdmap e52: 6 total, 6 up, 6 in 2024-09-16T02:11:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:00 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:00 smithi110 ceph-mon[98215]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-16T02:11:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:00 smithi110 ceph-mon[98215]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:11:00.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:00 smithi110 ceph-mon[98215]: osdmap e52: 6 total, 6 up, 6 in 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 -- 172.21.15.110:0/3328412421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102ef0 msgr2=0x7fa7100fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 --2- 172.21.15.110:0/3328412421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102ef0 0x7fa7100fc5b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7040048d0 tx=0x7fa704009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 -- 172.21.15.110:0/3328412421 shutdown_connections 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 --2- 172.21.15.110:0/3328412421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102ef0 0x7fa7100fc5b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 --2- 172.21.15.110:0/3328412421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa710102550 0x7fa710102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 -- 172.21.15.110:0/3328412421 >> 172.21.15.110:0/3328412421 conn(0x7fa7100f80f0 msgr2=0x7fa7100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 -- 172.21.15.110:0/3328412421 shutdown_connections 2024-09-16T02:11:00.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.900+0000 7fa716e9d640 1 -- 172.21.15.110:0/3328412421 wait complete. 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.901+0000 7fa716e9d640 1 Processor -- start 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.901+0000 7fa716e9d640 1 -- start start 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.901+0000 7fa716e9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 0x7fa710113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.901+0000 7fa716e9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa710102ef0 0x7fa710113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.901+0000 7fa716e9d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa710114090 con 0x7fa710102550 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.901+0000 7fa716e9d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71010d4a0 con 0x7fa710102ef0 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 0x7fa710113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 0x7fa710113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37494/0 (socket says 172.21.15.110:37494) 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 -- 172.21.15.110:0/1075544882 learned_addr learned my addr 172.21.15.110:0/1075544882 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa70ffff640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa710102ef0 0x7fa710113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 -- 172.21.15.110:0/1075544882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa710102ef0 msgr2=0x7fa710113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:00.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa710102ef0 0x7fa710113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 -- 172.21.15.110:0/1075544882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704005040 con 0x7fa710102550 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa714c39640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 0x7fa710113500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa700002a50 tx=0x7fa700004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa700007c30 con 0x7fa710102550 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa70000f040 con 0x7fa710102550 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71010d780 con 0x7fa710102550 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.902+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa70000dad0 con 0x7fa710102550 2024-09-16T02:11:00.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.903+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71010dcf0 con 0x7fa710102550 2024-09-16T02:11:00.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.903+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100fdcd0 con 0x7fa710102550 2024-09-16T02:11:00.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.904+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa70000dc30 con 0x7fa710102550 2024-09-16T02:11:00.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.904+0000 7fa70d7fa640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa6f806e660 0x7fa6f8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:00.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.905+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fa70008e0b0 con 0x7fa710102550 2024-09-16T02:11:00.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.905+0000 7fa70ffff640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa6f806e660 0x7fa6f8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:00.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.905+0000 7fa70ffff640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa6f806e660 0x7fa6f8070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7040048a0 tx=0x7fa704035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:00.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:00.909+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa700057100 con 0x7fa710102550 2024-09-16T02:11:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.092+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa71004b720 con 0x7fa6f806e660 2024-09-16T02:11:01.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.093+0000 7fa70d7fa640 1 -- 172.21.15.110:0/1075544882 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa71004b720 con 0x7fa6f806e660 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa6f806e660 msgr2=0x7fa6f8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa6f806e660 0x7fa6f8070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7040048a0 tx=0x7fa704035040 comp rx=0 tx=0).stop 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 msgr2=0x7fa710113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 0x7fa710113500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa700002a50 tx=0x7fa700004600 comp rx=0 tx=0).stop 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 shutdown_connections 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa6f806e660 0x7fa6f8070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa710102ef0 0x7fa710113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 --2- 172.21.15.110:0/1075544882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa710102550 0x7fa710113500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.095+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 >> 172.21.15.110:0/1075544882 conn(0x7fa7100f80f0 msgr2=0x7fa7100f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.096+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 shutdown_connections 2024-09-16T02:11:01.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.096+0000 7fa716e9d640 1 -- 172.21.15.110:0/1075544882 wait complete. 2024-09-16T02:11:01.106 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:11:01.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 -- 172.21.15.110:0/4053236754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 msgr2=0x7ff868102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/4053236754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff868102940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8580048d0 tx=0x7ff858009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 -- 172.21.15.110:0/4053236754 shutdown_connections 2024-09-16T02:11:01.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/4053236754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 0x7ff8680fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/4053236754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff868102940 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 -- 172.21.15.110:0/4053236754 >> 172.21.15.110:0/4053236754 conn(0x7ff8680f8110 msgr2=0x7ff8680fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 -- 172.21.15.110:0/4053236754 shutdown_connections 2024-09-16T02:11:01.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.174+0000 7ff86d7e1640 1 -- 172.21.15.110:0/4053236754 wait complete. 2024-09-16T02:11:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff86d7e1640 1 Processor -- start 2024-09-16T02:11:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff86d7e1640 1 -- start start 2024-09-16T02:11:01.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff86d7e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff86806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff86d7e1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 0x7ff86806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff86d7e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868070490 con 0x7ff868102570 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff86d7e1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868070600 con 0x7ff868102f10 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff866ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff86806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff866ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff86806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37520/0 (socket says 172.21.15.110:37520) 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff866ffd640 1 -- 172.21.15.110:0/2460175570 learned_addr learned my addr 172.21.15.110:0/2460175570 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff8667fc640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 0x7ff86806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff866ffd640 1 -- 172.21.15.110:0/2460175570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 msgr2=0x7ff86806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff866ffd640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 0x7ff86806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff866ffd640 1 -- 172.21.15.110:0/2460175570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858005040 con 0x7ff868102570 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.175+0000 7ff8667fc640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 0x7ff86806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.176+0000 7ff866ffd640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff86806fa10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff858003080 tx=0x7ff858009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.176+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff858038070 con 0x7ff868102570 2024-09-16T02:11:01.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.176+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff85802ade0 con 0x7ff868102570 2024-09-16T02:11:01.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.176+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff868070830 con 0x7ff868102570 2024-09-16T02:11:01.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.176+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85802c880 con 0x7ff868102570 2024-09-16T02:11:01.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.176+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff868119840 con 0x7ff868102570 2024-09-16T02:11:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.177+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8680fdcf0 con 0x7ff868102570 2024-09-16T02:11:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.178+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff858030020 con 0x7ff868102570 2024-09-16T02:11:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.178+0000 7ff84f7fe640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff85006e660 0x7ff850070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.178+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7ff8580ae2b0 con 0x7ff868102570 2024-09-16T02:11:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.178+0000 7ff8667fc640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff85006e660 0x7ff850070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.179+0000 7ff8667fc640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff85006e660 0x7ff850070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff868071350 tx=0x7ff85c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:01.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.182+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff858077390 con 0x7ff868102570 2024-09-16T02:11:01.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.366+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff868071100 con 0x7ff85006e660 2024-09-16T02:11:01.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.367+0000 7ff84f7fe640 1 -- 172.21.15.110:0/2460175570 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff868071100 con 0x7ff85006e660 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff85006e660 msgr2=0x7ff850070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff85006e660 0x7ff850070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff868071350 tx=0x7ff85c009040 comp rx=0 tx=0).stop 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 msgr2=0x7ff86806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff86806fa10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff858003080 tx=0x7ff858009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 shutdown_connections 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff85006e660 0x7ff850070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff868102f10 0x7ff86806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 --2- 172.21.15.110:0/2460175570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff868102570 0x7ff86806fa10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 >> 172.21.15.110:0/2460175570 conn(0x7ff8680f8110 msgr2=0x7ff8680f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 shutdown_connections 2024-09-16T02:11:01.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.369+0000 7ff86d7e1640 1 -- 172.21.15.110:0/2460175570 wait complete. 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 -- 172.21.15.110:0/511656186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 msgr2=0x7fb3080fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/511656186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb3080fc5c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0048d0 tx=0x7fb2fc009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 -- 172.21.15.110:0/511656186 shutdown_connections 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/511656186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb3080fc5c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/511656186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb308102560 0x7fb308102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 -- 172.21.15.110:0/511656186 >> 172.21.15.110:0/511656186 conn(0x7fb3080f8120 msgr2=0x7fb3080fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.447+0000 7fb30e6b0640 1 -- 172.21.15.110:0/511656186 shutdown_connections 2024-09-16T02:11:01.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 -- 172.21.15.110:0/511656186 wait complete. 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 Processor -- start 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 -- start start 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb308102560 0x7fb308113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb308113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308113d40 con 0x7fb308102f00 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.448+0000 7fb30e6b0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30810d180 con 0x7fb308102560 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb308113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb308113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37540/0 (socket says 172.21.15.110:37540) 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 -- 172.21.15.110:0/1124129512 learned_addr learned my addr 172.21.15.110:0/1124129512 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:01.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb307fff640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb308102560 0x7fb308113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 -- 172.21.15.110:0/1124129512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb308102560 msgr2=0x7fb308113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb308102560 0x7fb308113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 -- 172.21.15.110:0/1124129512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc005040 con 0x7fb308102f00 2024-09-16T02:11:01.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb3077fe640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb308113740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc003080 tx=0x7fb2fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:01.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc038070 con 0x7fb308102f00 2024-09-16T02:11:01.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2fc009760 con 0x7fb308102f00 2024-09-16T02:11:01.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc033420 con 0x7fb308102f00 2024-09-16T02:11:01.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30810d400 con 0x7fb308102f00 2024-09-16T02:11:01.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.449+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30810d8e0 con 0x7fb308102f00 2024-09-16T02:11:01.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.451+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3080fdce0 con 0x7fb308102f00 2024-09-16T02:11:01.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.451+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb2fc030020 con 0x7fb308102f00 2024-09-16T02:11:01.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.451+0000 7fb304ff9640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb2f006e660 0x7fb2f0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.452+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fb2fc0addb0 con 0x7fb308102f00 2024-09-16T02:11:01.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.452+0000 7fb307fff640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb2f006e660 0x7fb2f0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.452+0000 7fb307fff640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb2f006e660 0x7fb2f0070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8007fd0 tx=0x7fb2f8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:01.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.456+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb2fc076f10 con 0x7fb308102f00 2024-09-16T02:11:01.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.631+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3081095a0 con 0x7fb2f006e660 2024-09-16T02:11:01.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.639+0000 7fb304ff9640 1 -- 172.21.15.110:0/1124129512 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb3081095a0 con 0x7fb2f006e660 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (4m) 6s ago 12m 24.6M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (36s) 6s ago 13m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (31s) 28s ago 12m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (2m) 6s ago 12m 79.0M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (7m) 6s ago 7m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (7m) 6s ago 7m 154M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (7m) 28s ago 7m 17.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:11:01.642 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (7m) 28s ago 7m 14.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (4m) 6s ago 14m 493M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (3m) 28s ago 12m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (92s) 6s ago 14m 40.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (70s) 28s ago 12m 31.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (5m) 6s ago 13m 17.8M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (4m) 28s ago 12m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (12s) 6s ago 11m 11.6M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (10m) 6s ago 10m 221M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 88a4458b381f 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (10m) 6s ago 10m 185M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (10m) 28s ago 10m 241M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (9m) 28s ago 9m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (9m) 28s ago 9m 195M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:11:01.643 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (3m) 6s ago 12m 63.2M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:11:01.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb2f006e660 msgr2=0x7fb2f0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb2f006e660 0x7fb2f0070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8007fd0 tx=0x7fb2f8009040 comp rx=0 tx=0).stop 2024-09-16T02:11:01.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 msgr2=0x7fb308113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb308113740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc003080 tx=0x7fb2fc009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 shutdown_connections 2024-09-16T02:11:01.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb2f006e660 0x7fb2f0070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308102f00 0x7fb308113740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 --2- 172.21.15.110:0/1124129512 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb308102560 0x7fb308113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.641+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 >> 172.21.15.110:0/1124129512 conn(0x7fb3080f8120 msgr2=0x7fb3080f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.642+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 shutdown_connections 2024-09-16T02:11:01.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.642+0000 7fb30e6b0640 1 -- 172.21.15.110:0/1124129512 wait complete. 2024-09-16T02:11:01.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- 172.21.15.110:0/2046054706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 msgr2=0x7f14e80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 --2- 172.21.15.110:0/2046054706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e80fc590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14e40048d0 tx=0x7f14e4009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- 172.21.15.110:0/2046054706 shutdown_connections 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 --2- 172.21.15.110:0/2046054706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e80fc590 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 --2- 172.21.15.110:0/2046054706 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14e8102530 0x7f14e8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- 172.21.15.110:0/2046054706 >> 172.21.15.110:0/2046054706 conn(0x7f14e80f80f0 msgr2=0x7f14e80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- 172.21.15.110:0/2046054706 shutdown_connections 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- 172.21.15.110:0/2046054706 wait complete. 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 Processor -- start 2024-09-16T02:11:01.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- start start 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14e8102530 0x7f14e806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8070490 con 0x7f14e8102ed0 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.719+0000 7f14efbf9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8070600 con 0x7f14e8102530 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37554/0 (socket says 172.21.15.110:37554) 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 -- 172.21.15.110:0/142929489 learned_addr learned my addr 172.21.15.110:0/142929489 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed995640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14e8102530 0x7f14e806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 -- 172.21.15.110:0/142929489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14e8102530 msgr2=0x7f14e806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14e8102530 0x7f14e806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 -- 172.21.15.110:0/142929489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4005040 con 0x7f14e8102ed0 2024-09-16T02:11:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14ed194640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e806ff50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14e402a530 tx=0x7f14e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e4038070 con 0x7f14e8102ed0 2024-09-16T02:11:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14e402ade0 con 0x7f14e8102ed0 2024-09-16T02:11:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e8070830 con 0x7f14e8102ed0 2024-09-16T02:11:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e402c810 con 0x7f14e8102ed0 2024-09-16T02:11:01.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.720+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e8119870 con 0x7f14e8102ed0 2024-09-16T02:11:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.721+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e80fdcb0 con 0x7f14e8102ed0 2024-09-16T02:11:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.722+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f14e4030020 con 0x7f14e8102ed0 2024-09-16T02:11:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.722+0000 7f14da7fc640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f14d406e660 0x7f14d4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.722+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f14e40ade20 con 0x7f14e8102ed0 2024-09-16T02:11:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.722+0000 7f14ed995640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f14d406e660 0x7f14d4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:01.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.723+0000 7f14ed995640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f14d406e660 0x7f14d4070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f14dc004ed0 tx=0x7f14dc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:01.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.727+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f14e4076fb0 con 0x7f14e8102ed0 2024-09-16T02:11:01.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.955+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f14e80fbd30 con 0x7f14e8102ed0 2024-09-16T02:11:01.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.955+0000 7f14da7fc640 1 -- 172.21.15.110:0/142929489 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f14e407a670 con 0x7f14e8102ed0 2024-09-16T02:11:01.958 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:11:01.958 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:11:01.958 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:11:01.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:01.958 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 5, 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 9, 2024-09-16T02:11:01.959 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 5 2024-09-16T02:11:01.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:11:01.960 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:11:01.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f14d406e660 msgr2=0x7f14d4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f14d406e660 0x7f14d4070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f14dc004ed0 tx=0x7f14dc00b040 comp rx=0 tx=0).stop 2024-09-16T02:11:01.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 msgr2=0x7f14e806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e806ff50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14e402a530 tx=0x7f14e4009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 shutdown_connections 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f14d406e660 0x7f14d4070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e8102ed0 0x7f14e806ff50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 --2- 172.21.15.110:0/142929489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14e8102530 0x7f14e806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 >> 172.21.15.110:0/142929489 conn(0x7f14e80f80f0 msgr2=0x7f14e80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 shutdown_connections 2024-09-16T02:11:01.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:01.957+0000 7f14efbf9640 1 -- 172.21.15.110:0/142929489 wait complete. 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 -- 172.21.15.110:0/140182680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 msgr2=0x7fa130106570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 --2- 172.21.15.110:0/140182680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa130106570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0048d0 tx=0x7fa11c009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 -- 172.21.15.110:0/140182680 shutdown_connections 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 --2- 172.21.15.110:0/140182680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa130106570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 --2- 172.21.15.110:0/140182680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1300fd590 0x7fa1300fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 -- 172.21.15.110:0/140182680 >> 172.21.15.110:0/140182680 conn(0x7fa1300f7060 msgr2=0x7fa1300f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 -- 172.21.15.110:0/140182680 shutdown_connections 2024-09-16T02:11:02.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.035+0000 7fa1370c3640 1 -- 172.21.15.110:0/140182680 wait complete. 2024-09-16T02:11:02.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa1370c3640 1 Processor -- start 2024-09-16T02:11:02.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa1370c3640 1 -- start start 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa1370c3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1300fd590 0x7fa1300fb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa1370c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa1300fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa1370c3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300fbe40 con 0x7fa1300fdf30 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa1370c3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300fbfb0 con 0x7fa1300fd590 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa1300fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa1300fb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37562/0 (socket says 172.21.15.110:37562) 2024-09-16T02:11:02.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa12ffff640 1 -- 172.21.15.110:0/568426149 learned_addr learned my addr 172.21.15.110:0/568426149 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.036+0000 7fa134e5f640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1300fd590 0x7fa1300fb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12ffff640 1 -- 172.21.15.110:0/568426149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1300fd590 msgr2=0x7fa1300fb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12ffff640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1300fd590 0x7fa1300fb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12ffff640 1 -- 172.21.15.110:0/568426149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c005040 con 0x7fa1300fdf30 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12ffff640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa1300fb900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000c00 tx=0x7fa11c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11c038070 con 0x7fa1300fdf30 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa11c02ade0 con 0x7fa1300fdf30 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11c02c7e0 con 0x7fa1300fdf30 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300fc1e0 con 0x7fa1300fdf30 2024-09-16T02:11:02.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.037+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa130119860 con 0x7fa1300fdf30 2024-09-16T02:11:02.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.038+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa130066350 con 0x7fa1300fdf30 2024-09-16T02:11:02.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.039+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa11c030020 con 0x7fa1300fdf30 2024-09-16T02:11:02.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.039+0000 7fa12d7fa640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa12006e660 0x7fa120070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.039+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fa11c0addc0 con 0x7fa1300fdf30 2024-09-16T02:11:02.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.039+0000 7fa134e5f640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa12006e660 0x7fa120070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.040+0000 7fa134e5f640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa12006e660 0x7fa120070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa124004ed0 tx=0x7fa12400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:02.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.044+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa11c076fd0 con 0x7fa1300fdf30 2024-09-16T02:11:02.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.244+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa13004b720 con 0x7fa1300fdf30 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.244+0000 7fa12d7fa640 1 -- 172.21.15.110:0/568426149 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7fa11c07a690 con 0x7fa1300fdf30 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:11:02.247 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:11:02.248 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:11:02.249 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:02.250 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:02.251 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:02.251 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:02.251 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:11:02.251 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:02.251 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:02.251 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa12006e660 msgr2=0x7fa120070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa12006e660 0x7fa120070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa124004ed0 tx=0x7fa12400b040 comp rx=0 tx=0).stop 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 msgr2=0x7fa1300fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa1300fb900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000c00 tx=0x7fa11c009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 shutdown_connections 2024-09-16T02:11:02.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa12006e660 0x7fa120070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1300fdf30 0x7fa1300fb900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 --2- 172.21.15.110:0/568426149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1300fd590 0x7fa1300fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 >> 172.21.15.110:0/568426149 conn(0x7fa1300f7060 msgr2=0x7fa1300f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:02.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 shutdown_connections 2024-09-16T02:11:02.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.246+0000 7fa1370c3640 1 -- 172.21.15.110:0/568426149 wait complete. 2024-09-16T02:11:02.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 -- 172.21.15.110:0/3585956631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43000fabd0 msgr2=0x7f43000fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 --2- 172.21.15.110:0/3585956631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43000fabd0 0x7f43000fb040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42f00048d0 tx=0x7f42f0009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 -- 172.21.15.110:0/3585956631 shutdown_connections 2024-09-16T02:11:02.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 --2- 172.21.15.110:0/3585956631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43000fabd0 0x7f43000fb040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 --2- 172.21.15.110:0/3585956631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4300102680 0x7f4300102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 -- 172.21.15.110:0/3585956631 >> 172.21.15.110:0/3585956631 conn(0x7f4300071ac0 msgr2=0x7f4300071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 -- 172.21.15.110:0/3585956631 shutdown_connections 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.325+0000 7f4307c92640 1 -- 172.21.15.110:0/3585956631 wait complete. 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4307c92640 1 Processor -- start 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4307c92640 1 -- start start 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4307c92640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43000fabd0 0x7f4300113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4307c92640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 0x7f43001137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4307c92640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4300113da0 con 0x7f4300102680 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4307c92640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430010d1e0 con 0x7f43000fabd0 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f430522d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 0x7f43001137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f430522d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 0x7f43001137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37590/0 (socket says 172.21.15.110:37590) 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f430522d640 1 -- 172.21.15.110:0/1072299366 learned_addr learned my addr 172.21.15.110:0/1072299366 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:02.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f4305a2e640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43000fabd0 0x7f4300113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f430522d640 1 -- 172.21.15.110:0/1072299366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43000fabd0 msgr2=0x7f4300113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f430522d640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43000fabd0 0x7f4300113260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.326+0000 7f430522d640 1 -- 172.21.15.110:0/1072299366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0005040 con 0x7f4300102680 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.327+0000 7f430522d640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 0x7f43001137a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.327+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f0038070 con 0x7f4300102680 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.327+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42f002ade0 con 0x7f4300102680 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.327+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f002c7e0 con 0x7f4300102680 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.327+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430010d460 con 0x7f4300102680 2024-09-16T02:11:02.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.327+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430010d9a0 con 0x7f4300102680 2024-09-16T02:11:02.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.328+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43000725d0 con 0x7f4300102680 2024-09-16T02:11:02.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.328+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f42f0030020 con 0x7f4300102680 2024-09-16T02:11:02.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.329+0000 7f42f67fc640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f42ec06e660 0x7f42ec070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.329+0000 7f4305a2e640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f42ec06e660 0x7f42ec070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.329+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f42f00ade60 con 0x7f4300102680 2024-09-16T02:11:02.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.329+0000 7f4305a2e640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f42ec06e660 0x7f42ec070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42fc004ed0 tx=0x7f42fc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:02.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.333+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f42f0076ff0 con 0x7f4300102680 2024-09-16T02:11:02.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.517+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4300109630 con 0x7f42ec06e660 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.518+0000 7f42f67fc640 1 -- 172.21.15.110:0/1072299366 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4300109630 con 0x7f42ec06e660 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:11:02.521 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:11:02.522 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:11:02.522 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:11:02.522 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "7/21 daemons upgraded", 2024-09-16T02:11:02.522 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T02:11:02.522 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:11:02.522 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:11:02.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f42ec06e660 msgr2=0x7f42ec070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f42ec06e660 0x7f42ec070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42fc004ed0 tx=0x7f42fc00b040 comp rx=0 tx=0).stop 2024-09-16T02:11:02.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 msgr2=0x7f43001137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 0x7f43001137a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f0009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 shutdown_connections 2024-09-16T02:11:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f42ec06e660 0x7f42ec070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4300102680 0x7f43001137a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 --2- 172.21.15.110:0/1072299366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43000fabd0 0x7f4300113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 >> 172.21.15.110:0/1072299366 conn(0x7f4300071ac0 msgr2=0x7f4300105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 shutdown_connections 2024-09-16T02:11:02.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.521+0000 7f4307c92640 1 -- 172.21.15.110:0/1072299366 wait complete. 2024-09-16T02:11:02.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 -- 172.21.15.110:0/3390081351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 msgr2=0x7f71800fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 --2- 172.21.15.110:0/3390081351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71800fe830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7170009c50 tx=0x7f7170004d10 comp rx=0 tx=0).stop 2024-09-16T02:11:02.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 -- 172.21.15.110:0/3390081351 shutdown_connections 2024-09-16T02:11:02.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 --2- 172.21.15.110:0/3390081351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180064fc0 0x7f7180065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 --2- 172.21.15.110:0/3390081351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71800fe830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 -- 172.21.15.110:0/3390081351 >> 172.21.15.110:0/3390081351 conn(0x7f71800723b0 msgr2=0x7f71800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:02.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 -- 172.21.15.110:0/3390081351 shutdown_connections 2024-09-16T02:11:02.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.598+0000 7f71852a8640 1 -- 172.21.15.110:0/3390081351 wait complete. 2024-09-16T02:11:02.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:02 smithi110 ceph-mon[98215]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:02.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:02 smithi110 ceph-mon[98215]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:11:02.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:02 smithi110 ceph-mon[98215]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:02.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:02 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/142929489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:02.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:02 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/568426149' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:11:02.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f71852a8640 1 Processor -- start 2024-09-16T02:11:02.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f71852a8640 1 -- start start 2024-09-16T02:11:02.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f71852a8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180064fc0 0x7f71801131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f71852a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71801136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f71852a8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7180113cf0 con 0x7f71800fe460 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f71852a8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718010d130 con 0x7f7180064fc0 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71801136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71801136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37598/0 (socket says 172.21.15.110:37598) 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.599+0000 7f717e7fc640 1 -- 172.21.15.110:0/478701087 learned_addr learned my addr 172.21.15.110:0/478701087 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f717effd640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180064fc0 0x7f71801131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f717e7fc640 1 -- 172.21.15.110:0/478701087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180064fc0 msgr2=0x7f71801131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f717e7fc640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180064fc0 0x7f71801131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f717e7fc640 1 -- 172.21.15.110:0/478701087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700098b0 con 0x7f71800fe460 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f717e7fc640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71801136f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7174002a50 tx=0x7f7174004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7174007c30 con 0x7f71800fe460 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f717400f040 con 0x7f71800fe460 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718010d410 con 0x7f71800fe460 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f717400da90 con 0x7f71800fe460 2024-09-16T02:11:02.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.600+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718010d9b0 con 0x7f71800fe460 2024-09-16T02:11:02.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.601+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71800fdcf0 con 0x7f71800fe460 2024-09-16T02:11:02.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.602+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f717400dc30 con 0x7f71800fe460 2024-09-16T02:11:02.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.602+0000 7f71677fe640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f716806e660 0x7f7168070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:02.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.602+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f717408da90 con 0x7f71800fe460 2024-09-16T02:11:02.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.602+0000 7f717effd640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f716806e660 0x7f7168070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:02.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.603+0000 7f717effd640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f716806e660 0x7f7168070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7170009c20 tx=0x7f7170004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:02.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.606+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7174056b90 con 0x7f71800fe460 2024-09-16T02:11:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:02 smithi165 ceph-mon[77258]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:02 smithi165 ceph-mon[77258]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-16T02:11:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:02 smithi165 ceph-mon[77258]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:02 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/142929489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:02 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/568426149' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:11:02.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.837+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f718010e850 con 0x7f71800fe460 2024-09-16T02:11:02.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.837+0000 7f71677fe640 1 -- 172.21.15.110:0/478701087 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1428 (secure 0 0 0) 0x7f717405a250 con 0x7f71800fe460 2024-09-16T02:11:02.839 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-16T02:11:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-16T02:11:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f716806e660 msgr2=0x7f7168070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f716806e660 0x7f7168070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7170009c20 tx=0x7f7170004d10 comp rx=0 tx=0).stop 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 msgr2=0x7f71801136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71801136f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7174002a50 tx=0x7f7174004600 comp rx=0 tx=0).stop 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 shutdown_connections 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f716806e660 0x7f7168070b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71800fe460 0x7f71801136f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 --2- 172.21.15.110:0/478701087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7180064fc0 0x7f71801131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:02.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 >> 172.21.15.110:0/478701087 conn(0x7f71800723b0 msgr2=0x7f7180105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:02.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 shutdown_connections 2024-09-16T02:11:02.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:02.839+0000 7f71852a8640 1 -- 172.21.15.110:0/478701087 wait complete. 2024-09-16T02:11:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:03 smithi165 ceph-mon[77258]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:03 smithi165 ceph-mon[77258]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:03.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:03 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/478701087' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:11:03.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:03 smithi110 ceph-mon[98215]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:03.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:03 smithi110 ceph-mon[98215]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:03.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:03 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/478701087' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:11:04.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:04 smithi165 ceph-mon[77258]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-16T02:11:04.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:04 smithi165 ceph-mon[77258]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded) 2024-09-16T02:11:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:04 smithi110 ceph-mon[98215]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-16T02:11:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:04 smithi110 ceph-mon[98215]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded) 2024-09-16T02:11:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:06 smithi165 ceph-mon[77258]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:11:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:06 smithi110 ceph-mon[98215]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:11:08.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:08 smithi110 ceph-mon[98215]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 602 B/s rd, 1 op/s 2024-09-16T02:11:08.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:08.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:08 smithi165 ceph-mon[77258]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 602 B/s rd, 1 op/s 2024-09-16T02:11:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:08.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:10 smithi165 ceph-mon[77258]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-16T02:11:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:10 smithi165 ceph-mon[77258]: mgrmap e39: smithi110.hfirap(active, since 92s), standbys: smithi165.afwhot 2024-09-16T02:11:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:10 smithi110 ceph-mon[98215]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-16T02:11:10.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:10 smithi110 ceph-mon[98215]: mgrmap e39: smithi110.hfirap(active, since 92s), standbys: smithi165.afwhot 2024-09-16T02:11:12.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:12 smithi165 ceph-mon[77258]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 979 B/s rd, 267 B/s wr, 2 op/s 2024-09-16T02:11:12.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:12 smithi110 ceph-mon[98215]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 979 B/s rd, 267 B/s wr, 2 op/s 2024-09-16T02:11:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:14.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:14 smithi110 ceph-mon[98215]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:11:14.662 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:14 smithi165 ceph-mon[77258]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:11:14.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:15.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:15 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:15.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:15 smithi165 ceph-mon[77258]: Upgrade: osd.1 is safe to restart 2024-09-16T02:11:15.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:15 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T02:11:15.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:15 smithi110 ceph-mon[98215]: Upgrade: osd.1 is safe to restart 2024-09-16T02:11:16.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:16 smithi165 ceph-mon[77258]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:11:16.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:16 smithi165 ceph-mon[77258]: Upgrade: Updating osd.1 2024-09-16T02:11:16.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T02:11:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:16 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:11:16.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:16 smithi165 ceph-mon[77258]: Deploying daemon osd.1 on smithi110 2024-09-16T02:11:16.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:16 smithi110 ceph-mon[98215]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:11:16.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:16 smithi110 ceph-mon[98215]: Upgrade: Updating osd.1 2024-09-16T02:11:16.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:16.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T02:11:16.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:16 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:11:16.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:16 smithi110 ceph-mon[98215]: Deploying daemon osd.1 on smithi110 2024-09-16T02:11:18.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:18 smithi110 ceph-mon[98215]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:11:18.661 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:18 smithi110 systemd[1]: Stopping Ceph osd.1 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:11:18.661 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:18 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[53713]: 2024-09-16T02:11:18.607+0000 7ff000be0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:11:18.661 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:18 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[53713]: 2024-09-16T02:11:18.607+0000 7ff000be0640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-16T02:11:18.661 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:18 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[53713]: 2024-09-16T02:11:18.607+0000 7ff000be0640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:11:18.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:18 smithi165 ceph-mon[77258]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-16T02:11:19.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:19 smithi165 ceph-mon[77258]: osd.1 marked itself down and dead 2024-09-16T02:11:19.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:19 smithi110 ceph-mon[98215]: osd.1 marked itself down and dead 2024-09-16T02:11:20.094 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:19 smithi110 podman[114120]: 2024-09-16 02:11:19.79516047 +0000 UTC m=+1.290946932 container died 88a4458b381fbf9d334716c3981f7953261bd6b8cf086f5ef9676e4874caad84 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-6d025bc, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-16T02:11:20.411 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:20 smithi110 podman[114120]: 2024-09-16 02:11:20.17560788 +0000 UTC m=+1.671394344 container cleanup 88a4458b381fbf9d334716c3981f7953261bd6b8cf086f5ef9676e4874caad84 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6d025bc, org.label-schema.vendor=CentOS) 2024-09-16T02:11:20.411 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:20 smithi110 bash[114120]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1 2024-09-16T02:11:20.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:20 smithi165 ceph-mon[77258]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:11:20.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:20 smithi165 ceph-mon[77258]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:11:20.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:20 smithi165 ceph-mon[77258]: osdmap e53: 6 total, 5 up, 6 in 2024-09-16T02:11:20.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:20 smithi110 ceph-mon[98215]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T02:11:20.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:20 smithi110 ceph-mon[98215]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:11:20.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:20 smithi110 ceph-mon[98215]: osdmap e53: 6 total, 5 up, 6 in 2024-09-16T02:11:20.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:20 smithi110 podman[114137]: 2024-09-16 02:11:20.410096655 +0000 UTC m=+0.606046359 container remove 88a4458b381fbf9d334716c3981f7953261bd6b8cf086f5ef9676e4874caad84 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=quincy-6d025bc, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-16T02:11:21.015 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:20 smithi110 podman[114222]: 2024-09-16 02:11:20.628067874 +0000 UTC m=+0.015771991 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:11:21.015 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:20 smithi110 podman[114222]: 2024-09-16 02:11:20.769531377 +0000 UTC m=+0.157235495 container create e1caea0df604149349590dab547411585db6bd6ad2c1cd3c1e085bef96a98354 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-16T02:11:21.015 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 podman[114222]: 2024-09-16 02:11:21.014100964 +0000 UTC m=+0.401805074 container init e1caea0df604149349590dab547411585db6bd6ad2c1cd3c1e085bef96a98354 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T02:11:21.446 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 podman[114222]: 2024-09-16 02:11:21.01857847 +0000 UTC m=+0.406282581 container start e1caea0df604149349590dab547411585db6bd6ad2c1cd3c1e085bef96a98354 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T02:11:21.447 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 podman[114222]: 2024-09-16 02:11:21.097387042 +0000 UTC m=+0.485091161 container attach e1caea0df604149349590dab547411585db6bd6ad2c1cd3c1e085bef96a98354 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:11:21.447 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 podman[114222]: 2024-09-16 02:11:21.208098022 +0000 UTC m=+0.595802140 container died e1caea0df604149349590dab547411585db6bd6ad2c1cd3c1e085bef96a98354 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-16T02:11:21.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:21 smithi165 ceph-mon[77258]: osdmap e54: 6 total, 5 up, 6 in 2024-09-16T02:11:21.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:21 smithi110 ceph-mon[98215]: osdmap e54: 6 total, 5 up, 6 in 2024-09-16T02:11:22.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 podman[114245]: 2024-09-16 02:11:21.825989322 +0000 UTC m=+0.611994693 container remove e1caea0df604149349590dab547411585db6bd6ad2c1cd3c1e085bef96a98354 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:11:22.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-16T02:11:22.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 systemd[1]: Stopped Ceph osd.1 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:11:22.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:21 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.1.service: Consumed 54.644s CPU time. 2024-09-16T02:11:22.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 systemd[1]: Starting Ceph osd.1 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:11:22.573 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:22 smithi110 ceph-mon[98215]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:11:22.573 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:22.573 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:22.573 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 podman[114345]: 2024-09-16 02:11:22.166395678 +0000 UTC m=+0.015694702 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:11:22.573 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 podman[114345]: 2024-09-16 02:11:22.335893157 +0000 UTC m=+0.185192180 container create e14265fbac2c4696f411a05abd065a167e9466f2f74f63faea24f22e8830f605 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-16T02:11:22.573 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 podman[114345]: 2024-09-16 02:11:22.572118927 +0000 UTC m=+0.421417950 container init e14265fbac2c4696f411a05abd065a167e9466f2f74f63faea24f22e8830f605 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-16T02:11:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:22 smithi165 ceph-mon[77258]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:11:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:22.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:22.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 podman[114345]: 2024-09-16 02:11:22.575643121 +0000 UTC m=+0.424942145 container start e14265fbac2c4696f411a05abd065a167e9466f2f74f63faea24f22e8830f605 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:11:22.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 podman[114345]: 2024-09-16 02:11:22.66376223 +0000 UTC m=+0.513061254 container attach e14265fbac2c4696f411a05abd065a167e9466f2f74f63faea24f22e8830f605 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:11:22.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:22.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 bash[114345]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:22.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:22.958 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:22 smithi110 bash[114345]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:23.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-mon[98215]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-09-16T02:11:23.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T02:11:23.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T02:11:23.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T02:11:23.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T02:11:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:23 smithi165 ceph-mon[77258]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-09-16T02:11:24.118 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T02:11:24.118 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T02:11:24.118 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T02:11:24.118 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate[114360]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 bash[114345]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-16T02:11:24.119 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:23 smithi110 podman[114345]: 2024-09-16 02:11:23.763333427 +0000 UTC m=+1.612632451 container died e14265fbac2c4696f411a05abd065a167e9466f2f74f63faea24f22e8830f605 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T02:11:24.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:24 smithi110 ceph-mon[98215]: pgmap v63: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:24.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:24 smithi110 podman[114505]: 2024-09-16 02:11:24.476229104 +0000 UTC m=+0.702766227 container remove e14265fbac2c4696f411a05abd065a167e9466f2f74f63faea24f22e8830f605 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T02:11:24.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:24 smithi110 podman[114562]: 2024-09-16 02:11:24.583829142 +0000 UTC m=+0.015818100 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:11:24.707 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:24 smithi110 podman[114562]: 2024-09-16 02:11:24.702023767 +0000 UTC m=+0.134012710 container create ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:11:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:24 smithi165 ceph-mon[77258]: pgmap v63: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:25.457 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:25 smithi110 podman[114562]: 2024-09-16 02:11:25.080082247 +0000 UTC m=+0.512071198 container init ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD) 2024-09-16T02:11:25.457 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:25 smithi110 podman[114562]: 2024-09-16 02:11:25.083344122 +0000 UTC m=+0.515333066 container start ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-16T02:11:25.457 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:25 smithi110 ceph-osd[114580]: -- 172.21.15.110:0/2299093469 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5609760ee1e0 con 0x56097529bc00 2024-09-16T02:11:25.457 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:25 smithi110 bash[114562]: ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 2024-09-16T02:11:25.457 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:25 smithi110 systemd[1]: Started Ceph osd.1 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:11:26.538 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:26.538 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:26.538 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:11:26.539 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:26 smithi110 ceph-mon[98215]: pgmap v64: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:11:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:26 smithi165 ceph-mon[77258]: pgmap v64: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:26.796 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:26 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[114576]: 2024-09-16T02:11:26.716+0000 7fc4ae1cb640 -1 Falling back to public interface 2024-09-16T02:11:28.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:28 smithi110 ceph-mon[98215]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:28 smithi165 ceph-mon[77258]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:30 smithi165 ceph-mon[77258]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:30 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:30.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:30 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:30.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:30 smithi110 ceph-mon[98215]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:30.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:30 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:30.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:30 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:31 smithi165 ceph-mon[77258]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:31 smithi110 ceph-mon[98215]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:32 smithi165 ceph-mon[77258]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T02:11:32.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:32 smithi110 ceph-mon[98215]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T02:11:32.957 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:32 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[114576]: 2024-09-16T02:11:32.596+0000 7fc4ae1cb640 -1 osd.1 52 log_to_monitors true 2024-09-16T02:11:32.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.954+0000 7f82e0f5c640 1 -- 172.21.15.110:0/2692963845 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82cc032610 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.955+0000 7f82e41c2640 1 -- 172.21.15.110:0/2692963845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fbcf0 msgr2=0x7f82dc0fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:32.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.955+0000 7f82e41c2640 1 --2- 172.21.15.110:0/2692963845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc0fc140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0048d0 tx=0x7f82cc009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:32.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.955+0000 7f82e41c2640 1 -- 172.21.15.110:0/2692963845 shutdown_connections 2024-09-16T02:11:32.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.955+0000 7f82e41c2640 1 --2- 172.21.15.110:0/2692963845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc0fc140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:32.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.955+0000 7f82e41c2640 1 --2- 172.21.15.110:0/2692963845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fd340 0x7f82dc0fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:32.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.955+0000 7f82e41c2640 1 -- 172.21.15.110:0/2692963845 >> 172.21.15.110:0/2692963845 conn(0x7f82dc071b00 msgr2=0x7f82dc071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:32.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.956+0000 7f82e41c2640 1 -- 172.21.15.110:0/2692963845 shutdown_connections 2024-09-16T02:11:32.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.956+0000 7f82e41c2640 1 -- 172.21.15.110:0/2692963845 wait complete. 2024-09-16T02:11:32.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e41c2640 1 Processor -- start 2024-09-16T02:11:32.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e41c2640 1 -- start start 2024-09-16T02:11:32.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e41c2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:32.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e41c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fd340 0x7f82dc113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:32.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e175d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fd340 0x7f82dc113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:32.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e175d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fd340 0x7f82dc113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44464/0 (socket says 172.21.15.110:44464) 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc113d50 con 0x7f82dc0fd340 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc10d190 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e1f5e640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.957+0000 7f82e175d640 1 -- 172.21.15.110:0/535990190 learned_addr learned my addr 172.21.15.110:0/535990190 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.958+0000 7f82e1f5e640 1 -- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fd340 msgr2=0x7f82dc113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.958+0000 7f82e1f5e640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fd340 0x7f82dc113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:32.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.958+0000 7f82e1f5e640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc005040 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.958+0000 7f82e1f5e640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc113210 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f82d800eb40 tx=0x7f82d800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:32.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.959+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d8007a20 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.959+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82d800f040 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.959+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d800c860 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.959+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc10d410 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.959+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc10d9b0 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.960+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc0fcd00 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.961+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f82d801e030 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.962+0000 7f82d27fc640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f82c806e600 0x7f82c8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:32.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.962+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f82d801c070 con 0x7f82dc0fbcf0 2024-09-16T02:11:32.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.962+0000 7f82e175d640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f82c806e600 0x7f82c8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:32.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.963+0000 7f82e175d640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f82c806e600 0x7f82c8070ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82dc10ead0 tx=0x7f82cc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:32.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:32.967+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f82d805f720 con 0x7f82dc0fbcf0 2024-09-16T02:11:33.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.298+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82dc04b750 con 0x7f82c806e600 2024-09-16T02:11:33.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.300+0000 7f82d27fc640 1 -- 172.21.15.110:0/535990190 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f82dc04b750 con 0x7f82c806e600 2024-09-16T02:11:33.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f82c806e600 msgr2=0x7f82c8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f82c806e600 0x7f82c8070ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82dc10ead0 tx=0x7f82cc035040 comp rx=0 tx=0).stop 2024-09-16T02:11:33.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fbcf0 msgr2=0x7f82dc113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc113210 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f82d800eb40 tx=0x7f82d800b040 comp rx=0 tx=0).stop 2024-09-16T02:11:33.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 shutdown_connections 2024-09-16T02:11:33.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f82c806e600 0x7f82c8070ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82dc0fd340 0x7f82dc113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 --2- 172.21.15.110:0/535990190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82dc0fbcf0 0x7f82dc113210 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 >> 172.21.15.110:0/535990190 conn(0x7f82dc071b00 msgr2=0x7f82dc0fa660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:33.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 shutdown_connections 2024-09-16T02:11:33.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.303+0000 7f82e41c2640 1 -- 172.21.15.110:0/535990190 wait complete. 2024-09-16T02:11:33.316 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 -- 172.21.15.110:0/2815357600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 msgr2=0x7f79c006fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 --2- 172.21.15.110:0/2815357600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c006fe20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0048d0 tx=0x7f79bc009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 -- 172.21.15.110:0/2815357600 shutdown_connections 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 --2- 172.21.15.110:0/2815357600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c0070360 0x7f79c01088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 --2- 172.21.15.110:0/2815357600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c006fe20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 -- 172.21.15.110:0/2815357600 >> 172.21.15.110:0/2815357600 conn(0x7f79c00f8110 msgr2=0x7f79c00fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:33.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 -- 172.21.15.110:0/2815357600 shutdown_connections 2024-09-16T02:11:33.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.412+0000 7f79c7b26640 1 -- 172.21.15.110:0/2815357600 wait complete. 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.413+0000 7f79c7b26640 1 Processor -- start 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.413+0000 7f79c7b26640 1 -- start start 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.413+0000 7f79c7b26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c01153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.413+0000 7f79c7b26640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c0070360 0x7f79c01158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c7b26640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0115ee0 con 0x7f79c006fa50 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c7b26640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0116050 con 0x7f79c0070360 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c01153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c01153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44480/0 (socket says 172.21.15.110:44480) 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 -- 172.21.15.110:0/4146844269 learned_addr learned my addr 172.21.15.110:0/4146844269 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:33.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c50c1640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c0070360 0x7f79c01158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 -- 172.21.15.110:0/4146844269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c0070360 msgr2=0x7f79c01158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c0070360 0x7f79c01158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 -- 172.21.15.110:0/4146844269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc005040 con 0x7f79c006fa50 2024-09-16T02:11:33.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.414+0000 7f79c58c2640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c01153a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79bc000c00 tx=0x7f79bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:33.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.418+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79bc038070 con 0x7f79c006fa50 2024-09-16T02:11:33.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.418+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f79bc02ade0 con 0x7f79c006fa50 2024-09-16T02:11:33.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.418+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79bc02c7e0 con 0x7f79c006fa50 2024-09-16T02:11:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.419+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c010f470 con 0x7f79c006fa50 2024-09-16T02:11:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.419+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c010f930 con 0x7f79c006fa50 2024-09-16T02:11:33.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.420+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c0071190 con 0x7f79c006fa50 2024-09-16T02:11:33.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.421+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f79bc030020 con 0x7f79c006fa50 2024-09-16T02:11:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.421+0000 7f79b67fc640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f79ac06e530 0x7f79ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.422+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f79bc0adbe0 con 0x7f79c006fa50 2024-09-16T02:11:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.422+0000 7f79c50c1640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f79ac06e530 0x7f79ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.422+0000 7f79c50c1640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f79ac06e530 0x7f79ac0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f79c0110ca0 tx=0x7f79b000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.427+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f79bc076f00 con 0x7f79c006fa50 2024-09-16T02:11:33.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.617+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79c0110a50 con 0x7f79ac06e530 2024-09-16T02:11:33.619 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[114576]: 2024-09-16T02:11:33.421+0000 7fc4a1f5d640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:11:33.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.618+0000 7f79b67fc640 1 -- 172.21.15.110:0/4146844269 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f79c0110a50 con 0x7f79ac06e530 2024-09-16T02:11:33.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.620+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f79ac06e530 msgr2=0x7f79ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f79ac06e530 0x7f79ac0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f79c0110ca0 tx=0x7f79b000b040 comp rx=0 tx=0).stop 2024-09-16T02:11:33.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 msgr2=0x7f79c01153a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c01153a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79bc000c00 tx=0x7f79bc009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 shutdown_connections 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f79ac06e530 0x7f79ac0709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c0070360 0x7f79c01158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 --2- 172.21.15.110:0/4146844269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c006fa50 0x7f79c01153a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 >> 172.21.15.110:0/4146844269 conn(0x7f79c00f8110 msgr2=0x7f79c00f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 shutdown_connections 2024-09-16T02:11:33.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.621+0000 7f79c7b26640 1 -- 172.21.15.110:0/4146844269 wait complete. 2024-09-16T02:11:33.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/4084511577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc0fb4a0 msgr2=0x7fe0bc0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/4084511577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc0fb4a0 0x7fe0bc0fb910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40048d0 tx=0x7fe0a4009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/4084511577 shutdown_connections 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/4084511577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc0fb4a0 0x7fe0bc0fb910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/4084511577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/4084511577 >> 172.21.15.110:0/4084511577 conn(0x7fe0bc0f7060 msgr2=0x7fe0bc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/4084511577 shutdown_connections 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.702+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/4084511577 wait complete. 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0c0c7b640 1 Processor -- start 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0c0c7b640 1 -- start start 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0c0c7b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0bc0fb4a0 0x7fe0bc10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0c0c7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0c0c7b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc10ed20 con 0x7fe0bc1014e0 2024-09-16T02:11:33.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0c0c7b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc10ee90 con 0x7fe0bc0fb4a0 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44502/0 (socket says 172.21.15.110:44502) 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 -- 172.21.15.110:0/222448586 learned_addr learned my addr 172.21.15.110:0/222448586 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0ba59c640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0bc0fb4a0 0x7fe0bc10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 -- 172.21.15.110:0/222448586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0bc0fb4a0 msgr2=0x7fe0bc10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0bc0fb4a0 0x7fe0bc10e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 -- 172.21.15.110:0/222448586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4005040 con 0x7fe0bc1014e0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.703+0000 7fe0b9d9b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc10e6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4000c00 tx=0x7fe0a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.704+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a4038070 con 0x7fe0bc1014e0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.704+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc117200 con 0x7fe0bc1014e0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.704+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe0a402ade0 con 0x7fe0bc1014e0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.704+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a402c7e0 con 0x7fe0bc1014e0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.704+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc117660 con 0x7fe0bc1014e0 2024-09-16T02:11:33.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.705+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc0fcbe0 con 0x7fe0bc1014e0 2024-09-16T02:11:33.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.705+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe0a4030020 con 0x7fe0bc1014e0 2024-09-16T02:11:33.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.706+0000 7fe0b2ffd640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe0a806e530 0x7fe0a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.706+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fe0a40add90 con 0x7fe0bc1014e0 2024-09-16T02:11:33.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.706+0000 7fe0ba59c640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe0a806e530 0x7fe0a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.706+0000 7fe0ba59c640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe0a806e530 0x7fe0a80709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4007e60 tx=0x7fe0b4004bb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:33.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.710+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe0a4076f90 con 0x7fe0bc1014e0 2024-09-16T02:11:33.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.887+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0bc04b790 con 0x7fe0a806e530 2024-09-16T02:11:33.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-mon[98215]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T02:11:33.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-mon[98215]: osdmap e55: 6 total, 5 up, 6 in 2024-09-16T02:11:33.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-mon[98215]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:11:33.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-mon[98215]: from='client.44171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:33.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-mon[98215]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:33.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:33 smithi110 ceph-mon[98215]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.897+0000 7fe0b2ffd640 1 -- 172.21.15.110:0/222448586 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe0bc04b790 con 0x7fe0a806e530 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (5m) 3s ago 13m 24.6M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (68s) 3s ago 13m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (63s) 60s ago 12m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (3m) 3s ago 13m 81.2M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (8m) 3s ago 8m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:11:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (8m) 3s ago 8m 154M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (8m) 60s ago 8m 17.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (8m) 60s ago 8m 14.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (4m) 3s ago 14m 495M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (3m) 60s ago 12m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (2m) 3s ago 14m 42.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (102s) 60s ago 12m 31.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (5m) 3s ago 13m 17.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (4m) 60s ago 12m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (44s) 3s ago 11m 87.0M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (9s) 3s ago 11m 11.4M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (10m) 3s ago 10m 186M 1557M 17.2.7-1633-g6d025bc2 33ed8dba3996 58ea0f89ff1a 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (10m) 60s ago 10m 241M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:11:33.899 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (10m) 60s ago 10m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:11:33.900 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (9m) 60s ago 9m 195M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:11:33.900 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (3m) 3s ago 13m 65.3M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:11:33.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.898+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe0a806e530 msgr2=0x7fe0a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.898+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe0a806e530 0x7fe0a80709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4007e60 tx=0x7fe0b4004bb0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.898+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 msgr2=0x7fe0bc10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.898+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc10e6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4000c00 tx=0x7fe0a4009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 shutdown_connections 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe0a806e530 0x7fe0a80709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0bc1014e0 0x7fe0bc10e6d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 --2- 172.21.15.110:0/222448586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0bc0fb4a0 0x7fe0bc10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 >> 172.21.15.110:0/222448586 conn(0x7fe0bc0f7060 msgr2=0x7fe0bc0f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 shutdown_connections 2024-09-16T02:11:33.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.899+0000 7fe0c0c7b640 1 -- 172.21.15.110:0/222448586 wait complete. 2024-09-16T02:11:33.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:33 smithi165 ceph-mon[77258]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T02:11:33.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:33 smithi165 ceph-mon[77258]: osdmap e55: 6 total, 5 up, 6 in 2024-09-16T02:11:33.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:33 smithi165 ceph-mon[77258]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:11:33.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:33 smithi165 ceph-mon[77258]: from='client.44171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:33.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:33 smithi165 ceph-mon[77258]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:33.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:33 smithi165 ceph-mon[77258]: from='osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392]' entity='osd.1' 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 -- 172.21.15.110:0/3879315846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fd560 msgr2=0x7f9a440fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/3879315846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fd560 0x7f9a440fd930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a40004900 tx=0x7f9a40009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 -- 172.21.15.110:0/3879315846 shutdown_connections 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/3879315846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a440fdf00 0x7f9a441065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/3879315846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fd560 0x7f9a440fd930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 -- 172.21.15.110:0/3879315846 >> 172.21.15.110:0/3879315846 conn(0x7f9a440f7060 msgr2=0x7f9a440f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 -- 172.21.15.110:0/3879315846 shutdown_connections 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.978+0000 7f9a4beb7640 1 -- 172.21.15.110:0/3879315846 wait complete. 2024-09-16T02:11:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a4beb7640 1 Processor -- start 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a4beb7640 1 -- start start 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a4beb7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a440fd560 0x7f9a44113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a4beb7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 0x7f9a44113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a4beb7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44113e50 con 0x7f9a440fdf00 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a4beb7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4410d290 con 0x7f9a440fd560 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 0x7f9a44113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 0x7f9a44113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44522/0 (socket says 172.21.15.110:44522) 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 -- 172.21.15.110:0/2484798966 learned_addr learned my addr 172.21.15.110:0/2484798966 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49c53640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a440fd560 0x7f9a44113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 -- 172.21.15.110:0/2484798966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a440fd560 msgr2=0x7f9a44113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a440fd560 0x7f9a44113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 -- 172.21.15.110:0/2484798966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40005040 con 0x7f9a440fdf00 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.979+0000 7f9a49452640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 0x7f9a44113850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400c810 tx=0x7f9a340043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.980+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3400a820 con 0x7f9a440fdf00 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.980+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4410d570 con 0x7f9a440fdf00 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.980+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a3400ae20 con 0x7f9a440fdf00 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.980+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a340115c0 con 0x7f9a440fdf00 2024-09-16T02:11:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.980+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4410da90 con 0x7f9a440fdf00 2024-09-16T02:11:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.981+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a440662f0 con 0x7f9a440fdf00 2024-09-16T02:11:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.981+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9a34012840 con 0x7f9a440fdf00 2024-09-16T02:11:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.982+0000 7f9a3a7fc640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9a3006e530 0x7f9a300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.982+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f9a3408e5b0 con 0x7f9a440fdf00 2024-09-16T02:11:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.982+0000 7f9a49c53640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9a3006e530 0x7f9a300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.982+0000 7f9a49c53640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9a3006e530 0x7f9a300709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b020 tx=0x7f9a40009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:33.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:33.986+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9a3405b350 con 0x7f9a440fdf00 2024-09-16T02:11:34.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.240+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a44109580 con 0x7f9a440fdf00 2024-09-16T02:11:34.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.241+0000 7f9a3a7fc640 1 -- 172.21.15.110:0/2484798966 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f9a3405aee0 con 0x7f9a440fdf00 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4, 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 8, 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 5 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:11:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9a3006e530 msgr2=0x7f9a300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9a3006e530 0x7f9a300709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000b020 tx=0x7f9a40009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 msgr2=0x7f9a44113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 0x7f9a44113850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400c810 tx=0x7f9a340043c0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 shutdown_connections 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9a3006e530 0x7f9a300709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a440fdf00 0x7f9a44113850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 --2- 172.21.15.110:0/2484798966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a440fd560 0x7f9a44113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 >> 172.21.15.110:0/2484798966 conn(0x7f9a440f7060 msgr2=0x7f9a440f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 shutdown_connections 2024-09-16T02:11:34.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.243+0000 7f9a4beb7640 1 -- 172.21.15.110:0/2484798966 wait complete. 2024-09-16T02:11:34.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.325+0000 7f765bd79640 1 -- 172.21.15.110:0/3065720473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 msgr2=0x7f7654102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.325+0000 7f765bd79640 1 --2- 172.21.15.110:0/3065720473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f7654102900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76500048d0 tx=0x7f7650009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.325+0000 7f765bd79640 1 -- 172.21.15.110:0/3065720473 shutdown_connections 2024-09-16T02:11:34.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.325+0000 7f765bd79640 1 --2- 172.21.15.110:0/3065720473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 0x7f76540fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.325+0000 7f765bd79640 1 --2- 172.21.15.110:0/3065720473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f7654102900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.325+0000 7f765bd79640 1 -- 172.21.15.110:0/3065720473 >> 172.21.15.110:0/3065720473 conn(0x7f76540f8110 msgr2=0x7f76540fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:34.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 -- 172.21.15.110:0/3065720473 shutdown_connections 2024-09-16T02:11:34.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 -- 172.21.15.110:0/3065720473 wait complete. 2024-09-16T02:11:34.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 Processor -- start 2024-09-16T02:11:34.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 -- start start 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f76541131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 0x7f7654113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7654113d30 con 0x7f7654102530 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f765bd79640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765410d170 con 0x7f7654102ed0 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.326+0000 7f7659b15640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f76541131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659b15640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f76541131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44544/0 (socket says 172.21.15.110:44544) 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659b15640 1 -- 172.21.15.110:0/1441798001 learned_addr learned my addr 172.21.15.110:0/1441798001 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:34.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659314640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 0x7f7654113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659b15640 1 -- 172.21.15.110:0/1441798001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 msgr2=0x7f7654113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659b15640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 0x7f7654113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659b15640 1 -- 172.21.15.110:0/1441798001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650005040 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659314640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 0x7f7654113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f7659b15640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f76541131f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7650000c00 tx=0x7f7650009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7650038070 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f765002ade0 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f765002c7e0 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765410d3f0 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.327+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765410d8e0 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.328+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76540fdcb0 con 0x7f7654102530 2024-09-16T02:11:34.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.329+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7650030020 con 0x7f7654102530 2024-09-16T02:11:34.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.329+0000 7f764a7fc640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f764006e530 0x7f76400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.329+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f76500adcf0 con 0x7f7654102530 2024-09-16T02:11:34.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.329+0000 7f7659314640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f764006e530 0x7f76400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.330+0000 7f7659314640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f764006e530 0x7f76400709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f765410eab0 tx=0x7f764400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:34.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.334+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7650076f90 con 0x7f7654102530 2024-09-16T02:11:34.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.549+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76540fbd30 con 0x7f7654102530 2024-09-16T02:11:34.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.549+0000 7f764a7fc640 1 -- 172.21.15.110:0/1441798001 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7f765007a650 con 0x7f7654102530 2024-09-16T02:11:34.551 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:11:34.551 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:11:34.551 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:11:34.552 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:11:34.553 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:34.554 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:11:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:11:34.555 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:34.555 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:11:34.555 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f764006e530 msgr2=0x7f76400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f764006e530 0x7f76400709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f765410eab0 tx=0x7f764400b040 comp rx=0 tx=0).stop 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 msgr2=0x7f76541131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f76541131f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7650000c00 tx=0x7f7650009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 shutdown_connections 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f764006e530 0x7f76400709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7654102ed0 0x7f7654113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 --2- 172.21.15.110:0/1441798001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7654102530 0x7f76541131f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.551+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 >> 172.21.15.110:0/1441798001 conn(0x7f76540f8110 msgr2=0x7f76540f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.552+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 shutdown_connections 2024-09-16T02:11:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.552+0000 7f765bd79640 1 -- 172.21.15.110:0/1441798001 wait complete. 2024-09-16T02:11:34.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 -- 172.21.15.110:0/1654274160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000fb7c0 msgr2=0x7f4a0010cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 --2- 172.21.15.110:0/1654274160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000fb7c0 0x7f4a0010cbd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49f00048d0 tx=0x7f49f0009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 -- 172.21.15.110:0/1654274160 shutdown_connections 2024-09-16T02:11:34.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 --2- 172.21.15.110:0/1654274160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000fb7c0 0x7f4a0010cbd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 --2- 172.21.15.110:0/1654274160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a000faeb0 0x7f4a000fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 -- 172.21.15.110:0/1654274160 >> 172.21.15.110:0/1654274160 conn(0x7f4a00070ce0 msgr2=0x7f4a000710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 -- 172.21.15.110:0/1654274160 shutdown_connections 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.630+0000 7f4a072c4640 1 -- 172.21.15.110:0/1654274160 wait complete. 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a072c4640 1 Processor -- start 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a072c4640 1 -- start start 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a072c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 0x7f4a00119840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a072c4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a000fb7c0 0x7f4a00119d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a072c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0011a3d0 con 0x7f4a000faeb0 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a072c4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a001137e0 con 0x7f4a000fb7c0 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a05060640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 0x7f4a00119840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a05060640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 0x7f4a00119840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44570/0 (socket says 172.21.15.110:44570) 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a05060640 1 -- 172.21.15.110:0/760336790 learned_addr learned my addr 172.21.15.110:0/760336790 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a0485f640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a000fb7c0 0x7f4a00119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a05060640 1 -- 172.21.15.110:0/760336790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a000fb7c0 msgr2=0x7f4a00119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a05060640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a000fb7c0 0x7f4a00119d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.631+0000 7f4a05060640 1 -- 172.21.15.110:0/760336790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f0005040 con 0x7f4a000faeb0 2024-09-16T02:11:34.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.632+0000 7f4a05060640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 0x7f4a00119840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c790 tx=0x7f49fc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:34.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.632+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc00a820 con 0x7f4a000faeb0 2024-09-16T02:11:34.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.632+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49fc00ae20 con 0x7f4a000faeb0 2024-09-16T02:11:34.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.632+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc0113a0 con 0x7f4a000faeb0 2024-09-16T02:11:34.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.632+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a00113ac0 con 0x7f4a000faeb0 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.632+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a00113fe0 con 0x7f4a000faeb0 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.633+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a000fbc90 con 0x7f4a000faeb0 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.633+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f49fc012400 con 0x7f4a000faeb0 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.634+0000 7f49f5ffb640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49ec06e530 0x7f49ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.634+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f49fc08e220 con 0x7f4a000faeb0 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.634+0000 7f4a0485f640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49ec06e530 0x7f49ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.634+0000 7f4a0485f640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49ec06e530 0x7f49ec0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007ac0 tx=0x7f49f0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:34.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.638+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f49fc057490 con 0x7f4a000faeb0 2024-09-16T02:11:34.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.820+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a0010fb50 con 0x7f49ec06e530 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.822+0000 7f49f5ffb640 1 -- 172.21.15.110:0/760336790 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4a0010fb50 con 0x7f49ec06e530 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:11:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "8/21 daemons upgraded", 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:11:34.824 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:11:34.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49ec06e530 msgr2=0x7f49ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49ec06e530 0x7f49ec0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f49f0007ac0 tx=0x7f49f0035040 comp rx=0 tx=0).stop 2024-09-16T02:11:34.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 msgr2=0x7f4a00119840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 0x7f4a00119840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c790 tx=0x7f49fc0043c0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 shutdown_connections 2024-09-16T02:11:34.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49ec06e530 0x7f49ec0709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a000fb7c0 0x7f4a00119d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 --2- 172.21.15.110:0/760336790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a000faeb0 0x7f4a00119840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 >> 172.21.15.110:0/760336790 conn(0x7f4a00070ce0 msgr2=0x7f4a0010b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:34.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 shutdown_connections 2024-09-16T02:11:34.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.824+0000 7f4a072c4640 1 -- 172.21.15.110:0/760336790 wait complete. 2024-09-16T02:11:34.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 -- 172.21.15.110:0/340833801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 msgr2=0x7f49c80fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/340833801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c80fb8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0048d0 tx=0x7f49bc009da0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 -- 172.21.15.110:0/340833801 shutdown_connections 2024-09-16T02:11:34.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/340833801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c80fb8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/340833801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49c81014c0 0x7f49c8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 -- 172.21.15.110:0/340833801 >> 172.21.15.110:0/340833801 conn(0x7f49c80f7020 msgr2=0x7f49c80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:34.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 -- 172.21.15.110:0/340833801 shutdown_connections 2024-09-16T02:11:34.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.901+0000 7f49ce2f1640 1 -- 172.21.15.110:0/340833801 wait complete. 2024-09-16T02:11:34.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49ce2f1640 1 Processor -- start 2024-09-16T02:11:34.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49ce2f1640 1 -- start start 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49ce2f1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c81131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49ce2f1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49c81014c0 0x7f49c8113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49ce2f1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c8113d20 con 0x7f49c80fb480 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49ce2f1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c810d160 con 0x7f49c81014c0 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49c7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c81131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49c7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c81131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44576/0 (socket says 172.21.15.110:44576) 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49c7fff640 1 -- 172.21.15.110:0/1091678024 learned_addr learned my addr 172.21.15.110:0/1091678024 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.902+0000 7f49c77fe640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49c81014c0 0x7f49c8113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c7fff640 1 -- 172.21.15.110:0/1091678024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49c81014c0 msgr2=0x7f49c8113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c7fff640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49c81014c0 0x7f49c8113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:34.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c7fff640 1 -- 172.21.15.110:0/1091678024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc005040 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c7fff640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c81131e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49b800eb70 tx=0x7f49b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b8007c30 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49b800f040 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c810d3e0 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b80094e0 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.903+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c810d950 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.904+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c80fcbc0 con 0x7f49c80fb480 2024-09-16T02:11:34.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.905+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f49b8009660 con 0x7f49c80fb480 2024-09-16T02:11:34.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.905+0000 7f49c4ff9640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49b006e530 0x7f49b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:11:34.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.905+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f49b808de00 con 0x7f49c80fb480 2024-09-16T02:11:34.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.905+0000 7f49c77fe640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49b006e530 0x7f49b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:11:34.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.906+0000 7f49c77fe640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49b006e530 0x7f49b00709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f49c80ff250 tx=0x7f49bc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:11:34.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:34.909+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f49b8056ff0 con 0x7f49c80fb480 2024-09-16T02:11:35.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.141+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f49c804b720 con 0x7f49c80fb480 2024-09-16T02:11:35.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.141+0000 7f49c4ff9640 1 -- 172.21.15.110:0/1091678024 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1093 (secure 0 0 0) 0x7f49b805a6b0 con 0x7f49c80fb480 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-16T02:11:35.143 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-16T02:11:35.144 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-16T02:11:35.144 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-16T02:11:35.144 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-16T02:11:35.144 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-16T02:11:35.144 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-16T02:11:35.144 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49b006e530 msgr2=0x7f49b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49b006e530 0x7f49b00709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f49c80ff250 tx=0x7f49bc035040 comp rx=0 tx=0).stop 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 msgr2=0x7f49c81131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c81131e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49b800eb70 tx=0x7f49b800b040 comp rx=0 tx=0).stop 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 shutdown_connections 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f49b006e530 0x7f49b00709e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49c81014c0 0x7f49c8113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 --2- 172.21.15.110:0/1091678024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49c80fb480 0x7f49c81131e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:11:35.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.143+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 >> 172.21.15.110:0/1091678024 conn(0x7f49c80f7020 msgr2=0x7f49c8065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:11:35.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.144+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 shutdown_connections 2024-09-16T02:11:35.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:11:35.144+0000 7f49ce2f1640 1 -- 172.21.15.110:0/1091678024 wait complete. 2024-09-16T02:11:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2484798966' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392] boot 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: osdmap e56: 6 total, 6 up, 6 in 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1441798001' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:11:35.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:35 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1091678024' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:35.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2484798966' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: osd.1 [v2:172.21.15.110:6810/2337714392,v1:172.21.15.110:6811/2337714392] boot 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: osdmap e56: 6 total, 6 up, 6 in 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1441798001' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:11:35.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:35 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1091678024' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:11:36.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:36 smithi165 ceph-mon[77258]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:36.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:36 smithi165 ceph-mon[77258]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:36.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:36 smithi165 ceph-mon[77258]: osdmap e57: 6 total, 6 up, 6 in 2024-09-16T02:11:36.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:36 smithi110 ceph-mon[98215]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:11:36.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:36 smithi110 ceph-mon[98215]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:36.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:36 smithi110 ceph-mon[98215]: osdmap e57: 6 total, 6 up, 6 in 2024-09-16T02:11:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:38 smithi165 ceph-mon[77258]: pgmap v73: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:38 smithi110 ceph-mon[98215]: pgmap v73: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:11:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:39.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:39 smithi165 ceph-mon[77258]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded) 2024-09-16T02:11:39.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:39 smithi110 ceph-mon[98215]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded) 2024-09-16T02:11:40.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:40 smithi165 ceph-mon[77258]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-16T02:11:40.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:40 smithi110 ceph-mon[98215]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-16T02:11:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:42 smithi165 ceph-mon[77258]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:11:42.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:42 smithi110 ceph-mon[98215]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:11:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:44 smithi165 ceph-mon[77258]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T02:11:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:44 smithi110 ceph-mon[98215]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T02:11:46.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:46 smithi165 ceph-mon[77258]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:11:46.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:46 smithi110 ceph-mon[98215]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:11:48.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:48 smithi165 ceph-mon[77258]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 860 B/s rd, 1 op/s 2024-09-16T02:11:48.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:48 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:48.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:48 smithi110 ceph-mon[98215]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 860 B/s rd, 1 op/s 2024-09-16T02:11:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:48 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:49.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:50 smithi165 ceph-mon[77258]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:11:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:50 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:50 smithi165 ceph-mon[77258]: Upgrade: osd.2 is safe to restart 2024-09-16T02:11:50.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:50 smithi110 ceph-mon[98215]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:11:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:50 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T02:11:50.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:50 smithi110 ceph-mon[98215]: Upgrade: osd.2 is safe to restart 2024-09-16T02:11:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:51 smithi165 ceph-mon[77258]: Upgrade: Updating osd.2 2024-09-16T02:11:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:51 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:52.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:51 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T02:11:52.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:51 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:11:52.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:51 smithi165 ceph-mon[77258]: Deploying daemon osd.2 on smithi110 2024-09-16T02:11:52.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:51 smithi165 ceph-mon[77258]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:11:52.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:51 smithi110 ceph-mon[98215]: Upgrade: Updating osd.2 2024-09-16T02:11:52.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:51 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:52.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:51 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T02:11:52.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:51 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:11:52.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:51 smithi110 ceph-mon[98215]: Deploying daemon osd.2 on smithi110 2024-09-16T02:11:52.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:51 smithi110 ceph-mon[98215]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:11:53.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:53 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:53.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:53 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:53.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:53 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:11:53.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:53 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:11:54.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:54 smithi110 ceph-mon[98215]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:11:54.457 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:54 smithi110 systemd[1]: Stopping Ceph osd.2 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:11:54.457 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:54 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[60937]: 2024-09-16T02:11:54.370+0000 7fba328fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:11:54.458 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:54 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[60937]: 2024-09-16T02:11:54.370+0000 7fba328fa640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-16T02:11:54.458 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:54 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[60937]: 2024-09-16T02:11:54.370+0000 7fba328fa640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:11:54.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:54 smithi165 ceph-mon[77258]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:11:55.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:55 smithi165 ceph-mon[77258]: osd.2 marked itself down and dead 2024-09-16T02:11:55.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:55 smithi110 ceph-mon[98215]: osd.2 marked itself down and dead 2024-09-16T02:11:56.066 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:55 smithi110 podman[119604]: 2024-09-16 02:11:55.771073284 +0000 UTC m=+1.498103736 container died 58ea0f89ff1aab66c00a5e0e468cb32cc7c420643e7c631daa1e2562bbceb561 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-6d025bc, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T02:11:56.357 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 podman[119604]: 2024-09-16 02:11:56.162868621 +0000 UTC m=+1.889899063 container cleanup 58ea0f89ff1aab66c00a5e0e468cb32cc7c420643e7c631daa1e2562bbceb561 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=quincy-6d025bc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:11:56.357 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 bash[119604]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2 2024-09-16T02:11:56.674 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 podman[119618]: 2024-09-16 02:11:56.355907376 +0000 UTC m=+0.585666137 container remove 58ea0f89ff1aab66c00a5e0e468cb32cc7c420643e7c631daa1e2562bbceb561 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=quincy-6d025bc, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:11:56.675 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:56 smithi110 ceph-mon[98215]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:11:56.675 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:56 smithi110 ceph-mon[98215]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:11:56.675 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:56 smithi110 ceph-mon[98215]: osdmap e58: 6 total, 5 up, 6 in 2024-09-16T02:11:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:56 smithi165 ceph-mon[77258]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:11:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:56 smithi165 ceph-mon[77258]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:11:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:56 smithi165 ceph-mon[77258]: osdmap e58: 6 total, 5 up, 6 in 2024-09-16T02:11:56.927 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 podman[119708]: 2024-09-16 02:11:56.576423807 +0000 UTC m=+0.015957602 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:11:56.927 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 podman[119708]: 2024-09-16 02:11:56.698414795 +0000 UTC m=+0.137948618 container create fe9ece776173e806c8b359bffe954204e56045afaf3a89e59a01d98eea6cbb2f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T02:11:56.927 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 podman[119708]: 2024-09-16 02:11:56.926193871 +0000 UTC m=+0.365727654 container init fe9ece776173e806c8b359bffe954204e56045afaf3a89e59a01d98eea6cbb2f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-16T02:11:57.207 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:56 smithi110 podman[119708]: 2024-09-16 02:11:56.929955073 +0000 UTC m=+0.369488858 container start fe9ece776173e806c8b359bffe954204e56045afaf3a89e59a01d98eea6cbb2f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T02:11:57.207 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 podman[119708]: 2024-09-16 02:11:57.017426889 +0000 UTC m=+0.456960679 container attach fe9ece776173e806c8b359bffe954204e56045afaf3a89e59a01d98eea6cbb2f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-16T02:11:57.207 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 podman[119708]: 2024-09-16 02:11:57.118004469 +0000 UTC m=+0.557538260 container died fe9ece776173e806c8b359bffe954204e56045afaf3a89e59a01d98eea6cbb2f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True) 2024-09-16T02:11:57.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:57 smithi165 ceph-mon[77258]: osdmap e59: 6 total, 5 up, 6 in 2024-09-16T02:11:57.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:57 smithi110 ceph-mon[98215]: osdmap e59: 6 total, 5 up, 6 in 2024-09-16T02:11:58.159 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 podman[119731]: 2024-09-16 02:11:57.730603449 +0000 UTC m=+0.603297748 container remove fe9ece776173e806c8b359bffe954204e56045afaf3a89e59a01d98eea6cbb2f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T02:11:58.159 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-16T02:11:58.159 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 systemd[1]: Stopped Ceph osd.2 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:11:58.159 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.2.service: Consumed 44.209s CPU time. 2024-09-16T02:11:58.159 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:57 smithi110 systemd[1]: Starting Ceph osd.2 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:11:58.443 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:58 smithi110 ceph-mon[98215]: pgmap v85: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/264 objects degraded (3.788%) 2024-09-16T02:11:58.443 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:11:58 smithi110 ceph-mon[98215]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 4 pgs degraded (PG_DEGRADED) 2024-09-16T02:11:58.443 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 podman[119831]: 2024-09-16 02:11:58.060450233 +0000 UTC m=+0.015538095 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:11:58.443 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 podman[119831]: 2024-09-16 02:11:58.206189825 +0000 UTC m=+0.161277680 container create 886143fa1a63bb455b182e8bec639752a8fa0daabbd1a6a1fd48b53ffe193a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T02:11:58.443 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 podman[119831]: 2024-09-16 02:11:58.442262485 +0000 UTC m=+0.397350341 container init 886143fa1a63bb455b182e8bec639752a8fa0daabbd1a6a1fd48b53ffe193a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:11:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:58 smithi165 ceph-mon[77258]: pgmap v85: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/264 objects degraded (3.788%) 2024-09-16T02:11:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:11:58 smithi165 ceph-mon[77258]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 4 pgs degraded (PG_DEGRADED) 2024-09-16T02:11:58.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 podman[119831]: 2024-09-16 02:11:58.445865669 +0000 UTC m=+0.400953524 container start 886143fa1a63bb455b182e8bec639752a8fa0daabbd1a6a1fd48b53ffe193a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:11:58.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 podman[119831]: 2024-09-16 02:11:58.542342518 +0000 UTC m=+0.497430374 container attach 886143fa1a63bb455b182e8bec639752a8fa0daabbd1a6a1fd48b53ffe193a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True) 2024-09-16T02:11:58.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:58.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 bash[119831]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:58.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:58.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:58 smithi110 bash[119831]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:11:59.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T02:11:59.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T02:11:59.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T02:11:59.596 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T02:11:59.862 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T02:11:59.862 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T02:11:59.862 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T02:11:59.862 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T02:11:59.862 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-16T02:11:59.863 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-16T02:11:59.863 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T02:11:59.863 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T02:11:59.863 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate[119846]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-16T02:11:59.863 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 bash[119831]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-16T02:11:59.863 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:11:59 smithi110 podman[119831]: 2024-09-16 02:11:59.625940346 +0000 UTC m=+1.581028211 container died 886143fa1a63bb455b182e8bec639752a8fa0daabbd1a6a1fd48b53ffe193a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-16T02:12:00.651 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:00 smithi110 ceph-mon[98215]: pgmap v86: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:00.651 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 podman[119997]: 2024-09-16 02:12:00.288198646 +0000 UTC m=+0.653982164 container remove 886143fa1a63bb455b182e8bec639752a8fa0daabbd1a6a1fd48b53ffe193a3c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-16T02:12:00.652 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 podman[120064]: 2024-09-16 02:12:00.401849393 +0000 UTC m=+0.016437361 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:12:00.652 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 podman[120064]: 2024-09-16 02:12:00.522378884 +0000 UTC m=+0.136966841 container create feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T02:12:00.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:00 smithi165 ceph-mon[77258]: pgmap v86: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:00.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 podman[120064]: 2024-09-16 02:12:00.783807907 +0000 UTC m=+0.398395860 container init feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:12:00.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 podman[120064]: 2024-09-16 02:12:00.787336786 +0000 UTC m=+0.401924744 container start feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T02:12:00.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 ceph-osd[120083]: -- 172.21.15.110:0/898173082 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557acb02a1e0 con 0x557aca1d7c00 2024-09-16T02:12:00.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 bash[120064]: feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 2024-09-16T02:12:00.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:00 smithi110 systemd[1]: Started Ceph osd.2 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:12:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:01 smithi165 ceph-mon[77258]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:01 smithi110 ceph-mon[98215]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:02.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:02 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[120079]: 2024-09-16T02:12:02.673+0000 7fa5263d1640 -1 Falling back to public interface 2024-09-16T02:12:04.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:04 smithi165 ceph-mon[77258]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:04.702 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:04 smithi110 ceph-mon[98215]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:05.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 -- 172.21.15.110:0/275448414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 msgr2=0x7fc914102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 --2- 172.21.15.110:0/275448414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc914102a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9080048d0 tx=0x7fc908009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 -- 172.21.15.110:0/275448414 shutdown_connections 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 --2- 172.21.15.110:0/275448414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9140fabd0 0x7fc9140fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 --2- 172.21.15.110:0/275448414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc914102a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 -- 172.21.15.110:0/275448414 >> 172.21.15.110:0/275448414 conn(0x7fc914071ac0 msgr2=0x7fc914071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 -- 172.21.15.110:0/275448414 shutdown_connections 2024-09-16T02:12:05.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.236+0000 7fc91b116640 1 -- 172.21.15.110:0/275448414 wait complete. 2024-09-16T02:12:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc91b116640 1 Processor -- start 2024-09-16T02:12:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc91b116640 1 -- start start 2024-09-16T02:12:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc91b116640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9140fabd0 0x7fc9141132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc91b116640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc9141137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc91b116640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc914113df0 con 0x7fc914102680 2024-09-16T02:12:05.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc91b116640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91410d230 con 0x7fc9140fabd0 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc913fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc9141137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc913fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc9141137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49704/0 (socket says 172.21.15.110:49704) 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc913fff640 1 -- 172.21.15.110:0/2356584695 learned_addr learned my addr 172.21.15.110:0/2356584695 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.237+0000 7fc918eb2640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9140fabd0 0x7fc9141132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc913fff640 1 -- 172.21.15.110:0/2356584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9140fabd0 msgr2=0x7fc9141132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc913fff640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9140fabd0 0x7fc9141132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc913fff640 1 -- 172.21.15.110:0/2356584695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908005040 con 0x7fc914102680 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc913fff640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc9141137f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c790 tx=0x7fc9000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90000a7a0 con 0x7fc914102680 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91410d510 con 0x7fc914102680 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc90000ada0 con 0x7fc914102680 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9000113a0 con 0x7fc914102680 2024-09-16T02:12:05.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.238+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91410dab0 con 0x7fc914102680 2024-09-16T02:12:05.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.239+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9140725d0 con 0x7fc914102680 2024-09-16T02:12:05.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.240+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc90000a900 con 0x7fc914102680 2024-09-16T02:12:05.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.240+0000 7fc9117fa640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc90406e530 0x7fc9040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.241+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fc90008e180 con 0x7fc914102680 2024-09-16T02:12:05.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.241+0000 7fc918eb2640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc90406e530 0x7fc9040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.241+0000 7fc918eb2640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc90406e530 0x7fc9040709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc908009ac0 tx=0x7fc908035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:05.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.246+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc9000573f0 con 0x7fc914102680 2024-09-16T02:12:05.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.445+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc914109630 con 0x7fc90406e530 2024-09-16T02:12:05.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.446+0000 7fc9117fa640 1 -- 172.21.15.110:0/2356584695 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc914109630 con 0x7fc90406e530 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc90406e530 msgr2=0x7fc9040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc90406e530 0x7fc9040709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc908009ac0 tx=0x7fc908035040 comp rx=0 tx=0).stop 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 msgr2=0x7fc9141137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc9141137f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c790 tx=0x7fc9000043c0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 shutdown_connections 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc90406e530 0x7fc9040709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc914102680 0x7fc9141137f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.448+0000 7fc91b116640 1 --2- 172.21.15.110:0/2356584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9140fabd0 0x7fc9141132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.449+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 >> 172.21.15.110:0/2356584695 conn(0x7fc914071ac0 msgr2=0x7fc914105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:05.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.449+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 shutdown_connections 2024-09-16T02:12:05.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.449+0000 7fc91b116640 1 -- 172.21.15.110:0/2356584695 wait complete. 2024-09-16T02:12:05.459 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:12:05.506 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:05 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.529+0000 7fd028f75640 1 -- 172.21.15.110:0/3593085908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0240fe460 msgr2=0x7fd0240fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.529+0000 7fd028f75640 1 --2- 172.21.15.110:0/3593085908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0240fe460 0x7fd0240fe830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009c50 tx=0x7fd01c004d10 comp rx=0 tx=0).stop 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- 172.21.15.110:0/3593085908 shutdown_connections 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 --2- 172.21.15.110:0/3593085908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd024064fc0 0x7fd024065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 --2- 172.21.15.110:0/3593085908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0240fe460 0x7fd0240fe830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- 172.21.15.110:0/3593085908 >> 172.21.15.110:0/3593085908 conn(0x7fd0240723b0 msgr2=0x7fd0240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- 172.21.15.110:0/3593085908 shutdown_connections 2024-09-16T02:12:05.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- 172.21.15.110:0/3593085908 wait complete. 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 Processor -- start 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- start start 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 0x7fd0241153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0240fe460 0x7fd024115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024115f00 con 0x7fd024064fc0 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd028f75640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02410f340 con 0x7fd0240fe460 2024-09-16T02:12:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd02259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 0x7fd0241153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd02259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 0x7fd0241153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49730/0 (socket says 172.21.15.110:49730) 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.530+0000 7fd02259c640 1 -- 172.21.15.110:0/2504722343 learned_addr learned my addr 172.21.15.110:0/2504722343 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd021d9b640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0240fe460 0x7fd024115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd02259c640 1 -- 172.21.15.110:0/2504722343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0240fe460 msgr2=0x7fd024115900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd02259c640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0240fe460 0x7fd024115900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd02259c640 1 -- 172.21.15.110:0/2504722343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0098b0 con 0x7fd024064fc0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd02259c640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 0x7fd0241153c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd01c004a30 tx=0x7fd01c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01c009690 con 0x7fd024064fc0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02410f5c0 con 0x7fd024064fc0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd01c032b10 con 0x7fd024064fc0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01c03daa0 con 0x7fd024064fc0 2024-09-16T02:12:05.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.531+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02410fb60 con 0x7fd024064fc0 2024-09-16T02:12:05.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.532+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd004005210 con 0x7fd024064fc0 2024-09-16T02:12:05.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.533+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd01c02f030 con 0x7fd024064fc0 2024-09-16T02:12:05.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.534+0000 7fd01affd640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd01006e530 0x7fd0100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.534+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fd01c0af040 con 0x7fd024064fc0 2024-09-16T02:12:05.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.534+0000 7fd021d9b640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd01006e530 0x7fd0100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.534+0000 7fd021d9b640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd01006e530 0x7fd0100709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd024110c80 tx=0x7fd00c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:05.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.538+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd01c078230 con 0x7fd024064fc0 2024-09-16T02:12:05.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:05 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:05.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.729+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd004000bc0 con 0x7fd01006e530 2024-09-16T02:12:05.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.730+0000 7fd01affd640 1 -- 172.21.15.110:0/2504722343 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd004000bc0 con 0x7fd01006e530 2024-09-16T02:12:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd01006e530 msgr2=0x7fd0100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd01006e530 0x7fd0100709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd024110c80 tx=0x7fd00c009040 comp rx=0 tx=0).stop 2024-09-16T02:12:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 msgr2=0x7fd0241153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 0x7fd0241153c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd01c004a30 tx=0x7fd01c004d10 comp rx=0 tx=0).stop 2024-09-16T02:12:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 shutdown_connections 2024-09-16T02:12:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd01006e530 0x7fd0100709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0240fe460 0x7fd024115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 --2- 172.21.15.110:0/2504722343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd024064fc0 0x7fd0241153c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 >> 172.21.15.110:0/2504722343 conn(0x7fd0240723b0 msgr2=0x7fd024103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 shutdown_connections 2024-09-16T02:12:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.733+0000 7fd028f75640 1 -- 172.21.15.110:0/2504722343 wait complete. 2024-09-16T02:12:05.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 -- 172.21.15.110:0/2551199112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a80fb4a0 msgr2=0x7fd2a80fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/2551199112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a80fb910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0048d0 tx=0x7fd29c009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 -- 172.21.15.110:0/2551199112 shutdown_connections 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/2551199112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a80fb910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/2551199112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a81014e0 0x7fd2a81018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 -- 172.21.15.110:0/2551199112 >> 172.21.15.110:0/2551199112 conn(0x7fd2a80f7060 msgr2=0x7fd2a80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 -- 172.21.15.110:0/2551199112 shutdown_connections 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.812+0000 7fd2acfa9640 1 -- 172.21.15.110:0/2551199112 wait complete. 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2acfa9640 1 Processor -- start 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2acfa9640 1 -- start start 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2acfa9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a8113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2acfa9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 0x7fd2a8113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2acfa9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a8113d80 con 0x7fd2a81014e0 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2acfa9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a810d1c0 con 0x7fd2a80fb4a0 2024-09-16T02:12:05.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2a5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 0x7fd2a8113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2a5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 0x7fd2a8113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49738/0 (socket says 172.21.15.110:49738) 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2a5d9b640 1 -- 172.21.15.110:0/967203954 learned_addr learned my addr 172.21.15.110:0/967203954 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.813+0000 7fd2a659c640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a8113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2a5d9b640 1 -- 172.21.15.110:0/967203954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a80fb4a0 msgr2=0x7fd2a8113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2a5d9b640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a8113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2a5d9b640 1 -- 172.21.15.110:0/967203954 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c005040 con 0x7fd2a81014e0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2a659c640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a8113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2a5d9b640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 0x7fd2a8113780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd29c003080 tx=0x7fd29c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd29c038070 con 0x7fd2a81014e0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd29c02ade0 con 0x7fd2a81014e0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd29c02c880 con 0x7fd2a81014e0 2024-09-16T02:12:05.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a810d440 con 0x7fd2a81014e0 2024-09-16T02:12:05.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.814+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a810d850 con 0x7fd2a81014e0 2024-09-16T02:12:05.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.815+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a80fcbe0 con 0x7fd2a81014e0 2024-09-16T02:12:05.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.816+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd29c030020 con 0x7fd2a81014e0 2024-09-16T02:12:05.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.816+0000 7fd296ffd640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd29006e530 0x7fd2900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:05.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.817+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fd29c0ae120 con 0x7fd2a81014e0 2024-09-16T02:12:05.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.817+0000 7fd2a659c640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd29006e530 0x7fd2900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:05.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.817+0000 7fd2a659c640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd29006e530 0x7fd2900709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd298004c60 tx=0x7fd298009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:05.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:05.821+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd29c077310 con 0x7fd2a81014e0 2024-09-16T02:12:06.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.004+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2a8108490 con 0x7fd29006e530 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.013+0000 7fd296ffd640 1 -- 172.21.15.110:0/967203954 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd2a8108490 con 0x7fd29006e530 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (5m) 36s ago 13m 24.6M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (100s) 36s ago 14m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (96s) 92s ago 13m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (3m) 36s ago 13m 81.2M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (8m) 36s ago 8m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (8m) 36s ago 8m 154M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:12:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (8m) 92s ago 8m 17.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (8m) 92s ago 8m 14.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (5m) 36s ago 15m 495M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (4m) 92s ago 13m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (2m) 36s ago 15m 42.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (2m) 92s ago 13m 31.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (6m) 36s ago 14m 17.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (5m) 92s ago 13m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (76s) 36s ago 12m 87.0M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (41s) 36s ago 11m 11.4M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 starting - - - 1557M 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (11m) 92s ago 11m 241M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 21019b693d1c 2024-09-16T02:12:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (10m) 92s ago 10m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:12:06.018 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (10m) 92s ago 10m 195M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:12:06.018 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (4m) 36s ago 13m 65.3M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd29006e530 msgr2=0x7fd2900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd29006e530 0x7fd2900709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd298004c60 tx=0x7fd298009040 comp rx=0 tx=0).stop 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 msgr2=0x7fd2a8113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 0x7fd2a8113780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd29c003080 tx=0x7fd29c009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 shutdown_connections 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd29006e530 0x7fd2900709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2a81014e0 0x7fd2a8113780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 --2- 172.21.15.110:0/967203954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a80fb4a0 0x7fd2a8113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 >> 172.21.15.110:0/967203954 conn(0x7fd2a80f7060 msgr2=0x7fd2a8065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:06.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 shutdown_connections 2024-09-16T02:12:06.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.017+0000 7fd2acfa9640 1 -- 172.21.15.110:0/967203954 wait complete. 2024-09-16T02:12:06.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.106+0000 7fb7952e3640 1 -- 172.21.15.110:0/1358585246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 msgr2=0x7fb790101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.106+0000 7fb7952e3640 1 --2- 172.21.15.110:0/1358585246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790101880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7800048d0 tx=0x7fb780009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.106+0000 7fb7952e3640 1 -- 172.21.15.110:0/1358585246 shutdown_connections 2024-09-16T02:12:06.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.106+0000 7fb7952e3640 1 --2- 172.21.15.110:0/1358585246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7900fb470 0x7fb7900fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.106+0000 7fb7952e3640 1 --2- 172.21.15.110:0/1358585246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790101880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.106+0000 7fb7952e3640 1 -- 172.21.15.110:0/1358585246 >> 172.21.15.110:0/1358585246 conn(0x7fb7900f7030 msgr2=0x7fb7900f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:06.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.107+0000 7fb7952e3640 1 -- 172.21.15.110:0/1358585246 shutdown_connections 2024-09-16T02:12:06.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.107+0000 7fb7952e3640 1 -- 172.21.15.110:0/1358585246 wait complete. 2024-09-16T02:12:06.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.107+0000 7fb7952e3640 1 Processor -- start 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.107+0000 7fb7952e3640 1 -- start start 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb7952e3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7900fb470 0x7fb7901153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb7952e3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb7952e3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790115f10 con 0x7fb7901014b0 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb7952e3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79010f350 con 0x7fb7900fb470 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb787fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb787fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49760/0 (socket says 172.21.15.110:49760) 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb787fff640 1 -- 172.21.15.110:0/3954829519 learned_addr learned my addr 172.21.15.110:0/3954829519 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb78effd640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7900fb470 0x7fb7901153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb787fff640 1 -- 172.21.15.110:0/3954829519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7900fb470 msgr2=0x7fb7901153d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb787fff640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7900fb470 0x7fb7901153d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.108+0000 7fb787fff640 1 -- 172.21.15.110:0/3954829519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780005040 con 0x7fb7901014b0 2024-09-16T02:12:06.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.109+0000 7fb787fff640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790115910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb778002a50 tx=0x7fb778004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:06.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.109+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb778007c30 con 0x7fb7901014b0 2024-09-16T02:12:06.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.109+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb77800f040 con 0x7fb7901014b0 2024-09-16T02:12:06.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.109+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77800da10 con 0x7fb7901014b0 2024-09-16T02:12:06.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.109+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79010f630 con 0x7fb7901014b0 2024-09-16T02:12:06.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.109+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79010fbd0 con 0x7fb7901014b0 2024-09-16T02:12:06.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.110+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb770005210 con 0x7fb7901014b0 2024-09-16T02:12:06.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.111+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb77800db70 con 0x7fb7901014b0 2024-09-16T02:12:06.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.111+0000 7fb7877fe640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb77c06e5f0 0x7fb77c070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.112+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fb77808d5a0 con 0x7fb7901014b0 2024-09-16T02:12:06.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.112+0000 7fb78effd640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb77c06e5f0 0x7fb77c070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.112+0000 7fb78effd640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb77c06e5f0 0x7fb77c070aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb780009ac0 tx=0x7fb780035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:06.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.119+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb77805a490 con 0x7fb7901014b0 2024-09-16T02:12:06.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.376+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb770005cd0 con 0x7fb7901014b0 2024-09-16T02:12:06.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.377+0000 7fb7877fe640 1 -- 172.21.15.110:0/3954829519 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fb77805a020 con 0x7fb7901014b0 2024-09-16T02:12:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:12:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 3, 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:12:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 7, 2024-09-16T02:12:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T02:12:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:12:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb77c06e5f0 msgr2=0x7fb77c070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb77c06e5f0 0x7fb77c070aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb780009ac0 tx=0x7fb780035040 comp rx=0 tx=0).stop 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 msgr2=0x7fb790115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790115910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb778002a50 tx=0x7fb778004600 comp rx=0 tx=0).stop 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 shutdown_connections 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb77c06e5f0 0x7fb77c070aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7901014b0 0x7fb790115910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 --2- 172.21.15.110:0/3954829519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7900fb470 0x7fb7901153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.379+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 >> 172.21.15.110:0/3954829519 conn(0x7fb7900f7030 msgr2=0x7fb7900fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:06.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.380+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 shutdown_connections 2024-09-16T02:12:06.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.380+0000 7fb7952e3640 1 -- 172.21.15.110:0/3954829519 wait complete. 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.495+0000 7fb47f98d640 1 -- 172.21.15.110:0/1844855920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4780fe450 msgr2=0x7fb4780fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.495+0000 7fb47f98d640 1 --2- 172.21.15.110:0/1844855920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4780fe450 0x7fb4780fe820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb4740048d0 tx=0x7fb474009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.495+0000 7fb47f98d640 1 -- 172.21.15.110:0/1844855920 shutdown_connections 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.495+0000 7fb47f98d640 1 --2- 172.21.15.110:0/1844855920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb478064fe0 0x7fb478065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.495+0000 7fb47f98d640 1 --2- 172.21.15.110:0/1844855920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4780fe450 0x7fb4780fe820 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.495+0000 7fb47f98d640 1 -- 172.21.15.110:0/1844855920 >> 172.21.15.110:0/1844855920 conn(0x7fb4780723b0 msgr2=0x7fb4780727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:06.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.496+0000 7fb47f98d640 1 -- 172.21.15.110:0/1844855920 shutdown_connections 2024-09-16T02:12:06.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.496+0000 7fb47f98d640 1 -- 172.21.15.110:0/1844855920 wait complete. 2024-09-16T02:12:06.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.496+0000 7fb47f98d640 1 Processor -- start 2024-09-16T02:12:06.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.496+0000 7fb47f98d640 1 -- start start 2024-09-16T02:12:06.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47f98d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 0x7fb478113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47f98d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4780fe450 0x7fb478113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47f98d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb478113e20 con 0x7fb478064fe0 2024-09-16T02:12:06.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47f98d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47810d1d0 con 0x7fb4780fe450 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 0x7fb478113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 0x7fb478113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49790/0 (socket says 172.21.15.110:49790) 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 -- 172.21.15.110:0/2221714746 learned_addr learned my addr 172.21.15.110:0/2221714746 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47cf28640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4780fe450 0x7fb478113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 -- 172.21.15.110:0/2221714746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4780fe450 msgr2=0x7fb478113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4780fe450 0x7fb478113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 -- 172.21.15.110:0/2221714746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474005040 con 0x7fb478064fe0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb47d729640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 0x7fb478113250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb474003080 tx=0x7fb474009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.497+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb474038070 con 0x7fb478064fe0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.498+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47810d450 con 0x7fb478064fe0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.498+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb4740097e0 con 0x7fb478064fe0 2024-09-16T02:12:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.498+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47403d420 con 0x7fb478064fe0 2024-09-16T02:12:06.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.498+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47810d910 con 0x7fb478064fe0 2024-09-16T02:12:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.499+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4780fdce0 con 0x7fb478064fe0 2024-09-16T02:12:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.499+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb474030020 con 0x7fb478064fe0 2024-09-16T02:12:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.500+0000 7fb46dffb640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb46406e530 0x7fb4640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.500+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fb4740ae570 con 0x7fb478064fe0 2024-09-16T02:12:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.500+0000 7fb47cf28640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb46406e530 0x7fb4640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.501+0000 7fb47cf28640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb46406e530 0x7fb4640709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb47810eb10 tx=0x7fb468009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:06.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.504+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb474077760 con 0x7fb478064fe0 2024-09-16T02:12:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:06 smithi165 ceph-mon[77258]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 719 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:06 smithi165 ceph-mon[77258]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:06 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3954829519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:06.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:06 smithi110 ceph-mon[98215]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 719 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:06 smithi110 ceph-mon[98215]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:06 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3954829519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:06.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.716+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb47804b720 con 0x7fb478064fe0 2024-09-16T02:12:06.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.717+0000 7fb46dffb640 1 -- 172.21.15.110:0/2221714746 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7fb47407ae20 con 0x7fb478064fe0 2024-09-16T02:12:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:12:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:12:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:12:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:12:06.722 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:06.723 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:12:06.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb46406e530 msgr2=0x7fb4640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb46406e530 0x7fb4640709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb47810eb10 tx=0x7fb468009120 comp rx=0 tx=0).stop 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 msgr2=0x7fb478113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 0x7fb478113250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb474003080 tx=0x7fb474009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 shutdown_connections 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb46406e530 0x7fb4640709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4780fe450 0x7fb478113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 --2- 172.21.15.110:0/2221714746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb478064fe0 0x7fb478113250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 >> 172.21.15.110:0/2221714746 conn(0x7fb4780723b0 msgr2=0x7fb4780fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 shutdown_connections 2024-09-16T02:12:06.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.719+0000 7fb47f98d640 1 -- 172.21.15.110:0/2221714746 wait complete. 2024-09-16T02:12:06.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 -- 172.21.15.110:0/2641120819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5884102620 msgr2=0x7f58841029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 --2- 172.21.15.110:0/2641120819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5884102620 0x7f58841029f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58740048d0 tx=0x7f5874009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 -- 172.21.15.110:0/2641120819 shutdown_connections 2024-09-16T02:12:06.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 --2- 172.21.15.110:0/2641120819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58840fac80 0x7f58840fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 --2- 172.21.15.110:0/2641120819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5884102620 0x7f58841029f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 -- 172.21.15.110:0/2641120819 >> 172.21.15.110:0/2641120819 conn(0x7f5884070ce0 msgr2=0x7f58840710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:06.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 -- 172.21.15.110:0/2641120819 shutdown_connections 2024-09-16T02:12:06.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.803+0000 7f58899cd640 1 -- 172.21.15.110:0/2641120819 wait complete. 2024-09-16T02:12:06.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f58899cd640 1 Processor -- start 2024-09-16T02:12:06.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f58899cd640 1 -- start start 2024-09-16T02:12:06.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f58899cd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 0x7f58841131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f58899cd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5884102620 0x7f5884113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f58899cd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884113d00 con 0x7f58840fac80 2024-09-16T02:12:06.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f58899cd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588410d140 con 0x7f5884102620 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.804+0000 7f5882ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 0x7f58841131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f5882ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 0x7f58841131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49812/0 (socket says 172.21.15.110:49812) 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f5882ffd640 1 -- 172.21.15.110:0/3335536936 learned_addr learned my addr 172.21.15.110:0/3335536936 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f587a7fc640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5884102620 0x7f5884113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f5882ffd640 1 -- 172.21.15.110:0/3335536936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5884102620 msgr2=0x7f5884113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f5882ffd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5884102620 0x7f5884113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f5882ffd640 1 -- 172.21.15.110:0/3335536936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874005040 con 0x7f58840fac80 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f5882ffd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 0x7f58841131c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5874000c00 tx=0x7f5874009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5874038070 con 0x7f58840fac80 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f587402ade0 con 0x7f58840fac80 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588410d3c0 con 0x7f58840fac80 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.805+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587402c7e0 con 0x7f58840fac80 2024-09-16T02:12:06.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.806+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588410d900 con 0x7f58840fac80 2024-09-16T02:12:06.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.807+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58840657b0 con 0x7f58840fac80 2024-09-16T02:12:06.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.807+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5874030020 con 0x7f58840fac80 2024-09-16T02:12:06.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.808+0000 7f587bfff640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f587006e530 0x7f58700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:06.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.808+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f58740adc50 con 0x7f58840fac80 2024-09-16T02:12:06.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.808+0000 7f587a7fc640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f587006e530 0x7f58700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:06.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.808+0000 7f587a7fc640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f587006e530 0x7f58700709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f588410ea80 tx=0x7f586c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:06.812+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5874076f70 con 0x7f58840fac80 2024-09-16T02:12:07.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.008+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f588404b720 con 0x7f587006e530 2024-09-16T02:12:07.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.009+0000 7f587bfff640 1 -- 172.21.15.110:0/3335536936 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f588404b720 con 0x7f587006e530 2024-09-16T02:12:07.011 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:12:07.012 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:12:07.013 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:12:07.013 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "9/21 daemons upgraded", 2024-09-16T02:12:07.013 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T02:12:07.013 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:12:07.013 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:12:07.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f587006e530 msgr2=0x7f58700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:07.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f587006e530 0x7f58700709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f588410ea80 tx=0x7f586c00b040 comp rx=0 tx=0).stop 2024-09-16T02:12:07.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 msgr2=0x7f58841131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:07.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 0x7f58841131c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5874000c00 tx=0x7f5874009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 shutdown_connections 2024-09-16T02:12:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f587006e530 0x7f58700709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5884102620 0x7f5884113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 --2- 172.21.15.110:0/3335536936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58840fac80 0x7f58841131c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 >> 172.21.15.110:0/3335536936 conn(0x7f5884070ce0 msgr2=0x7f5884105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 shutdown_connections 2024-09-16T02:12:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.012+0000 7f58899cd640 1 -- 172.21.15.110:0/3335536936 wait complete. 2024-09-16T02:12:07.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 -- 172.21.15.110:0/3692692233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 msgr2=0x7f89f80fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:07.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 --2- 172.21.15.110:0/3692692233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f80fb780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0048d0 tx=0x7f89ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 -- 172.21.15.110:0/3692692233 shutdown_connections 2024-09-16T02:12:07.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 --2- 172.21.15.110:0/3692692233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f80fbd50 0x7f89f8108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 --2- 172.21.15.110:0/3692692233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f80fb780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 -- 172.21.15.110:0/3692692233 >> 172.21.15.110:0/3692692233 conn(0x7f89f80f7030 msgr2=0x7f89f80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 -- 172.21.15.110:0/3692692233 shutdown_connections 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.106+0000 7f89fea70640 1 -- 172.21.15.110:0/3692692233 wait complete. 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fea70640 1 Processor -- start 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fea70640 1 -- start start 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fea70640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f8115490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fea70640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f80fbd50 0x7f89f81159d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fea70640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8116020 con 0x7f89f80fb3b0 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fea70640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f810f480 con 0x7f89f80fbd50 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fc80c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f8115490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:07.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fc80c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f8115490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49828/0 (socket says 172.21.15.110:49828) 2024-09-16T02:12:07.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89fc80c640 1 -- 172.21.15.110:0/3040402727 learned_addr learned my addr 172.21.15.110:0/3040402727 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:07.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.107+0000 7f89f7fff640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f80fbd50 0x7f89f81159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:07.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89fc80c640 1 -- 172.21.15.110:0/3040402727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f80fbd50 msgr2=0x7f89f81159d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:07.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89fc80c640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f80fbd50 0x7f89f81159d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89fc80c640 1 -- 172.21.15.110:0/3040402727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec005040 con 0x7f89f80fb3b0 2024-09-16T02:12:07.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89fc80c640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f8115490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89ec004930 tx=0x7f89ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:07.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec038070 con 0x7f89f80fb3b0 2024-09-16T02:12:07.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f89ec02add0 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f810f700 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec02c820 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.108+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f810fb80 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.109+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f80fac90 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.110+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f89ec030020 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.110+0000 7f89f57fa640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f89e806e530 0x7f89e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.110+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f89ec0add70 con 0x7f89f80fb3b0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.110+0000 7f89f7fff640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f89e806e530 0x7f89e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:07.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.111+0000 7f89f7fff640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f89e806e530 0x7f89e80709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89f8110e50 tx=0x7f89e400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:07.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.114+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f89ec0771c0 con 0x7f89f80fb3b0 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.376+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f89f8110b00 con 0x7f89f80fb3b0 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.376+0000 7f89f57fa640 1 -- 172.21.15.110:0/3040402727 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1130 (secure 0 0 0) 0x7f89ec041480 con 0x7f89f80fb3b0 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout: osd.2 (root=default,host=smithi110) is down 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-16T02:12:07.379 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-16T02:12:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-16T02:12:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f89e806e530 msgr2=0x7f89e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f89e806e530 0x7f89e80709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89f8110e50 tx=0x7f89e400b040 comp rx=0 tx=0).stop 2024-09-16T02:12:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 msgr2=0x7f89f8115490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f8115490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89ec004930 tx=0x7f89ec009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 shutdown_connections 2024-09-16T02:12:07.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f89e806e530 0x7f89e80709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f80fbd50 0x7f89f81159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 --2- 172.21.15.110:0/3040402727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89f80fb3b0 0x7f89f8115490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:07.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 >> 172.21.15.110:0/3040402727 conn(0x7f89f80f7030 msgr2=0x7f89f80f75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:07.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 shutdown_connections 2024-09-16T02:12:07.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:07.379+0000 7f89fea70640 1 -- 172.21.15.110:0/3040402727 wait complete. 2024-09-16T02:12:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:07.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2221714746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:12:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:07.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:07 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3040402727' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:12:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2221714746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:12:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:07.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:07.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:07.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3040402727' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:12:08.199 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:07 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[120079]: 2024-09-16T02:12:07.888+0000 7fa5263d1640 -1 osd.2 57 log_to_monitors true 2024-09-16T02:12:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:08 smithi110 ceph-mon[98215]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:08 smithi110 ceph-mon[98215]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 653 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:08 smithi110 ceph-mon[98215]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T02:12:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:08 smithi165 ceph-mon[77258]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:08 smithi165 ceph-mon[77258]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 653 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:08 smithi165 ceph-mon[77258]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T02:12:09.707 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:12:09 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[120079]: 2024-09-16T02:12:09.498+0000 7fa51a163640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:12:10.149 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:09 smithi110 ceph-mon[98215]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T02:12:10.149 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:09 smithi110 ceph-mon[98215]: osdmap e60: 6 total, 5 up, 6 in 2024-09-16T02:12:10.149 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:09 smithi110 ceph-mon[98215]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:12:10.149 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:09 smithi110 ceph-mon[98215]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:10.149 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:09 smithi110 ceph-mon[98215]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' 2024-09-16T02:12:10.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:09 smithi165 ceph-mon[77258]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T02:12:10.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:09 smithi165 ceph-mon[77258]: osdmap e60: 6 total, 5 up, 6 in 2024-09-16T02:12:10.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:09 smithi165 ceph-mon[77258]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-16T02:12:10.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:09 smithi165 ceph-mon[77258]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:10.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:09 smithi165 ceph-mon[77258]: from='osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229]' entity='osd.2' 2024-09-16T02:12:11.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:11.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:11.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:12:11.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:12:11.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:11.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:11.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:11.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:11.452 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:11.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:11.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:11.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T02:12:11.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:12:11.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229] boot 2024-09-16T02:12:11.453 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: osdmap e61: 6 total, 6 up, 6 in 2024-09-16T02:12:11.454 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:12:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:11.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:11.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:12:11.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:12:11.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:11.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:11.458 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:11.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:11.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:11.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:11.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:11.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T02:12:11.459 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:12:11.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: osd.2 [v2:172.21.15.110:6818/1026248229,v1:172.21.15.110:6819/1026248229] boot 2024-09-16T02:12:11.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: osdmap e61: 6 total, 6 up, 6 in 2024-09-16T02:12:11.460 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T02:12:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:12 smithi110 ceph-mon[98215]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:12 smithi110 ceph-mon[98215]: osdmap e62: 6 total, 6 up, 6 in 2024-09-16T02:12:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:12 smithi165 ceph-mon[77258]: pgmap v94: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-16T02:12:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:12 smithi165 ceph-mon[77258]: osdmap e62: 6 total, 6 up, 6 in 2024-09-16T02:12:13.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:13 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 17/264 objects degraded (6.439%), 5 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:13.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:13 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 17/264 objects degraded (6.439%), 5 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:14 smithi165 ceph-mon[77258]: pgmap v96: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 56 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 17/264 objects degraded (6.439%) 2024-09-16T02:12:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:14 smithi110 ceph-mon[98215]: pgmap v96: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 56 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 17/264 objects degraded (6.439%) 2024-09-16T02:12:15.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:15 smithi165 ceph-mon[77258]: pgmap v97: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 780 B/s rd, 1 op/s 2024-09-16T02:12:15.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:15 smithi165 ceph-mon[77258]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/264 objects degraded (6.439%), 5 pgs degraded) 2024-09-16T02:12:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:15 smithi110 ceph-mon[98215]: pgmap v97: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 780 B/s rd, 1 op/s 2024-09-16T02:12:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:15 smithi110 ceph-mon[98215]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/264 objects degraded (6.439%), 5 pgs degraded) 2024-09-16T02:12:18.653 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:18 smithi165 ceph-mon[77258]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:12:18.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:18 smithi110 ceph-mon[98215]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T02:12:20.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:20 smithi165 ceph-mon[77258]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T02:12:20.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:20 smithi110 ceph-mon[98215]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T02:12:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:22 smithi165 ceph-mon[77258]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:12:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:22.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:22 smithi110 ceph-mon[98215]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:12:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:24.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:24 smithi165 ceph-mon[77258]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-16T02:12:24.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:24 smithi110 ceph-mon[98215]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-16T02:12:25.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:25 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:25.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:25 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:26.400 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:26 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:26 smithi165 ceph-mon[77258]: Upgrade: osd.3 is safe to restart 2024-09-16T02:12:26.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:26 smithi165 ceph-mon[77258]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:12:26.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:26 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T02:12:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:26 smithi110 ceph-mon[98215]: Upgrade: osd.3 is safe to restart 2024-09-16T02:12:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:26 smithi110 ceph-mon[98215]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:12:27.942 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:27 smithi165 ceph-mon[77258]: Upgrade: Updating osd.3 2024-09-16T02:12:27.943 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:27.943 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T02:12:27.943 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:12:27.943 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:27 smithi165 ceph-mon[77258]: Deploying daemon osd.3 on smithi165 2024-09-16T02:12:27.943 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:27 smithi165 ceph-mon[77258]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:12:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:27 smithi110 ceph-mon[98215]: Upgrade: Updating osd.3 2024-09-16T02:12:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T02:12:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:12:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:27 smithi110 ceph-mon[98215]: Deploying daemon osd.3 on smithi165 2024-09-16T02:12:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:27 smithi110 ceph-mon[98215]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:12:29.749 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:29 smithi165 systemd[1]: Stopping Ceph osd.3 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:12:30.200 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:29 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[39926]: 2024-09-16T02:12:29.760+0000 7f5090808640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:12:30.200 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:29 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[39926]: 2024-09-16T02:12:29.760+0000 7f5090808640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-16T02:12:30.201 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:29 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[39926]: 2024-09-16T02:12:29.760+0000 7f5090808640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:12:30.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:30 smithi110 ceph-mon[98215]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:12:30.661 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:30 smithi110 ceph-mon[98215]: osd.3 marked itself down and dead 2024-09-16T02:12:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:30 smithi165 ceph-mon[77258]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:12:30.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:30 smithi165 ceph-mon[77258]: osd.3 marked itself down and dead 2024-09-16T02:12:31.121 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:30 smithi165 podman[86221]: 2024-09-16 02:12:30.859302063 +0000 UTC m=+1.212146913 container died 21019b693d1c25e4a5bfc30561aeab81d015612ec5848af6c781ed70a4ea405f (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=quincy-6d025bc, maintainer=Guillaume Abrioux ) 2024-09-16T02:12:31.405 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:31 smithi165 podman[86221]: 2024-09-16 02:12:31.210790001 +0000 UTC m=+1.563634847 container cleanup 21019b693d1c25e4a5bfc30561aeab81d015612ec5848af6c781ed70a4ea405f (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-6d025bc) 2024-09-16T02:12:31.405 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:31 smithi165 bash[86221]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3 2024-09-16T02:12:31.676 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:31 smithi110 ceph-mon[98215]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:12:31.677 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:31 smithi110 ceph-mon[98215]: osdmap e63: 6 total, 5 up, 6 in 2024-09-16T02:12:31.677 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:31 smithi110 ceph-mon[98215]: osdmap e64: 6 total, 5 up, 6 in 2024-09-16T02:12:31.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:31 smithi165 ceph-mon[77258]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:12:31.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:31 smithi165 ceph-mon[77258]: osdmap e63: 6 total, 5 up, 6 in 2024-09-16T02:12:31.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:31 smithi165 ceph-mon[77258]: osdmap e64: 6 total, 5 up, 6 in 2024-09-16T02:12:31.700 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:31 smithi165 podman[86247]: 2024-09-16 02:12:31.428802469 +0000 UTC m=+0.570568286 container remove 21019b693d1c25e4a5bfc30561aeab81d015612ec5848af6c781ed70a4ea405f (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=quincy-6d025bc, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T02:12:32.008 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:31 smithi165 podman[86335]: 2024-09-16 02:12:31.648972515 +0000 UTC m=+0.015766338 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:12:32.008 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:31 smithi165 podman[86335]: 2024-09-16 02:12:31.779790276 +0000 UTC m=+0.146584086 container create d925687a6919addc81e3ccf157348e5984f14cce31dde3913ca8d8d110d507e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-16T02:12:32.008 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 podman[86335]: 2024-09-16 02:12:32.007220144 +0000 UTC m=+0.374013958 container init d925687a6919addc81e3ccf157348e5984f14cce31dde3913ca8d8d110d507e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-16T02:12:32.405 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 podman[86335]: 2024-09-16 02:12:32.01070203 +0000 UTC m=+0.377495841 container start d925687a6919addc81e3ccf157348e5984f14cce31dde3913ca8d8d110d507e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-16T02:12:32.405 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 podman[86335]: 2024-09-16 02:12:32.073675655 +0000 UTC m=+0.440469475 container attach d925687a6919addc81e3ccf157348e5984f14cce31dde3913ca8d8d110d507e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:12:32.405 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 podman[86335]: 2024-09-16 02:12:32.192666511 +0000 UTC m=+0.559460322 container died d925687a6919addc81e3ccf157348e5984f14cce31dde3913ca8d8d110d507e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T02:12:32.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:32 smithi165 ceph-mon[77258]: pgmap v106: 65 pgs: 16 stale+active+clean, 49 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:12:32.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:32 smithi110 ceph-mon[98215]: pgmap v106: 65 pgs: 16 stale+active+clean, 49 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:12:33.181 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 podman[86358]: 2024-09-16 02:12:32.752070427 +0000 UTC m=+0.553700364 container remove d925687a6919addc81e3ccf157348e5984f14cce31dde3913ca8d8d110d507e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-16T02:12:33.181 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-16T02:12:33.181 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 systemd[1]: Stopped Ceph osd.3 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:12:33.181 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 1.002s CPU time. 2024-09-16T02:12:33.181 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:32 smithi165 systemd[1]: Starting Ceph osd.3 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:12:33.440 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 podman[86455]: 2024-09-16 02:12:33.082856104 +0000 UTC m=+0.016325587 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:12:33.440 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 podman[86455]: 2024-09-16 02:12:33.186563924 +0000 UTC m=+0.120033398 container create 847679f92f433ac44c501dd835360febcd2a92e182ec39684fdc7230c128df94 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T02:12:33.440 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 podman[86455]: 2024-09-16 02:12:33.439090474 +0000 UTC m=+0.372559949 container init 847679f92f433ac44c501dd835360febcd2a92e182ec39684fdc7230c128df94 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-16T02:12:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:33 smithi165 ceph-mon[77258]: Health check failed: Degraded data redundancy: 55/264 objects degraded (20.833%), 16 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:33.700 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 podman[86455]: 2024-09-16 02:12:33.442519873 +0000 UTC m=+0.375989356 container start 847679f92f433ac44c501dd835360febcd2a92e182ec39684fdc7230c128df94 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:12:33.701 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 podman[86455]: 2024-09-16 02:12:33.530825024 +0000 UTC m=+0.464294516 container attach 847679f92f433ac44c501dd835360febcd2a92e182ec39684fdc7230c128df94 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-16T02:12:33.701 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:12:33.701 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 bash[86455]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:12:33.701 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:12:33.701 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:33 smithi165 bash[86455]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:12:33.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:33 smithi110 ceph-mon[98215]: Health check failed: Degraded data redundancy: 55/264 objects degraded (20.833%), 16 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:34.595 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-mon[77258]: pgmap v108: 65 pgs: 18 active+undersized, 1 stale+active+clean, 16 active+undersized+degraded, 30 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 55/264 objects degraded (20.833%) 2024-09-16T02:12:34.595 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T02:12:34.595 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T02:12:34.595 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T02:12:34.595 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T02:12:34.912 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T02:12:34.912 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate[86470]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 bash[86455]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-16T02:12:34.913 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:34 smithi165 podman[86455]: 2024-09-16 02:12:34.622699157 +0000 UTC m=+1.556168640 container died 847679f92f433ac44c501dd835360febcd2a92e182ec39684fdc7230c128df94 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-16T02:12:34.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:34 smithi110 ceph-mon[98215]: pgmap v108: 65 pgs: 18 active+undersized, 1 stale+active+clean, 16 active+undersized+degraded, 30 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 55/264 objects degraded (20.833%) 2024-09-16T02:12:35.450 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 podman[86610]: 2024-09-16 02:12:35.187528762 +0000 UTC m=+0.558525844 container remove 847679f92f433ac44c501dd835360febcd2a92e182ec39684fdc7230c128df94 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-16T02:12:35.450 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 podman[86668]: 2024-09-16 02:12:35.389689148 +0000 UTC m=+0.109716674 container create 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-16T02:12:35.451 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 podman[86668]: 2024-09-16 02:12:35.295901262 +0000 UTC m=+0.015928801 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:12:35.950 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 podman[86668]: 2024-09-16 02:12:35.618476753 +0000 UTC m=+0.338504280 container init 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-16T02:12:35.950 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 podman[86668]: 2024-09-16 02:12:35.621690321 +0000 UTC m=+0.341717848 container start 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-16T02:12:35.951 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 ceph-osd[86687]: -- 172.21.15.165:0/2741188299 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f73c361e0 con 0x563f72de3c00 2024-09-16T02:12:35.951 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 bash[86668]: 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb 2024-09-16T02:12:35.951 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:35 smithi165 systemd[1]: Started Ceph osd.3 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:12:36.642 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:36 smithi165 ceph-mon[77258]: pgmap v109: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:36.642 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:36.642 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:36.642 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:36 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:36.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:36 smithi110 ceph-mon[98215]: pgmap v109: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:36.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:36.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:36.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:36 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:37.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.470+0000 7fd51d76e640 1 -- 172.21.15.110:0/3700524390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102ed0 msgr2=0x7fd5180fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.470+0000 7fd51d76e640 1 --2- 172.21.15.110:0/3700524390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102ed0 0x7fd5180fc590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5000048d0 tx=0x7fd500009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- 172.21.15.110:0/3700524390 shutdown_connections 2024-09-16T02:12:37.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 --2- 172.21.15.110:0/3700524390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102ed0 0x7fd5180fc590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 --2- 172.21.15.110:0/3700524390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd518102530 0x7fd518102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- 172.21.15.110:0/3700524390 >> 172.21.15.110:0/3700524390 conn(0x7fd5180f80f0 msgr2=0x7fd5180fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- 172.21.15.110:0/3700524390 shutdown_connections 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- 172.21.15.110:0/3700524390 wait complete. 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 Processor -- start 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- start start 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 0x7fd5181131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd518102ed0 0x7fd518113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518113d10 con 0x7fd518102530 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd51d76e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51810d150 con 0x7fd518102ed0 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.471+0000 7fd516ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 0x7fd5181131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:37.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd516ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 0x7fd5181131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37244/0 (socket says 172.21.15.110:37244) 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd516ffd640 1 -- 172.21.15.110:0/1518897023 learned_addr learned my addr 172.21.15.110:0/1518897023 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd50ffff640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd518102ed0 0x7fd518113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd516ffd640 1 -- 172.21.15.110:0/1518897023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd518102ed0 msgr2=0x7fd518113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd516ffd640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd518102ed0 0x7fd518113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd516ffd640 1 -- 172.21.15.110:0/1518897023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500005040 con 0x7fd518102530 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd516ffd640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 0x7fd5181131d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd508002a80 tx=0x7fd508004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd508007c30 con 0x7fd518102530 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd50800f040 con 0x7fd518102530 2024-09-16T02:12:37.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51810d430 con 0x7fd518102530 2024-09-16T02:12:37.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50800dab0 con 0x7fd518102530 2024-09-16T02:12:37.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.472+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51810d920 con 0x7fd518102530 2024-09-16T02:12:37.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.473+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5180fdcb0 con 0x7fd518102530 2024-09-16T02:12:37.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.474+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd50800dc10 con 0x7fd518102530 2024-09-16T02:12:37.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.474+0000 7fd50f7fe640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd50406e530 0x7fd5040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:37.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.474+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fd50808d830 con 0x7fd518102530 2024-09-16T02:12:37.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.474+0000 7fd50ffff640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd50406e530 0x7fd5040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:37.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.475+0000 7fd50ffff640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd50406e530 0x7fd5040709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5000048a0 tx=0x7fd500035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:37.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.479+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd508056b50 con 0x7fd518102530 2024-09-16T02:12:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.659+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd51804b7a0 con 0x7fd50406e530 2024-09-16T02:12:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.660+0000 7fd50f7fe640 1 -- 172.21.15.110:0/1518897023 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd51804b7a0 con 0x7fd50406e530 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd50406e530 msgr2=0x7fd5040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd50406e530 0x7fd5040709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5000048a0 tx=0x7fd500035040 comp rx=0 tx=0).stop 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 msgr2=0x7fd5181131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 0x7fd5181131d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd508002a80 tx=0x7fd508004600 comp rx=0 tx=0).stop 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 shutdown_connections 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd50406e530 0x7fd5040709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd518102ed0 0x7fd518113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 --2- 172.21.15.110:0/1518897023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd518102530 0x7fd5181131d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 >> 172.21.15.110:0/1518897023 conn(0x7fd5180f80f0 msgr2=0x7fd5180f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:37.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 shutdown_connections 2024-09-16T02:12:37.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.662+0000 7fd51d76e640 1 -- 172.21.15.110:0/1518897023 wait complete. 2024-09-16T02:12:37.672 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:12:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.741+0000 7fd2def2d640 1 -- 172.21.15.110:0/4158403293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 msgr2=0x7fd2d81018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.741+0000 7fd2def2d640 1 --2- 172.21.15.110:0/4158403293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d81018b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0048d0 tx=0x7fd2cc009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.741+0000 7fd2def2d640 1 -- 172.21.15.110:0/4158403293 shutdown_connections 2024-09-16T02:12:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.741+0000 7fd2def2d640 1 --2- 172.21.15.110:0/4158403293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d80fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.741+0000 7fd2def2d640 1 --2- 172.21.15.110:0/4158403293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d81018b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.741+0000 7fd2def2d640 1 -- 172.21.15.110:0/4158403293 >> 172.21.15.110:0/4158403293 conn(0x7fd2d80f7060 msgr2=0x7fd2d80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.742+0000 7fd2def2d640 1 -- 172.21.15.110:0/4158403293 shutdown_connections 2024-09-16T02:12:37.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.742+0000 7fd2def2d640 1 -- 172.21.15.110:0/4158403293 wait complete. 2024-09-16T02:12:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.742+0000 7fd2def2d640 1 Processor -- start 2024-09-16T02:12:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.742+0000 7fd2def2d640 1 -- start start 2024-09-16T02:12:37.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2def2d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d810e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2def2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d810e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2def2d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d810ed10 con 0x7fd2d81014e0 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2def2d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d810ee80 con 0x7fd2d80fb4a0 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d810e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2dccc9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d810e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d810e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37262/0 (socket says 172.21.15.110:37262) 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2dccc9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d810e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.110:48890/0 (socket says 172.21.15.110:48890) 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 -- 172.21.15.110:0/2006752627 learned_addr learned my addr 172.21.15.110:0/2006752627 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 -- 172.21.15.110:0/2006752627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 msgr2=0x7fd2d810e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d810e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 -- 172.21.15.110:0/2006752627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc005040 con 0x7fd2d81014e0 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2dccc9640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d810e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.743+0000 7fd2d7fff640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d810e6c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4002a50 tx=0x7fd2c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.744+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2c4007c30 con 0x7fd2d81014e0 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.744+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd2c400f040 con 0x7fd2d81014e0 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.744+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d81171f0 con 0x7fd2d81014e0 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.744+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2c400da50 con 0x7fd2d81014e0 2024-09-16T02:12:37.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.744+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d8117700 con 0x7fd2d81014e0 2024-09-16T02:12:37.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.745+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d80fcbe0 con 0x7fd2d81014e0 2024-09-16T02:12:37.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.746+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd2c400dc90 con 0x7fd2d81014e0 2024-09-16T02:12:37.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.746+0000 7fd2d57fa640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd2c806e530 0x7fd2c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:37.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.746+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fd2c408d730 con 0x7fd2d81014e0 2024-09-16T02:12:37.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.746+0000 7fd2dccc9640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd2c806e530 0x7fd2c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:37.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.747+0000 7fd2dccc9640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd2c806e530 0x7fd2c80709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009ac0 tx=0x7fd2cc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:37.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.752+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd2c40569d0 con 0x7fd2d81014e0 2024-09-16T02:12:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.933+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2d81084f0 con 0x7fd2c806e530 2024-09-16T02:12:37.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.934+0000 7fd2d57fa640 1 -- 172.21.15.110:0/2006752627 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd2d81084f0 con 0x7fd2c806e530 2024-09-16T02:12:37.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd2c806e530 msgr2=0x7fd2c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd2c806e530 0x7fd2c80709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009ac0 tx=0x7fd2cc035040 comp rx=0 tx=0).stop 2024-09-16T02:12:37.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 msgr2=0x7fd2d810e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:37.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d810e6c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4002a50 tx=0x7fd2c4004600 comp rx=0 tx=0).stop 2024-09-16T02:12:37.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 shutdown_connections 2024-09-16T02:12:37.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd2c806e530 0x7fd2c80709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2d81014e0 0x7fd2d810e6c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 --2- 172.21.15.110:0/2006752627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2d80fb4a0 0x7fd2d810e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:37.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 >> 172.21.15.110:0/2006752627 conn(0x7fd2d80f7060 msgr2=0x7fd2d80f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:37.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 shutdown_connections 2024-09-16T02:12:37.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:37.936+0000 7fd2def2d640 1 -- 172.21.15.110:0/2006752627 wait complete. 2024-09-16T02:12:37.950 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:37 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:12:37.494+0000 7f71ea836640 -1 Falling back to public interface 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 -- 172.21.15.110:0/3328285318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd81025f0 msgr2=0x7f4fd81029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3328285318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd81025f0 0x7f4fd81029c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40048d0 tx=0x7f4fd4009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 -- 172.21.15.110:0/3328285318 shutdown_connections 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3328285318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd80fac60 0x7f4fd80fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3328285318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd81025f0 0x7f4fd81029c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 -- 172.21.15.110:0/3328285318 >> 172.21.15.110:0/3328285318 conn(0x7f4fd8070c80 msgr2=0x7f4fd8071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 -- 172.21.15.110:0/3328285318 shutdown_connections 2024-09-16T02:12:38.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.015+0000 7f4fdf856640 1 -- 172.21.15.110:0/3328285318 wait complete. 2024-09-16T02:12:38.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdf856640 1 Processor -- start 2024-09-16T02:12:38.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdf856640 1 -- start start 2024-09-16T02:12:38.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdf856640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 0x7f4fd8113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdf856640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd81025f0 0x7f4fd8113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdf856640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8113d70 con 0x7f4fd80fac60 2024-09-16T02:12:38.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdf856640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8113ee0 con 0x7f4fd81025f0 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.016+0000 7f4fdd5f2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 0x7f4fd8113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdd5f2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 0x7f4fd8113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37288/0 (socket says 172.21.15.110:37288) 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdd5f2640 1 -- 172.21.15.110:0/3812108542 learned_addr learned my addr 172.21.15.110:0/3812108542 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdcdf1640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd81025f0 0x7f4fd8113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdd5f2640 1 -- 172.21.15.110:0/3812108542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd81025f0 msgr2=0x7f4fd8113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdd5f2640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd81025f0 0x7f4fd8113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdd5f2640 1 -- 172.21.15.110:0/3812108542 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4005040 con 0x7f4fd80fac60 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdd5f2640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 0x7f4fd8113230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4000c00 tx=0x7f4fd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd4038070 con 0x7f4fd80fac60 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd810d300 con 0x7f4fd80fac60 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4fd402ade0 con 0x7f4fd80fac60 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.017+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd402c7e0 con 0x7f4fd80fac60 2024-09-16T02:12:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.018+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd810d7c0 con 0x7f4fd80fac60 2024-09-16T02:12:38.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.018+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8065810 con 0x7f4fd80fac60 2024-09-16T02:12:38.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.019+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4fd4030020 con 0x7f4fd80fac60 2024-09-16T02:12:38.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.020+0000 7f4fcdffb640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4fc406e530 0x7f4fc40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.020+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f4fd40adcf0 con 0x7f4fd80fac60 2024-09-16T02:12:38.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.020+0000 7f4fdcdf1640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4fc406e530 0x7f4fc40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.020+0000 7f4fdcdf1640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4fc406e530 0x7f4fc40709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fd810eb30 tx=0x7f4fc800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.024+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4fd4076f90 con 0x7f4fd80fac60 2024-09-16T02:12:38.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.199+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fd810e8e0 con 0x7f4fc406e530 2024-09-16T02:12:38.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.208+0000 7f4fcdffb640 1 -- 172.21.15.110:0/3812108542 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4fd810e8e0 con 0x7f4fc406e530 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (6m) 32s ago 14m 24.6M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (2m) 32s ago 14m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (2m) 2m ago 13m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (4m) 32s ago 14m 81.9M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (9m) 32s ago 9m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (9m) 32s ago 9m 154M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (9m) 2m ago 9m 17.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (9m) 2m ago 9m 14.0M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (5m) 32s ago 15m 500M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:12:38.210 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (4m) 2m ago 13m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (3m) 32s ago 16m 44.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (2m) 2m ago 13m 31.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (6m) 32s ago 14m 17.1M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (5m) 2m ago 13m 16.2M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (108s) 32s ago 12m 88.6M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (73s) 32s ago 12m 94.2M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (37s) 32s ago 12m 14.4M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 starting - - - 2581M 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (11m) 2m ago 11m 209M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 a0dbde65e553 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (10m) 2m ago 10m 195M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:12:38.211 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (4m) 32s ago 14m 65.3M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:12:38.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4fc406e530 msgr2=0x7f4fc40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4fc406e530 0x7f4fc40709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fd810eb30 tx=0x7f4fc800b040 comp rx=0 tx=0).stop 2024-09-16T02:12:38.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 msgr2=0x7f4fd8113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 0x7f4fd8113230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4000c00 tx=0x7f4fd4009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 shutdown_connections 2024-09-16T02:12:38.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4fc406e530 0x7f4fc40709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd81025f0 0x7f4fd8113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 --2- 172.21.15.110:0/3812108542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fd80fac60 0x7f4fd8113230 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.210+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 >> 172.21.15.110:0/3812108542 conn(0x7f4fd8070c80 msgr2=0x7f4fd80f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.211+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 shutdown_connections 2024-09-16T02:12:38.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.211+0000 7f4fdf856640 1 -- 172.21.15.110:0/3812108542 wait complete. 2024-09-16T02:12:38.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 -- 172.21.15.110:0/2042424031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 msgr2=0x7f05e80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 --2- 172.21.15.110:0/2042424031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e80fc590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f05d00048d0 tx=0x7f05d0009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 -- 172.21.15.110:0/2042424031 shutdown_connections 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 --2- 172.21.15.110:0/2042424031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e80fc590 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 --2- 172.21.15.110:0/2042424031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05e8102530 0x7f05e8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 -- 172.21.15.110:0/2042424031 >> 172.21.15.110:0/2042424031 conn(0x7f05e80f80f0 msgr2=0x7f05e80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 -- 172.21.15.110:0/2042424031 shutdown_connections 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 -- 172.21.15.110:0/2042424031 wait complete. 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.288+0000 7f05edf7c640 1 Processor -- start 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05edf7c640 1 -- start start 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05edf7c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05e8102530 0x7f05e81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05edf7c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05edf7c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8113d30 con 0x7f05e8102ed0 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05edf7c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e810d170 con 0x7f05e8102530 2024-09-16T02:12:38.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37318/0 (socket says 172.21.15.110:37318) 2024-09-16T02:12:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 -- 172.21.15.110:0/3631341149 learned_addr learned my addr 172.21.15.110:0/3631341149 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05e77fe640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05e8102530 0x7f05e81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 -- 172.21.15.110:0/3631341149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05e8102530 msgr2=0x7f05e81131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05e8102530 0x7f05e81131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 -- 172.21.15.110:0/3631341149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0005040 con 0x7f05e8102ed0 2024-09-16T02:12:38.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.289+0000 7f05dffff640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e8113730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05d00043d0 tx=0x7f05d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.290+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05d0038070 con 0x7f05e8102ed0 2024-09-16T02:12:38.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.290+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05d00096e0 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.290+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05d002c8a0 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.290+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e810d3f0 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.290+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e810d930 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.291+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80fdcb0 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.292+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f05d0030020 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.292+0000 7f05e4ff9640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f05d406e530 0x7f05d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.292+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f05d00addd0 con 0x7f05e8102ed0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.292+0000 7f05e77fe640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f05d406e530 0x7f05d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.293+0000 7f05e77fe640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f05d406e530 0x7f05d40709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05d8007fd0 tx=0x7f05d8009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.296+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f05d0077020 con 0x7f05e8102ed0 2024-09-16T02:12:38.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.530+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f05e81095f0 con 0x7f05e8102ed0 2024-09-16T02:12:38.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.531+0000 7f05e4ff9640 1 -- 172.21.15.110:0/3631341149 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f05d007a6e0 con 0x7f05e8102ed0 2024-09-16T02:12:38.532 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:12:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:12:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:12:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2, 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 3 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:12:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 6, 2024-09-16T02:12:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 7 2024-09-16T02:12:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:12:38.534 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:12:38.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.532+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f05d406e530 msgr2=0x7f05d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.532+0000 7f05edf7c640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f05d406e530 0x7f05d40709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05d8007fd0 tx=0x7f05d8009e90 comp rx=0 tx=0).stop 2024-09-16T02:12:38.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.532+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 msgr2=0x7f05e8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.532+0000 7f05edf7c640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e8113730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05d00043d0 tx=0x7f05d0009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 shutdown_connections 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f05d406e530 0x7f05d40709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e8102ed0 0x7f05e8113730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 --2- 172.21.15.110:0/3631341149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05e8102530 0x7f05e81131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 >> 172.21.15.110:0/3631341149 conn(0x7f05e80f80f0 msgr2=0x7f05e80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 shutdown_connections 2024-09-16T02:12:38.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.533+0000 7f05edf7c640 1 -- 172.21.15.110:0/3631341149 wait complete. 2024-09-16T02:12:38.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 -- 172.21.15.110:0/1837527147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea70102620 msgr2=0x7fea701029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 --2- 172.21.15.110:0/1837527147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea70102620 0x7fea701029f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea600048d0 tx=0x7fea60009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 -- 172.21.15.110:0/1837527147 shutdown_connections 2024-09-16T02:12:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 --2- 172.21.15.110:0/1837527147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea700fac80 0x7fea700fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 --2- 172.21.15.110:0/1837527147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea70102620 0x7fea701029f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 -- 172.21.15.110:0/1837527147 >> 172.21.15.110:0/1837527147 conn(0x7fea70070ce0 msgr2=0x7fea700710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.615 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:38 smithi110 ceph-mon[98215]: pgmap v110: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:38.615 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:38.615 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 -- 172.21.15.110:0/1837527147 shutdown_connections 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.613+0000 7fea751a0640 1 -- 172.21.15.110:0/1837527147 wait complete. 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea751a0640 1 Processor -- start 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea751a0640 1 -- start start 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea751a0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 0x7fea701131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea751a0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea70102620 0x7fea70113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea751a0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea70113d00 con 0x7fea700fac80 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea751a0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7010d140 con 0x7fea70102620 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea6ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 0x7fea701131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea6ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 0x7fea701131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37334/0 (socket says 172.21.15.110:37334) 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea6ed9d640 1 -- 172.21.15.110:0/800110915 learned_addr learned my addr 172.21.15.110:0/800110915 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.614+0000 7fea6e59c640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea70102620 0x7fea70113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea6ed9d640 1 -- 172.21.15.110:0/800110915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea70102620 msgr2=0x7fea70113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea6ed9d640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea70102620 0x7fea70113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea6ed9d640 1 -- 172.21.15.110:0/800110915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60005040 con 0x7fea700fac80 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea6ed9d640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 0x7fea701131c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea60000c00 tx=0x7fea60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea60038070 con 0x7fea700fac80 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea6002ade0 con 0x7fea700fac80 2024-09-16T02:12:38.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6002c7b0 con 0x7fea700fac80 2024-09-16T02:12:38.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7010d3c0 con 0x7fea700fac80 2024-09-16T02:12:38.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.615+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7010d880 con 0x7fea700fac80 2024-09-16T02:12:38.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.616+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea700657b0 con 0x7fea700fac80 2024-09-16T02:12:38.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.617+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fea60030020 con 0x7fea700fac80 2024-09-16T02:12:38.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.617+0000 7fea577fe640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea58072940 0x7fea58074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.617+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fea600ae4a0 con 0x7fea700fac80 2024-09-16T02:12:38.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.617+0000 7fea6e59c640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea58072940 0x7fea58074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.618+0000 7fea6e59c640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea58072940 0x7fea58074df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea7010ea80 tx=0x7fea6400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.622+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea60077690 con 0x7fea700fac80 2024-09-16T02:12:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:38 smithi165 ceph-mon[77258]: pgmap v110: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:38.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:38.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.822+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea7004b750 con 0x7fea700fac80 2024-09-16T02:12:38.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.822+0000 7fea577fe640 1 -- 172.21.15.110:0/800110915 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7fea6007ad50 con 0x7fea700fac80 2024-09-16T02:12:38.824 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:12:38.824 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:12:38.824 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:12:38.824 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:12:38.824 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:12:38.824 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:38.825 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:12:38.825 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:12:38.825 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:12:38.825 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:12:38.825 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:12:38.825 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:12:38.826 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:12:38.827 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:38.828 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea58072940 msgr2=0x7fea58074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea58072940 0x7fea58074df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea7010ea80 tx=0x7fea6400b040 comp rx=0 tx=0).stop 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 msgr2=0x7fea701131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 0x7fea701131c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea60000c00 tx=0x7fea60009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 shutdown_connections 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea58072940 0x7fea58074df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea70102620 0x7fea70113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.824+0000 7fea751a0640 1 --2- 172.21.15.110:0/800110915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea700fac80 0x7fea701131c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.825+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 >> 172.21.15.110:0/800110915 conn(0x7fea70070ce0 msgr2=0x7fea70105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.825+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 shutdown_connections 2024-09-16T02:12:38.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.825+0000 7fea751a0640 1 -- 172.21.15.110:0/800110915 wait complete. 2024-09-16T02:12:38.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 -- 172.21.15.110:0/3991343427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102580 msgr2=0x7f9af8102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 --2- 172.21.15.110:0/3991343427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102580 0x7f9af8102950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0048d0 tx=0x7f9aec009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 -- 172.21.15.110:0/3991343427 shutdown_connections 2024-09-16T02:12:38.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 --2- 172.21.15.110:0/3991343427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9af8102f20 0x7f9af80fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 --2- 172.21.15.110:0/3991343427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102580 0x7f9af8102950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 -- 172.21.15.110:0/3991343427 >> 172.21.15.110:0/3991343427 conn(0x7f9af80f81a0 msgr2=0x7f9af80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:38.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 -- 172.21.15.110:0/3991343427 shutdown_connections 2024-09-16T02:12:38.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 -- 172.21.15.110:0/3991343427 wait complete. 2024-09-16T02:12:38.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 Processor -- start 2024-09-16T02:12:38.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.921+0000 7f9afee8b640 1 -- start start 2024-09-16T02:12:38.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9afee8b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9af8102580 0x7f9af8113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9afee8b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 0x7f9af8113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9afee8b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af8113d70 con 0x7f9af8102f20 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9afee8b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af810d1b0 con 0x7f9af8102580 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9af7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 0x7f9af8113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9af7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 0x7f9af8113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37358/0 (socket says 172.21.15.110:37358) 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9af7fff640 1 -- 172.21.15.110:0/1322272591 learned_addr learned my addr 172.21.15.110:0/1322272591 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9afcc27640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9af8102580 0x7f9af8113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9af7fff640 1 -- 172.21.15.110:0/1322272591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9af8102580 msgr2=0x7f9af8113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9af7fff640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9af8102580 0x7f9af8113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.922+0000 7f9af7fff640 1 -- 172.21.15.110:0/1322272591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec005040 con 0x7f9af8102f20 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.923+0000 7f9af7fff640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 0x7f9af8113770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4002840 tx=0x7f9ae4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.923+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ae4007c30 con 0x7f9af8102f20 2024-09-16T02:12:38.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.923+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9ae400f040 con 0x7f9af8102f20 2024-09-16T02:12:38.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.923+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af810d490 con 0x7f9af8102f20 2024-09-16T02:12:38.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.923+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ae400d990 con 0x7f9af8102f20 2024-09-16T02:12:38.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.923+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af810da30 con 0x7f9af8102f20 2024-09-16T02:12:38.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.924+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af80fdd00 con 0x7f9af8102f20 2024-09-16T02:12:38.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.924+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9ae4009600 con 0x7f9af8102f20 2024-09-16T02:12:38.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.925+0000 7f9af57fa640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9ae806e530 0x7f9ae80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:38.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.925+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f9ae408d710 con 0x7f9af8102f20 2024-09-16T02:12:38.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.925+0000 7f9afcc27640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9ae806e530 0x7f9ae80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:38.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.926+0000 7f9afcc27640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9ae806e530 0x7f9ae80709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009ac0 tx=0x7f9aec035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:38.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:38.930+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9ae4056a30 con 0x7f9af8102f20 2024-09-16T02:12:39.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.111+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9af81095f0 con 0x7f9ae806e530 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.113+0000 7f9af57fa640 1 -- 172.21.15.110:0/1322272591 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9af81095f0 con 0x7f9ae806e530 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:12:39.114 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "10/21 daemons upgraded", 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:12:39.115 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:12:39.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9ae806e530 msgr2=0x7f9ae80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:39.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9ae806e530 0x7f9ae80709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009ac0 tx=0x7f9aec035040 comp rx=0 tx=0).stop 2024-09-16T02:12:39.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 msgr2=0x7f9af8113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:39.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 0x7f9af8113770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4002840 tx=0x7f9ae4004570 comp rx=0 tx=0).stop 2024-09-16T02:12:39.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 shutdown_connections 2024-09-16T02:12:39.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f9ae806e530 0x7f9ae80709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af8102f20 0x7f9af8113770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 --2- 172.21.15.110:0/1322272591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9af8102580 0x7f9af8113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 >> 172.21.15.110:0/1322272591 conn(0x7f9af80f81a0 msgr2=0x7f9af80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:39.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 shutdown_connections 2024-09-16T02:12:39.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.115+0000 7f9afee8b640 1 -- 172.21.15.110:0/1322272591 wait complete. 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.193+0000 7f13c270e640 1 -- 172.21.15.110:0/1991382574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102ef0 msgr2=0x7f13bc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.193+0000 7f13c270e640 1 --2- 172.21.15.110:0/1991382574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102ef0 0x7f13bc0fc5b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13a40048d0 tx=0x7f13a4009da0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.193+0000 7f13c270e640 1 -- 172.21.15.110:0/1991382574 shutdown_connections 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.193+0000 7f13c270e640 1 --2- 172.21.15.110:0/1991382574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102ef0 0x7f13bc0fc5b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.193+0000 7f13c270e640 1 --2- 172.21.15.110:0/1991382574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102550 0x7f13bc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.193+0000 7f13c270e640 1 -- 172.21.15.110:0/1991382574 >> 172.21.15.110:0/1991382574 conn(0x7f13bc0f80f0 msgr2=0x7f13bc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 -- 172.21.15.110:0/1991382574 shutdown_connections 2024-09-16T02:12:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 -- 172.21.15.110:0/1991382574 wait complete. 2024-09-16T02:12:39.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 Processor -- start 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 -- start start 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 0x7f13bc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102ef0 0x7f13bc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc070490 con 0x7f13bc102550 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.194+0000 7f13c270e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc070600 con 0x7f13bc102ef0 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 0x7f13bc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 0x7f13bc06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37370/0 (socket says 172.21.15.110:37370) 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 -- 172.21.15.110:0/1828247281 learned_addr learned my addr 172.21.15.110:0/1828247281 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13b3fff640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102ef0 0x7f13bc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 -- 172.21.15.110:0/1828247281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102ef0 msgr2=0x7f13bc06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102ef0 0x7f13bc06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 -- 172.21.15.110:0/1828247281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4005040 con 0x7f13bc102550 2024-09-16T02:12:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13b3fff640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102ef0 0x7f13bc06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:12:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.195+0000 7f13bbfff640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 0x7f13bc06fa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00eb70 tx=0x7f13ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.196+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ac007c30 con 0x7f13bc102550 2024-09-16T02:12:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.196+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc070830 con 0x7f13bc102550 2024-09-16T02:12:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.196+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc119bc0 con 0x7f13bc102550 2024-09-16T02:12:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.196+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13ac00f040 con 0x7f13bc102550 2024-09-16T02:12:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.197+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ac009420 con 0x7f13bc102550 2024-09-16T02:12:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.198+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c005210 con 0x7f13bc102550 2024-09-16T02:12:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.198+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f13ac009660 con 0x7f13bc102550 2024-09-16T02:12:39.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.198+0000 7f13b97fa640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13a806e530 0x7f13a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:12:39.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.199+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f13ac08dba0 con 0x7f13bc102550 2024-09-16T02:12:39.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.199+0000 7f13b3fff640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13a806e530 0x7f13a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:12:39.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.199+0000 7f13b3fff640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13a806e530 0x7f13a80709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13a4000c00 tx=0x7f13a4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:12:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.203+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f13ac056ec0 con 0x7f13bc102550 2024-09-16T02:12:39.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.450+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f139c0054c0 con 0x7f13bc102550 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3631341149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/800110915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.452 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.450+0000 7f13b97fa640 1 -- 172.21.15.110:0/1828247281 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1461 (secure 0 0 0) 0x7f13ac0195d0 con 0x7f13bc102550 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout: osd.3 (root=default,host=smithi165) is down 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-16T02:12:39.453 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-16T02:12:39.454 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-16T02:12:39.455 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-16T02:12:39.455 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-16T02:12:39.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.452+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13a806e530 msgr2=0x7f13a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:39.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.452+0000 7f13c270e640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13a806e530 0x7f13a80709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13a4000c00 tx=0x7f13a4035040 comp rx=0 tx=0).stop 2024-09-16T02:12:39.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.452+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 msgr2=0x7f13bc06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:12:39.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.452+0000 7f13c270e640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 0x7f13bc06fa10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00eb70 tx=0x7f13ac00b040 comp rx=0 tx=0).stop 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 shutdown_connections 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13a806e530 0x7f13a80709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc102ef0 0x7f13bc06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 --2- 172.21.15.110:0/1828247281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13bc102550 0x7f13bc06fa10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 >> 172.21.15.110:0/1828247281 conn(0x7f13bc0f80f0 msgr2=0x7f13bc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 shutdown_connections 2024-09-16T02:12:39.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:12:39.453+0000 7f13c270e640 1 -- 172.21.15.110:0/1828247281 wait complete. 2024-09-16T02:12:39.611 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:39.611 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:39.612 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:39.612 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3631341149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:39.612 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.612 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.612 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/800110915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:12:39.612 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:39.613 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:40.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:40 smithi165 ceph-mon[77258]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:40.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:40 smithi165 ceph-mon[77258]: pgmap v111: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:40.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:40 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1828247281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:12:40.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:40 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:40 smithi110 ceph-mon[98215]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:12:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:40 smithi110 ceph-mon[98215]: pgmap v111: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:40 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1828247281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:12:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:40 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:42 smithi165 ceph-mon[77258]: pgmap v112: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:42 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:42 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:42 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:12:42.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:42 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:12:42.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:42 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:42 smithi110 ceph-mon[98215]: pgmap v112: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:42.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:42 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:42 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:42 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:12:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:42 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:12:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:42 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:43.700 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:12:43.515+0000 7f71ea836640 -1 osd.3 62 log_to_monitors true 2024-09-16T02:12:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:43 smithi165 ceph-mon[77258]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:43.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:43 smithi110 ceph-mon[98215]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-16T02:12:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:44 smithi165 ceph-mon[77258]: pgmap v113: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:44 smithi165 ceph-mon[77258]: from='osd.3 [v2:172.21.15.165:6800/707634838,v1:172.21.15.165:6801/707634838]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:12:44.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:44 smithi165 ceph-mon[77258]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:12:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:44 smithi110 ceph-mon[98215]: pgmap v113: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-16T02:12:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:44 smithi110 ceph-mon[98215]: from='osd.3 [v2:172.21.15.165:6800/707634838,v1:172.21.15.165:6801/707634838]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:12:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:44 smithi110 ceph-mon[98215]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T02:12:45.450 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:12:45 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:12:45.159+0000 7f71de5c8640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:12:45.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:45 smithi165 ceph-mon[77258]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T02:12:45.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:45 smithi165 ceph-mon[77258]: from='osd.3 [v2:172.21.15.165:6800/707634838,v1:172.21.15.165:6801/707634838]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:12:45.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:45 smithi165 ceph-mon[77258]: osdmap e65: 6 total, 5 up, 6 in 2024-09-16T02:12:45.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:45 smithi165 ceph-mon[77258]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:12:45.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:45 smithi165 ceph-mon[77258]: from='osd.3 ' entity='osd.3' 2024-09-16T02:12:45.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:45 smithi110 ceph-mon[98215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T02:12:45.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:45 smithi110 ceph-mon[98215]: from='osd.3 [v2:172.21.15.165:6800/707634838,v1:172.21.15.165:6801/707634838]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:12:45.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:45 smithi110 ceph-mon[98215]: osdmap e65: 6 total, 5 up, 6 in 2024-09-16T02:12:45.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:45 smithi110 ceph-mon[98215]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:12:45.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:45 smithi110 ceph-mon[98215]: from='osd.3 ' entity='osd.3' 2024-09-16T02:12:46.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:46 smithi165 ceph-mon[77258]: pgmap v115: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 59/264 objects degraded (22.348%) 2024-09-16T02:12:46.742 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:46 smithi165 ceph-mon[77258]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:12:46.742 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:46 smithi165 ceph-mon[77258]: osd.3 [v2:172.21.15.165:6800/707634838,v1:172.21.15.165:6801/707634838] boot 2024-09-16T02:12:46.742 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:46 smithi165 ceph-mon[77258]: osdmap e66: 6 total, 6 up, 6 in 2024-09-16T02:12:46.742 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:46 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:12:46.743 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:46 smithi110 ceph-mon[98215]: pgmap v115: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 59/264 objects degraded (22.348%) 2024-09-16T02:12:46.743 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:46 smithi110 ceph-mon[98215]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:12:46.743 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:46 smithi110 ceph-mon[98215]: osd.3 [v2:172.21.15.165:6800/707634838,v1:172.21.15.165:6801/707634838] boot 2024-09-16T02:12:46.743 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:46 smithi110 ceph-mon[98215]: osdmap e66: 6 total, 6 up, 6 in 2024-09-16T02:12:46.743 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:46 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T02:12:48.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:48 smithi165 ceph-mon[77258]: osdmap e67: 6 total, 6 up, 6 in 2024-09-16T02:12:48.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:48 smithi165 ceph-mon[77258]: pgmap v118: 65 pgs: 4 activating, 17 active+undersized, 17 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 56/264 objects degraded (21.212%) 2024-09-16T02:12:48.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:48 smithi110 ceph-mon[98215]: osdmap e67: 6 total, 6 up, 6 in 2024-09-16T02:12:48.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:48 smithi110 ceph-mon[98215]: pgmap v118: 65 pgs: 4 activating, 17 active+undersized, 17 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 56/264 objects degraded (21.212%) 2024-09-16T02:12:49.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:49 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 56/264 objects degraded (21.212%), 17 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:49.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:49 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 56/264 objects degraded (21.212%), 17 pgs degraded (PG_DEGRADED) 2024-09-16T02:12:50.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:50 smithi165 ceph-mon[77258]: pgmap v119: 65 pgs: 4 activating, 7 active+undersized, 9 active+undersized+degraded, 45 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/264 objects degraded (10.985%) 2024-09-16T02:12:50.456 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:50 smithi110 ceph-mon[98215]: pgmap v119: 65 pgs: 4 activating, 7 active+undersized, 9 active+undersized+degraded, 45 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/264 objects degraded (10.985%) 2024-09-16T02:12:51.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:51 smithi165 ceph-mon[77258]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/264 objects degraded (10.985%), 9 pgs degraded) 2024-09-16T02:12:51.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:51 smithi110 ceph-mon[98215]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/264 objects degraded (10.985%), 9 pgs degraded) 2024-09-16T02:12:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:52 smithi165 ceph-mon[77258]: pgmap v120: 65 pgs: 4 activating, 61 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 587 B/s rd, 1 op/s 2024-09-16T02:12:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:52.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:52 smithi110 ceph-mon[98215]: pgmap v120: 65 pgs: 4 activating, 61 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 587 B/s rd, 1 op/s 2024-09-16T02:12:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:12:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:12:54.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:54 smithi165 ceph-mon[77258]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-16T02:12:54.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:54 smithi110 ceph-mon[98215]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-16T02:12:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:56 smithi110 ceph-mon[98215]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1004 B/s rd, 1 op/s 2024-09-16T02:12:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:56 smithi165 ceph-mon[77258]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1004 B/s rd, 1 op/s 2024-09-16T02:12:57.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:57 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:57.792 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:57 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:58 smithi165 ceph-mon[77258]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 905 B/s rd, 1 op/s 2024-09-16T02:12:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:58 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:58.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:58 smithi165 ceph-mon[77258]: Upgrade: osd.4 is safe to restart 2024-09-16T02:12:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:58 smithi110 ceph-mon[98215]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 905 B/s rd, 1 op/s 2024-09-16T02:12:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:58 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T02:12:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:58 smithi110 ceph-mon[98215]: Upgrade: osd.4 is safe to restart 2024-09-16T02:13:00.015 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:59 smithi165 ceph-mon[77258]: Upgrade: Updating osd.4 2024-09-16T02:13:00.015 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:00.016 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T02:13:00.016 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:00.016 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:59 smithi165 ceph-mon[77258]: Deploying daemon osd.4 on smithi165 2024-09-16T02:13:00.016 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:12:59 smithi165 ceph-mon[77258]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:13:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:59 smithi110 ceph-mon[98215]: Upgrade: Updating osd.4 2024-09-16T02:13:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T02:13:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:59 smithi110 ceph-mon[98215]: Deploying daemon osd.4 on smithi165 2024-09-16T02:13:00.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:12:59 smithi110 ceph-mon[98215]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:13:01.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:01 smithi165 systemd[1]: Stopping Ceph osd.4 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:13:02.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:01 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[46730]: 2024-09-16T02:13:01.851+0000 7f26e0839640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:13:02.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:01 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[46730]: 2024-09-16T02:13:01.851+0000 7f26e0839640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-16T02:13:02.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:01 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[46730]: 2024-09-16T02:13:01.851+0000 7f26e0839640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:13:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:02 smithi165 ceph-mon[77258]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:13:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:02 smithi165 ceph-mon[77258]: osd.4 marked itself down and dead 2024-09-16T02:13:02.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:02 smithi110 ceph-mon[98215]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:13:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:02 smithi110 ceph-mon[98215]: osd.4 marked itself down and dead 2024-09-16T02:13:02.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:03.135 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:02 smithi165 podman[91217]: 2024-09-16 02:13:02.83799863 +0000 UTC m=+1.095713429 container died a0dbde65e553d78fa787e5b07fa9fb617a237a797272ad1e09da65facb249194 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6d025bc, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T02:13:03.414 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:03 smithi165 podman[91217]: 2024-09-16 02:13:03.326287945 +0000 UTC m=+1.584002789 container cleanup a0dbde65e553d78fa787e5b07fa9fb617a237a797272ad1e09da65facb249194 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-6d025bc, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T02:13:03.414 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:03 smithi165 bash[91217]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4 2024-09-16T02:13:03.700 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:03 smithi165 podman[91242]: 2024-09-16 02:13:03.586810587 +0000 UTC m=+0.750675779 container remove a0dbde65e553d78fa787e5b07fa9fb617a237a797272ad1e09da65facb249194 (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-6d025bc) 2024-09-16T02:13:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:03 smithi165 ceph-mon[77258]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:13:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:03 smithi165 ceph-mon[77258]: osdmap e68: 6 total, 5 up, 6 in 2024-09-16T02:13:03.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:03 smithi165 ceph-mon[77258]: osdmap e69: 6 total, 5 up, 6 in 2024-09-16T02:13:03.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:03 smithi110 ceph-mon[98215]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:13:03.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:03 smithi110 ceph-mon[98215]: osdmap e68: 6 total, 5 up, 6 in 2024-09-16T02:13:03.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:03 smithi110 ceph-mon[98215]: osdmap e69: 6 total, 5 up, 6 in 2024-09-16T02:13:04.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:03 smithi165 podman[91333]: 2024-09-16 02:13:03.937677114 +0000 UTC m=+0.103025461 container create e4ec3708665ceb6807485d0272ec78dc6306711b994547edb9bfc729fcffa01c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-16T02:13:04.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:03 smithi165 podman[91333]: 2024-09-16 02:13:03.850708078 +0000 UTC m=+0.016056390 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:13:04.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 podman[91333]: 2024-09-16 02:13:04.173679513 +0000 UTC m=+0.339027827 container init e4ec3708665ceb6807485d0272ec78dc6306711b994547edb9bfc729fcffa01c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-16T02:13:04.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 podman[91333]: 2024-09-16 02:13:04.178095538 +0000 UTC m=+0.343443849 container start e4ec3708665ceb6807485d0272ec78dc6306711b994547edb9bfc729fcffa01c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T02:13:04.670 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:04 smithi165 ceph-mon[77258]: pgmap v127: 65 pgs: 13 peering, 4 stale+active+clean, 48 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:13:04.670 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:04 smithi165 ceph-mon[77258]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-16T02:13:04.670 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 podman[91333]: 2024-09-16 02:13:04.25684247 +0000 UTC m=+0.422190780 container attach e4ec3708665ceb6807485d0272ec78dc6306711b994547edb9bfc729fcffa01c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-16T02:13:04.670 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 podman[91333]: 2024-09-16 02:13:04.376963021 +0000 UTC m=+0.542311326 container died e4ec3708665ceb6807485d0272ec78dc6306711b994547edb9bfc729fcffa01c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:13:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:04 smithi110 ceph-mon[98215]: pgmap v127: 65 pgs: 13 peering, 4 stale+active+clean, 48 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:13:04.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:04 smithi110 ceph-mon[98215]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-16T02:13:05.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 podman[91356]: 2024-09-16 02:13:04.944003351 +0000 UTC m=+0.560185531 container remove e4ec3708665ceb6807485d0272ec78dc6306711b994547edb9bfc729fcffa01c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-16T02:13:05.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-16T02:13:05.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 systemd[1]: Stopped Ceph osd.4 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:13:05.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:04 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.4.service: Consumed 50.144s CPU time. 2024-09-16T02:13:05.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 systemd[1]: Starting Ceph osd.4 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:13:05.657 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:05 smithi165 ceph-mon[77258]: Health check failed: Degraded data redundancy: 22/264 objects degraded (8.333%), 5 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:05.657 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 podman[91454]: 2024-09-16 02:13:05.395500686 +0000 UTC m=+0.110360307 container create bdbc29a48f5d54fbcfea380b86d84fc77003abe0f2d855fc0e212f5a53ec75e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T02:13:05.657 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 podman[91454]: 2024-09-16 02:13:05.300976669 +0000 UTC m=+0.015836295 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:13:05.657 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 podman[91454]: 2024-09-16 02:13:05.597769121 +0000 UTC m=+0.312628745 container init bdbc29a48f5d54fbcfea380b86d84fc77003abe0f2d855fc0e212f5a53ec75e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-16T02:13:05.657 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 podman[91454]: 2024-09-16 02:13:05.601044285 +0000 UTC m=+0.315903909 container start bdbc29a48f5d54fbcfea380b86d84fc77003abe0f2d855fc0e212f5a53ec75e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:13:05.658 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 podman[91454]: 2024-09-16 02:13:05.656000917 +0000 UTC m=+0.370860543 container attach bdbc29a48f5d54fbcfea380b86d84fc77003abe0f2d855fc0e212f5a53ec75e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-16T02:13:05.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:05.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 bash[91454]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:05.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:05.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:05 smithi165 bash[91454]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:05.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:05 smithi110 ceph-mon[98215]: Health check failed: Degraded data redundancy: 22/264 objects degraded (8.333%), 5 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:06.754 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-mon[77258]: pgmap v129: 65 pgs: 8 active+undersized, 13 peering, 2 stale+active+clean, 5 active+undersized+degraded, 37 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 22/264 objects degraded (8.333%) 2024-09-16T02:13:06.754 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T02:13:06.754 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T02:13:06.754 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T02:13:06.754 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T02:13:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:06 smithi110 ceph-mon[98215]: pgmap v129: 65 pgs: 8 active+undersized, 13 peering, 2 stale+active+clean, 5 active+undersized+degraded, 37 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 22/264 objects degraded (8.333%) 2024-09-16T02:13:07.068 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T02:13:07.068 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T02:13:07.068 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T02:13:07.068 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T02:13:07.068 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-16T02:13:07.068 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-16T02:13:07.069 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T02:13:07.069 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T02:13:07.069 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate[91468]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-16T02:13:07.069 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 bash[91454]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-16T02:13:07.069 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:06 smithi165 podman[91454]: 2024-09-16 02:13:06.78199481 +0000 UTC m=+1.496854434 container died bdbc29a48f5d54fbcfea380b86d84fc77003abe0f2d855fc0e212f5a53ec75e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-16T02:13:07.450 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 podman[91603]: 2024-09-16 02:13:07.309595754 +0000 UTC m=+0.520794502 container remove bdbc29a48f5d54fbcfea380b86d84fc77003abe0f2d855fc0e212f5a53ec75e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T02:13:07.863 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 podman[91663]: 2024-09-16 02:13:07.41733294 +0000 UTC m=+0.015673528 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:13:07.863 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 podman[91663]: 2024-09-16 02:13:07.527242493 +0000 UTC m=+0.125583111 container create 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-16T02:13:07.863 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 podman[91663]: 2024-09-16 02:13:07.862636608 +0000 UTC m=+0.460977187 container init 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T02:13:08.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 podman[91663]: 2024-09-16 02:13:07.865911152 +0000 UTC m=+0.464251729 container start 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T02:13:08.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 ceph-osd[91683]: -- 172.21.15.165:0/1938473930 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f79feb01e0 con 0x55f79fe46000 2024-09-16T02:13:08.200 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 bash[91663]: 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc 2024-09-16T02:13:08.201 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:07 smithi165 systemd[1]: Started Ceph osd.4 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:13:08.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:08 smithi165 ceph-mon[77258]: pgmap v130: 65 pgs: 12 active+undersized, 13 peering, 9 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 32/264 objects degraded (12.121%) 2024-09-16T02:13:08.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:08.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:08.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:08.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:08.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:08 smithi110 ceph-mon[98215]: pgmap v130: 65 pgs: 12 active+undersized, 13 peering, 9 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 32/264 objects degraded (12.121%) 2024-09-16T02:13:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:09.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 -- 172.21.15.110:0/284811824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 msgr2=0x7f18c8106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:09.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 --2- 172.21.15.110:0/284811824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8106550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18b80048d0 tx=0x7f18b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 -- 172.21.15.110:0/284811824 shutdown_connections 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 --2- 172.21.15.110:0/284811824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8106550 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 --2- 172.21.15.110:0/284811824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c80fd570 0x7f18c80fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 -- 172.21.15.110:0/284811824 >> 172.21.15.110:0/284811824 conn(0x7f18c80f7000 msgr2=0x7f18c80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 -- 172.21.15.110:0/284811824 shutdown_connections 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.542+0000 7f18d0520640 1 -- 172.21.15.110:0/284811824 wait complete. 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18d0520640 1 Processor -- start 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18d0520640 1 -- start start 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18d0520640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c80fd570 0x7f18c8113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18d0520640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18d0520640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8113d60 con 0x7f18c80fdf10 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18d0520640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c810d1a0 con 0x7f18c80fd570 2024-09-16T02:13:09.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18cdabb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:09.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18cdabb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51730/0 (socket says 172.21.15.110:51730) 2024-09-16T02:13:09.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18cdabb640 1 -- 172.21.15.110:0/1132291804 learned_addr learned my addr 172.21.15.110:0/1132291804 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:09.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18ce2bc640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c80fd570 0x7f18c8113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18cdabb640 1 -- 172.21.15.110:0/1132291804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c80fd570 msgr2=0x7f18c8113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18cdabb640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c80fd570 0x7f18c8113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.543+0000 7f18cdabb640 1 -- 172.21.15.110:0/1132291804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8005040 con 0x7f18c80fdf10 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.544+0000 7f18cdabb640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8113760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.544+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b8038070 con 0x7f18c80fdf10 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.544+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c810d420 con 0x7f18c80fdf10 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.544+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f18b802ade0 con 0x7f18c80fdf10 2024-09-16T02:13:09.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.544+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b802c7e0 con 0x7f18c80fdf10 2024-09-16T02:13:09.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.544+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c810d8e0 con 0x7f18c80fdf10 2024-09-16T02:13:09.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.545+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c8066330 con 0x7f18c80fdf10 2024-09-16T02:13:09.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.546+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f18b8030020 con 0x7f18c80fdf10 2024-09-16T02:13:09.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.546+0000 7f18beffd640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f18b406e530 0x7f18b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:09.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.547+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f18b80adf10 con 0x7f18c80fdf10 2024-09-16T02:13:09.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.547+0000 7f18ce2bc640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f18b406e530 0x7f18b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:09.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.547+0000 7f18ce2bc640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f18b406e530 0x7f18b40709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f18c4004eb0 tx=0x7f18c400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:09.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.550+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f18b8077230 con 0x7f18c80fdf10 2024-09-16T02:13:09.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:09 smithi165 ceph-mon[77258]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-16T02:13:09.700 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:09 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:13:09.492+0000 7ff4098e7640 -1 Falling back to public interface 2024-09-16T02:13:09.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:09 smithi110 ceph-mon[98215]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-16T02:13:09.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.734+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18c81095f0 con 0x7f18b406e530 2024-09-16T02:13:09.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.735+0000 7f18beffd640 1 -- 172.21.15.110:0/1132291804 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f18c400f040 con 0x7f18b406e530 2024-09-16T02:13:09.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f18b406e530 msgr2=0x7f18b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:09.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f18b406e530 0x7f18b40709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f18c4004eb0 tx=0x7f18c400b040 comp rx=0 tx=0).stop 2024-09-16T02:13:09.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 msgr2=0x7f18c8113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:09.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8113760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 shutdown_connections 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f18b406e530 0x7f18b40709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c80fdf10 0x7f18c8113760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 --2- 172.21.15.110:0/1132291804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c80fd570 0x7f18c8113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 >> 172.21.15.110:0/1132291804 conn(0x7f18c80f7000 msgr2=0x7f18c80f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 shutdown_connections 2024-09-16T02:13:09.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.737+0000 7f18d0520640 1 -- 172.21.15.110:0/1132291804 wait complete. 2024-09-16T02:13:09.749 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 -- 172.21.15.110:0/2091327776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 msgr2=0x7f3af0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 --2- 172.21.15.110:0/2091327776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0102920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8009c50 tx=0x7f3ae8004d10 comp rx=0 tx=0).stop 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 -- 172.21.15.110:0/2091327776 shutdown_connections 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 --2- 172.21.15.110:0/2091327776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 0x7f3af00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 --2- 172.21.15.110:0/2091327776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0102920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 -- 172.21.15.110:0/2091327776 >> 172.21.15.110:0/2091327776 conn(0x7f3af00f80f0 msgr2=0x7f3af00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 -- 172.21.15.110:0/2091327776 shutdown_connections 2024-09-16T02:13:09.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 -- 172.21.15.110:0/2091327776 wait complete. 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 Processor -- start 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.816+0000 7f3af851e640 1 -- start start 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af851e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af851e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 0x7f3af0113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af851e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af01140d0 con 0x7f3af0102550 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af851e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af010d4e0 con 0x7f3af0102ef0 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51738/0 (socket says 172.21.15.110:51738) 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 -- 172.21.15.110:0/953158593 learned_addr learned my addr 172.21.15.110:0/953158593 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:09.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af5ab9640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 0x7f3af0113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 -- 172.21.15.110:0/953158593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 msgr2=0x7f3af0113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:09.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 0x7f3af0113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 -- 172.21.15.110:0/953158593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae80098b0 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af5ab9640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 0x7f3af0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af62ba640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0113540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8003400 tx=0x7f3ae8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ae80094c0 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ae8009620 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af010d760 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.817+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ae803d8f0 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.818+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af010dd00 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.818+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af00fdcd0 con 0x7f3af0102550 2024-09-16T02:13:09.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.819+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3ae802f030 con 0x7f3af0102550 2024-09-16T02:13:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.820+0000 7f3aeeffd640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3ad806e530 0x7f3ad80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.820+0000 7f3af5ab9640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3ad806e530 0x7f3ad80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.820+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f3ae80af350 con 0x7f3af0102550 2024-09-16T02:13:09.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.820+0000 7f3af5ab9640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3ad806e530 0x7f3ad80709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4004fd0 tx=0x7f3ae400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:09.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:09.824+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ae8078680 con 0x7f3af0102550 2024-09-16T02:13:10.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.006+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3af004b720 con 0x7f3ad806e530 2024-09-16T02:13:10.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.007+0000 7f3aeeffd640 1 -- 172.21.15.110:0/953158593 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3af004b720 con 0x7f3ad806e530 2024-09-16T02:13:10.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3ad806e530 msgr2=0x7f3ad80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3ad806e530 0x7f3ad80709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4004fd0 tx=0x7f3ae400b040 comp rx=0 tx=0).stop 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 msgr2=0x7f3af0113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0113540 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8003400 tx=0x7f3ae8004d10 comp rx=0 tx=0).stop 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 shutdown_connections 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3ad806e530 0x7f3ad80709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af0102ef0 0x7f3af0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 --2- 172.21.15.110:0/953158593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3af0102550 0x7f3af0113540 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 >> 172.21.15.110:0/953158593 conn(0x7f3af00f80f0 msgr2=0x7f3af00f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 shutdown_connections 2024-09-16T02:13:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.010+0000 7f3af851e640 1 -- 172.21.15.110:0/953158593 wait complete. 2024-09-16T02:13:10.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 -- 172.21.15.110:0/863816447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 msgr2=0x7f718c0fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 --2- 172.21.15.110:0/863816447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fd950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f717c004900 tx=0x7f717c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 -- 172.21.15.110:0/863816447 shutdown_connections 2024-09-16T02:13:10.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 --2- 172.21.15.110:0/863816447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f718c0fdf20 0x7f718c1065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 --2- 172.21.15.110:0/863816447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fd950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 -- 172.21.15.110:0/863816447 >> 172.21.15.110:0/863816447 conn(0x7f718c0f7060 msgr2=0x7f718c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 -- 172.21.15.110:0/863816447 shutdown_connections 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 -- 172.21.15.110:0/863816447 wait complete. 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.089+0000 7f71938a8640 1 Processor -- start 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f71938a8640 1 -- start start 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f71938a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f71938a8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f718c0fdf20 0x7f718c0fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f71938a8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0fbf50 con 0x7f718c0fd580 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f71938a8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0fc0c0 con 0x7f718c0fdf20 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51764/0 (socket says 172.21.15.110:51764) 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 -- 172.21.15.110:0/4192652474 learned_addr learned my addr 172.21.15.110:0/4192652474 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 -- 172.21.15.110:0/4192652474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f718c0fdf20 msgr2=0x7f718c0fb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7190e43640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f718c0fdf20 0x7f718c0fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f718c0fdf20 0x7f718c0fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 -- 172.21.15.110:0/4192652474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c005040 con 0x7f718c0fd580 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7191644640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fb440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f717c004960 tx=0x7f717c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f717c038070 con 0x7f718c0fd580 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.090+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c1195c0 con 0x7f718c0fd580 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.091+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f717c008ed0 con 0x7f718c0fd580 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.091+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f717c0095a0 con 0x7f718c0fd580 2024-09-16T02:13:10.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.091+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c119940 con 0x7f718c0fd580 2024-09-16T02:13:10.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.092+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0662d0 con 0x7f718c0fd580 2024-09-16T02:13:10.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.092+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f717c030020 con 0x7f718c0fd580 2024-09-16T02:13:10.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.093+0000 7f7181ffb640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f717806e530 0x7f71780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.093+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f717c0adfa0 con 0x7f718c0fd580 2024-09-16T02:13:10.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.093+0000 7f7190e43640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f717806e530 0x7f71780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.093+0000 7f7190e43640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f717806e530 0x7f71780709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f718c0fcd80 tx=0x7f7188008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:10.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.097+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f717c077250 con 0x7f718c0fd580 2024-09-16T02:13:10.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.271+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f718c04b7b0 con 0x7f717806e530 2024-09-16T02:13:10.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.280+0000 7f7181ffb640 1 -- 172.21.15.110:0/4192652474 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f718c04b7b0 con 0x7f717806e530 2024-09-16T02:13:10.282 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:13:10.282 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (6m) 64s ago 15m 24.6M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:13:10.282 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (2m) 64s ago 15m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (2m) 31s ago 14m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (4m) 64s ago 14m 81.9M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (9m) 64s ago 9m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (9m) 64s ago 9m 154M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (9m) 31s ago 9m 17.6M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (9m) 31s ago 9m 14.6M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (6m) 64s ago 16m 500M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (5m) 31s ago 14m 440M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (3m) 64s ago 16m 44.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (3m) 31s ago 14m 37.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 64s ago 15m 17.1M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 31s ago 14m 16.6M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (2m) 64s ago 13m 88.6M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:13:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (105s) 64s ago 13m 94.2M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:13:10.284 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (69s) 64s ago 12m 14.4M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:13:10.284 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (34s) 31s ago 12m 14.4M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 0a846f393eb0 2024-09-16T02:13:10.284 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 starting - - - 2581M 2024-09-16T02:13:10.284 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (11m) 31s ago 11m 196M 2581M 17.2.7-1633-g6d025bc2 33ed8dba3996 644a6f60bbc7 2024-09-16T02:13:10.284 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (5m) 64s ago 14m 65.3M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f717806e530 msgr2=0x7f71780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f717806e530 0x7f71780709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f718c0fcd80 tx=0x7f7188008040 comp rx=0 tx=0).stop 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 msgr2=0x7f718c0fb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fb440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f717c004960 tx=0x7f717c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 shutdown_connections 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f717806e530 0x7f71780709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f718c0fdf20 0x7f718c0fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 --2- 172.21.15.110:0/4192652474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f718c0fd580 0x7f718c0fb440 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 >> 172.21.15.110:0/4192652474 conn(0x7f718c0f7060 msgr2=0x7f718c0f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 shutdown_connections 2024-09-16T02:13:10.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.282+0000 7f71938a8640 1 -- 172.21.15.110:0/4192652474 wait complete. 2024-09-16T02:13:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1314057111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 msgr2=0x7fbd08102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1314057111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08102920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0048d0 tx=0x7fbcfc009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1314057111 shutdown_connections 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1314057111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd08102ef0 0x7fbd080fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1314057111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08102920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1314057111 >> 172.21.15.110:0/1314057111 conn(0x7fbd080f80f0 msgr2=0x7fbd080fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1314057111 shutdown_connections 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.360+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1314057111 wait complete. 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0f05e640 1 Processor -- start 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0f05e640 1 -- start start 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0f05e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0f05e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd08102ef0 0x7fbd08113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0f05e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd081140c0 con 0x7fbd08102550 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0f05e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0810d4d0 con 0x7fbd08102ef0 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0cdfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0cdfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08113530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37968/0 (socket says 172.21.15.110:37968) 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd0cdfa640 1 -- 172.21.15.110:0/1904916202 learned_addr learned my addr 172.21.15.110:0/1904916202 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.361+0000 7fbd07fff640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd08102ef0 0x7fbd08113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd0cdfa640 1 -- 172.21.15.110:0/1904916202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd08102ef0 msgr2=0x7fbd08113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd0cdfa640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd08102ef0 0x7fbd08113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd0cdfa640 1 -- 172.21.15.110:0/1904916202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc005040 con 0x7fbd08102550 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd0cdfa640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08113530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc000c00 tx=0x7fbcfc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcfc038070 con 0x7fbd08102550 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbcfc02ade0 con 0x7fbd08102550 2024-09-16T02:13:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0810d750 con 0x7fbd08102550 2024-09-16T02:13:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcfc02c7e0 con 0x7fbd08102550 2024-09-16T02:13:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.362+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0810dc90 con 0x7fbd08102550 2024-09-16T02:13:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.363+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd080fdcd0 con 0x7fbd08102550 2024-09-16T02:13:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.364+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbcfc030020 con 0x7fbd08102550 2024-09-16T02:13:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.364+0000 7fbd057fa640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fbcf806e530 0x7fbcf80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.364+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fbcfc0adc50 con 0x7fbd08102550 2024-09-16T02:13:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.364+0000 7fbd07fff640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fbcf806e530 0x7fbcf80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.365+0000 7fbd07fff640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fbcf806e530 0x7fbcf80709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd0810e7b0 tx=0x7fbcf400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:10.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.368+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbcfc076f70 con 0x7fbd08102550 2024-09-16T02:13:10.527 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:10 smithi110 ceph-mon[98215]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-16T02:13:10.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.607+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbd0804b720 con 0x7fbd08102550 2024-09-16T02:13:10.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.608+0000 7fbd057fa640 1 -- 172.21.15.110:0/1904916202 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fbcfc07a630 con 0x7fbd08102550 2024-09-16T02:13:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:13:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 1, 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:13:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 5, 2024-09-16T02:13:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 8 2024-09-16T02:13:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:13:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fbcf806e530 msgr2=0x7fbcf80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fbcf806e530 0x7fbcf80709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd0810e7b0 tx=0x7fbcf400b040 comp rx=0 tx=0).stop 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 msgr2=0x7fbd08113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08113530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc000c00 tx=0x7fbcfc009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 shutdown_connections 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fbcf806e530 0x7fbcf80709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd08102ef0 0x7fbd08113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 --2- 172.21.15.110:0/1904916202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08102550 0x7fbd08113530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 >> 172.21.15.110:0/1904916202 conn(0x7fbd080f80f0 msgr2=0x7fbd080f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 shutdown_connections 2024-09-16T02:13:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.610+0000 7fbd0f05e640 1 -- 172.21.15.110:0/1904916202 wait complete. 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 -- 172.21.15.110:0/2910639409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 msgr2=0x7f64300fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 --2- 172.21.15.110:0/2910639409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f64300fc5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f641c0048d0 tx=0x7f641c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 -- 172.21.15.110:0/2910639409 shutdown_connections 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 --2- 172.21.15.110:0/2910639409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f64300fc5b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 --2- 172.21.15.110:0/2910639409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6430102550 0x7f6430102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 -- 172.21.15.110:0/2910639409 >> 172.21.15.110:0/2910639409 conn(0x7f64300f80f0 msgr2=0x7f64300fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 -- 172.21.15.110:0/2910639409 shutdown_connections 2024-09-16T02:13:10.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.688+0000 7f643725c640 1 -- 172.21.15.110:0/2910639409 wait complete. 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f643725c640 1 Processor -- start 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f643725c640 1 -- start start 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f643725c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6430102550 0x7f6430113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f643725c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f6430113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f643725c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64301140c0 con 0x7f6430102ef0 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f643725c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643010d4d0 con 0x7f6430102550 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f642ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f6430113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f642ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f6430113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37980/0 (socket says 172.21.15.110:37980) 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f642ffff640 1 -- 172.21.15.110:0/2403780576 learned_addr learned my addr 172.21.15.110:0/2403780576 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.689+0000 7f6434ff8640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6430102550 0x7f6430113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642ffff640 1 -- 172.21.15.110:0/2403780576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6430102550 msgr2=0x7f6430113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642ffff640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6430102550 0x7f6430113530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642ffff640 1 -- 172.21.15.110:0/2403780576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c005040 con 0x7f6430102ef0 2024-09-16T02:13:10.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642ffff640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f6430113a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f641c0043d0 tx=0x7f641c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:10.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f641c038070 con 0x7f6430102ef0 2024-09-16T02:13:10.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f641c0096e0 con 0x7f6430102ef0 2024-09-16T02:13:10.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643010d750 con 0x7f6430102ef0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f641c02c8a0 con 0x7f6430102ef0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.690+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643010dc90 con 0x7f6430102ef0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.691+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64300fdcd0 con 0x7f6430102ef0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.691+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f641c030020 con 0x7f6430102ef0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.692+0000 7f642d7fa640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f642006e530 0x7f64200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.692+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f641c0adce0 con 0x7f6430102ef0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.692+0000 7f6434ff8640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f642006e530 0x7f64200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:10.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.692+0000 7f6434ff8640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f642006e530 0x7f64200709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6424004ed0 tx=0x7f642400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:10.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.696+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f641c077000 con 0x7f6430102ef0 2024-09-16T02:13:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:10 smithi165 ceph-mon[77258]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-16T02:13:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.915+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64300fbd50 con 0x7f6430102ef0 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.915+0000 7f642d7fa640 1 -- 172.21.15.110:0/2403780576 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7f641c07a6c0 con 0x7f6430102ef0 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:13:10.918 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:13:10.919 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:13:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:10.921 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:13:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f642006e530 msgr2=0x7f64200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f642006e530 0x7f64200709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6424004ed0 tx=0x7f642400b040 comp rx=0 tx=0).stop 2024-09-16T02:13:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 msgr2=0x7f6430113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f6430113a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f641c0043d0 tx=0x7f641c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 shutdown_connections 2024-09-16T02:13:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f642006e530 0x7f64200709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6430102ef0 0x7f6430113a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 --2- 172.21.15.110:0/2403780576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6430102550 0x7f6430113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 >> 172.21.15.110:0/2403780576 conn(0x7f64300f80f0 msgr2=0x7f64300f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 shutdown_connections 2024-09-16T02:13:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.918+0000 7f643725c640 1 -- 172.21.15.110:0/2403780576 wait complete. 2024-09-16T02:13:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/2186046602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 msgr2=0x7f6f780fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/2186046602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f780fc5b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0048d0 tx=0x7f6f6c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/2186046602 shutdown_connections 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/2186046602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f780fc5b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/2186046602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f78102550 0x7f6f78102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/2186046602 >> 172.21.15.110:0/2186046602 conn(0x7f6f780f80f0 msgr2=0x7f6f780fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/2186046602 shutdown_connections 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.997+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/2186046602 wait complete. 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.998+0000 7f6f7e4bc640 1 Processor -- start 2024-09-16T02:13:11.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.998+0000 7f6f7e4bc640 1 -- start start 2024-09-16T02:13:11.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.998+0000 7f6f7e4bc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f78102550 0x7f6f78113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:11.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.998+0000 7f6f7e4bc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f78113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.998+0000 7f6f7e4bc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781140b0 con 0x7f6f78102ef0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.998+0000 7f6f7e4bc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7810d4c0 con 0x7f6f78102550 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f78113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f78113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38004/0 (socket says 172.21.15.110:38004) 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 -- 172.21.15.110:0/1082193536 learned_addr learned my addr 172.21.15.110:0/1082193536 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f77fff640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f78102550 0x7f6f78113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 -- 172.21.15.110:0/1082193536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f78102550 msgr2=0x7f6f78113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f78102550 0x7f6f78113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 -- 172.21.15.110:0/1082193536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c005040 con 0x7f6f78102ef0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f777fe640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f78113a60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c02a530 tx=0x7f6f6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f6c038070 con 0x7f6f78102ef0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f6c02ade0 con 0x7f6f78102ef0 2024-09-16T02:13:11.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f6c02c770 con 0x7f6f78102ef0 2024-09-16T02:13:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7810d740 con 0x7f6f78102ef0 2024-09-16T02:13:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:10.999+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7810dc80 con 0x7f6f78102ef0 2024-09-16T02:13:11.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.000+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f780fdcd0 con 0x7f6f78102ef0 2024-09-16T02:13:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.001+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6f6c030020 con 0x7f6f78102ef0 2024-09-16T02:13:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.001+0000 7f6f74ff9640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f6f6006e530 0x7f6f600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.001+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f6f6c0ae350 con 0x7f6f78102ef0 2024-09-16T02:13:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.001+0000 7f6f77fff640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f6f6006e530 0x7f6f600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:11.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.002+0000 7f6f77fff640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f6f6006e530 0x7f6f600709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009af0 tx=0x7f6f6800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:11.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.006+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6f6c0775c0 con 0x7f6f78102ef0 2024-09-16T02:13:11.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.192+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f78109580 con 0x7f6f6006e530 2024-09-16T02:13:11.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.193+0000 7f6f74ff9640 1 -- 172.21.15.110:0/1082193536 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6f78109580 con 0x7f6f6006e530 2024-09-16T02:13:11.195 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "11/21 daemons upgraded", 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T02:13:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:13:11.197 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.195+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f6f6006e530 msgr2=0x7f6f600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.195+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f6f6006e530 0x7f6f600709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009af0 tx=0x7f6f6800b040 comp rx=0 tx=0).stop 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.195+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 msgr2=0x7f6f78113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.195+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f78113a60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c02a530 tx=0x7f6f6c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.195+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 shutdown_connections 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.195+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f6f6006e530 0x7f6f600709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.196+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f78102ef0 0x7f6f78113a60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.196+0000 7f6f7e4bc640 1 --2- 172.21.15.110:0/1082193536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f78102550 0x7f6f78113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.196+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 >> 172.21.15.110:0/1082193536 conn(0x7f6f780f80f0 msgr2=0x7f6f780f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:11.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.196+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 shutdown_connections 2024-09-16T02:13:11.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.196+0000 7f6f7e4bc640 1 -- 172.21.15.110:0/1082193536 wait complete. 2024-09-16T02:13:11.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 -- 172.21.15.110:0/1956466330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc100fac60 msgr2=0x7fdc100fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/1956466330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc100fac60 0x7fdc100fb0b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80048d0 tx=0x7fdbf8009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 -- 172.21.15.110:0/1956466330 shutdown_connections 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/1956466330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc100fac60 0x7fdc100fb0b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/1956466330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc101025f0 0x7fdc101029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 -- 172.21.15.110:0/1956466330 >> 172.21.15.110:0/1956466330 conn(0x7fdc10070c80 msgr2=0x7fdc10071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 -- 172.21.15.110:0/1956466330 shutdown_connections 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 -- 172.21.15.110:0/1956466330 wait complete. 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.273+0000 7fdc15d2f640 1 Processor -- start 2024-09-16T02:13:11.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc15d2f640 1 -- start start 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc15d2f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc100fac60 0x7fdc101131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc15d2f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 0x7fdc10113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc15d2f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10113d10 con 0x7fdc101025f0 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc15d2f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1010d150 con 0x7fdc100fac60 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 0x7fdc10113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 0x7fdc10113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38024/0 (socket says 172.21.15.110:38024) 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc0f7fe640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc100fac60 0x7fdc101131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 -- 172.21.15.110:0/139392511 learned_addr learned my addr 172.21.15.110:0/139392511 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:11.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 -- 172.21.15.110:0/139392511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc100fac60 msgr2=0x7fdc101131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc100fac60 0x7fdc101131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 -- 172.21.15.110:0/139392511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8005040 con 0x7fdc101025f0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc07fff640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 0x7fdc10113710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8000c00 tx=0x7fdbf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.274+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf8038070 con 0x7fdc101025f0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.275+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbf802ade0 con 0x7fdc101025f0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.275+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1010d3d0 con 0x7fdc101025f0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.275+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf802c7e0 con 0x7fdc101025f0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.275+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1010d910 con 0x7fdc101025f0 2024-09-16T02:13:11.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.276+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc10065810 con 0x7fdc101025f0 2024-09-16T02:13:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.276+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdbf8030020 con 0x7fdc101025f0 2024-09-16T02:13:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.277+0000 7fdc0cff9640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fdbfc06e530 0x7fdbfc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.277+0000 7fdc0f7fe640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fdbfc06e530 0x7fdbfc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.277+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fdbf80adcf0 con 0x7fdc101025f0 2024-09-16T02:13:11.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.277+0000 7fdc0f7fe640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fdbfc06e530 0x7fdbfc0709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc00004ed0 tx=0x7fdc0000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:11.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.281+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbf8076f90 con 0x7fdc101025f0 2024-09-16T02:13:11.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.517+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdc101096b0 con 0x7fdc101025f0 2024-09-16T02:13:11.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.517+0000 7fdc0cff9640 1 -- 172.21.15.110:0/139392511 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1296 (secure 0 0 0) 0x7fdbf807a650 con 0x7fdc101025f0 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: osd.4 (root=default,host=smithi165) is down 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-16T02:13:11.520 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-16T02:13:11.521 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fdbfc06e530 msgr2=0x7fdbfc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fdbfc06e530 0x7fdbfc0709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc00004ed0 tx=0x7fdc0000b040 comp rx=0 tx=0).stop 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 msgr2=0x7fdc10113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 0x7fdc10113710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8000c00 tx=0x7fdbf8009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 shutdown_connections 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fdbfc06e530 0x7fdbfc0709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc101025f0 0x7fdc10113710 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 --2- 172.21.15.110:0/139392511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc100fac60 0x7fdc101131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 >> 172.21.15.110:0/139392511 conn(0x7fdc10070c80 msgr2=0x7fdc100f9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 shutdown_connections 2024-09-16T02:13:11.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:11.519+0000 7fdc15d2f640 1 -- 172.21.15.110:0/139392511 wait complete. 2024-09-16T02:13:11.752 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1904916202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2403780576' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1904916202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2403780576' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:11.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:12.640 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:12 smithi165 ceph-mon[77258]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:12.640 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:12 smithi165 ceph-mon[77258]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 114 B/s rd, 0 op/s; 46/264 objects degraded (17.424%) 2024-09-16T02:13:12.640 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:12 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/139392511' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:13:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:12 smithi110 ceph-mon[98215]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:12 smithi110 ceph-mon[98215]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 114 B/s rd, 0 op/s; 46/264 objects degraded (17.424%) 2024-09-16T02:13:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:12 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/139392511' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s; 46/264 objects degraded (17.424%) 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:14.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:14.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:14.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:14.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:14.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:14 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s; 46/264 objects degraded (17.424%) 2024-09-16T02:13:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:14.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:14 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:15.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:15.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-mon[77258]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T02:13:15.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:15.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-mon[77258]: from='osd.4 [v2:172.21.15.165:6808/893516898,v1:172.21.15.165:6809/893516898]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:13:15.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-mon[77258]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:13:15.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:13:15.365+0000 7ff4098e7640 -1 osd.4 67 log_to_monitors true 2024-09-16T02:13:15.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:13:15 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:13:15.495+0000 7ff401681640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:13:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:15 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:15 smithi110 ceph-mon[98215]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T02:13:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:15 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:15 smithi110 ceph-mon[98215]: from='osd.4 [v2:172.21.15.165:6808/893516898,v1:172.21.15.165:6809/893516898]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:13:15.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:15 smithi110 ceph-mon[98215]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T02:13:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:16 smithi165 ceph-mon[77258]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 514 B/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-16T02:13:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:16 smithi165 ceph-mon[77258]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T02:13:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:16 smithi165 ceph-mon[77258]: osdmap e70: 6 total, 5 up, 6 in 2024-09-16T02:13:16.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:16 smithi165 ceph-mon[77258]: from='osd.4 [v2:172.21.15.165:6808/893516898,v1:172.21.15.165:6809/893516898]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:16.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:16 smithi165 ceph-mon[77258]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:16.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:16 smithi110 ceph-mon[98215]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 514 B/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-16T02:13:16.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:16 smithi110 ceph-mon[98215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T02:13:16.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:16 smithi110 ceph-mon[98215]: osdmap e70: 6 total, 5 up, 6 in 2024-09-16T02:13:16.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:16 smithi110 ceph-mon[98215]: from='osd.4 [v2:172.21.15.165:6808/893516898,v1:172.21.15.165:6809/893516898]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:16.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:16 smithi110 ceph-mon[98215]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:17.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:17 smithi165 ceph-mon[77258]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:13:17.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:17 smithi165 ceph-mon[77258]: osd.4 [v2:172.21.15.165:6808/893516898,v1:172.21.15.165:6809/893516898] boot 2024-09-16T02:13:17.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:17 smithi165 ceph-mon[77258]: osdmap e71: 6 total, 6 up, 6 in 2024-09-16T02:13:17.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:17 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:13:17.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:17 smithi165 ceph-mon[77258]: osdmap e72: 6 total, 6 up, 6 in 2024-09-16T02:13:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:17 smithi110 ceph-mon[98215]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:13:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:17 smithi110 ceph-mon[98215]: osd.4 [v2:172.21.15.165:6808/893516898,v1:172.21.15.165:6809/893516898] boot 2024-09-16T02:13:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:17 smithi110 ceph-mon[98215]: osdmap e71: 6 total, 6 up, 6 in 2024-09-16T02:13:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:17 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T02:13:17.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:17 smithi110 ceph-mon[98215]: osdmap e72: 6 total, 6 up, 6 in 2024-09-16T02:13:18.851 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:18 smithi165 ceph-mon[77258]: pgmap v137: 65 pgs: 6 peering, 16 active+undersized, 12 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 39/264 objects degraded (14.773%) 2024-09-16T02:13:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:18 smithi110 ceph-mon[98215]: pgmap v137: 65 pgs: 6 peering, 16 active+undersized, 12 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 39/264 objects degraded (14.773%) 2024-09-16T02:13:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:19 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 39/264 objects degraded (14.773%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:19.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:19 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 39/264 objects degraded (14.773%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:20 smithi165 ceph-mon[77258]: pgmap v139: 65 pgs: 6 peering, 9 active+undersized, 7 active+undersized+degraded, 43 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 27/264 objects degraded (10.227%) 2024-09-16T02:13:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:20 smithi110 ceph-mon[98215]: pgmap v139: 65 pgs: 6 peering, 9 active+undersized, 7 active+undersized+degraded, 43 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 27/264 objects degraded (10.227%) 2024-09-16T02:13:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:21 smithi165 ceph-mon[77258]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/264 objects degraded (10.227%), 7 pgs degraded) 2024-09-16T02:13:21.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:21 smithi110 ceph-mon[98215]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/264 objects degraded (10.227%), 7 pgs degraded) 2024-09-16T02:13:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:22 smithi165 ceph-mon[77258]: pgmap v140: 65 pgs: 6 peering, 59 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-09-16T02:13:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:22 smithi110 ceph-mon[98215]: pgmap v140: 65 pgs: 6 peering, 59 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-09-16T02:13:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:24 smithi165 ceph-mon[77258]: pgmap v141: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 520 B/s rd, 1 op/s 2024-09-16T02:13:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:24 smithi110 ceph-mon[98215]: pgmap v141: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 520 B/s rd, 1 op/s 2024-09-16T02:13:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:26 smithi165 ceph-mon[77258]: pgmap v142: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-16T02:13:26.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:26 smithi110 ceph-mon[98215]: pgmap v142: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-16T02:13:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:28 smithi165 ceph-mon[77258]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-16T02:13:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:28 smithi110 ceph-mon[98215]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-16T02:13:29.832 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:29 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:29.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:29 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:30.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:30 smithi110 ceph-mon[98215]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:30.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:30 smithi110 ceph-mon[98215]: Upgrade: osd.5 is safe to restart 2024-09-16T02:13:30.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:30 smithi110 ceph-mon[98215]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 776 B/s rd, 1 op/s 2024-09-16T02:13:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:30 smithi165 ceph-mon[77258]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T02:13:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:30 smithi165 ceph-mon[77258]: Upgrade: osd.5 is safe to restart 2024-09-16T02:13:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:30 smithi165 ceph-mon[77258]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 776 B/s rd, 1 op/s 2024-09-16T02:13:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:31 smithi165 ceph-mon[77258]: Upgrade: Updating osd.5 2024-09-16T02:13:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T02:13:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:31 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:31 smithi165 ceph-mon[77258]: Deploying daemon osd.5 on smithi165 2024-09-16T02:13:31.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:31 smithi165 ceph-mon[77258]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:13:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:31 smithi110 ceph-mon[98215]: Upgrade: Updating osd.5 2024-09-16T02:13:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T02:13:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:31 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:31 smithi110 ceph-mon[98215]: Deploying daemon osd.5 on smithi165 2024-09-16T02:13:31.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:31 smithi110 ceph-mon[98215]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:13:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:33 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:33.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:33 smithi165 systemd[1]: Stopping Ceph osd.5 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:13:33.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:33 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:34.200 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[53292]: 2024-09-16T02:13:33.809+0000 7ff9b7d41640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:13:34.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[53292]: 2024-09-16T02:13:33.809+0000 7ff9b7d41640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-16T02:13:34.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[53292]: 2024-09-16T02:13:33.809+0000 7ff9b7d41640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:13:34.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:34 smithi165 ceph-mon[77258]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:13:34.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:34 smithi165 ceph-mon[77258]: osd.5 marked itself down and dead 2024-09-16T02:13:34.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:34 smithi110 ceph-mon[98215]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:13:34.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:34 smithi110 ceph-mon[98215]: osd.5 marked itself down and dead 2024-09-16T02:13:35.177 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:34 smithi165 podman[96501]: 2024-09-16 02:13:34.877764883 +0000 UTC m=+1.166270528 container died 644a6f60bbc77a4476746abdad1fa5e698501bea8dd1e07b45eefd2ccd3af87f (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, RELEASE=quincy-6d025bc, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:13:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:35 smithi165 ceph-mon[77258]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:13:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:35 smithi165 ceph-mon[77258]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-16T02:13:35.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:35 smithi165 ceph-mon[77258]: osdmap e73: 6 total, 5 up, 6 in 2024-09-16T02:13:35.450 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:35 smithi165 podman[96501]: 2024-09-16 02:13:35.267921438 +0000 UTC m=+1.556427082 container cleanup 644a6f60bbc77a4476746abdad1fa5e698501bea8dd1e07b45eefd2ccd3af87f (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=quincy-6d025bc) 2024-09-16T02:13:35.451 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:35 smithi165 bash[96501]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5 2024-09-16T02:13:35.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:35 smithi110 ceph-mon[98215]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T02:13:35.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:35 smithi110 ceph-mon[98215]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-16T02:13:35.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:35 smithi110 ceph-mon[98215]: osdmap e73: 6 total, 5 up, 6 in 2024-09-16T02:13:35.880 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:35 smithi165 podman[96528]: 2024-09-16 02:13:35.535904819 +0000 UTC m=+0.661493091 container remove 644a6f60bbc77a4476746abdad1fa5e698501bea8dd1e07b45eefd2ccd3af87f (image=quay.ceph.io/ceph-ci/ceph@sha256:83596473fc70117d507bb3d925c5bd11b70f46bbd4dffcc8452f145d93eaedc4, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-6d025bc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-16T02:13:36.148 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:35 smithi165 podman[96619]: 2024-09-16 02:13:35.782457947 +0000 UTC m=+0.015829709 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:13:36.149 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:35 smithi165 podman[96619]: 2024-09-16 02:13:35.895106001 +0000 UTC m=+0.128477760 container create da5df79b09547f003ee48dbaff1952006637992fc1572655c4b4c6f5e3457af9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-09-16T02:13:36.149 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 podman[96619]: 2024-09-16 02:13:36.147906533 +0000 UTC m=+0.381278292 container init da5df79b09547f003ee48dbaff1952006637992fc1572655c4b4c6f5e3457af9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T02:13:36.413 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 podman[96619]: 2024-09-16 02:13:36.151303713 +0000 UTC m=+0.384675472 container start da5df79b09547f003ee48dbaff1952006637992fc1572655c4b4c6f5e3457af9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T02:13:36.413 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 podman[96619]: 2024-09-16 02:13:36.23091138 +0000 UTC m=+0.464283141 container attach da5df79b09547f003ee48dbaff1952006637992fc1572655c4b4c6f5e3457af9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-16T02:13:36.413 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 podman[96619]: 2024-09-16 02:13:36.336382744 +0000 UTC m=+0.569754504 container died da5df79b09547f003ee48dbaff1952006637992fc1572655c4b4c6f5e3457af9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T02:13:36.668 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:36 smithi165 ceph-mon[77258]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:13:36.668 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:36 smithi165 ceph-mon[77258]: osdmap e74: 6 total, 5 up, 6 in 2024-09-16T02:13:36.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:36 smithi110 ceph-mon[98215]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T02:13:36.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:36 smithi110 ceph-mon[98215]: osdmap e74: 6 total, 5 up, 6 in 2024-09-16T02:13:37.200 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 podman[96642]: 2024-09-16 02:13:36.925670625 +0000 UTC m=+0.583232831 container remove da5df79b09547f003ee48dbaff1952006637992fc1572655c4b4c6f5e3457af9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-16T02:13:37.200 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-16T02:13:37.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 systemd[1]: Stopped Ceph osd.5 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:13:37.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:36 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.5.service: Consumed 49.776s CPU time. 2024-09-16T02:13:37.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 systemd[1]: Starting Ceph osd.5 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:13:37.663 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-09-16T02:13:37.663 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]: dispatch 2024-09-16T02:13:37.663 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 5]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 5]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:37.664 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:37.664 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 podman[96741]: 2024-09-16 02:13:37.343364579 +0000 UTC m=+0.098237170 container create 7cd443127dfbe00667310125232e7947f1bc4bd29eb20f5fdf900f3562f99565 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-16T02:13:37.665 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 podman[96741]: 2024-09-16 02:13:37.2607061 +0000 UTC m=+0.015578689 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:13:37.665 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 podman[96741]: 2024-09-16 02:13:37.587543307 +0000 UTC m=+0.342415896 container init 7cd443127dfbe00667310125232e7947f1bc4bd29eb20f5fdf900f3562f99565 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:13:37.665 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 podman[96741]: 2024-09-16 02:13:37.590913659 +0000 UTC m=+0.345786257 container start 7cd443127dfbe00667310125232e7947f1bc4bd29eb20f5fdf900f3562f99565 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-16T02:13:37.665 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 podman[96741]: 2024-09-16 02:13:37.662372893 +0000 UTC m=+0.417245485 container attach 7cd443127dfbe00667310125232e7947f1bc4bd29eb20f5fdf900f3562f99565 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 5]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 5]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]: dispatch 2024-09-16T02:13:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2024-09-16T02:13:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:37.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:37.950 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:37.950 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 bash[96741]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:37.950 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:37.950 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:37 smithi165 bash[96741]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T02:13:38.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T02:13:38.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T02:13:38.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T02:13:38.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T02:13:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: pgmap v150: 65 pgs: 7 active+undersized, 7 stale+active+clean, 3 active+undersized+degraded, 48 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 10/264 objects degraded (3.788%) 2024-09-16T02:13:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-09-16T02:13:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]': finished 2024-09-16T02:13:38.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 5]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 5]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: osdmap e75: 6 total, 5 up, 6 in 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 3 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:38.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-mon[77258]: osdmap e76: 6 total, 5 up, 6 in 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: pgmap v150: 65 pgs: 7 active+undersized, 7 stale+active+clean, 3 active+undersized+degraded, 48 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 10/264 objects degraded (3.788%) 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 5]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [0, 2]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 5]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 5]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [1, 2]}]': finished 2024-09-16T02:13:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]': finished 2024-09-16T02:13:38.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2024-09-16T02:13:38.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: osdmap e75: 6 total, 5 up, 6 in 2024-09-16T02:13:38.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 3 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:38.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:38 smithi110 ceph-mon[98215]: osdmap e76: 6 total, 5 up, 6 in 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate[96756]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-16T02:13:39.201 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 bash[96741]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-16T02:13:39.202 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:38 smithi165 podman[96741]: 2024-09-16 02:13:38.775043982 +0000 UTC m=+1.529916575 container died 7cd443127dfbe00667310125232e7947f1bc4bd29eb20f5fdf900f3562f99565 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-16T02:13:39.811 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:39 smithi165 podman[96886]: 2024-09-16 02:13:39.516172683 +0000 UTC m=+0.729032311 container remove 7cd443127dfbe00667310125232e7947f1bc4bd29eb20f5fdf900f3562f99565 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T02:13:39.811 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:39 smithi165 podman[96944]: 2024-09-16 02:13:39.708512687 +0000 UTC m=+0.099709330 container create a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T02:13:39.811 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:39 smithi165 podman[96944]: 2024-09-16 02:13:39.624984845 +0000 UTC m=+0.016181488 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:13:40.421 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:39 smithi165 podman[96944]: 2024-09-16 02:13:39.95276613 +0000 UTC m=+0.343962773 container init a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T02:13:40.421 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:39 smithi165 podman[96944]: 2024-09-16 02:13:39.956136892 +0000 UTC m=+0.347333536 container start a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T02:13:40.421 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:39 smithi165 ceph-osd[96963]: -- 172.21.15.165:0/620253518 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563afe8281e0 con 0x563afe826000 2024-09-16T02:13:40.421 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:40 smithi165 bash[96944]: a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c 2024-09-16T02:13:40.422 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:40 smithi165 systemd[1]: Started Ceph osd.5 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:13:40.684 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:40 smithi165 ceph-mon[77258]: pgmap v153: 65 pgs: 1 peering, 11 active+undersized, 3 stale+active+clean, 7 active+undersized+degraded, 43 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 17/264 objects degraded (6.439%) 2024-09-16T02:13:40.684 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:40 smithi165 ceph-mon[77258]: osdmap e77: 6 total, 5 up, 6 in 2024-09-16T02:13:40.684 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:40.684 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:40.684 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:40.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:40 smithi110 ceph-mon[98215]: pgmap v153: 65 pgs: 1 peering, 11 active+undersized, 3 stale+active+clean, 7 active+undersized+degraded, 43 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 17/264 objects degraded (6.439%) 2024-09-16T02:13:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:40 smithi110 ceph-mon[98215]: osdmap e77: 6 total, 5 up, 6 in 2024-09-16T02:13:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:40.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:41.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 -- 172.21.15.110:0/3840599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fb810 msgr2=0x7ff6080fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 --2- 172.21.15.110:0/3840599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fb810 0x7ff6080fbbe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80048d0 tx=0x7ff5f8009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 -- 172.21.15.110:0/3840599389 shutdown_connections 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 --2- 172.21.15.110:0/3840599389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fcf80 0x7ff6080fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 --2- 172.21.15.110:0/3840599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fb810 0x7ff6080fbbe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 -- 172.21.15.110:0/3840599389 >> 172.21.15.110:0/3840599389 conn(0x7ff6080723b0 msgr2=0x7ff6080727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 -- 172.21.15.110:0/3840599389 shutdown_connections 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.609+0000 7ff60ce17640 1 -- 172.21.15.110:0/3840599389 wait complete. 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60ce17640 1 Processor -- start 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60ce17640 1 -- start start 2024-09-16T02:13:41.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60ce17640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fb810 0x7ff60810e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60ce17640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 0x7ff60810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60ce17640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60810ed40 con 0x7ff6080fcf80 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60ce17640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60810eeb0 con 0x7ff6080fb810 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff605d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 0x7ff60810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff605d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 0x7ff60810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36514/0 (socket says 172.21.15.110:36514) 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff605d9b640 1 -- 172.21.15.110:0/2906245683 learned_addr learned my addr 172.21.15.110:0/2906245683 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60659c640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fb810 0x7ff60810e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff605d9b640 1 -- 172.21.15.110:0/2906245683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fb810 msgr2=0x7ff60810e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff605d9b640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fb810 0x7ff60810e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff605d9b640 1 -- 172.21.15.110:0/2906245683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8005040 con 0x7ff6080fcf80 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.610+0000 7ff60659c640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fb810 0x7ff60810e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.611+0000 7ff605d9b640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 0x7ff60810e6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc002a50 tx=0x7ff5fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.611+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5fc007c30 con 0x7ff6080fcf80 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.611+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5fc00f040 con 0x7ff6080fcf80 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.611+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5fc00da50 con 0x7ff6080fcf80 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.611+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff608117220 con 0x7ff6080fcf80 2024-09-16T02:13:41.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.611+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff608117730 con 0x7ff6080fcf80 2024-09-16T02:13:41.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.612+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6080fcbc0 con 0x7ff6080fcf80 2024-09-16T02:13:41.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.613+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff5fc00dbf0 con 0x7ff6080fcf80 2024-09-16T02:13:41.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.613+0000 7ff5f6ffd640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff5f006e530 0x7ff5f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:41.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.613+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6792+0+0 (secure 0 0 0) 0x7ff5fc08d990 con 0x7ff6080fcf80 2024-09-16T02:13:41.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.613+0000 7ff60659c640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff5f006e530 0x7ff5f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:41.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.614+0000 7ff60659c640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff5f006e530 0x7ff5f00709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009ac0 tx=0x7ff5f8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:41.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.618+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff5fc056a00 con 0x7ff6080fcf80 2024-09-16T02:13:41.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:41 smithi165 ceph-mon[77258]: osdmap e78: 6 total, 5 up, 6 in 2024-09-16T02:13:41.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:41 smithi110 ceph-mon[98215]: osdmap e78: 6 total, 5 up, 6 in 2024-09-16T02:13:41.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.803+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff60804b720 con 0x7ff5f006e530 2024-09-16T02:13:41.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.804+0000 7ff5f6ffd640 1 -- 172.21.15.110:0/2906245683 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff60804b720 con 0x7ff5f006e530 2024-09-16T02:13:41.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff5f006e530 msgr2=0x7ff5f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:41.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff5f006e530 0x7ff5f00709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009ac0 tx=0x7ff5f8035040 comp rx=0 tx=0).stop 2024-09-16T02:13:41.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 msgr2=0x7ff60810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:41.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 0x7ff60810e6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc002a50 tx=0x7ff5fc004600 comp rx=0 tx=0).stop 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 shutdown_connections 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7ff5f006e530 0x7ff5f00709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6080fcf80 0x7ff60810e6f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 --2- 172.21.15.110:0/2906245683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6080fb810 0x7ff60810e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 >> 172.21.15.110:0/2906245683 conn(0x7ff6080723b0 msgr2=0x7ff6080fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 shutdown_connections 2024-09-16T02:13:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.806+0000 7ff60ce17640 1 -- 172.21.15.110:0/2906245683 wait complete. 2024-09-16T02:13:41.816 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 -- 172.21.15.110:0/2285032492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102ef0 msgr2=0x7fd7d40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/2285032492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102ef0 0x7fd7d40fc5b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40048d0 tx=0x7fd7c4009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 -- 172.21.15.110:0/2285032492 shutdown_connections 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/2285032492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102ef0 0x7fd7d40fc5b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/2285032492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d4102550 0x7fd7d4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 -- 172.21.15.110:0/2285032492 >> 172.21.15.110:0/2285032492 conn(0x7fd7d40f80f0 msgr2=0x7fd7d40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 -- 172.21.15.110:0/2285032492 shutdown_connections 2024-09-16T02:13:41.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 -- 172.21.15.110:0/2285032492 wait complete. 2024-09-16T02:13:41.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.887+0000 7fd7dac5e640 1 Processor -- start 2024-09-16T02:13:41.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7dac5e640 1 -- start start 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7dac5e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 0x7fd7d4113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7dac5e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d4102ef0 0x7fd7d4113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7dac5e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41140c0 con 0x7fd7d4102550 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7dac5e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d410d4d0 con 0x7fd7d4102ef0 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 0x7fd7d4113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 0x7fd7d4113530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36524/0 (socket says 172.21.15.110:36524) 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 -- 172.21.15.110:0/3790964009 learned_addr learned my addr 172.21.15.110:0/3790964009 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:41.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d3fff640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d4102ef0 0x7fd7d4113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 -- 172.21.15.110:0/3790964009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d4102ef0 msgr2=0x7fd7d4113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d4102ef0 0x7fd7d4113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 -- 172.21.15.110:0/3790964009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4005040 con 0x7fd7d4102550 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.888+0000 7fd7d89fa640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 0x7fd7d4113530 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00db00 tx=0x7fd7bc004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.889+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7bc017070 con 0x7fd7d4102550 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.889+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d410d7b0 con 0x7fd7d4102550 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.889+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7bc00f040 con 0x7fd7d4102550 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.889+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7bc003960 con 0x7fd7d4102550 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.889+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d410dd20 con 0x7fd7d4102550 2024-09-16T02:13:41.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.890+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d40fdcd0 con 0x7fd7d4102550 2024-09-16T02:13:41.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.890+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd7bc003b50 con 0x7fd7d4102550 2024-09-16T02:13:41.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.891+0000 7fd7d17fa640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd7c006e530 0x7fd7c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:41.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.891+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fd7bc08e2b0 con 0x7fd7d4102550 2024-09-16T02:13:41.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.891+0000 7fd7d3fff640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd7c006e530 0x7fd7c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:41.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.891+0000 7fd7d3fff640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd7c006e530 0x7fd7c00709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40048a0 tx=0x7fd7c4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:41.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:41.895+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd7bc057270 con 0x7fd7d4102550 2024-09-16T02:13:42.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.076+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7d410d940 con 0x7fd7c006e530 2024-09-16T02:13:42.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.077+0000 7fd7d17fa640 1 -- 172.21.15.110:0/3790964009 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd7d410d940 con 0x7fd7c006e530 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd7c006e530 msgr2=0x7fd7c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd7c006e530 0x7fd7c00709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40048a0 tx=0x7fd7c4035040 comp rx=0 tx=0).stop 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 msgr2=0x7fd7d4113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 0x7fd7d4113530 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00db00 tx=0x7fd7bc004e60 comp rx=0 tx=0).stop 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 shutdown_connections 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd7c006e530 0x7fd7c00709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d4102ef0 0x7fd7d4113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 --2- 172.21.15.110:0/3790964009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d4102550 0x7fd7d4113530 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 >> 172.21.15.110:0/3790964009 conn(0x7fd7d40f80f0 msgr2=0x7fd7d40f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 shutdown_connections 2024-09-16T02:13:42.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.080+0000 7fd7dac5e640 1 -- 172.21.15.110:0/3790964009 wait complete. 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 -- 172.21.15.110:0/3835564093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1980fb4a0 msgr2=0x7fc1980fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 --2- 172.21.15.110:0/3835564093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1980fb4a0 0x7fc1980fb910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1840048d0 tx=0x7fc184009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 -- 172.21.15.110:0/3835564093 shutdown_connections 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 --2- 172.21.15.110:0/3835564093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1980fb4a0 0x7fc1980fb910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 --2- 172.21.15.110:0/3835564093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1981014e0 0x7fc1981018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 -- 172.21.15.110:0/3835564093 >> 172.21.15.110:0/3835564093 conn(0x7fc1980f7060 msgr2=0x7fc1980f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 -- 172.21.15.110:0/3835564093 shutdown_connections 2024-09-16T02:13:42.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 -- 172.21.15.110:0/3835564093 wait complete. 2024-09-16T02:13:42.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.158+0000 7fc19efae640 1 Processor -- start 2024-09-16T02:13:42.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc19efae640 1 -- start start 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc19efae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1980fb4a0 0x7fc19810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc19efae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 0x7fc19810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc19efae640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19810ecb0 con 0x7fc1981014e0 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc19efae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19810ee20 con 0x7fc1980fb4a0 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc197fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 0x7fc19810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc197fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 0x7fc19810e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36528/0 (socket says 172.21.15.110:36528) 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc197fff640 1 -- 172.21.15.110:0/3711152 learned_addr learned my addr 172.21.15.110:0/3711152 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:42.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc19cd4a640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1980fb4a0 0x7fc19810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc197fff640 1 -- 172.21.15.110:0/3711152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1980fb4a0 msgr2=0x7fc19810e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc197fff640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1980fb4a0 0x7fc19810e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.159+0000 7fc197fff640 1 -- 172.21.15.110:0/3711152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184005040 con 0x7fc1981014e0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.160+0000 7fc197fff640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 0x7fc19810e6b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc184000c00 tx=0x7fc184009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.160+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc184038070 con 0x7fc1981014e0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.160+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc18402ade0 con 0x7fc1981014e0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.160+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1981171e0 con 0x7fc1981014e0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.160+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18402c7e0 con 0x7fc1981014e0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.160+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc198117640 con 0x7fc1981014e0 2024-09-16T02:13:42.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.161+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1980fcbe0 con 0x7fc1981014e0 2024-09-16T02:13:42.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.161+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc184030020 con 0x7fc1981014e0 2024-09-16T02:13:42.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.162+0000 7fc1957fa640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc18806e530 0x7fc1880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.162+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fc1840ade80 con 0x7fc1981014e0 2024-09-16T02:13:42.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.162+0000 7fc19cd4a640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc18806e530 0x7fc1880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.162+0000 7fc19cd4a640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc18806e530 0x7fc1880709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc18c007fd0 tx=0x7fc18c009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:42.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.166+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc184076f70 con 0x7fc1981014e0 2024-09-16T02:13:42.200 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:41 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:13:41.847+0000 7f818a9ca640 -1 Falling back to public interface 2024-09-16T02:13:42.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.341+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc19804b720 con 0x7fc18806e530 2024-09-16T02:13:42.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.349+0000 7fc1957fa640 1 -- 172.21.15.110:0/3711152 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc19804b720 con 0x7fc18806e530 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (7m) 96s ago 15m 24.6M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (3m) 96s ago 15m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (3m) 31s ago 14m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (5m) 96s ago 15m 81.9M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (10m) 96s ago 10m 101M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (10m) 96s ago 10m 154M - 17.2.7-1633-g6d025bc2 33ed8dba3996 97b328f403dd 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (10m) 31s ago 10m 17.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (10m) 31s ago 10m 14.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (6m) 96s ago 16m 500M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (5m) 31s ago 14m 441M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:13:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (4m) 96s ago 17m 44.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (3m) 31s ago 14m 41.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (7m) 96s ago 15m 17.1M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 31s ago 14m 16.6M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (2m) 96s ago 14m 88.6M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (2m) 96s ago 13m 94.2M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (101s) 96s ago 13m 14.4M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (67s) 31s ago 12m 106M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 0a846f393eb0 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (34s) 31s ago 12m 11.7M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 8ed078cd81d0 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 starting - - - 2581M 2024-09-16T02:13:42.352 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (5m) 96s ago 15m 65.3M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:13:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.351+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc18806e530 msgr2=0x7fc1880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.351+0000 7fc19efae640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc18806e530 0x7fc1880709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc18c007fd0 tx=0x7fc18c009e90 comp rx=0 tx=0).stop 2024-09-16T02:13:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.351+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 msgr2=0x7fc19810e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.351+0000 7fc19efae640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 0x7fc19810e6b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc184000c00 tx=0x7fc184009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 shutdown_connections 2024-09-16T02:13:42.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fc18806e530 0x7fc1880709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1981014e0 0x7fc19810e6b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 --2- 172.21.15.110:0/3711152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1980fb4a0 0x7fc19810e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 >> 172.21.15.110:0/3711152 conn(0x7fc1980f7060 msgr2=0x7fc1980f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 shutdown_connections 2024-09-16T02:13:42.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.352+0000 7fc19efae640 1 -- 172.21.15.110:0/3711152 wait complete. 2024-09-16T02:13:42.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 -- 172.21.15.110:0/905050897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 msgr2=0x7fb27c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 --2- 172.21.15.110:0/905050897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c0fc590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0048d0 tx=0x7fb26c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 -- 172.21.15.110:0/905050897 shutdown_connections 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 --2- 172.21.15.110:0/905050897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c0fc590 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 --2- 172.21.15.110:0/905050897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb27c102530 0x7fb27c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 -- 172.21.15.110:0/905050897 >> 172.21.15.110:0/905050897 conn(0x7fb27c0f8110 msgr2=0x7fb27c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 -- 172.21.15.110:0/905050897 shutdown_connections 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.429+0000 7fb28411e640 1 -- 172.21.15.110:0/905050897 wait complete. 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb28411e640 1 Processor -- start 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb28411e640 1 -- start start 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb28411e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb27c102530 0x7fb27c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb28411e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb28411e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c113d30 con 0x7fb27c102ed0 2024-09-16T02:13:42.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb28411e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c10d170 con 0x7fb27c102530 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb2816b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb2816b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36538/0 (socket says 172.21.15.110:36538) 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb2816b9640 1 -- 172.21.15.110:0/1782714077 learned_addr learned my addr 172.21.15.110:0/1782714077 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.430+0000 7fb281eba640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb27c102530 0x7fb27c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2816b9640 1 -- 172.21.15.110:0/1782714077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb27c102530 msgr2=0x7fb27c1131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2816b9640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb27c102530 0x7fb27c1131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2816b9640 1 -- 172.21.15.110:0/1782714077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c005040 con 0x7fb27c102ed0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2816b9640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c113730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0043d0 tx=0x7fb26c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c038070 con 0x7fb27c102ed0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb26c0096e0 con 0x7fb27c102ed0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c10d3f0 con 0x7fb27c102ed0 2024-09-16T02:13:42.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c02c8a0 con 0x7fb27c102ed0 2024-09-16T02:13:42.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.431+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c10d930 con 0x7fb27c102ed0 2024-09-16T02:13:42.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.432+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c0fdcb0 con 0x7fb27c102ed0 2024-09-16T02:13:42.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.433+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb26c030020 con 0x7fb27c102ed0 2024-09-16T02:13:42.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.433+0000 7fb2727fc640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb26806e530 0x7fb2680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.433+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fb26c0adfc0 con 0x7fb27c102ed0 2024-09-16T02:13:42.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.433+0000 7fb281eba640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb26806e530 0x7fb2680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.433+0000 7fb281eba640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb26806e530 0x7fb2680709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb278009fd0 tx=0x7fb278009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:42.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.437+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb26c077000 con 0x7fb27c102ed0 2024-09-16T02:13:42.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.676+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb27c109540 con 0x7fb27c102ed0 2024-09-16T02:13:42.678 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:42 smithi110 ceph-mon[98215]: pgmap v156: 65 pgs: 4 remapped+peering, 1 peering, 15 active+undersized, 11 active+undersized+degraded, 34 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 37/264 objects degraded (14.015%) 2024-09-16T02:13:42.678 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:42 smithi110 ceph-mon[98215]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-16T02:13:42.678 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:42 smithi110 ceph-mon[98215]: osdmap e79: 6 total, 5 up, 6 in 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.677+0000 7fb2727fc640 1 -- 172.21.15.110:0/1782714077 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7fb26c07a6c0 con 0x7fb27c102ed0 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:42.679 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 5 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 4, 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 9 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:13:42.680 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:13:42.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb26806e530 msgr2=0x7fb2680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb26806e530 0x7fb2680709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb278009fd0 tx=0x7fb278009e50 comp rx=0 tx=0).stop 2024-09-16T02:13:42.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 msgr2=0x7fb27c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c113730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0043d0 tx=0x7fb26c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 shutdown_connections 2024-09-16T02:13:42.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb26806e530 0x7fb2680709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb27c102ed0 0x7fb27c113730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 --2- 172.21.15.110:0/1782714077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb27c102530 0x7fb27c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 >> 172.21.15.110:0/1782714077 conn(0x7fb27c0f8110 msgr2=0x7fb27c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.679+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 shutdown_connections 2024-09-16T02:13:42.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.680+0000 7fb28411e640 1 -- 172.21.15.110:0/1782714077 wait complete. 2024-09-16T02:13:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:42 smithi165 ceph-mon[77258]: pgmap v156: 65 pgs: 4 remapped+peering, 1 peering, 15 active+undersized, 11 active+undersized+degraded, 34 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 37/264 objects degraded (14.015%) 2024-09-16T02:13:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:42 smithi165 ceph-mon[77258]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-16T02:13:42.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:42 smithi165 ceph-mon[77258]: osdmap e79: 6 total, 5 up, 6 in 2024-09-16T02:13:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.762+0000 7fea4199b640 1 -- 172.21.15.110:0/2528173703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 msgr2=0x7fea3c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.762+0000 7fea4199b640 1 --2- 172.21.15.110:0/2528173703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c102900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0048d0 tx=0x7fea2c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.762+0000 7fea4199b640 1 -- 172.21.15.110:0/2528173703 shutdown_connections 2024-09-16T02:13:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.762+0000 7fea4199b640 1 --2- 172.21.15.110:0/2528173703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c102ed0 0x7fea3c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.762+0000 7fea4199b640 1 --2- 172.21.15.110:0/2528173703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c102900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.762+0000 7fea4199b640 1 -- 172.21.15.110:0/2528173703 >> 172.21.15.110:0/2528173703 conn(0x7fea3c0f80f0 msgr2=0x7fea3c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 -- 172.21.15.110:0/2528173703 shutdown_connections 2024-09-16T02:13:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 -- 172.21.15.110:0/2528173703 wait complete. 2024-09-16T02:13:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 Processor -- start 2024-09-16T02:13:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 -- start start 2024-09-16T02:13:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c102ed0 0x7fea3c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c113d50 con 0x7fea3c102530 2024-09-16T02:13:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.763+0000 7fea4199b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c10d190 con 0x7fea3c102ed0 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36560/0 (socket says 172.21.15.110:36560) 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 -- 172.21.15.110:0/2332694267 learned_addr learned my addr 172.21.15.110:0/2332694267 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3a7fc640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c102ed0 0x7fea3c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 -- 172.21.15.110:0/2332694267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c102ed0 msgr2=0x7fea3c113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c102ed0 0x7fea3c113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 -- 172.21.15.110:0/2332694267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c005040 con 0x7fea3c102530 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea3affd640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c113210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fea2c000c00 tx=0x7fea2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2c038070 con 0x7fea3c102530 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea2c02ade0 con 0x7fea3c102530 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2c02c7b0 con 0x7fea3c102530 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c10d410 con 0x7fea3c102530 2024-09-16T02:13:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.764+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c10d950 con 0x7fea3c102530 2024-09-16T02:13:42.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.766+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c0fdcb0 con 0x7fea3c102530 2024-09-16T02:13:42.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.766+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fea2c030020 con 0x7fea3c102530 2024-09-16T02:13:42.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.767+0000 7fea237fe640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea2406e530 0x7fea240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.767+0000 7fea3a7fc640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea2406e530 0x7fea240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.767+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fea2c0ae610 con 0x7fea3c102530 2024-09-16T02:13:42.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.767+0000 7fea3a7fc640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea2406e530 0x7fea240709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea3c10ead0 tx=0x7fea3000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:42.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.771+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea2c077650 con 0x7fea3c102530 2024-09-16T02:13:42.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.970+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea3c04b720 con 0x7fea3c102530 2024-09-16T02:13:42.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.971+0000 7fea237fe640 1 -- 172.21.15.110:0/2332694267 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1947 (secure 0 0 0) 0x7fea2c07ad10 con 0x7fea3c102530 2024-09-16T02:13:42.972 INFO:teuthology.orchestra.run.smithi110.stdout:e16 2024-09-16T02:13:42.972 INFO:teuthology.orchestra.run.smithi110.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T02:13:42.972 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 15 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:03:24.623988+0000 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:13:42.973 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=14444} 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:13:42.974 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:14444} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.110:6826/3304502676,v1:172.21.15.110:6827/3304502676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:14454} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.110:6828/1889333536,v1:172.21.15.110:6829/1889333536] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:13:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:24247} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:42.976 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:13:42.976 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:13:42.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea2406e530 msgr2=0x7fea240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea2406e530 0x7fea240709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea3c10ead0 tx=0x7fea3000b040 comp rx=0 tx=0).stop 2024-09-16T02:13:42.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 msgr2=0x7fea3c113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c113210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fea2c000c00 tx=0x7fea2c009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 shutdown_connections 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fea2406e530 0x7fea240709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea3c102ed0 0x7fea3c113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 --2- 172.21.15.110:0/2332694267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fea3c102530 0x7fea3c113210 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 >> 172.21.15.110:0/2332694267 conn(0x7fea3c0f80f0 msgr2=0x7fea3c0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 shutdown_connections 2024-09-16T02:13:42.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:42.973+0000 7fea4199b640 1 -- 172.21.15.110:0/2332694267 wait complete. 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 -- 172.21.15.110:0/972655214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fb810 msgr2=0x7fa4ec0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 --2- 172.21.15.110:0/972655214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fb810 0x7fa4ec0fbbe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0048d0 tx=0x7fa4dc009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 -- 172.21.15.110:0/972655214 shutdown_connections 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 --2- 172.21.15.110:0/972655214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 --2- 172.21.15.110:0/972655214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fb810 0x7fa4ec0fbbe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 -- 172.21.15.110:0/972655214 >> 172.21.15.110:0/972655214 conn(0x7fa4ec0723b0 msgr2=0x7fa4ec0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 -- 172.21.15.110:0/972655214 shutdown_connections 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.052+0000 7fa4f2685640 1 -- 172.21.15.110:0/972655214 wait complete. 2024-09-16T02:13:43.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4f2685640 1 Processor -- start 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4f2685640 1 -- start start 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4f2685640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4ec0fb810 0x7fa4ec0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4f2685640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4f2685640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0f8fc0 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4f2685640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0f9130 con 0x7fa4ec0fb810 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4eb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4eb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36588/0 (socket says 172.21.15.110:36588) 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4eb7fe640 1 -- 172.21.15.110:0/3299135765 learned_addr learned my addr 172.21.15.110:0/3299135765 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:43.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4ebfff640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4ec0fb810 0x7fa4ec0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4eb7fe640 1 -- 172.21.15.110:0/3299135765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4ec0fb810 msgr2=0x7fa4ec0f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4eb7fe640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4ec0fb810 0x7fa4ec0f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.053+0000 7fa4eb7fe640 1 -- 172.21.15.110:0/3299135765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc005040 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.054+0000 7fa4eb7fe640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0f8a80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0002a50 tx=0x7fa4e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.054+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4e0007c30 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.054+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec0f93c0 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.054+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4e000f040 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.054+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4e000dad0 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.054+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec119940 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.055+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec0fcbc0 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.055+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa4e000dc30 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.056+0000 7fa4e8ff9640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa4d406e530 0x7fa4d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.056+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fa4e008e080 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.056+0000 7fa4ebfff640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa4d406e530 0x7fa4d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:43.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.056+0000 7fa4ebfff640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa4d406e530 0x7fa4d40709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009ac0 tx=0x7fa4dc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:43.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.060+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4e00570c0 con 0x7fa4ec0fcf80 2024-09-16T02:13:43.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.244+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4ec0f9ca0 con 0x7fa4d406e530 2024-09-16T02:13:43.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.246+0000 7fa4e8ff9640 1 -- 172.21.15.110:0/3299135765 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa4ec0f9ca0 con 0x7fa4d406e530 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "osd", 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:13:43.248 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "12/21 daemons upgraded", 2024-09-16T02:13:43.249 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T02:13:43.249 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:13:43.249 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:13:43.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa4d406e530 msgr2=0x7fa4d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa4d406e530 0x7fa4d40709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009ac0 tx=0x7fa4dc035040 comp rx=0 tx=0).stop 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 msgr2=0x7fa4ec0f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0f8a80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0002a50 tx=0x7fa4e0004600 comp rx=0 tx=0).stop 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 shutdown_connections 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa4d406e530 0x7fa4d40709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4ec0fcf80 0x7fa4ec0f8a80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 --2- 172.21.15.110:0/3299135765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4ec0fb810 0x7fa4ec0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 >> 172.21.15.110:0/3299135765 conn(0x7fa4ec0723b0 msgr2=0x7fa4ec064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 shutdown_connections 2024-09-16T02:13:43.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.248+0000 7fa4f2685640 1 -- 172.21.15.110:0/3299135765 wait complete. 2024-09-16T02:13:43.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.326+0000 7fb18878d640 1 -- 172.21.15.110:0/775640435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 msgr2=0x7fb1800fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.326+0000 7fb18878d640 1 --2- 172.21.15.110:0/775640435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb1800fbbe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb1740048d0 tx=0x7fb174009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- 172.21.15.110:0/775640435 shutdown_connections 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 --2- 172.21.15.110:0/775640435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1800fcf80 0x7fb1800fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 --2- 172.21.15.110:0/775640435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb1800fbbe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- 172.21.15.110:0/775640435 >> 172.21.15.110:0/775640435 conn(0x7fb1800723b0 msgr2=0x7fb1800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- 172.21.15.110:0/775640435 shutdown_connections 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- 172.21.15.110:0/775640435 wait complete. 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 Processor -- start 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- start start 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb180113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:43.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1800fcf80 0x7fb180113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180113d40 con 0x7fb1800fb810 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb18878d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18010d180 con 0x7fb1800fcf80 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.327+0000 7fb186529640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb180113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb186529640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb180113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36606/0 (socket says 172.21.15.110:36606) 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb186529640 1 -- 172.21.15.110:0/246028427 learned_addr learned my addr 172.21.15.110:0/246028427 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb185d28640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1800fcf80 0x7fb180113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb186529640 1 -- 172.21.15.110:0/246028427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1800fcf80 msgr2=0x7fb180113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb186529640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1800fcf80 0x7fb180113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb186529640 1 -- 172.21.15.110:0/246028427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174005040 con 0x7fb1800fb810 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb186529640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb180113200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb174000c00 tx=0x7fb174009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb174038070 con 0x7fb1800fb810 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb17402ade0 con 0x7fb1800fb810 2024-09-16T02:13:43.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18010d400 con 0x7fb1800fb810 2024-09-16T02:13:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17402c7e0 con 0x7fb1800fb810 2024-09-16T02:13:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.328+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18010d940 con 0x7fb1800fb810 2024-09-16T02:13:43.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.329+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800fcbc0 con 0x7fb1800fb810 2024-09-16T02:13:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.330+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb174030020 con 0x7fb1800fb810 2024-09-16T02:13:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.330+0000 7fb172ffd640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb16c06e530 0x7fb16c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:13:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.330+0000 7fb185d28640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb16c06e530 0x7fb16c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:13:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.330+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6792+0+0 (secure 0 0 0) 0x7fb1740adf20 con 0x7fb1800fb810 2024-09-16T02:13:43.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.331+0000 7fb185d28640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb16c06e530 0x7fb16c0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb18010eac0 tx=0x7fb17c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:13:43.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.335+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1740e31b0 con 0x7fb1800fb810 2024-09-16T02:13:43.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.574+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb18004b750 con 0x7fb1800fb810 2024-09-16T02:13:43.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:43.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:43.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:43.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: osdmap e80: 6 total, 5 up, 6 in 2024-09-16T02:13:43.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1782714077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:43.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.577 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.577 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2332694267' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:13:43.577 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.577 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.575+0000 7fb172ffd640 1 -- 172.21.15.110:0/246028427 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1506 (secure 0 0 0) 0x7fb174076f90 con 0x7fb1800fb810 2024-09-16T02:13:43.577 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 1 pg peering; Degraded data redundancy: 37/264 objects degraded (14.015%), 11 pgs degraded 2024-09-16T02:13:43.577 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:13:43.577 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: osd.5 (root=default,host=smithi165) is down 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1f is stuck peering for 2m, current state remapped+peering, last acting [3,4,0] 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/264 objects degraded (14.015%), 11 pgs degraded 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-16T02:13:43.578 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-16T02:13:43.579 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-16T02:13:43.579 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-16T02:13:43.579 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-16T02:13:43.579 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-16T02:13:43.579 INFO:teuthology.orchestra.run.smithi110.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb16c06e530 msgr2=0x7fb16c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb16c06e530 0x7fb16c0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb18010eac0 tx=0x7fb17c00b040 comp rx=0 tx=0).stop 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 msgr2=0x7fb180113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb180113200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb174000c00 tx=0x7fb174009da0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 shutdown_connections 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb16c06e530 0x7fb16c0709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1800fcf80 0x7fb180113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 --2- 172.21.15.110:0/246028427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1800fb810 0x7fb180113200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 >> 172.21.15.110:0/246028427 conn(0x7fb1800723b0 msgr2=0x7fb180064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:13:43.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 shutdown_connections 2024-09-16T02:13:43.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:13:43.577+0000 7fb18878d640 1 -- 172.21.15.110:0/246028427 wait complete. 2024-09-16T02:13:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: osdmap e80: 6 total, 5 up, 6 in 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1782714077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2332694267' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:43.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:44 smithi165 ceph-mon[77258]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:44 smithi165 ceph-mon[77258]: pgmap v159: 65 pgs: 5 active+clean+remapped, 4 remapped+peering, 13 active+undersized, 11 active+undersized+degraded, 32 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 1/264 objects misplaced (0.379%); 0 B/s, 133 objects/s recovering 2024-09-16T02:13:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:44 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/246028427' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:13:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:44 smithi110 ceph-mon[98215]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:13:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:44 smithi110 ceph-mon[98215]: pgmap v159: 65 pgs: 5 active+clean+remapped, 4 remapped+peering, 13 active+undersized, 11 active+undersized+degraded, 32 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 1/264 objects misplaced (0.379%); 0 B/s, 133 objects/s recovering 2024-09-16T02:13:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:44 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/246028427' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:13:45.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:45 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 37/264 objects degraded (14.015%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:45.851 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:45 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 37/264 objects degraded (14.015%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:46.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:46 smithi110 ceph-mon[98215]: pgmap v160: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 862 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 8/264 objects misplaced (3.030%); 2.7 MiB/s, 142 objects/s recovering 2024-09-16T02:13:46.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:46 smithi110 ceph-mon[98215]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-16T02:13:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:46 smithi165 ceph-mon[77258]: pgmap v160: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 862 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 8/264 objects misplaced (3.030%); 2.7 MiB/s, 142 objects/s recovering 2024-09-16T02:13:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:46 smithi165 ceph-mon[77258]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-16T02:13:47.450 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:13:47.076+0000 7f818a9ca640 -1 osd.5 72 log_to_monitors true 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-16T02:13:47.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-16T02:13:47.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-16T02:13:47.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-16T02:13:47.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-16T02:13:47.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-16T02:13:47.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='osd.5 [v2:172.21.15.165:6816/1192685626,v1:172.21.15.165:6817/1192685626]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:13:47.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:47 smithi165 ceph-mon[77258]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-16T02:13:47.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-16T02:13:47.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-16T02:13:47.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-16T02:13:47.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-16T02:13:47.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='osd.5 [v2:172.21.15.165:6816/1192685626,v1:172.21.15.165:6817/1192685626]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:13:47.959 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:47 smithi110 ceph-mon[98215]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T02:13:48.855 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:13:48.463+0000 7f817e75c640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all osd 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: Upgrade: Setting require_osd_release to 19 squid 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: pgmap v161: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 739 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 8/264 objects misplaced (3.030%); 2.3 MiB/s, 122 objects/s recovering 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='osd.5 [v2:172.21.15.165:6816/1192685626,v1:172.21.15.165:6817/1192685626]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:48.855 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: osdmap e81: 6 total, 5 up, 6 in 2024-09-16T02:13:48.856 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:48.856 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:48.856 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-16T02:13:48.856 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: from='osd.5 ' entity='osd.5' 2024-09-16T02:13:48.856 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:48 smithi165 ceph-mon[77258]: osdmap e82: 6 total, 5 up, 6 in 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all osd 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: Upgrade: Setting require_osd_release to 19 squid 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: pgmap v161: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 739 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 8/264 objects misplaced (3.030%); 2.3 MiB/s, 122 objects/s recovering 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='osd.5 [v2:172.21.15.165:6816/1192685626,v1:172.21.15.165:6817/1192685626]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: osdmap e81: 6 total, 5 up, 6 in 2024-09-16T02:13:48.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-16T02:13:48.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:48.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-16T02:13:48.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: from='osd.5 ' entity='osd.5' 2024-09-16T02:13:48.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:48 smithi110 ceph-mon[98215]: osdmap e82: 6 total, 5 up, 6 in 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2 up:standby 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:13:49.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: osd.5 [v2:172.21.15.165:6816/1192685626,v1:172.21.15.165:6817/1192685626] boot 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: osdmap e83: 6 total, 6 up, 6 in 2024-09-16T02:13:49.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:49 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:13:49.870 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-16T02:13:49.870 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-16T02:13:49.870 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 2 up:standby 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: osd.5 [v2:172.21.15.165:6816/1192685626,v1:172.21.15.165:6817/1192685626] boot 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: osdmap e83: 6 total, 6 up, 6 in 2024-09-16T02:13:49.871 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:49 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T02:13:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: pgmap v164: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 256 MiB data, 1006 MiB used, 535 GiB / 536 GiB avail; 740 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 8/264 objects misplaced (3.030%); 2.3 MiB/s, 45 objects/s recovering 2024-09-16T02:13:50.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: osdmap e84: 6 total, 6 up, 6 in 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.110:6828/591551052,v1:172.21.15.110:6829/591551052] up:boot 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:50.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:50 smithi165 ceph-mon[77258]: osdmap e85: 6 total, 6 up, 6 in 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: pgmap v164: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 33 active+clean; 256 MiB data, 1006 MiB used, 535 GiB / 536 GiB avail; 740 B/s rd, 1 op/s; 37/264 objects degraded (14.015%); 8/264 objects misplaced (3.030%); 2.3 MiB/s, 45 objects/s recovering 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: osdmap e84: 6 total, 6 up, 6 in 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.110:6828/591551052,v1:172.21.15.110:6829/591551052] up:boot 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.yaugxw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:13:50.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:50 smithi110 ceph-mon[98215]: osdmap e85: 6 total, 6 up, 6 in 2024-09-16T02:13:51.872 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:51 smithi110 ceph-mon[98215]: Upgrade: Updating mds.cephfs.smithi110.yaugxw 2024-09-16T02:13:51.872 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:51 smithi110 ceph-mon[98215]: Deploying daemon mds.cephfs.smithi110.yaugxw on smithi110 2024-09-16T02:13:51.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:51 smithi165 ceph-mon[77258]: Upgrade: Updating mds.cephfs.smithi110.yaugxw 2024-09-16T02:13:51.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:51 smithi165 ceph-mon[77258]: Deploying daemon mds.cephfs.smithi110.yaugxw on smithi110 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[98211]: 2024-09-16T02:13:52.401+0000 7f61a5676640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: pgmap v168: 65 pgs: 8 active+clean+remapped, 12 active+undersized, 9 active+undersized+degraded, 36 active+clean; 256 MiB data, 1006 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 32/264 objects degraded (12.121%); 8/264 objects misplaced (3.030%) 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: Health check update: Degraded data redundancy: 32/264 objects degraded (12.121%), 9 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: osdmap e86: 6 total, 6 up, 6 in 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T02:13:52.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:13:52.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: osdmap e87: 6 total, 6 up, 6 in 2024-09-16T02:13:52.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: Standby daemon mds.cephfs.smithi165.gxrypw assigned to filesystem cephfs as rank 0 2024-09-16T02:13:52.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T02:13:52.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T02:13:52.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:52 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi165.gxrypw=up:replay} 2 up:standby 2024-09-16T02:13:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: pgmap v168: 65 pgs: 8 active+clean+remapped, 12 active+undersized, 9 active+undersized+degraded, 36 active+clean; 256 MiB data, 1006 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 32/264 objects degraded (12.121%); 8/264 objects misplaced (3.030%) 2024-09-16T02:13:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: Health check update: Degraded data redundancy: 32/264 objects degraded (12.121%), 9 pgs degraded (PG_DEGRADED) 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: osdmap e86: 6 total, 6 up, 6 in 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: osdmap e87: 6 total, 6 up, 6 in 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: Standby daemon mds.cephfs.smithi165.gxrypw assigned to filesystem cephfs as rank 0 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T02:13:52.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:52 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi165.gxrypw=up:replay} 2 up:standby 2024-09-16T02:13:53.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:53 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:13:53.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:53 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:13:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:54 smithi165 ceph-mon[77258]: pgmap v171: 65 pgs: 2 active+clean+remapped, 3 active+undersized, 4 active+undersized+degraded, 56 active+clean; 256 MiB data, 1014 MiB used, 535 GiB / 536 GiB avail; 5.1 MiB/s rd, 2 op/s; 19/264 objects degraded (7.197%); 4/264 objects misplaced (1.515%); 1.0 MiB/s, 83 objects/s recovering 2024-09-16T02:13:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:54 smithi110 ceph-mon[98215]: pgmap v171: 65 pgs: 2 active+clean+remapped, 3 active+undersized, 4 active+undersized+degraded, 56 active+clean; 256 MiB data, 1014 MiB used, 535 GiB / 536 GiB avail; 5.1 MiB/s rd, 2 op/s; 19/264 objects degraded (7.197%); 4/264 objects misplaced (1.515%); 1.0 MiB/s, 83 objects/s recovering 2024-09-16T02:13:55.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:55 smithi165 ceph-mon[77258]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/264 objects degraded (7.197%), 4 pgs degraded) 2024-09-16T02:13:55.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:55 smithi110 ceph-mon[98215]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/264 objects degraded (7.197%), 4 pgs degraded) 2024-09-16T02:13:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:56 smithi165 ceph-mon[77258]: pgmap v172: 65 pgs: 65 active+clean; 256 MiB data, 1007 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s; 700 KiB/s, 55 objects/s recovering 2024-09-16T02:13:56.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:56 smithi110 ceph-mon[98215]: pgmap v172: 65 pgs: 65 active+clean; 256 MiB data, 1007 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s; 700 KiB/s, 55 objects/s recovering 2024-09-16T02:13:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:13:58 smithi165 ceph-mon[77258]: pgmap v173: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s; 598 KiB/s, 47 objects/s recovering 2024-09-16T02:13:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:13:58 smithi110 ceph-mon[98215]: pgmap v173: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s; 598 KiB/s, 47 objects/s recovering 2024-09-16T02:14:00.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:00 smithi110 ceph-mon[98215]: pgmap v174: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s; 512 KiB/s, 40 objects/s recovering 2024-09-16T02:14:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:00 smithi165 ceph-mon[77258]: pgmap v174: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s; 512 KiB/s, 40 objects/s recovering 2024-09-16T02:14:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:01 smithi165 ceph-mon[77258]: reconnect by client.24263 192.168.0.1:0/994083850 after 0 2024-09-16T02:14:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:01 smithi165 ceph-mon[77258]: reconnect by client.14492 192.168.0.1:0/323678790 after 0.000999985 2024-09-16T02:14:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:01 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:reconnect 2024-09-16T02:14:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:01 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi165.gxrypw=up:reconnect} 2 up:standby 2024-09-16T02:14:01.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:01 smithi110 ceph-mon[98215]: reconnect by client.24263 192.168.0.1:0/994083850 after 0 2024-09-16T02:14:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:01 smithi110 ceph-mon[98215]: reconnect by client.14492 192.168.0.1:0/323678790 after 0.000999985 2024-09-16T02:14:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:01 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:reconnect 2024-09-16T02:14:01.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:01 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi165.gxrypw=up:reconnect} 2 up:standby 2024-09-16T02:14:02.918 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s; 416 KiB/s, 33 objects/s recovering 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:rejoin 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi165.gxrypw=up:rejoin} 2 up:standby 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: daemon mds.cephfs.smithi165.gxrypw is now active in filesystem cephfs as rank 0 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:02.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s; 416 KiB/s, 33 objects/s recovering 2024-09-16T02:14:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:rejoin 2024-09-16T02:14:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi165.gxrypw=up:rejoin} 2 up:standby 2024-09-16T02:14:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: daemon mds.cephfs.smithi165.gxrypw is now active in filesystem cephfs as rank 0 2024-09-16T02:14:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:03.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:03 smithi110 ceph-mon[98215]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T02:14:03.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:03 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:active 2024-09-16T02:14:03.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:03 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:boot 2024-09-16T02:14:03.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:03 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 3 up:standby 2024-09-16T02:14:03.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:03 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:14:03.859 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:03 smithi110 ceph-mon[98215]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 186 B/s wr, 7 op/s; 374 KiB/s, 29 objects/s recovering 2024-09-16T02:14:03.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:03 smithi165 ceph-mon[77258]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T02:14:03.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:03 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] up:active 2024-09-16T02:14:03.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:03 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:boot 2024-09-16T02:14:03.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:03 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 3 up:standby 2024-09-16T02:14:03.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:03 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:14:03.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:03 smithi165 ceph-mon[77258]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 186 B/s wr, 7 op/s; 374 KiB/s, 29 objects/s recovering 2024-09-16T02:14:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:06 smithi165 ceph-mon[77258]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T02:14:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:06.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:06 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:06.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:06 smithi110 ceph-mon[98215]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T02:14:06.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:06 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:08.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:08 smithi165 ceph-mon[77258]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T02:14:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:08.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:08 smithi110 ceph-mon[98215]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T02:14:10.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:10 smithi165 ceph-mon[77258]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T02:14:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:10 smithi110 ceph-mon[98215]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T02:14:11.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:11 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:11.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:11 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:12.567 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:12 smithi110 ceph-mon[98215]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-09-16T02:14:12.567 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:12.567 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:14:12.567 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:12 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:12.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:12 smithi165 ceph-mon[77258]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-09-16T02:14:12.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:12.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi110.svegdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:14:12.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:12 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 -- 172.21.15.110:0/123912380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a40fe450 msgr2=0x7fe3a40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 --2- 172.21.15.110:0/123912380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a40fe450 0x7fe3a40fe820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe3940048d0 tx=0x7fe394009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 -- 172.21.15.110:0/123912380 shutdown_connections 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 --2- 172.21.15.110:0/123912380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a4064fe0 0x7fe3a4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 --2- 172.21.15.110:0/123912380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a40fe450 0x7fe3a40fe820 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 -- 172.21.15.110:0/123912380 >> 172.21.15.110:0/123912380 conn(0x7fe3a40723b0 msgr2=0x7fe3a40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 -- 172.21.15.110:0/123912380 shutdown_connections 2024-09-16T02:14:13.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.661+0000 7fe3a8878640 1 -- 172.21.15.110:0/123912380 wait complete. 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a8878640 1 Processor -- start 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a8878640 1 -- start start 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a8878640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 0x7fe3a40fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a8878640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a40fe450 0x7fe3a40fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a8878640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40fc070 con 0x7fe3a4064fe0 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a8878640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40fc1e0 con 0x7fe3a40fe450 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 0x7fe3a40fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 0x7fe3a40fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46386/0 (socket says 172.21.15.110:46386) 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a259c640 1 -- 172.21.15.110:0/2224421083 learned_addr learned my addr 172.21.15.110:0/2224421083 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a1d9b640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a40fe450 0x7fe3a40fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:13.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a259c640 1 -- 172.21.15.110:0/2224421083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a40fe450 msgr2=0x7fe3a40fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a259c640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a40fe450 0x7fe3a40fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.662+0000 7fe3a259c640 1 -- 172.21.15.110:0/2224421083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394005040 con 0x7fe3a4064fe0 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.663+0000 7fe3a259c640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 0x7fe3a40fb560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe394003080 tx=0x7fe394009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.663+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe394038070 con 0x7fe3a4064fe0 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.663+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe39402ade0 con 0x7fe3a4064fe0 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.663+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a4119570 con 0x7fe3a4064fe0 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.663+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a41198a0 con 0x7fe3a4064fe0 2024-09-16T02:14:13.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.663+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe39402c880 con 0x7fe3a4064fe0 2024-09-16T02:14:13.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.664+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a40fdce0 con 0x7fe3a4064fe0 2024-09-16T02:14:13.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.665+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe394030020 con 0x7fe3a4064fe0 2024-09-16T02:14:13.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.666+0000 7fe392ffd640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe38c06e530 0x7fe38c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:13.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.666+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6614+0+0 (secure 0 0 0) 0x7fe3940ae2a0 con 0x7fe3a4064fe0 2024-09-16T02:14:13.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.666+0000 7fe3a1d9b640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe38c06e530 0x7fe38c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:13.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.666+0000 7fe3a1d9b640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe38c06e530 0x7fe38c0709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40fcea0 tx=0x7fe398008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:13.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.672+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe394077310 con 0x7fe3a4064fe0 2024-09-16T02:14:13.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:13 smithi110 ceph-mon[98215]: Upgrade: Updating mds.cephfs.smithi110.svegdg 2024-09-16T02:14:13.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:13 smithi110 ceph-mon[98215]: Deploying daemon mds.cephfs.smithi110.svegdg on smithi110 2024-09-16T02:14:13.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.890+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3a40fcc50 con 0x7fe38c06e530 2024-09-16T02:14:13.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.892+0000 7fe392ffd640 1 -- 172.21.15.110:0/2224421083 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe3a40fcc50 con 0x7fe38c06e530 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe38c06e530 msgr2=0x7fe38c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe38c06e530 0x7fe38c0709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40fcea0 tx=0x7fe398008040 comp rx=0 tx=0).stop 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 msgr2=0x7fe3a40fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 0x7fe3a40fb560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe394003080 tx=0x7fe394009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 shutdown_connections 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe38c06e530 0x7fe38c0709e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a40fe450 0x7fe3a40fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 --2- 172.21.15.110:0/2224421083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3a4064fe0 0x7fe3a40fb560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 >> 172.21.15.110:0/2224421083 conn(0x7fe3a40723b0 msgr2=0x7fe3a40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 shutdown_connections 2024-09-16T02:14:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.894+0000 7fe3a8878640 1 -- 172.21.15.110:0/2224421083 wait complete. 2024-09-16T02:14:13.905 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:14:13.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:13 smithi165 ceph-mon[77258]: Upgrade: Updating mds.cephfs.smithi110.svegdg 2024-09-16T02:14:13.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:13 smithi165 ceph-mon[77258]: Deploying daemon mds.cephfs.smithi110.svegdg on smithi110 2024-09-16T02:14:13.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 -- 172.21.15.110:0/394899923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 msgr2=0x7f3a280fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:13.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/394899923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a280fd3d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009c50 tx=0x7f3a18004d10 comp rx=0 tx=0).stop 2024-09-16T02:14:13.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 -- 172.21.15.110:0/394899923 shutdown_connections 2024-09-16T02:14:13.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/394899923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a280fd3d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/394899923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 0x7f3a280fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 -- 172.21.15.110:0/394899923 >> 172.21.15.110:0/394899923 conn(0x7f3a280723b0 msgr2=0x7f3a280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:13.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 -- 172.21.15.110:0/394899923 shutdown_connections 2024-09-16T02:14:13.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 -- 172.21.15.110:0/394899923 wait complete. 2024-09-16T02:14:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.993+0000 7f3a2ee28640 1 Processor -- start 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a2ee28640 1 -- start start 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a2ee28640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 0x7f3a281120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a2ee28640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a28112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a2ee28640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28112c10 con 0x7f3a280fcf80 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a2ee28640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2810c050 con 0x7f3a280fb810 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a27fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a28112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a27fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a28112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46404/0 (socket says 172.21.15.110:46404) 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a27fff640 1 -- 172.21.15.110:0/2237674033 learned_addr learned my addr 172.21.15.110:0/2237674033 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.994+0000 7f3a2cbc4640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 0x7f3a281120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a27fff640 1 -- 172.21.15.110:0/2237674033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 msgr2=0x7f3a281120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a27fff640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 0x7f3a281120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a27fff640 1 -- 172.21.15.110:0/2237674033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180098b0 con 0x7f3a280fcf80 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a2cbc4640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 0x7f3a281120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a27fff640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a28112610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a18004a30 tx=0x7f3a18004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a18009690 con 0x7f3a280fcf80 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a18032b10 con 0x7f3a280fcf80 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1803aa80 con 0x7f3a280fcf80 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2810c2d0 con 0x7f3a280fcf80 2024-09-16T02:14:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.995+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2810c810 con 0x7f3a280fcf80 2024-09-16T02:14:14.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.996+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a280fcbc0 con 0x7f3a280fcf80 2024-09-16T02:14:14.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.997+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3a1802f030 con 0x7f3a280fcf80 2024-09-16T02:14:14.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.998+0000 7f3a257fa640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a1406e530 0x7f3a140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.998+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f3a180b08f0 con 0x7f3a280fcf80 2024-09-16T02:14:14.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.998+0000 7f3a2cbc4640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a1406e530 0x7f3a140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:13.998+0000 7f3a2cbc4640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a1406e530 0x7f3a140709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a200041d0 tx=0x7f3a20009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.003+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3a180799e0 con 0x7f3a280fcf80 2024-09-16T02:14:14.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.197+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a2804b720 con 0x7f3a1406e530 2024-09-16T02:14:14.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.198+0000 7f3a257fa640 1 -- 172.21.15.110:0/2237674033 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3a2804b720 con 0x7f3a1406e530 2024-09-16T02:14:14.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.200+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a1406e530 msgr2=0x7f3a140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.200+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a1406e530 0x7f3a140709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a200041d0 tx=0x7f3a20009040 comp rx=0 tx=0).stop 2024-09-16T02:14:14.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.200+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 msgr2=0x7f3a28112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.200+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a28112610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a18004a30 tx=0x7f3a18004d10 comp rx=0 tx=0).stop 2024-09-16T02:14:14.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 shutdown_connections 2024-09-16T02:14:14.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a1406e530 0x7f3a140709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a280fcf80 0x7f3a28112610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 --2- 172.21.15.110:0/2237674033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a280fb810 0x7f3a281120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 >> 172.21.15.110:0/2237674033 conn(0x7f3a280723b0 msgr2=0x7f3a280fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:14.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 shutdown_connections 2024-09-16T02:14:14.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.201+0000 7f3a2ee28640 1 -- 172.21.15.110:0/2237674033 wait complete. 2024-09-16T02:14:14.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 -- 172.21.15.110:0/1524123691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 msgr2=0x7f05a40fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1524123691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a40fb8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f05980048d0 tx=0x7f0598009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 -- 172.21.15.110:0/1524123691 shutdown_connections 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1524123691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a40fb8f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1524123691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 0x7f05a4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 -- 172.21.15.110:0/1524123691 >> 172.21.15.110:0/1524123691 conn(0x7f05a40f7000 msgr2=0x7f05a40f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 -- 172.21.15.110:0/1524123691 shutdown_connections 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.281+0000 7f05abaa3640 1 -- 172.21.15.110:0/1524123691 wait complete. 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05abaa3640 1 Processor -- start 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05abaa3640 1 -- start start 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05abaa3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a41120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05abaa3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 0x7f05a4112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05abaa3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4112c10 con 0x7f05a40fb480 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05abaa3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a410c050 con 0x7f05a41014c0 2024-09-16T02:14:14.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a983f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a41120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a983f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a41120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46424/0 (socket says 172.21.15.110:46424) 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a983f640 1 -- 172.21.15.110:0/1675615083 learned_addr learned my addr 172.21.15.110:0/1675615083 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a903e640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 0x7f05a4112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a983f640 1 -- 172.21.15.110:0/1675615083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 msgr2=0x7f05a4112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a983f640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 0x7f05a4112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a983f640 1 -- 172.21.15.110:0/1675615083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598005040 con 0x7f05a40fb480 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.282+0000 7f05a903e640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 0x7f05a4112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.283+0000 7f05a983f640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a41120d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c830 tx=0x7f05a0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.283+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a000a850 con 0x7f05a40fb480 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.283+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05a000ae50 con 0x7f05a40fb480 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.283+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a410c330 con 0x7f05a40fb480 2024-09-16T02:14:14.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.283+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a00113a0 con 0x7f05a40fb480 2024-09-16T02:14:14.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.283+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a410c8d0 con 0x7f05a40fb480 2024-09-16T02:14:14.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.284+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40fcbc0 con 0x7f05a40fb480 2024-09-16T02:14:14.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.284+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f05a0012400 con 0x7f05a40fb480 2024-09-16T02:14:14.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.285+0000 7f05967fc640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f059006e530 0x7f05900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.285+0000 7f05a903e640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f059006e530 0x7f05900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.285+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f05a008e450 con 0x7f05a40fb480 2024-09-16T02:14:14.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.285+0000 7f05a903e640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f059006e530 0x7f05900709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f059800b020 tx=0x7f0598009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.289+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f05a0057540 con 0x7f05a40fb480 2024-09-16T02:14:14.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.468+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05a404b720 con 0x7f059006e530 2024-09-16T02:14:14.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.477+0000 7f05967fc640 1 -- 172.21.15.110:0/1675615083 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f05a404b720 con 0x7f059006e530 2024-09-16T02:14:14.479 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:14:14.479 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (7m) 8s ago 16m 25.2M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:14:14.479 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (3m) 8s ago 16m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:14:14.479 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (3m) 31s ago 15m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:14:14.479 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (5m) 8s ago 15m 81.6M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (10m) 8s ago 10m 10.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 883c53f57c60 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (13s) 8s ago 11m 11.7M - 19.1.1-326-g8921c8ef f1455bd0219c 228da41254bc 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (10m) 31s ago 10m 17.9M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (10m) 31s ago 10m 14.8M - 17.2.7-1633-g6d025bc2 33ed8dba3996 15ba6809cb05 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (7m) 8s ago 17m 503M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (6m) 31s ago 15m 441M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (4m) 8s ago 17m 46.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (4m) 31s ago 15m 36.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (8m) 8s ago 16m 17.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (7m) 31s ago 15m 16.5M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:14:14.480 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (3m) 8s ago 14m 116M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:14:14.481 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (2m) 8s ago 14m 111M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:14:14.481 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (2m) 8s ago 13m 115M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:14:14.481 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (99s) 31s ago 13m 117M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 0a846f393eb0 2024-09-16T02:14:14.481 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (67s) 31s ago 12m 86.2M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 8ed078cd81d0 2024-09-16T02:14:14.481 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (34s) 31s ago 12m 11.8M 2581M 19.1.1-326-g8921c8ef f1455bd0219c a01a4f216cf5 2024-09-16T02:14:14.481 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (6m) 8s ago 15m 65.4M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f059006e530 msgr2=0x7f05900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f059006e530 0x7f05900709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f059800b020 tx=0x7f0598009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 msgr2=0x7f05a41120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a41120d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f05a000c830 tx=0x7f05a0004430 comp rx=0 tx=0).stop 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 shutdown_connections 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f059006e530 0x7f05900709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a41014c0 0x7f05a4112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 --2- 172.21.15.110:0/1675615083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05a40fb480 0x7f05a41120d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 >> 172.21.15.110:0/1675615083 conn(0x7f05a40f7000 msgr2=0x7f05a40f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:14.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 shutdown_connections 2024-09-16T02:14:14.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.479+0000 7f05abaa3640 1 -- 172.21.15.110:0/1675615083 wait complete. 2024-09-16T02:14:14.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 -- 172.21.15.110:0/2239116115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 msgr2=0x7f20400fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2239116115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fd950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f203c0048d0 tx=0x7f203c009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 -- 172.21.15.110:0/2239116115 shutdown_connections 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2239116115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20400fdf20 0x7f2040106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2239116115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fd950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 -- 172.21.15.110:0/2239116115 >> 172.21.15.110:0/2239116115 conn(0x7f20400f7010 msgr2=0x7f20400f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 -- 172.21.15.110:0/2239116115 shutdown_connections 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.558+0000 7f2047cf5640 1 -- 172.21.15.110:0/2239116115 wait complete. 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2047cf5640 1 Processor -- start 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2047cf5640 1 -- start start 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2047cf5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2047cf5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20400fdf20 0x7f20400fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2047cf5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400fbe30 con 0x7f20400fd580 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2047cf5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400fbfa0 con 0x7f20400fdf20 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46440/0 (socket says 172.21.15.110:46440) 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 -- 172.21.15.110:0/2089574911 learned_addr learned my addr 172.21.15.110:0/2089574911 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 -- 172.21.15.110:0/2089574911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20400fdf20 msgr2=0x7f20400fb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20400fdf20 0x7f20400fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 -- 172.21.15.110:0/2089574911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c005040 con 0x7f20400fd580 2024-09-16T02:14:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.559+0000 7f2045a91640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fb3b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f203c0043d0 tx=0x7f203c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.560+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203c038070 con 0x7f20400fd580 2024-09-16T02:14:14.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.560+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f203c0096e0 con 0x7f20400fd580 2024-09-16T02:14:14.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.560+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203c03d420 con 0x7f20400fd580 2024-09-16T02:14:14.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.560+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20400fc1d0 con 0x7f20400fd580 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.560+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2040119880 con 0x7f20400fd580 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.561+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20400663b0 con 0x7f20400fd580 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.561+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f203c030020 con 0x7f20400fd580 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.562+0000 7f20367fc640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f202c06e530 0x7f202c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.562+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f203c0ae7b0 con 0x7f20400fd580 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.562+0000 7f2045290640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f202c06e530 0x7f202c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.562+0000 7f2045290640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f202c06e530 0x7f202c0709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20400fccf0 tx=0x7f2030009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.566+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f203c077820 con 0x7f20400fd580 2024-09-16T02:14:14.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:14 smithi110 ceph-mon[98215]: pgmap v181: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-09-16T02:14:14.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.800+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f204004b720 con 0x7f20400fd580 2024-09-16T02:14:14.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.801+0000 7f20367fc640 1 -- 172.21.15.110:0/2089574911 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f203c07aee0 con 0x7f20400fd580 2024-09-16T02:14:14.803 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:14:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:14:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:14:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2, 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 17.2.7-1633-g6d025bc2 (6d025bc26f3176c910707f8cb4c8d8e076640615) quincy (stable)": 2, 2024-09-16T02:14:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 11 2024-09-16T02:14:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:14:14.805 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:14:14.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f202c06e530 msgr2=0x7f202c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f202c06e530 0x7f202c0709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20400fccf0 tx=0x7f2030009c50 comp rx=0 tx=0).stop 2024-09-16T02:14:14.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 msgr2=0x7f20400fb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fb3b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f203c0043d0 tx=0x7f203c009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 shutdown_connections 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f202c06e530 0x7f202c0709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20400fdf20 0x7f20400fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 --2- 172.21.15.110:0/2089574911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20400fd580 0x7f20400fb3b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 >> 172.21.15.110:0/2089574911 conn(0x7f20400f7010 msgr2=0x7f20400f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 shutdown_connections 2024-09-16T02:14:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.803+0000 7f2047cf5640 1 -- 172.21.15.110:0/2089574911 wait complete. 2024-09-16T02:14:14.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 -- 172.21.15.110:0/4148411724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 msgr2=0x7f5f580fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4148411724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f580fe820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5f480048d0 tx=0x7f5f48009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 -- 172.21.15.110:0/4148411724 shutdown_connections 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4148411724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 0x7f5f58065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4148411724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f580fe820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 -- 172.21.15.110:0/4148411724 >> 172.21.15.110:0/4148411724 conn(0x7f5f580723b0 msgr2=0x7f5f580727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 -- 172.21.15.110:0/4148411724 shutdown_connections 2024-09-16T02:14:14.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.884+0000 7f5f5d078640 1 -- 172.21.15.110:0/4148411724 wait complete. 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5d078640 1 Processor -- start 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5d078640 1 -- start start 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5d078640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 0x7f5f58113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5d078640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f58113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5d078640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58113d50 con 0x7f5f580fe450 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5d078640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5810d190 con 0x7f5f58064fe0 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f58113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f58113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46466/0 (socket says 172.21.15.110:46466) 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5659c640 1 -- 172.21.15.110:0/4259092734 learned_addr learned my addr 172.21.15.110:0/4259092734 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f56d9d640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 0x7f5f58113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5659c640 1 -- 172.21.15.110:0/4259092734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 msgr2=0x7f5f58113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5659c640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 0x7f5f58113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f5659c640 1 -- 172.21.15.110:0/4259092734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48005040 con 0x7f5f580fe450 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.885+0000 7f5f56d9d640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 0x7f5f58113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.886+0000 7f5f5659c640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f58113750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c002a50 tx=0x7f5f4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.886+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f4c007c30 con 0x7f5f580fe450 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.886+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5f4c00f040 con 0x7f5f580fe450 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.886+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f4c00da90 con 0x7f5f580fe450 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.886+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5810d470 con 0x7f5f580fe450 2024-09-16T02:14:14.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.886+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5810d990 con 0x7f5f580fe450 2024-09-16T02:14:14.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.887+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f580fdce0 con 0x7f5f580fe450 2024-09-16T02:14:14.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.887+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5f4c00dd00 con 0x7f5f580fe450 2024-09-16T02:14:14.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.888+0000 7f5f3f7fe640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5f4006e530 0x7f5f400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:14.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.888+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f5f4c08daf0 con 0x7f5f580fe450 2024-09-16T02:14:14.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.888+0000 7f5f56d9d640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5f4006e530 0x7f5f400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:14.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.888+0000 7f5f56d9d640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5f4006e530 0x7f5f400709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f48007ac0 tx=0x7f5f48035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:14.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:14.892+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5f4c056b60 con 0x7f5f580fe450 2024-09-16T02:14:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:14 smithi165 ceph-mon[77258]: pgmap v181: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-09-16T02:14:15.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.093+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5f5810e8b0 con 0x7f5f580fe450 2024-09-16T02:14:15.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.094+0000 7f5f3f7fe640 1 -- 172.21.15.110:0/4259092734 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1755 (secure 0 0 0) 0x7f5f4c05a220 con 0x7f5f580fe450 2024-09-16T02:14:15.096 INFO:teuthology.orchestra.run.smithi110.stdout:e24 2024-09-16T02:14:15.096 INFO:teuthology.orchestra.run.smithi110.stdout:btime 2024-09-16T02:14:14:453570+0000 2024-09-16T02:14:15.096 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:14:15.096 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 23 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:14:02.593138+0000 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:14:15.097 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 87 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=24247} 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:14:15.098 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 24247 members: 24247 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{0:24247} state up:active seq 163 join_fscid=1 addr [v2:172.21.15.165:6826/441401724,v1:172.21.15.165:6827/441401724] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:24251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3082327974,v1:172.21.15.165:6825/3082327974] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T02:14:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:14:15.100 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 24 2024-09-16T02:14:15.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5f4006e530 msgr2=0x7f5f400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5f4006e530 0x7f5f400709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f48007ac0 tx=0x7f5f48035040 comp rx=0 tx=0).stop 2024-09-16T02:14:15.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 msgr2=0x7f5f58113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f58113750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c002a50 tx=0x7f5f4c004600 comp rx=0 tx=0).stop 2024-09-16T02:14:15.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 shutdown_connections 2024-09-16T02:14:15.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5f4006e530 0x7f5f400709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f580fe450 0x7f5f58113750 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 --2- 172.21.15.110:0/4259092734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f58064fe0 0x7f5f58113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 >> 172.21.15.110:0/4259092734 conn(0x7f5f580723b0 msgr2=0x7f5f580fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:15.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 shutdown_connections 2024-09-16T02:14:15.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.096+0000 7f5f5d078640 1 -- 172.21.15.110:0/4259092734 wait complete. 2024-09-16T02:14:15.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 -- 172.21.15.110:0/1886123755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 msgr2=0x7f91100fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 --2- 172.21.15.110:0/1886123755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f91100fc5b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90f80048d0 tx=0x7f90f8009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 -- 172.21.15.110:0/1886123755 shutdown_connections 2024-09-16T02:14:15.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 --2- 172.21.15.110:0/1886123755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f91100fc5b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 --2- 172.21.15.110:0/1886123755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9110102550 0x7f9110102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 -- 172.21.15.110:0/1886123755 >> 172.21.15.110:0/1886123755 conn(0x7f91100f80f0 msgr2=0x7f91100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:15.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 -- 172.21.15.110:0/1886123755 shutdown_connections 2024-09-16T02:14:15.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.175+0000 7f9114cb5640 1 -- 172.21.15.110:0/1886123755 wait complete. 2024-09-16T02:14:15.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f9114cb5640 1 Processor -- start 2024-09-16T02:14:15.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f9114cb5640 1 -- start start 2024-09-16T02:14:15.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f9114cb5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9110102550 0x7f9110113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:15.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f9114cb5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f9110113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:15.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f9114cb5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101140b0 con 0x7f9110102ef0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f9114cb5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911010d4c0 con 0x7f9110102550 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f910dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f9110113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f910dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f9110113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46484/0 (socket says 172.21.15.110:46484) 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.176+0000 7f910dd9b640 1 -- 172.21.15.110:0/3520684403 learned_addr learned my addr 172.21.15.110:0/3520684403 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f910e59c640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9110102550 0x7f9110113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f910dd9b640 1 -- 172.21.15.110:0/3520684403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9110102550 msgr2=0x7f9110113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f910dd9b640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9110102550 0x7f9110113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f910dd9b640 1 -- 172.21.15.110:0/3520684403 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8005040 con 0x7f9110102ef0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f910dd9b640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f9110113a60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f90f80043d0 tx=0x7f90f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f8038070 con 0x7f9110102ef0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911010d740 con 0x7f9110102ef0 2024-09-16T02:14:15.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90f80096e0 con 0x7f9110102ef0 2024-09-16T02:14:15.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f802c8a0 con 0x7f9110102ef0 2024-09-16T02:14:15.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.177+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911010dc80 con 0x7f9110102ef0 2024-09-16T02:14:15.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.178+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91100fdcd0 con 0x7f9110102ef0 2024-09-16T02:14:15.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.179+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f90f8030020 con 0x7f9110102ef0 2024-09-16T02:14:15.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.179+0000 7f9106ffd640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f90fc06e530 0x7f90fc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:15.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.179+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f90f80adfb0 con 0x7f9110102ef0 2024-09-16T02:14:15.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.179+0000 7f910e59c640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f90fc06e530 0x7f90fc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:15.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.180+0000 7f910e59c640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f90fc06e530 0x7f90fc0709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9100007fd0 tx=0x7f9100009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:15.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.183+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90f8077020 con 0x7f9110102ef0 2024-09-16T02:14:15.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.368+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9110109580 con 0x7f90fc06e530 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.370+0000 7f9106ffd640 1 -- 172.21.15.110:0/3520684403 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9110109580 con 0x7f90fc06e530 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:14:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "osd", 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "13/21 daemons upgraded", 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mds daemons", 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:14:15.373 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:14:15.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f90fc06e530 msgr2=0x7f90fc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f90fc06e530 0x7f90fc0709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9100007fd0 tx=0x7f9100009e90 comp rx=0 tx=0).stop 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 msgr2=0x7f9110113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f9110113a60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f90f80043d0 tx=0x7f90f8009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 shutdown_connections 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f90fc06e530 0x7f90fc0709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9110102ef0 0x7f9110113a60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 --2- 172.21.15.110:0/3520684403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9110102550 0x7f9110113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 >> 172.21.15.110:0/3520684403 conn(0x7f91100f80f0 msgr2=0x7f91100f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 shutdown_connections 2024-09-16T02:14:15.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.372+0000 7f9114cb5640 1 -- 172.21.15.110:0/3520684403 wait complete. 2024-09-16T02:14:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 -- 172.21.15.110:0/3083053724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 msgr2=0x7f9060102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 --2- 172.21.15.110:0/3083053724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060102920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f90540048d0 tx=0x7f9054009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 -- 172.21.15.110:0/3083053724 shutdown_connections 2024-09-16T02:14:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 --2- 172.21.15.110:0/3083053724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9060102ef0 0x7f90600fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 --2- 172.21.15.110:0/3083053724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060102920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 -- 172.21.15.110:0/3083053724 >> 172.21.15.110:0/3083053724 conn(0x7f90600f80f0 msgr2=0x7f90600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 -- 172.21.15.110:0/3083053724 shutdown_connections 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 -- 172.21.15.110:0/3083053724 wait complete. 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.451+0000 7f9067f31640 1 Processor -- start 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9067f31640 1 -- start start 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9067f31640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9067f31640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9060102ef0 0x7f9060113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9067f31640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90601140d0 con 0x7f9060102550 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9067f31640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906010d4e0 con 0x7f9060102ef0 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46496/0 (socket says 172.21.15.110:46496) 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 -- 172.21.15.110:0/859751911 learned_addr learned my addr 172.21.15.110:0/859751911 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 -- 172.21.15.110:0/859751911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9060102ef0 msgr2=0x7f9060113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9060102ef0 0x7f9060113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 -- 172.21.15.110:0/859751911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054005040 con 0x7f9060102550 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.452+0000 7f9065ccd640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060113540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9054000c00 tx=0x7f9054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.453+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9054038070 con 0x7f9060102550 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.453+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f905402ade0 con 0x7f9060102550 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.453+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906010d760 con 0x7f9060102550 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.453+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905402c7e0 con 0x7f9060102550 2024-09-16T02:14:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.453+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906010dca0 con 0x7f9060102550 2024-09-16T02:14:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.454+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90600fdcd0 con 0x7f9060102550 2024-09-16T02:14:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.455+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9054030020 con 0x7f9060102550 2024-09-16T02:14:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.455+0000 7f90527fc640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f904c06e530 0x7f904c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.455+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6614+0+0 (secure 0 0 0) 0x7f90540addd0 con 0x7f9060102550 2024-09-16T02:14:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.455+0000 7f90654cc640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f904c06e530 0x7f904c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.456+0000 7f90654cc640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f904c06e530 0x7f904c0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f906010e7c0 tx=0x7f905c009c50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:15.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.461+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9054076f70 con 0x7f9060102550 2024-09-16T02:14:15.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.691+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9060109620 con 0x7f9060102550 2024-09-16T02:14:15.694 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:15.694 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:15.694 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: osdmap e88: 6 total, 6 up, 6 in 2024-09-16T02:14:15.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 2 up:standby 2024-09-16T02:14:15.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:15.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:14:15.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2089574911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:15.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:15 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/4259092734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:14:15.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.692+0000 7f90527fc640 1 -- 172.21.15.110:0/859751911 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f905407a630 con 0x7f9060102550 2024-09-16T02:14:15.695 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:14:15.696 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:14:15.696 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:14:15.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f904c06e530 msgr2=0x7f904c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f904c06e530 0x7f904c0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f906010e7c0 tx=0x7f905c009c50 comp rx=0 tx=0).stop 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 msgr2=0x7f9060113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060113540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9054000c00 tx=0x7f9054009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 shutdown_connections 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f904c06e530 0x7f904c0709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9060102ef0 0x7f9060113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 --2- 172.21.15.110:0/859751911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9060102550 0x7f9060113540 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 >> 172.21.15.110:0/859751911 conn(0x7f90600f80f0 msgr2=0x7f90600f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 shutdown_connections 2024-09-16T02:14:15.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:15.694+0000 7f9067f31640 1 -- 172.21.15.110:0/859751911 wait complete. 2024-09-16T02:14:15.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:15.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:15.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: osdmap e88: 6 total, 6 up, 6 in 2024-09-16T02:14:15.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 2 up:standby 2024-09-16T02:14:15.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:15.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:14:15.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2089574911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:15.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:15 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/4259092734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:14:16.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:16 smithi110 ceph-mon[98215]: pgmap v183: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 4.9 KiB/s wr, 3 op/s 2024-09-16T02:14:16.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:16 smithi110 ceph-mon[98215]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:16.726 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:16 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/859751911' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:14:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:16 smithi165 ceph-mon[77258]: pgmap v183: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 4.9 KiB/s wr, 3 op/s 2024-09-16T02:14:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:16 smithi165 ceph-mon[77258]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:16 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/859751911' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:14:18.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:18 smithi165 ceph-mon[77258]: pgmap v184: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-09-16T02:14:18.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:18 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:18.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:18 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:18.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:18 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:18 smithi110 ceph-mon[98215]: pgmap v184: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-09-16T02:14:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:18 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:18 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:18 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:19.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:19 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.110:6828/926668832,v1:172.21.15.110:6829/926668832] up:boot 2024-09-16T02:14:19.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:19 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 3 up:standby 2024-09-16T02:14:19.808 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:19 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:14:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:19 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.110:6828/926668832,v1:172.21.15.110:6829/926668832] up:boot 2024-09-16T02:14:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:19 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 3 up:standby 2024-09-16T02:14:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:19 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:14:20.778 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:20 smithi110 ceph-mon[98215]: pgmap v185: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-09-16T02:14:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:20 smithi165 ceph-mon[77258]: pgmap v185: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s wr, 2 op/s 2024-09-16T02:14:22.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:22 smithi110 ceph-mon[98215]: pgmap v186: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:22 smithi165 ceph-mon[77258]: pgmap v186: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:23.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.797 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:23 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:23 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:24.786 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:24 smithi110 ceph-mon[98215]: pgmap v187: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:24 smithi165 ceph-mon[77258]: pgmap v187: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:26 smithi110 ceph-mon[98215]: pgmap v188: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:26.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:26 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:26.925 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:26 smithi165 ceph-mon[77258]: pgmap v188: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:26.925 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:26.925 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:26.925 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:26.925 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:26.925 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:26 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:27.730 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:27.730 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.730 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.730 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.730 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:27 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:27.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:27 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:28 smithi165 ceph-mon[77258]: pgmap v189: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:28 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:28.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:28 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:14:28.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:28 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:28 smithi110 ceph-mon[98215]: pgmap v189: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:28 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:28 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.hskfht", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:14:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:28 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:29.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:29 smithi165 ceph-mon[77258]: Upgrade: Updating mds.cephfs.smithi165.hskfht 2024-09-16T02:14:29.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:29 smithi165 ceph-mon[77258]: Deploying daemon mds.cephfs.smithi165.hskfht on smithi165 2024-09-16T02:14:29.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:29 smithi110 ceph-mon[98215]: Upgrade: Updating mds.cephfs.smithi165.hskfht 2024-09-16T02:14:29.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:29 smithi110 ceph-mon[98215]: Deploying daemon mds.cephfs.smithi165.hskfht on smithi165 2024-09-16T02:14:30.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:30 smithi110 ceph-mon[98215]: pgmap v190: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:30.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:30 smithi110 ceph-mon[98215]: osdmap e89: 6 total, 6 up, 6 in 2024-09-16T02:14:30.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:30 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 2 up:standby 2024-09-16T02:14:30.908 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:30 smithi165 ceph-mon[77258]: pgmap v190: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:30.909 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:30 smithi165 ceph-mon[77258]: osdmap e89: 6 total, 6 up, 6 in 2024-09-16T02:14:30.909 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:30 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 2 up:standby 2024-09-16T02:14:32.842 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:32 smithi165 ceph-mon[77258]: pgmap v192: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:32.842 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:32 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:32.842 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:32 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:32.842 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:32 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:32 smithi110 ceph-mon[98215]: pgmap v192: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:32 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:32 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:32 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:33 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.165:6824/2342221402,v1:172.21.15.165:6825/2342221402] up:boot 2024-09-16T02:14:33.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:33 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 3 up:standby 2024-09-16T02:14:33.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:33 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:14:33.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:33 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.165:6824/2342221402,v1:172.21.15.165:6825/2342221402] up:boot 2024-09-16T02:14:33.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:33 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi165.gxrypw=up:active} 3 up:standby 2024-09-16T02:14:33.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:33 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:14:34.667 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:34 smithi165 ceph-mon[77258]: pgmap v193: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:34.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:34 smithi110 ceph-mon[98215]: pgmap v193: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:36.158 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.158 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.158 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:35 smithi165 ceph-mon[77258]: pgmap v194: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:36.158 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.158 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:35 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:35 smithi110 ceph-mon[98215]: pgmap v194: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:36.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:36.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:35 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:37.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:37.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:38.610 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:38 smithi165 ceph-mon[77258]: pgmap v195: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:38.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:38 smithi110 ceph-mon[98215]: pgmap v195: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:39.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:39 smithi165 ceph-mon[77258]: pgmap v196: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:39.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:39.958 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:39 smithi110 ceph-mon[98215]: pgmap v196: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:41.222 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:40 smithi165 ceph-mon[77258]: Upgrade: Updating mds.cephfs.smithi165.gxrypw 2024-09-16T02:14:41.222 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:41.222 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:14:41.222 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:40 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:41.222 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:40 smithi165 ceph-mon[77258]: Deploying daemon mds.cephfs.smithi165.gxrypw on smithi165 2024-09-16T02:14:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:40 smithi110 ceph-mon[98215]: Upgrade: Updating mds.cephfs.smithi165.gxrypw 2024-09-16T02:14:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.gxrypw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T02:14:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:40 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:41.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:40 smithi110 ceph-mon[98215]: Deploying daemon mds.cephfs.smithi165.gxrypw on smithi165 2024-09-16T02:14:41.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[98211]: 2024-09-16T02:14:41.652+0000 7f61a5676640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:14:42.314 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: pgmap v197: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: osdmap e90: 6 total, 6 up, 6 in 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: Standby daemon mds.cephfs.smithi110.yaugxw assigned to filesystem cephfs as rank 0 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T02:14:42.315 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:41 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:replay} 2 up:standby 2024-09-16T02:14:42.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: pgmap v197: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: osdmap e90: 6 total, 6 up, 6 in 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: Standby daemon mds.cephfs.smithi110.yaugxw assigned to filesystem cephfs as rank 0 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T02:14:42.451 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:41 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:replay} 2 up:standby 2024-09-16T02:14:43.457 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:43 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:14:43.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:43 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:14:44.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:44 smithi165 ceph-mon[77258]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-09-16T02:14:44.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:44 smithi110 ceph-mon[98215]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-09-16T02:14:45.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 -- 172.21.15.110:0/3855871026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 msgr2=0x7efebc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:45.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 --2- 172.21.15.110:0/3855871026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc0fd3d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efeac0048d0 tx=0x7efeac009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:45.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 -- 172.21.15.110:0/3855871026 shutdown_connections 2024-09-16T02:14:45.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 --2- 172.21.15.110:0/3855871026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc0fd3d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 --2- 172.21.15.110:0/3855871026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efebc0fb810 0x7efebc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 -- 172.21.15.110:0/3855871026 >> 172.21.15.110:0/3855871026 conn(0x7efebc0723b0 msgr2=0x7efebc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 -- 172.21.15.110:0/3855871026 shutdown_connections 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 -- 172.21.15.110:0/3855871026 wait complete. 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 Processor -- start 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.781+0000 7efec3d87640 1 -- start start 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec3d87640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efebc0fb810 0x7efebc10e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec3d87640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc10e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec3d87640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc10eed0 con 0x7efebc0fcf80 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec3d87640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc10f040 con 0x7efebc0fb810 2024-09-16T02:14:45.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc10e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc10e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52110/0 (socket says 172.21.15.110:52110) 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 -- 172.21.15.110:0/3980442960 learned_addr learned my addr 172.21.15.110:0/3980442960 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1b23640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efebc0fb810 0x7efebc10e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 -- 172.21.15.110:0/3980442960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efebc0fb810 msgr2=0x7efebc10e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efebc0fb810 0x7efebc10e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 -- 172.21.15.110:0/3980442960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac005040 con 0x7efebc0fcf80 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.782+0000 7efec1322640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc10e900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efeac003080 tx=0x7efeac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.783+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeac038070 con 0x7efebc0fcf80 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.783+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc1172f0 con 0x7efebc0fcf80 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.783+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efeac0097e0 con 0x7efebc0fcf80 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.783+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeac03d420 con 0x7efebc0fcf80 2024-09-16T02:14:45.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.783+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc117780 con 0x7efebc0fcf80 2024-09-16T02:14:45.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.784+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0fcbc0 con 0x7efebc0fcf80 2024-09-16T02:14:45.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.784+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efeac030020 con 0x7efebc0fcf80 2024-09-16T02:14:45.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.785+0000 7efeb27fc640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7efea806e530 0x7efea80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:45.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.785+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7efeac0ae6b0 con 0x7efebc0fcf80 2024-09-16T02:14:45.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.785+0000 7efec1b23640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7efea806e530 0x7efea80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:45.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.785+0000 7efec1b23640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7efea806e530 0x7efea80709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009b50 tx=0x7efeb8009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:45.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:45.789+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efeac0776d0 con 0x7efebc0fcf80 2024-09-16T02:14:46.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.057+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efebc0657c0 con 0x7efea806e530 2024-09-16T02:14:46.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.058+0000 7efeb27fc640 1 -- 172.21.15.110:0/3980442960 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efebc0657c0 con 0x7efea806e530 2024-09-16T02:14:46.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7efea806e530 msgr2=0x7efea80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7efea806e530 0x7efea80709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009b50 tx=0x7efeb8009120 comp rx=0 tx=0).stop 2024-09-16T02:14:46.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 msgr2=0x7efebc10e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc10e900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efeac003080 tx=0x7efeac009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 shutdown_connections 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7efea806e530 0x7efea80709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0fcf80 0x7efebc10e900 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 --2- 172.21.15.110:0/3980442960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efebc0fb810 0x7efebc10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 >> 172.21.15.110:0/3980442960 conn(0x7efebc0723b0 msgr2=0x7efebc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 shutdown_connections 2024-09-16T02:14:46.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.061+0000 7efec3d87640 1 -- 172.21.15.110:0/3980442960 wait complete. 2024-09-16T02:14:46.070 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 -- 172.21.15.110:0/4092276774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fb810 msgr2=0x7f04200fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 --2- 172.21.15.110:0/4092276774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fb810 0x7f04200fbbe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f04100048d0 tx=0x7f0410009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 -- 172.21.15.110:0/4092276774 shutdown_connections 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 --2- 172.21.15.110:0/4092276774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04200fcf80 0x7f04200fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 --2- 172.21.15.110:0/4092276774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fb810 0x7f04200fbbe0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 -- 172.21.15.110:0/4092276774 >> 172.21.15.110:0/4092276774 conn(0x7f04200723b0 msgr2=0x7f04200727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 -- 172.21.15.110:0/4092276774 shutdown_connections 2024-09-16T02:14:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.142+0000 7f04265af640 1 -- 172.21.15.110:0/4092276774 wait complete. 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.143+0000 7f04265af640 1 Processor -- start 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.143+0000 7f04265af640 1 -- start start 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.143+0000 7f04265af640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04200fb810 0x7f0420112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f04265af640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 0x7f0420112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f04265af640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420112cd0 con 0x7f04200fcf80 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f04265af640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042010c080 con 0x7f04200fb810 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 0x7f0420112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 0x7f0420112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52132/0 (socket says 172.21.15.110:52132) 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 -- 172.21.15.110:0/86509063 learned_addr learned my addr 172.21.15.110:0/86509063 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:46.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041ffff640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04200fb810 0x7f0420112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 -- 172.21.15.110:0/86509063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04200fb810 msgr2=0x7f0420112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04200fb810 0x7f0420112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 -- 172.21.15.110:0/86509063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410005040 con 0x7f04200fcf80 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041f7fe640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 0x7f0420112640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f041400daf0 tx=0x7f041400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041400edb0 con 0x7f04200fcf80 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.144+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0414017910 con 0x7f04200fcf80 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.145+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04140169f0 con 0x7f04200fcf80 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.145+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042010c300 con 0x7f04200fcf80 2024-09-16T02:14:46.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.145+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042010c820 con 0x7f04200fcf80 2024-09-16T02:14:46.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.146+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04200fcbc0 con 0x7f04200fcf80 2024-09-16T02:14:46.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.147+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0414014070 con 0x7f04200fcf80 2024-09-16T02:14:46.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.147+0000 7f041cff9640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f040806e530 0x7f04080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.147+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f04140905a0 con 0x7f04200fcf80 2024-09-16T02:14:46.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.147+0000 7f041ffff640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f040806e530 0x7f04080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.148+0000 7f041ffff640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f040806e530 0x7f04080709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0410009ac0 tx=0x7f0410035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:46.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.152+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0414059640 con 0x7f04200fcf80 2024-09-16T02:14:46.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.367+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f042004b720 con 0x7f040806e530 2024-09-16T02:14:46.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.368+0000 7f041cff9640 1 -- 172.21.15.110:0/86509063 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f042004b720 con 0x7f040806e530 2024-09-16T02:14:46.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f040806e530 msgr2=0x7f04080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f040806e530 0x7f04080709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0410009ac0 tx=0x7f0410035040 comp rx=0 tx=0).stop 2024-09-16T02:14:46.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 msgr2=0x7f0420112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 0x7f0420112640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f041400daf0 tx=0x7f041400b460 comp rx=0 tx=0).stop 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 shutdown_connections 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f040806e530 0x7f04080709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04200fcf80 0x7f0420112640 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 --2- 172.21.15.110:0/86509063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04200fb810 0x7f0420112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 >> 172.21.15.110:0/86509063 conn(0x7f04200723b0 msgr2=0x7f04200fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 shutdown_connections 2024-09-16T02:14:46.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.371+0000 7f04265af640 1 -- 172.21.15.110:0/86509063 wait complete. 2024-09-16T02:14:46.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.451+0000 7f191d9f6640 1 -- 172.21.15.110:0/910256518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 msgr2=0x7f1918065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.451+0000 7f191d9f6640 1 --2- 172.21.15.110:0/910256518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918065430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f190c0048d0 tx=0x7f190c009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.451+0000 7f191d9f6640 1 -- 172.21.15.110:0/910256518 shutdown_connections 2024-09-16T02:14:46.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.451+0000 7f191d9f6640 1 --2- 172.21.15.110:0/910256518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918065430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.451+0000 7f191d9f6640 1 --2- 172.21.15.110:0/910256518 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 0x7f19180fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.451+0000 7f191d9f6640 1 -- 172.21.15.110:0/910256518 >> 172.21.15.110:0/910256518 conn(0x7f19180723b0 msgr2=0x7f19180727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.452+0000 7f191d9f6640 1 -- 172.21.15.110:0/910256518 shutdown_connections 2024-09-16T02:14:46.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.452+0000 7f191d9f6640 1 -- 172.21.15.110:0/910256518 wait complete. 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.452+0000 7f191d9f6640 1 Processor -- start 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f191d9f6640 1 -- start start 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f191d9f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f191d9f6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 0x7f1918113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f191d9f6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918113e00 con 0x7f1918064fc0 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f191d9f6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191810d1b0 con 0x7f19180fe460 2024-09-16T02:14:46.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52164/0 (socket says 172.21.15.110:52164) 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 -- 172.21.15.110:0/16032780 learned_addr learned my addr 172.21.15.110:0/16032780 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f19167fc640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 0x7f1918113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 -- 172.21.15.110:0/16032780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 msgr2=0x7f1918113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 0x7f1918113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 -- 172.21.15.110:0/16032780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c005040 con 0x7f1918064fc0 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f19167fc640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 0x7f1918113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.453+0000 7f1916ffd640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918113230 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f190800b790 tx=0x7f19080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.454+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190800c700 con 0x7f1918064fc0 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.454+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f190800cd00 con 0x7f1918064fc0 2024-09-16T02:14:46.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.454+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191810d490 con 0x7f1918064fc0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.455+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191810d9b0 con 0x7f1918064fc0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.455+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1908015e70 con 0x7f1918064fc0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.455+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1908012070 con 0x7f1918064fc0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.456+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19180fdcf0 con 0x7f1918064fc0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.456+0000 7f18ff7fe640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f190006e320 0x7f19000707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.456+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f190808d4a0 con 0x7f1918064fc0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.456+0000 7f19167fc640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f190006e320 0x7f19000707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.457+0000 7f19167fc640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f190006e320 0x7f19000707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f190c00b020 tx=0x7f190c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:46.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.460+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1908092060 con 0x7f1918064fc0 2024-09-16T02:14:46.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.644+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f191804b720 con 0x7f190006e320 2024-09-16T02:14:46.646 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:46 smithi110 ceph-mon[98215]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.653+0000 7f18ff7fe640 1 -- 172.21.15.110:0/16032780 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f191804b720 con 0x7f190006e320 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (8m) 24s ago 16m 25.2M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (4m) 24s ago 16m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (4m) 11s ago 16m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (6m) 24s ago 16m 81.6M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (28s) 24s ago 11m 12.7M - 19.1.1-326-g8921c8ef f1455bd0219c eebd9daf924f 2024-09-16T02:14:46.654 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (45s) 24s ago 11m 13.1M - 19.1.1-326-g8921c8ef f1455bd0219c 228da41254bc 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (11m) 11s ago 11m 87.7M - 17.2.7-1633-g6d025bc2 33ed8dba3996 c81abc0bc1bc 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (14s) 11s ago 11m 11.8M - 19.1.1-326-g8921c8ef f1455bd0219c 583992a380a3 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (7m) 24s ago 17m 503M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (6m) 11s ago 15m 441M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (5m) 24s ago 18m 48.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (4m) 11s ago 15m 38.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (8m) 24s ago 16m 17.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (8m) 11s ago 15m 16.6M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (3m) 24s ago 15m 116M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (3m) 24s ago 14m 111M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (2m) 24s ago 14m 113M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (2m) 11s ago 13m 128M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 0a846f393eb0 2024-09-16T02:14:46.655 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (99s) 11s ago 13m 91.7M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 8ed078cd81d0 2024-09-16T02:14:46.656 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (67s) 11s ago 13m 102M 2581M 19.1.1-326-g8921c8ef f1455bd0219c a01a4f216cf5 2024-09-16T02:14:46.656 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (6m) 24s ago 16m 65.4M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:14:46.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f190006e320 msgr2=0x7f19000707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f190006e320 0x7f19000707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f190c00b020 tx=0x7f190c009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 msgr2=0x7f1918113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918113230 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f190800b790 tx=0x7f19080091d0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 shutdown_connections 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f190006e320 0x7f19000707d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19180fe460 0x7f1918113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 --2- 172.21.15.110:0/16032780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1918064fc0 0x7f1918113230 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 >> 172.21.15.110:0/16032780 conn(0x7f19180723b0 msgr2=0x7f1918105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 shutdown_connections 2024-09-16T02:14:46.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.655+0000 7f191d9f6640 1 -- 172.21.15.110:0/16032780 wait complete. 2024-09-16T02:14:46.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 -- 172.21.15.110:0/3578726464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 msgr2=0x7f60780fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 --2- 172.21.15.110:0/3578726464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f60780fbbe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60740048d0 tx=0x7f6074009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 -- 172.21.15.110:0/3578726464 shutdown_connections 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 --2- 172.21.15.110:0/3578726464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60780fcf80 0x7f60780fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 --2- 172.21.15.110:0/3578726464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f60780fbbe0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 -- 172.21.15.110:0/3578726464 >> 172.21.15.110:0/3578726464 conn(0x7f60780723b0 msgr2=0x7f60780727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 -- 172.21.15.110:0/3578726464 shutdown_connections 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 -- 172.21.15.110:0/3578726464 wait complete. 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 Processor -- start 2024-09-16T02:14:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.736+0000 7f607f70b640 1 -- start start 2024-09-16T02:14:46.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607f70b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f6078113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607f70b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60780fcf80 0x7f6078113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607f70b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078113df0 con 0x7f60780fb810 2024-09-16T02:14:46.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607f70b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607810d1a0 con 0x7f60780fcf80 2024-09-16T02:14:46.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f6078113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f6078113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52178/0 (socket says 172.21.15.110:52178) 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 -- 172.21.15.110:0/1694207464 learned_addr learned my addr 172.21.15.110:0/1694207464 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 -- 172.21.15.110:0/1694207464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60780fcf80 msgr2=0x7f6078113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60780fcf80 0x7f6078113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 -- 172.21.15.110:0/1694207464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074005040 con 0x7f60780fb810 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607d4a7640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f6078113220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6074003080 tx=0x7f6074009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6074038070 con 0x7f60780fb810 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f60740097e0 con 0x7f60780fb810 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607810d420 con 0x7f60780fb810 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.737+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f607403d420 con 0x7f60780fb810 2024-09-16T02:14:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.738+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607810d8e0 con 0x7f60780fb810 2024-09-16T02:14:46.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.739+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780fcbc0 con 0x7f60780fb810 2024-09-16T02:14:46.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.739+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6074030020 con 0x7f60780fb810 2024-09-16T02:14:46.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.740+0000 7f606dffb640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f606406e530 0x7f60640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:46.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.740+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f60740ae7f0 con 0x7f60780fb810 2024-09-16T02:14:46.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.740+0000 7f607cca6640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f606406e530 0x7f60640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:46.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.740+0000 7f607cca6640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f606406e530 0x7f60640709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f607810eae0 tx=0x7f6068006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:46.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.744+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6074077810 con 0x7f60780fb810 2024-09-16T02:14:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:46 smithi165 ceph-mon[77258]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-16T02:14:46.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.988+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f607804b720 con 0x7f60780fb810 2024-09-16T02:14:46.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.988+0000 7f606dffb640 1 -- 172.21.15.110:0/1694207464 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f607407aed0 con 0x7f60780fb810 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:14:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 3 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 13 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:14:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.990+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f606406e530 msgr2=0x7f60640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.990+0000 7f607f70b640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f606406e530 0x7f60640709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f607810eae0 tx=0x7f6068006d20 comp rx=0 tx=0).stop 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.990+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 msgr2=0x7f6078113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.990+0000 7f607f70b640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f6078113220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6074003080 tx=0x7f6074009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.990+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 shutdown_connections 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.990+0000 7f607f70b640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f606406e530 0x7f60640709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.991+0000 7f607f70b640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60780fcf80 0x7f6078113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.991+0000 7f607f70b640 1 --2- 172.21.15.110:0/1694207464 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60780fb810 0x7f6078113220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.991+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 >> 172.21.15.110:0/1694207464 conn(0x7f60780723b0 msgr2=0x7f6078064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:46.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.991+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 shutdown_connections 2024-09-16T02:14:46.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:46.991+0000 7f607f70b640 1 -- 172.21.15.110:0/1694207464 wait complete. 2024-09-16T02:14:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 -- 172.21.15.110:0/1014955596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 msgr2=0x7fd97c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 --2- 172.21.15.110:0/1014955596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c102900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0048d0 tx=0x7fd96c009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 -- 172.21.15.110:0/1014955596 shutdown_connections 2024-09-16T02:14:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 --2- 172.21.15.110:0/1014955596 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd97c102ed0 0x7fd97c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 --2- 172.21.15.110:0/1014955596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c102900 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 -- 172.21.15.110:0/1014955596 >> 172.21.15.110:0/1014955596 conn(0x7fd97c0f80f0 msgr2=0x7fd97c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 -- 172.21.15.110:0/1014955596 shutdown_connections 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.071+0000 7fd980b47640 1 -- 172.21.15.110:0/1014955596 wait complete. 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd980b47640 1 Processor -- start 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd980b47640 1 -- start start 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd980b47640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd980b47640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd97c102ed0 0x7fd97c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd980b47640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c070490 con 0x7fd97c102530 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd980b47640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c070600 con 0x7fd97c102ed0 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd97a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd97a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52196/0 (socket says 172.21.15.110:52196) 2024-09-16T02:14:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd97a59c640 1 -- 172.21.15.110:0/2994613981 learned_addr learned my addr 172.21.15.110:0/2994613981 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd979d9b640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd97c102ed0 0x7fd97c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd97a59c640 1 -- 172.21.15.110:0/2994613981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd97c102ed0 msgr2=0x7fd97c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd97a59c640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd97c102ed0 0x7fd97c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.072+0000 7fd97a59c640 1 -- 172.21.15.110:0/2994613981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c005040 con 0x7fd97c102530 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.073+0000 7fd97a59c640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c06fa10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd96c003080 tx=0x7fd96c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.073+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96c038070 con 0x7fd97c102530 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.073+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd96c0097e0 con 0x7fd97c102530 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.073+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c070830 con 0x7fd97c102530 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.073+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96c03d420 con 0x7fd97c102530 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.073+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c119890 con 0x7fd97c102530 2024-09-16T02:14:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.074+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c0fdcb0 con 0x7fd97c102530 2024-09-16T02:14:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.075+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd96c030020 con 0x7fd97c102530 2024-09-16T02:14:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.076+0000 7fd96affd640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd96406e530 0x7fd9640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.076+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fd96c0ae8b0 con 0x7fd97c102530 2024-09-16T02:14:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.076+0000 7fd979d9b640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd96406e530 0x7fd9640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.076+0000 7fd979d9b640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd96406e530 0x7fd9640709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd97c071350 tx=0x7fd970009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:47.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.082+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd96c0779f0 con 0x7fd97c102530 2024-09-16T02:14:47.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.294+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd97c071100 con 0x7fd97c102530 2024-09-16T02:14:47.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.294+0000 7fd96affd640 1 -- 172.21.15.110:0/2994613981 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1790 (secure 0 0 0) 0x7fd96c07b0b0 con 0x7fd97c102530 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:e29 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:btime 2024-09-16T02:14:41:657659+0000 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:14:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 29 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:14:41.657644+0000 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:14:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 90 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=34380} 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:14:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 0 members: 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:34380} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.110:6828/926668832,v1:172.21.15.110:6829/926668832] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:14:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/2342221402,v1:172.21.15.165:6825/2342221402] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:14:47.300 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 29 2024-09-16T02:14:47.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.297+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd96406e530 msgr2=0x7fd9640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.297+0000 7fd980b47640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd96406e530 0x7fd9640709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd97c071350 tx=0x7fd970009040 comp rx=0 tx=0).stop 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.297+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 msgr2=0x7fd97c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.297+0000 7fd980b47640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c06fa10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd96c003080 tx=0x7fd96c009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 shutdown_connections 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fd96406e530 0x7fd9640709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd97c102ed0 0x7fd97c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 --2- 172.21.15.110:0/2994613981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c102530 0x7fd97c06fa10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 >> 172.21.15.110:0/2994613981 conn(0x7fd97c0f80f0 msgr2=0x7fd97c0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 shutdown_connections 2024-09-16T02:14:47.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.298+0000 7fd980b47640 1 -- 172.21.15.110:0/2994613981 wait complete. 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 -- 172.21.15.110:0/3525555849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c064fe0 msgr2=0x7f405c0653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 --2- 172.21.15.110:0/3525555849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c064fe0 0x7f405c0653b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40580048d0 tx=0x7f4058009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 -- 172.21.15.110:0/3525555849 shutdown_connections 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 --2- 172.21.15.110:0/3525555849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0658f0 0x7f405c108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 --2- 172.21.15.110:0/3525555849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c064fe0 0x7f405c0653b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 -- 172.21.15.110:0/3525555849 >> 172.21.15.110:0/3525555849 conn(0x7f405c0723b0 msgr2=0x7f405c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 -- 172.21.15.110:0/3525555849 shutdown_connections 2024-09-16T02:14:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.381+0000 7f40644ea640 1 -- 172.21.15.110:0/3525555849 wait complete. 2024-09-16T02:14:47.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.382+0000 7f40644ea640 1 Processor -- start 2024-09-16T02:14:47.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.382+0000 7f40644ea640 1 -- start start 2024-09-16T02:14:47.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.382+0000 7f40644ea640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c064fe0 0x7f405c1153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.382+0000 7f40644ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 0x7f405c115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f40644ea640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c115fb0 con 0x7f405c0658f0 2024-09-16T02:14:47.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f40644ea640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c10f3a0 con 0x7f405c064fe0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 0x7f405c115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 0x7f405c115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52216/0 (socket says 172.21.15.110:52216) 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 -- 172.21.15.110:0/4043659900 learned_addr learned my addr 172.21.15.110:0/4043659900 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4062286640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c064fe0 0x7f405c1153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 -- 172.21.15.110:0/4043659900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c064fe0 msgr2=0x7f405c1153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c064fe0 0x7f405c1153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 -- 172.21.15.110:0/4043659900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058005040 con 0x7f405c0658f0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4061a85640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 0x7f405c115920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f404c00b790 tx=0x7f404c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404c00c700 con 0x7f405c0658f0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c10f680 con 0x7f405c0658f0 2024-09-16T02:14:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f404c00cd00 con 0x7f405c0658f0 2024-09-16T02:14:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.383+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404c015e80 con 0x7f405c0658f0 2024-09-16T02:14:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.384+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c10fba0 con 0x7f405c0658f0 2024-09-16T02:14:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.385+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c0fbae0 con 0x7f405c0658f0 2024-09-16T02:14:47.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.385+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f404c012070 con 0x7f405c0658f0 2024-09-16T02:14:47.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.386+0000 7f4052ffd640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f404806e530 0x7f40480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.386+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f404c08da80 con 0x7f405c0658f0 2024-09-16T02:14:47.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.386+0000 7f4062286640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f404806e530 0x7f40480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.386+0000 7f4062286640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f404806e530 0x7f40480709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4058003080 tx=0x7f4058035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:47.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.390+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f404c056b20 con 0x7f405c0658f0 2024-09-16T02:14:47.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.583+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f405c110a90 con 0x7f404806e530 2024-09-16T02:14:47.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:47 smithi110 ceph-mon[98215]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:47.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:47 smithi110 ceph-mon[98215]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:47.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:47 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1694207464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:47.585 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:47 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2994613981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:14:47.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.584+0000 7f4052ffd640 1 -- 172.21.15.110:0/4043659900 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f405c110a90 con 0x7f404806e530 2024-09-16T02:14:47.586 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:14:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T02:14:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": true, 2024-09-16T02:14:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [ 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "mon", 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "osd", 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr" 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": "15/21 daemons upgraded", 2024-09-16T02:14:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "Currently upgrading mds daemons", 2024-09-16T02:14:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:14:47.588 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:14:47.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f404806e530 msgr2=0x7f40480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f404806e530 0x7f40480709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4058003080 tx=0x7f4058035040 comp rx=0 tx=0).stop 2024-09-16T02:14:47.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 msgr2=0x7f405c115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 0x7f405c115920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f404c00b790 tx=0x7f404c0091d0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 shutdown_connections 2024-09-16T02:14:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f404806e530 0x7f40480709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405c0658f0 0x7f405c115920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 --2- 172.21.15.110:0/4043659900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c064fe0 0x7f405c1153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 >> 172.21.15.110:0/4043659900 conn(0x7f405c0723b0 msgr2=0x7f405c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.587+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 shutdown_connections 2024-09-16T02:14:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.588+0000 7f40644ea640 1 -- 172.21.15.110:0/4043659900 wait complete. 2024-09-16T02:14:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/2426712201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 msgr2=0x7fe1e4065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/2426712201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4065430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80048d0 tx=0x7fe1d8009da0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/2426712201 shutdown_connections 2024-09-16T02:14:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/2426712201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4065430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/2426712201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e40fe450 0x7fe1e40fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/2426712201 >> 172.21.15.110:0/2426712201 conn(0x7fe1e40723b0 msgr2=0x7fe1e40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/2426712201 shutdown_connections 2024-09-16T02:14:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.667+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/2426712201 wait complete. 2024-09-16T02:14:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.668+0000 7fe1e9d9e640 1 Processor -- start 2024-09-16T02:14:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.668+0000 7fe1e9d9e640 1 -- start start 2024-09-16T02:14:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e9d9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e9d9e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e40fe450 0x7fe1e4113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e9d9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4113d60 con 0x7fe1e4064fe0 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e9d9e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e410d1a0 con 0x7fe1e40fe450 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52236/0 (socket says 172.21.15.110:52236) 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 -- 172.21.15.110:0/707952680 learned_addr learned my addr 172.21.15.110:0/707952680 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e2ffd640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e40fe450 0x7fe1e4113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 -- 172.21.15.110:0/707952680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e40fe450 msgr2=0x7fe1e4113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e40fe450 0x7fe1e4113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 -- 172.21.15.110:0/707952680 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8005040 con 0x7fe1e4064fe0 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.669+0000 7fe1e37fe640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4113220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4002a50 tx=0x7fe1d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.670+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d4007c30 con 0x7fe1e4064fe0 2024-09-16T02:14:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.670+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e410d480 con 0x7fe1e4064fe0 2024-09-16T02:14:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.670+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e410d970 con 0x7fe1e4064fe0 2024-09-16T02:14:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.670+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1d400f040 con 0x7fe1e4064fe0 2024-09-16T02:14:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.670+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d400da90 con 0x7fe1e4064fe0 2024-09-16T02:14:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.671+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d0005210 con 0x7fe1e4064fe0 2024-09-16T02:14:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.671+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe1d400dcd0 con 0x7fe1e4064fe0 2024-09-16T02:14:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.672+0000 7fe1cbfff640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe1cc06e530 0x7fe1cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:14:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.672+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fe1d408d9e0 con 0x7fe1e4064fe0 2024-09-16T02:14:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.672+0000 7fe1e2ffd640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe1cc06e530 0x7fe1cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:14:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.672+0000 7fe1e2ffd640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe1cc06e530 0x7fe1cc0709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4072dd0 tx=0x7fe1d8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:14:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.680+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe1d4056a80 con 0x7fe1e4064fe0 2024-09-16T02:14:47.835 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:47 smithi165 ceph-mon[77258]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:47.835 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:47 smithi165 ceph-mon[77258]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:47.835 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:47 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1694207464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:47.835 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:47 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2994613981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:14:47.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.924+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe1d00054c0 con 0x7fe1e4064fe0 2024-09-16T02:14:47.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.925+0000 7fe1cbfff640 1 -- 172.21.15.110:0/707952680 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fe1d405a140 con 0x7fe1e4064fe0 2024-09-16T02:14:47.926 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-16T02:14:47.926 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-16T02:14:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs is degraded 2024-09-16T02:14:47.926 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:14:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:14:47.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe1cc06e530 msgr2=0x7fe1cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe1cc06e530 0x7fe1cc0709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4072dd0 tx=0x7fe1d8035040 comp rx=0 tx=0).stop 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 msgr2=0x7fe1e4113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4113220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4002a50 tx=0x7fe1d4004600 comp rx=0 tx=0).stop 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 shutdown_connections 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe1cc06e530 0x7fe1cc0709e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e40fe450 0x7fe1e4113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 --2- 172.21.15.110:0/707952680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e4064fe0 0x7fe1e4113220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 >> 172.21.15.110:0/707952680 conn(0x7fe1e40723b0 msgr2=0x7fe1e4105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.927+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 shutdown_connections 2024-09-16T02:14:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:14:47.928+0000 7fe1e9d9e640 1 -- 172.21.15.110:0/707952680 wait complete. 2024-09-16T02:14:48.937 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:48 smithi165 ceph-mon[77258]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:48.937 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:48 smithi165 ceph-mon[77258]: pgmap v201: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-16T02:14:48.938 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:48 smithi165 ceph-mon[77258]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:48.938 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:48 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/707952680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:14:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:48 smithi110 ceph-mon[98215]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:48 smithi110 ceph-mon[98215]: pgmap v201: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-16T02:14:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:48 smithi110 ceph-mon[98215]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:14:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:48 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/707952680' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:14:50.833 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-16T02:14:50.833 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:50.833 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:50.833 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:50.833 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.165:6826/3028375374,v1:172.21.15.165:6827/3028375374] up:boot 2024-09-16T02:14:50.834 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:replay} 3 up:standby 2024-09-16T02:14:50.834 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:50 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.165:6826/3028375374,v1:172.21.15.165:6827/3028375374] up:boot 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:replay} 3 up:standby 2024-09-16T02:14:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:50 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:14:51.845 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:51 smithi165 ceph-mon[77258]: reconnect by client.14492 192.168.0.1:0/323678790 after 0.000999984 2024-09-16T02:14:51.845 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:51 smithi165 ceph-mon[77258]: reconnect by client.24263 192.168.0.1:0/994083850 after 0.00199997 2024-09-16T02:14:51.845 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:51 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:reconnect 2024-09-16T02:14:51.845 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:51 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:reconnect} 3 up:standby 2024-09-16T02:14:51.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:51 smithi110 ceph-mon[98215]: reconnect by client.14492 192.168.0.1:0/323678790 after 0.000999984 2024-09-16T02:14:51.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:51 smithi110 ceph-mon[98215]: reconnect by client.24263 192.168.0.1:0/994083850 after 0.00199997 2024-09-16T02:14:51.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:51 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:reconnect 2024-09-16T02:14:51.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:51 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:reconnect} 3 up:standby 2024-09-16T02:14:52.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-16T02:14:52.602 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:rejoin 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:rejoin} 3 up:standby 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: daemon mds.cephfs.smithi110.yaugxw is now active in filesystem cephfs as rank 0 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.603 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:52.792 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-16T02:14:52.792 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:rejoin 2024-09-16T02:14:52.792 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: fsmap cephfs:1/1 {0=cephfs.smithi110.yaugxw=up:rejoin} 3 up:standby 2024-09-16T02:14:52.792 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.793 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.793 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: daemon mds.cephfs.smithi110.yaugxw is now active in filesystem cephfs as rank 0 2024-09-16T02:14:52.793 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.793 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.793 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:52.793 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:14:53.791 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:53 smithi165 ceph-mon[77258]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T02:14:53.791 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:53 smithi165 ceph-mon[77258]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:active 2024-09-16T02:14:53.791 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:53 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:14:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:53 smithi110 ceph-mon[98215]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T02:14:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:53 smithi110 ceph-mon[98215]: mds.? [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] up:active 2024-09-16T02:14:53.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:53 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:14:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:54 smithi165 ceph-mon[77258]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T02:14:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:54 smithi110 ceph-mon[98215]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T02:14:56.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all mds 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.svegdg"}]': finished 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.yaugxw"}]': finished 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.gxrypw"}]': finished 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.hskfht"}]': finished 2024-09-16T02:14:56.702 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:56 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all mds 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.svegdg"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.svegdg"}]': finished 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.yaugxw"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi110.yaugxw"}]': finished 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.gxrypw"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.gxrypw"}]': finished 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.hskfht"}]: dispatch 2024-09-16T02:14:56.708 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.hskfht"}]': finished 2024-09-16T02:14:56.709 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:56 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-16T02:14:57.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:57 smithi165 ceph-mon[77258]: Upgrade: Setting filesystem cephfs Joinable 2024-09-16T02:14:57.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:57 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-16T02:14:57.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:57 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:14:57.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:57 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-16T02:14:57.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:57 smithi110 ceph-mon[98215]: Upgrade: Setting filesystem cephfs Joinable 2024-09-16T02:14:57.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:57 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-16T02:14:57.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:57 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:14:57.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:57 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-16T02:14:58.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: pgmap v206: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all rgw 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all iscsi 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all nfs 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Setting container_image for all nvmeof 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Finalizing container_image settings 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-16T02:14:58.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T02:14:58.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: Upgrade: Complete! 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:58.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:58.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.960 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-16T02:14:58.960 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: pgmap v206: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-16T02:14:58.960 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-16T02:14:58.960 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 3 up:standby 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: fsmap cephfs:1 {0=cephfs.smithi110.yaugxw=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all rgw 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.961 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all iscsi 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all nfs 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.962 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Setting container_image for all nvmeof 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Finalizing container_image settings 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T02:14:58.963 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T02:14:58.964 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.965 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: Upgrade: Complete! 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:14:58.966 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:14:58.967 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:14:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:14:59 smithi165 ceph-mon[77258]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-16T02:14:59.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:14:59 smithi110 ceph-mon[98215]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-16T02:15:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:02 smithi165 ceph-mon[77258]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-16T02:15:02.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:15:02.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:02 smithi110 ceph-mon[98215]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-16T02:15:02.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:15:04.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:04 smithi165 ceph-mon[77258]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-16T02:15:04.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:04 smithi110 ceph-mon[98215]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-09-16T02:15:06.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:06 smithi165 ceph-mon[77258]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-16T02:15:06.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:06 smithi110 ceph-mon[98215]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-16T02:15:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:15:08.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:08 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:08.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:08 smithi165 ceph-mon[77258]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-16T02:15:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:15:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:08 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:08.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:08 smithi110 ceph-mon[98215]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-16T02:15:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:10 smithi165 ceph-mon[77258]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-16T02:15:10.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:10 smithi110 ceph-mon[98215]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-16T02:15:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:12 smithi165 ceph-mon[77258]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-16T02:15:12.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:12 smithi110 ceph-mon[98215]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-16T02:15:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:14 smithi165 ceph-mon[77258]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-16T02:15:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:14 smithi110 ceph-mon[98215]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-16T02:15:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:16 smithi165 ceph-mon[77258]: pgmap v215: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 7.7 MiB/s rd, 3 op/s 2024-09-16T02:15:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:16 smithi110 ceph-mon[98215]: pgmap v215: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 7.7 MiB/s rd, 3 op/s 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 -- 172.21.15.110:0/4010981561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 msgr2=0x7f5ac80fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/4010981561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac80fb0f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80048d0 tx=0x7f5ab8009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 -- 172.21.15.110:0/4010981561 shutdown_connections 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/4010981561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac80fb0f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/4010981561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ac8102620 0x7f5ac81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 -- 172.21.15.110:0/4010981561 >> 172.21.15.110:0/4010981561 conn(0x7f5ac8070ce0 msgr2=0x7f5ac80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 -- 172.21.15.110:0/4010981561 shutdown_connections 2024-09-16T02:15:18.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.013+0000 7f5acf1f9640 1 -- 172.21.15.110:0/4010981561 wait complete. 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5acf1f9640 1 Processor -- start 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5acf1f9640 1 -- start start 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5acf1f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5acf1f9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ac8102620 0x7f5ac8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5acf1f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8113d10 con 0x7f5ac80fac80 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5acf1f9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac810d150 con 0x7f5ac8102620 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.014+0000 7f5accf95640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5accf95640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac81131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35040/0 (socket says 172.21.15.110:35040) 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5accf95640 1 -- 172.21.15.110:0/3544375504 learned_addr learned my addr 172.21.15.110:0/3544375504 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5abffff640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ac8102620 0x7f5ac8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5accf95640 1 -- 172.21.15.110:0/3544375504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ac8102620 msgr2=0x7f5ac8113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5accf95640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ac8102620 0x7f5ac8113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5accf95640 1 -- 172.21.15.110:0/3544375504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8005040 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5accf95640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac81131d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4002a50 tx=0x7f5ac4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ac4007c30 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ac400f040 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac810d430 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ac400dad0 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.015+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac810d9a0 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.016+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac80657b0 con 0x7f5ac80fac80 2024-09-16T02:15:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.017+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5ac400dc30 con 0x7f5ac80fac80 2024-09-16T02:15:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.017+0000 7f5abd7fa640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5ab006e530 0x7f5ab00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.017+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f5ac408e100 con 0x7f5ac80fac80 2024-09-16T02:15:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.017+0000 7f5abffff640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5ab006e530 0x7f5ab00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.018+0000 7f5abffff640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5ab006e530 0x7f5ab00709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ac0 tx=0x7f5ab8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:18.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.022+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ac4057120 con 0x7f5ac80fac80 2024-09-16T02:15:18.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.201+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ac804b720 con 0x7f5ab006e530 2024-09-16T02:15:18.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.203+0000 7f5abd7fa640 1 -- 172.21.15.110:0/3544375504 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f5ac804b720 con 0x7f5ab006e530 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5ab006e530 msgr2=0x7f5ab00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5ab006e530 0x7f5ab00709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009ac0 tx=0x7f5ab8035040 comp rx=0 tx=0).stop 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 msgr2=0x7f5ac81131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac81131d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4002a50 tx=0x7f5ac4004600 comp rx=0 tx=0).stop 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 shutdown_connections 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f5ab006e530 0x7f5ab00709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ac8102620 0x7f5ac8113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 --2- 172.21.15.110:0/3544375504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ac80fac80 0x7f5ac81131d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:18.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 >> 172.21.15.110:0/3544375504 conn(0x7f5ac8070ce0 msgr2=0x7f5ac8100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:18.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 shutdown_connections 2024-09-16T02:15:18.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:18.205+0000 7f5acf1f9640 1 -- 172.21.15.110:0/3544375504 wait complete. 2024-09-16T02:15:18.904 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:18 smithi110 ceph-mon[98215]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-09-16T02:15:18.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch ps' 2024-09-16T02:15:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:18 smithi165 ceph-mon[77258]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-09-16T02:15:19.218 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:15:19.657 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:19 smithi110 ceph-mon[98215]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:15:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:19 smithi165 ceph-mon[77258]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:15:20.629 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:20 smithi110 ceph-mon[98215]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1 op/s 2024-09-16T02:15:20.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.830+0000 7f491a69b640 1 -- 172.21.15.110:0/2993653698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 msgr2=0x7f49141065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:20.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.830+0000 7f491a69b640 1 --2- 172.21.15.110:0/2993653698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141065b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4908004900 tx=0x7f4908009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:20.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.830+0000 7f491a69b640 1 -- 172.21.15.110:0/2993653698 shutdown_connections 2024-09-16T02:15:20.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.830+0000 7f491a69b640 1 --2- 172.21.15.110:0/2993653698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141065b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:20.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.830+0000 7f491a69b640 1 --2- 172.21.15.110:0/2993653698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49140fd540 0x7f49140fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:20.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.830+0000 7f491a69b640 1 -- 172.21.15.110:0/2993653698 >> 172.21.15.110:0/2993653698 conn(0x7f49140f7000 msgr2=0x7f49140f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 -- 172.21.15.110:0/2993653698 shutdown_connections 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 -- 172.21.15.110:0/2993653698 wait complete. 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 Processor -- start 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 -- start start 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49140fd540 0x7f49141132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914113df0 con 0x7f49140fdee0 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.831+0000 7f491a69b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914113f60 con 0x7f49140fd540 2024-09-16T02:15:20.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47588/0 (socket says 172.21.15.110:47588) 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 -- 172.21.15.110:0/3711722435 learned_addr learned my addr 172.21.15.110:0/3711722435 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f4913fff640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49140fd540 0x7f49141132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 -- 172.21.15.110:0/3711722435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49140fd540 msgr2=0x7f49141132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49140fd540 0x7f49141132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 -- 172.21.15.110:0/3711722435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908005040 con 0x7f49140fdee0 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f49137fe640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141137f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4908009ac0 tx=0x7f4908009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4908038070 con 0x7f49140fdee0 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f490802ae80 con 0x7f49140fdee0 2024-09-16T02:15:20.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491410d380 con 0x7f49140fdee0 2024-09-16T02:15:20.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4908009680 con 0x7f49140fdee0 2024-09-16T02:15:20.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.832+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491410d840 con 0x7f49140fdee0 2024-09-16T02:15:20.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.833+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49140662d0 con 0x7f49140fdee0 2024-09-16T02:15:20.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.834+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4908030020 con 0x7f49140fdee0 2024-09-16T02:15:20.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.834+0000 7f4910ff9640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f48fc06e530 0x7f48fc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:20.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.834+0000 7f4913fff640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f48fc06e530 0x7f48fc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:20.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.835+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f49080ae670 con 0x7f49140fdee0 2024-09-16T02:15:20.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.835+0000 7f4913fff640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f48fc06e530 0x7f48fc0709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4904004eb0 tx=0x7f490400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:20.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:20.839+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4908077710 con 0x7f49140fdee0 2024-09-16T02:15:20.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:20 smithi165 ceph-mon[77258]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1 op/s 2024-09-16T02:15:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.016+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4914109560 con 0x7f48fc06e530 2024-09-16T02:15:21.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.024+0000 7f4910ff9640 1 -- 172.21.15.110:0/3711722435 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4914109560 con 0x7f48fc06e530 2024-09-16T02:15:21.027 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:15:21.027 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (8m) 58s ago 17m 25.2M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:15:21.027 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (4m) 58s ago 17m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:15:21.028 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (4m) 29s ago 16m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:15:21.028 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (7m) 58s ago 17m 81.6M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:15:21.028 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (63s) 58s ago 12m 12.7M - 19.1.1-326-g8921c8ef f1455bd0219c eebd9daf924f 2024-09-16T02:15:21.028 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (79s) 58s ago 12m 13.1M - 19.1.1-326-g8921c8ef f1455bd0219c 228da41254bc 2024-09-16T02:15:21.028 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (31s) 29s ago 12m 11.9M - 19.1.1-326-g8921c8ef f1455bd0219c 0edf2322c770 2024-09-16T02:15:21.029 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (49s) 29s ago 12m 13.1M - 19.1.1-326-g8921c8ef f1455bd0219c 583992a380a3 2024-09-16T02:15:21.029 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (8m) 58s ago 18m 503M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:15:21.029 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (7m) 29s ago 16m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:15:21.029 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (5m) 58s ago 18m 48.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:15:21.029 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (5m) 29s ago 16m 38.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:15:21.030 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (9m) 58s ago 17m 17.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:15:21.030 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (8m) 29s ago 16m 16.6M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:15:21.030 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (4m) 58s ago 15m 116M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:15:21.030 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (3m) 58s ago 15m 111M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:15:21.030 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (3m) 58s ago 14m 113M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:15:21.031 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (2m) 29s ago 14m 130M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 0a846f393eb0 2024-09-16T02:15:21.031 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (2m) 29s ago 13m 91.8M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 8ed078cd81d0 2024-09-16T02:15:21.031 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (101s) 29s ago 13m 101M 2581M 19.1.1-326-g8921c8ef f1455bd0219c a01a4f216cf5 2024-09-16T02:15:21.031 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (7m) 58s ago 16m 65.4M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:15:21.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f48fc06e530 msgr2=0x7f48fc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:21.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f48fc06e530 0x7f48fc0709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4904004eb0 tx=0x7f490400b040 comp rx=0 tx=0).stop 2024-09-16T02:15:21.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 msgr2=0x7f49141137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:21.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141137f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4908009ac0 tx=0x7f4908009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:21.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 shutdown_connections 2024-09-16T02:15:21.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f48fc06e530 0x7f48fc0709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:21.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49140fdee0 0x7f49141137f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:21.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 --2- 172.21.15.110:0/3711722435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49140fd540 0x7f49141132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:21.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 >> 172.21.15.110:0/3711722435 conn(0x7f49140f7000 msgr2=0x7f49140f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:21.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 shutdown_connections 2024-09-16T02:15:21.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:21.026+0000 7f491a69b640 1 -- 172.21.15.110:0/3711722435 wait complete. 2024-09-16T02:15:21.751 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch upgrade status' 2024-09-16T02:15:21.995 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:15:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:22 smithi110 ceph-mon[98215]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:15:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:22 smithi110 ceph-mon[98215]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T02:15:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:22 smithi165 ceph-mon[77258]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:15:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:22 smithi165 ceph-mon[77258]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T02:15:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:23.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- 172.21.15.110:0/2763668461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc1014e0 msgr2=0x7f2bfc1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/2763668461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc1018b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0048d0 tx=0x7f2bec009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- 172.21.15.110:0/2763668461 shutdown_connections 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/2763668461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/2763668461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc1018b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- 172.21.15.110:0/2763668461 >> 172.21.15.110:0/2763668461 conn(0x7f2bfc0f7060 msgr2=0x7f2bfc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- 172.21.15.110:0/2763668461 shutdown_connections 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- 172.21.15.110:0/2763668461 wait complete. 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 Processor -- start 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- start start 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc1153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:23.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc115f10 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.559+0000 7f2c01cb1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc10f350 con 0x7f2bfc1014e0 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc1153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc1153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47614/0 (socket says 172.21.15.110:47614) 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 -- 172.21.15.110:0/865319909 learned_addr learned my addr 172.21.15.110:0/865319909 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bf3fff640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 -- 172.21.15.110:0/865319909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc1014e0 msgr2=0x7f2bfc115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 -- 172.21.15.110:0/865319909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec005040 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bf3fff640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bfb7fe640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc1153d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bec003080 tx=0x7f2bec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:23.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bec038070 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2bec0097e0 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc10f5d0 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bec03d420 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.560+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc10fb10 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.561+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0fcbe0 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.562+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2bec030020 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.562+0000 7f2bf8ff9640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f2be806e530 0x7f2be80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:23.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.562+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f2bec0ae7f0 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.562+0000 7f2bf3fff640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f2be806e530 0x7f2be80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:23.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.563+0000 7f2bf3fff640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f2be806e530 0x7f2be80709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc110c90 tx=0x7f2be4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:23.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.566+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2bec077810 con 0x7f2bfc0fb4a0 2024-09-16T02:15:23.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.756+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bfc04b720 con 0x7f2be806e530 2024-09-16T02:15:23.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.757+0000 7f2bf8ff9640 1 -- 172.21.15.110:0/865319909 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f2bfc04b720 con 0x7f2be806e530 2024-09-16T02:15:23.759 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:15:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "target_image": null, 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "in_progress": false, 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "which": "", 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "services_complete": [], 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "progress": null, 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "message": "", 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "is_paused": false 2024-09-16T02:15:23.760 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:15:23.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f2be806e530 msgr2=0x7f2be80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f2be806e530 0x7f2be80709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc110c90 tx=0x7f2be4009040 comp rx=0 tx=0).stop 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 msgr2=0x7f2bfc1153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc1153d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2bec003080 tx=0x7f2bec009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 shutdown_connections 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f2be806e530 0x7f2be80709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bfc1014e0 0x7f2bfc115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 --2- 172.21.15.110:0/865319909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bfc0fb4a0 0x7f2bfc1153d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 >> 172.21.15.110:0/865319909 conn(0x7f2bfc0f7060 msgr2=0x7f2bfc065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 shutdown_connections 2024-09-16T02:15:23.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:23.759+0000 7f2c01cb1640 1 -- 172.21.15.110:0/865319909 wait complete. 2024-09-16T02:15:24.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph health detail' 2024-09-16T02:15:24.734 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:15:24.855 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:24 smithi110 ceph-mon[98215]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:24 smithi165 ceph-mon[77258]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:25.847 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:25 smithi110 ceph-mon[98215]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:15:25.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:25 smithi165 ceph-mon[77258]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:15:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 -- 172.21.15.110:0/1940554325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065c10 msgr2=0x7f13c40fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 --2- 172.21.15.110:0/1940554325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065c10 0x7f13c40fe0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13b80048d0 tx=0x7f13b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 -- 172.21.15.110:0/1940554325 shutdown_connections 2024-09-16T02:15:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 --2- 172.21.15.110:0/1940554325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065c10 0x7f13c40fe0d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 --2- 172.21.15.110:0/1940554325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065300 0x7f13c40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 -- 172.21.15.110:0/1940554325 >> 172.21.15.110:0/1940554325 conn(0x7f13c40723b0 msgr2=0x7f13c40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 -- 172.21.15.110:0/1940554325 shutdown_connections 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.350+0000 7f13caa1d640 1 -- 172.21.15.110:0/1940554325 wait complete. 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13caa1d640 1 Processor -- start 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13caa1d640 1 -- start start 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13caa1d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 0x7f13c41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13caa1d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065c10 0x7f13c4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13caa1d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4113d10 con 0x7f13c4065300 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13caa1d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c410d150 con 0x7f13c4065c10 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 0x7f13c41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 0x7f13c41131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47632/0 (socket says 172.21.15.110:47632) 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c3fff640 1 -- 172.21.15.110:0/382557730 learned_addr learned my addr 172.21.15.110:0/382557730 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:15:26.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c37fe640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065c10 0x7f13c4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c3fff640 1 -- 172.21.15.110:0/382557730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065c10 msgr2=0x7f13c4113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c3fff640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065c10 0x7f13c4113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c3fff640 1 -- 172.21.15.110:0/382557730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b8005040 con 0x7f13c4065300 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.351+0000 7f13c37fe640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065c10 0x7f13c4113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.352+0000 7f13c3fff640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 0x7f13c41131d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00cb10 tx=0x7f13bc007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.352+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13bc004200 con 0x7f13c4065300 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.352+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c410d430 con 0x7f13c4065300 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.352+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13bc00acc0 con 0x7f13c4065300 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.352+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13bc003dc0 con 0x7f13c4065300 2024-09-16T02:15:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.352+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c410d9d0 con 0x7f13c4065300 2024-09-16T02:15:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.353+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40fdce0 con 0x7f13c4065300 2024-09-16T02:15:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.353+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f13bc00a820 con 0x7f13c4065300 2024-09-16T02:15:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.354+0000 7f13c0ff9640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13ac06e530 0x7f13ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.354+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f13bc08ea00 con 0x7f13c4065300 2024-09-16T02:15:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.354+0000 7f13c37fe640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13ac06e530 0x7f13ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:26.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.354+0000 7f13c37fe640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13ac06e530 0x7f13ac0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b020 tx=0x7f13b8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:26.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.358+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f13bc0579c0 con 0x7f13c4065300 2024-09-16T02:15:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.593+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f13c404b720 con 0x7f13c4065300 2024-09-16T02:15:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.593+0000 7f13c0ff9640 1 -- 172.21.15.110:0/382557730 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f13bc004360 con 0x7f13c4065300 2024-09-16T02:15:26.596 INFO:teuthology.orchestra.run.smithi110.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:15:26.596 INFO:teuthology.orchestra.run.smithi110.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T02:15:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T02:15:26.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13ac06e530 msgr2=0x7f13ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:26.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13ac06e530 0x7f13ac0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13b800b020 tx=0x7f13b8009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 msgr2=0x7f13c41131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:26.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 0x7f13c41131d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00cb10 tx=0x7f13bc007f00 comp rx=0 tx=0).stop 2024-09-16T02:15:26.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 shutdown_connections 2024-09-16T02:15:26.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f13ac06e530 0x7f13ac0709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13c4065c10 0x7f13c4113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 --2- 172.21.15.110:0/382557730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13c4065300 0x7f13c41131d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 >> 172.21.15.110:0/382557730 conn(0x7f13c40723b0 msgr2=0x7f13c40fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 shutdown_connections 2024-09-16T02:15:26.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:26.596+0000 7f13caa1d640 1 -- 172.21.15.110:0/382557730 wait complete. 2024-09-16T02:15:26.896 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:26 smithi110 ceph-mon[98215]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:26 smithi165 ceph-mon[77258]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:27.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions' 2024-09-16T02:15:27.466 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:15:27.831 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:27 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/382557730' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:15:27.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:27 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/382557730' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T02:15:28.854 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:28 smithi110 ceph-mon[98215]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:28 smithi165 ceph-mon[77258]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:29.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 -- 172.21.15.110:0/1735892613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a2406fab0 msgr2=0x7f3a2406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1735892613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a2406fab0 0x7f3a2406fe80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0048d0 tx=0x7f3a1c009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 -- 172.21.15.110:0/1735892613 shutdown_connections 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1735892613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a240703c0 0x7f3a24108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1735892613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a2406fab0 0x7f3a2406fe80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 -- 172.21.15.110:0/1735892613 >> 172.21.15.110:0/1735892613 conn(0x7f3a240f80f0 msgr2=0x7f3a240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 -- 172.21.15.110:0/1735892613 shutdown_connections 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.037+0000 7f3a2b653640 1 -- 172.21.15.110:0/1735892613 wait complete. 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a2b653640 1 Processor -- start 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a2b653640 1 -- start start 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a2b653640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a2406fab0 0x7f3a241153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a2b653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 0x7f3a24115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a2b653640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24115f20 con 0x7f3a240703c0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a2b653640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24116090 con 0x7f3a2406fab0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a28bee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 0x7f3a24115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a28bee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 0x7f3a24115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47648/0 (socket says 172.21.15.110:47648) 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a28bee640 1 -- 172.21.15.110:0/1306123601 learned_addr learned my addr 172.21.15.110:0/1306123601 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a28bee640 1 -- 172.21.15.110:0/1306123601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a2406fab0 msgr2=0x7f3a241153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a28bee640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a2406fab0 0x7f3a241153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.038+0000 7f3a28bee640 1 -- 172.21.15.110:0/1306123601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c005040 con 0x7f3a240703c0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.039+0000 7f3a28bee640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 0x7f3a24115920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800eb70 tx=0x7f3a1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.039+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a18007c30 con 0x7f3a240703c0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.039+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a1800f040 con 0x7f3a240703c0 2024-09-16T02:15:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.039+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2410f4b0 con 0x7f3a240703c0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.039+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a180094e0 con 0x7f3a240703c0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.039+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2410f9d0 con 0x7f3a240703c0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.040+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240711f0 con 0x7f3a240703c0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.040+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3a18009660 con 0x7f3a240703c0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.041+0000 7f3a21ffb640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a0c06e530 0x7f3a0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.041+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f3a1808dfd0 con 0x7f3a240703c0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.041+0000 7f3a293ef640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a0c06e530 0x7f3a0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.041+0000 7f3a293ef640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a0c06e530 0x7f3a0c0709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0043d0 tx=0x7f3a1c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:15:29.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.045+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3a18056ff0 con 0x7f3a240703c0 2024-09-16T02:15:29.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.277+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a240fbd30 con 0x7f3a240703c0 2024-09-16T02:15:29.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.278+0000 7f3a21ffb640 1 -- 172.21.15.110:0/1306123601 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f3a1805a6b0 con 0x7f3a240703c0 2024-09-16T02:15:29.280 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:15:29.280 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:15:29.280 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:15:29.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:15:29.280 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:15:29.281 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:15:29.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a0c06e530 msgr2=0x7f3a0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:29.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a0c06e530 0x7f3a0c0709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0043d0 tx=0x7f3a1c009da0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 msgr2=0x7f3a24115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:15:29.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 0x7f3a24115920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800eb70 tx=0x7f3a1800b040 comp rx=0 tx=0).stop 2024-09-16T02:15:29.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 shutdown_connections 2024-09-16T02:15:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3a0c06e530 0x7f3a0c0709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a240703c0 0x7f3a24115920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 --2- 172.21.15.110:0/1306123601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a2406fab0 0x7f3a241153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:15:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 >> 172.21.15.110:0/1306123601 conn(0x7f3a240f80f0 msgr2=0x7f3a240f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:15:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 shutdown_connections 2024-09-16T02:15:29.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:15:29.280+0000 7f3a2b653640 1 -- 172.21.15.110:0/1306123601 wait complete. 2024-09-16T02:15:29.925 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:29 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1306123601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:15:29.949 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-16T02:15:29.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:29 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1306123601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:15:30.195 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:15:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:30 smithi165 ceph-mon[77258]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:30 smithi110 ceph-mon[98215]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:31.869 INFO:teuthology.orchestra.run.smithi110.stdout:wait for servicemap items w/ changing names to refresh 2024-09-16T02:15:32.569 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'sleep 60' 2024-09-16T02:15:32.830 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:15:32.831 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:32 smithi110 ceph-mon[98215]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:32 smithi165 ceph-mon[77258]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:34 smithi165 ceph-mon[77258]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:34.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:34 smithi110 ceph-mon[98215]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T02:15:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:36 smithi165 ceph-mon[77258]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:36 smithi110 ceph-mon[98215]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:37.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:37.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:38 smithi165 ceph-mon[77258]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:38.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:38 smithi110 ceph-mon[98215]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:40 smithi165 ceph-mon[77258]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:40 smithi110 ceph-mon[98215]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:42.903 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:42 smithi110 ceph-mon[98215]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:42 smithi165 ceph-mon[77258]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:44 smithi165 ceph-mon[77258]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:44.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:44 smithi110 ceph-mon[98215]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:46 smithi165 ceph-mon[77258]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:46 smithi110 ceph-mon[98215]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:48 smithi165 ceph-mon[77258]: pgmap v231: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:48 smithi110 ceph-mon[98215]: pgmap v231: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:50 smithi165 ceph-mon[77258]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:50.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:50 smithi110 ceph-mon[98215]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:52 smithi165 ceph-mon[77258]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:52 smithi110 ceph-mon[98215]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:15:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:54 smithi165 ceph-mon[77258]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:54 smithi110 ceph-mon[98215]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:55.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:55 smithi165 ceph-mon[77258]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:55.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:55 smithi110 ceph-mon[98215]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:15:58.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:58 smithi110 ceph-mon[98215]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:58.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:15:58.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:15:58.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:15:58.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:15:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:15:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:58 smithi165 ceph-mon[77258]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:15:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:15:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:15:58.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:15:58.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:15:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:16:00.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:00 smithi110 ceph-mon[98215]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:00 smithi165 ceph-mon[77258]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:02.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:02 smithi110 ceph-mon[98215]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:02 smithi165 ceph-mon[77258]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:04 smithi165 ceph-mon[77258]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:04 smithi110 ceph-mon[98215]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:06 smithi165 ceph-mon[77258]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:06 smithi110 ceph-mon[98215]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:07.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:08 smithi165 ceph-mon[77258]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:08 smithi110 ceph-mon[98215]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:10 smithi165 ceph-mon[77258]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:10.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:10 smithi110 ceph-mon[98215]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:12 smithi110 ceph-mon[98215]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:12 smithi165 ceph-mon[77258]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:14 smithi165 ceph-mon[77258]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:14.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:14 smithi110 ceph-mon[98215]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:16 smithi165 ceph-mon[77258]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:16 smithi110 ceph-mon[98215]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:18.753 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:18 smithi165 ceph-mon[77258]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:18 smithi110 ceph-mon[98215]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:20 smithi165 ceph-mon[77258]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:20 smithi110 ceph-mon[98215]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:22 smithi110 ceph-mon[98215]: pgmap v248: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:22 smithi165 ceph-mon[77258]: pgmap v248: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:24 smithi165 ceph-mon[77258]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:24 smithi110 ceph-mon[98215]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:26 smithi165 ceph-mon[77258]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:26 smithi110 ceph-mon[98215]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:28.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:28 smithi165 ceph-mon[77258]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:28 smithi110 ceph-mon[98215]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:30.759 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:30 smithi110 ceph-mon[98215]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:30 smithi165 ceph-mon[77258]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:32.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:32 smithi110 ceph-mon[98215]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:32 smithi165 ceph-mon[77258]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:34.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:34 smithi110 ceph-mon[98215]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:34 smithi165 ceph-mon[77258]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:35.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch ps' 2024-09-16T02:16:35.369 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:36.658 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:36 smithi110 ceph-mon[98215]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:36 smithi165 ceph-mon[77258]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:37.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 -- 172.21.15.110:0/409659591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 msgr2=0x7fce9c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:37.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 --2- 172.21.15.110:0/409659591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c0fbbe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0048d0 tx=0x7fce8c009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 -- 172.21.15.110:0/409659591 shutdown_connections 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 --2- 172.21.15.110:0/409659591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c0fcf80 0x7fce9c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 --2- 172.21.15.110:0/409659591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c0fbbe0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 -- 172.21.15.110:0/409659591 >> 172.21.15.110:0/409659591 conn(0x7fce9c0723b0 msgr2=0x7fce9c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 -- 172.21.15.110:0/409659591 shutdown_connections 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 -- 172.21.15.110:0/409659591 wait complete. 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 Processor -- start 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.163+0000 7fcea29e4640 1 -- start start 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fcea29e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fcea29e4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c0fcf80 0x7fce9c10e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:37.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fcea29e4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c10ed30 con 0x7fce9c0fb810 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fcea29e4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c10eea0 con 0x7fce9c0fcf80 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c10e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36632/0 (socket says 172.21.15.110:36632) 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 -- 172.21.15.110:0/3060102676 learned_addr learned my addr 172.21.15.110:0/3060102676 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 -- 172.21.15.110:0/3060102676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c0fcf80 msgr2=0x7fce9c10e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c0fcf80 0x7fce9c10e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 -- 172.21.15.110:0/3060102676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c005040 con 0x7fce9c0fb810 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce9bfff640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c10e2b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0043d0 tx=0x7fce8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c038070 con 0x7fce9c0fb810 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c117180 con 0x7fce9c0fb810 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce8c0096e0 con 0x7fce9c0fb810 2024-09-16T02:16:37.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c03d420 con 0x7fce9c0fb810 2024-09-16T02:16:37.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.164+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c117610 con 0x7fce9c0fb810 2024-09-16T02:16:37.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.165+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c0fcbc0 con 0x7fce9c0fb810 2024-09-16T02:16:37.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.166+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fce8c030020 con 0x7fce9c0fb810 2024-09-16T02:16:37.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.166+0000 7fce997fa640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fce8806e530 0x7fce880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:37.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.166+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fce8c0ae800 con 0x7fce9c0fb810 2024-09-16T02:16:37.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.167+0000 7fce93fff640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fce8806e530 0x7fce880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:37.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.167+0000 7fce93fff640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fce8806e530 0x7fce880709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce84009af0 tx=0x7fce84009cd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:37.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.171+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce8c077820 con 0x7fce9c0fb810 2024-09-16T02:16:37.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.359+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 --> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce9c04b720 con 0x7fce8806e530 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.374+0000 7fce997fa640 1 -- 172.21.15.110:0/3060102676 <== mgr.34102 v2:172.21.15.110:6800/1811753471 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fce9c04b720 con 0x7fce8806e530 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stdout:alertmanager.smithi110 smithi110 *:9093,9094 running (10m) 2m ago 18m 25.2M - 0.25.0 c8568f914cd2 b3d0c56f831a 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi110 smithi110 running (6m) 2m ago 18m 6891k - 19.1.1-326-g8921c8ef f1455bd0219c ac15e6bd6f84 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stdout:crash.smithi165 smithi165 running (6m) 105s ago 17m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c b7c48494abe4 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stdout:grafana.smithi110 smithi110 *:3000 running (8m) 2m ago 18m 81.6M - 9.4.12 2bacad6d85d8 22ecc644af4d 2024-09-16T02:16:37.375 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.svegdg smithi110 running (2m) 2m ago 13m 12.7M - 19.1.1-326-g8921c8ef f1455bd0219c eebd9daf924f 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi110.yaugxw smithi110 running (2m) 2m ago 13m 13.1M - 19.1.1-326-g8921c8ef f1455bd0219c 228da41254bc 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.gxrypw smithi165 running (108s) 105s ago 13m 11.9M - 19.1.1-326-g8921c8ef f1455bd0219c 0edf2322c770 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mds.cephfs.smithi165.hskfht smithi165 running (2m) 105s ago 13m 13.1M - 19.1.1-326-g8921c8ef f1455bd0219c 583992a380a3 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi110.hfirap smithi110 *:8443,9283,8765 running (9m) 2m ago 19m 503M - 19.1.1-326-g8921c8ef f1455bd0219c 1fe290abac64 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.smithi165.afwhot smithi165 *:8443,9283,8765 running (8m) 105s ago 17m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 7e4c691fa773 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi110 smithi110 running (7m) 2m ago 20m 48.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c fdcdc064e607 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:mon.smithi165 smithi165 running (6m) 105s ago 17m 38.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c d551eee6c53c 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi110 smithi110 *:9100 running (10m) 2m ago 18m 17.4M - 1.5.0 0da6a335fe13 2128cf6a08ad 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:node-exporter.smithi165 smithi165 *:9100 running (9m) 105s ago 17m 16.6M - 1.5.0 0da6a335fe13 e855fd77096e 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (5m) 2m ago 16m 116M 1557M 19.1.1-326-g8921c8ef f1455bd0219c 49fe1eb49bf9 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi110 running (5m) 2m ago 16m 111M 1557M 19.1.1-326-g8921c8ef f1455bd0219c ce907e4f548a 2024-09-16T02:16:37.376 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi110 running (4m) 2m ago 16m 113M 1557M 19.1.1-326-g8921c8ef f1455bd0219c feb249c713be 2024-09-16T02:16:37.377 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi165 running (4m) 105s ago 15m 130M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 0a846f393eb0 2024-09-16T02:16:37.377 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi165 running (3m) 105s ago 15m 91.8M 2581M 19.1.1-326-g8921c8ef f1455bd0219c 8ed078cd81d0 2024-09-16T02:16:37.377 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi165 running (2m) 105s ago 14m 101M 2581M 19.1.1-326-g8921c8ef f1455bd0219c a01a4f216cf5 2024-09-16T02:16:37.377 INFO:teuthology.orchestra.run.smithi110.stdout:prometheus.smithi110 smithi110 *:9095 running (8m) 2m ago 18m 65.4M - 2.43.0 a07b618ecd1d e19f5653aa22 2024-09-16T02:16:37.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fce8806e530 msgr2=0x7fce880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:37.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fce8806e530 0x7fce880709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce84009af0 tx=0x7fce84009cd0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 msgr2=0x7fce9c10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c10e2b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0043d0 tx=0x7fce8c009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 shutdown_connections 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fce8806e530 0x7fce880709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c0fcf80 0x7fce9c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 --2- 172.21.15.110:0/3060102676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0fb810 0x7fce9c10e2b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 >> 172.21.15.110:0/3060102676 conn(0x7fce9c0723b0 msgr2=0x7fce9c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 shutdown_connections 2024-09-16T02:16:37.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:37.376+0000 7fcea29e4640 1 -- 172.21.15.110:0/3060102676 wait complete. 2024-09-16T02:16:37.836 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:37.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:38.005 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions' 2024-09-16T02:16:38.250 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:38.622 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:38 smithi110 ceph-mon[98215]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:16:38.622 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:38 smithi110 ceph-mon[98215]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:38 smithi165 ceph-mon[77258]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T02:16:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:38 smithi165 ceph-mon[77258]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 -- 172.21.15.110:0/4093031824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 msgr2=0x7fe6b00fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 --2- 172.21.15.110:0/4093031824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b00fb040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe6980048d0 tx=0x7fe698009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 -- 172.21.15.110:0/4093031824 shutdown_connections 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 --2- 172.21.15.110:0/4093031824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b00fb040 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 --2- 172.21.15.110:0/4093031824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6b0102680 0x7fe6b0102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 -- 172.21.15.110:0/4093031824 >> 172.21.15.110:0/4093031824 conn(0x7fe6b0071ac0 msgr2=0x7fe6b0071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 -- 172.21.15.110:0/4093031824 shutdown_connections 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.842+0000 7fe6b558e640 1 -- 172.21.15.110:0/4093031824 wait complete. 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6b558e640 1 Processor -- start 2024-09-16T02:16:39.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6b558e640 1 -- start start 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6b558e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b0113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6b558e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6b0102680 0x7fe6b01137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6b558e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b0113da0 con 0x7fe6b00fabd0 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6b558e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b010d1e0 con 0x7fe6b0102680 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b0113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b0113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36650/0 (socket says 172.21.15.110:36650) 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 -- 172.21.15.110:0/1801324927 learned_addr learned my addr 172.21.15.110:0/1801324927 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6a7fff640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6b0102680 0x7fe6b01137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 -- 172.21.15.110:0/1801324927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6b0102680 msgr2=0x7fe6b01137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6b0102680 0x7fe6b01137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 -- 172.21.15.110:0/1801324927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe698005040 con 0x7fe6b00fabd0 2024-09-16T02:16:39.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.843+0000 7fe6aeffd640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b0113260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c790 tx=0x7fe6a00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.844+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6a000a820 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.844+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6a000ae20 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.844+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6a00113a0 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.844+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b010d4c0 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.844+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b010da30 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.845+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b00725d0 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.845+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe6a0012400 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.845+0000 7fe6a77fe640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe69c06e530 0x7fe69c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.846+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fe6a008e3f0 con 0x7fe6b00fabd0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.846+0000 7fe6a7fff640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe69c06e530 0x7fe69c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:39.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.846+0000 7fe6a7fff640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe69c06e530 0x7fe69c0709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00f8d90 tx=0x7fe698035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:39.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:39.850+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe6a0057490 con 0x7fe6b00fabd0 2024-09-16T02:16:40.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.082+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe6b004b720 con 0x7fe6b00fabd0 2024-09-16T02:16:40.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.083+0000 7fe6a77fe640 1 -- 172.21.15.110:0/1801324927 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe6a000a980 con 0x7fe6b00fabd0 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": { 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": { 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": { 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-16T02:16:40.085 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T02:16:40.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-16T02:16:40.086 INFO:teuthology.orchestra.run.smithi110.stdout: "overall": { 2024-09-16T02:16:40.086 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T02:16:40.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-16T02:16:40.086 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe69c06e530 msgr2=0x7fe69c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe69c06e530 0x7fe69c0709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00f8d90 tx=0x7fe698035040 comp rx=0 tx=0).stop 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 msgr2=0x7fe6b0113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b0113260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c790 tx=0x7fe6a00043c0 comp rx=0 tx=0).stop 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 shutdown_connections 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe69c06e530 0x7fe69c0709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6b0102680 0x7fe6b01137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 --2- 172.21.15.110:0/1801324927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6b00fabd0 0x7fe6b0113260 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 >> 172.21.15.110:0/1801324927 conn(0x7fe6b0071ac0 msgr2=0x7fe6b0105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 shutdown_connections 2024-09-16T02:16:40.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:40.085+0000 7fe6b558e640 1 -- 172.21.15.110:0/1801324927 wait complete. 2024-09-16T02:16:40.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:40 smithi110 ceph-mon[98215]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:40.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:40 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1801324927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:16:40.719 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-16T02:16:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:40 smithi165 ceph-mon[77258]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:40 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1801324927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:16:40.961 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:42.576 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:42 smithi110 ceph-mon[98215]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 -- 172.21.15.110:0/960731629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102ef0 msgr2=0x7fb3900fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 --2- 172.21.15.110:0/960731629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102ef0 0x7fb3900fc5b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb3840048d0 tx=0x7fb384009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 -- 172.21.15.110:0/960731629 shutdown_connections 2024-09-16T02:16:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 --2- 172.21.15.110:0/960731629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102ef0 0x7fb3900fc5b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 --2- 172.21.15.110:0/960731629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb390102550 0x7fb390102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 -- 172.21.15.110:0/960731629 >> 172.21.15.110:0/960731629 conn(0x7fb3900f80f0 msgr2=0x7fb3900fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 -- 172.21.15.110:0/960731629 shutdown_connections 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 -- 172.21.15.110:0/960731629 wait complete. 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.574+0000 7fb39685b640 1 Processor -- start 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb39685b640 1 -- start start 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb39685b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 0x7fb390113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb39685b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb390102ef0 0x7fb390113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb39685b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901140a0 con 0x7fb390102550 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb39685b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39010d4b0 con 0x7fb390102ef0 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 0x7fb390113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 0x7fb390113510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53978/0 (socket says 172.21.15.110:53978) 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38ffff640 1 -- 172.21.15.110:0/538234440 learned_addr learned my addr 172.21.15.110:0/538234440 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:42.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38f7fe640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb390102ef0 0x7fb390113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38ffff640 1 -- 172.21.15.110:0/538234440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb390102ef0 msgr2=0x7fb390113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38ffff640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb390102ef0 0x7fb390113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.575+0000 7fb38ffff640 1 -- 172.21.15.110:0/538234440 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384005040 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.576+0000 7fb38ffff640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 0x7fb390113510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c830 tx=0x7fb380004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.576+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38000a850 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.576+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb38000ae50 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.576+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39010d790 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.576+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3800113a0 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.576+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39010dd30 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.577+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3900fdcd0 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.577+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb380012400 con 0x7fb390102550 2024-09-16T02:16:42.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.578+0000 7fb38cff9640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb37806e530 0x7fb3780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:42.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.578+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fb38008e480 con 0x7fb390102550 2024-09-16T02:16:42.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.578+0000 7fb38f7fe640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb37806e530 0x7fb3780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:42.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.578+0000 7fb38f7fe640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb37806e530 0x7fb3780709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb39010e790 tx=0x7fb384009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:42.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.582+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb380057520 con 0x7fb390102550 2024-09-16T02:16:42.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.815+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb39004b720 con 0x7fb390102550 2024-09-16T02:16:42.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.815+0000 7fb38cff9640 1 -- 172.21.15.110:0/538234440 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb38005abe0 con 0x7fb390102550 2024-09-16T02:16:42.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb37806e530 msgr2=0x7fb3780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb37806e530 0x7fb3780709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb39010e790 tx=0x7fb384009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 msgr2=0x7fb390113510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 0x7fb390113510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c830 tx=0x7fb380004430 comp rx=0 tx=0).stop 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 shutdown_connections 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb37806e530 0x7fb3780709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb390102ef0 0x7fb390113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 --2- 172.21.15.110:0/538234440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb390102550 0x7fb390113510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 >> 172.21.15.110:0/538234440 conn(0x7fb3900f80f0 msgr2=0x7fb3900f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 shutdown_connections 2024-09-16T02:16:42.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:42.817+0000 7fb39685b640 1 -- 172.21.15.110:0/538234440 wait complete. 2024-09-16T02:16:42.827 INFO:teuthology.orchestra.run.smithi110.stdout:true 2024-09-16T02:16:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:42 smithi165 ceph-mon[77258]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:43.475 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-16T02:16:43.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:43 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/538234440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:16:43.720 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:43.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:43 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/538234440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:16:44.732 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:44 smithi110 ceph-mon[98215]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:44 smithi165 ceph-mon[77258]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:45.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 -- 172.21.15.110:0/3413003478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 msgr2=0x7f957c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:45.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 --2- 172.21.15.110:0/3413003478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c101890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f956c0048d0 tx=0x7f956c009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 -- 172.21.15.110:0/3413003478 shutdown_connections 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 --2- 172.21.15.110:0/3413003478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 0x7f957c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 --2- 172.21.15.110:0/3413003478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c101890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 -- 172.21.15.110:0/3413003478 >> 172.21.15.110:0/3413003478 conn(0x7f957c0f7000 msgr2=0x7f957c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 -- 172.21.15.110:0/3413003478 shutdown_connections 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.227+0000 7f9581570640 1 -- 172.21.15.110:0/3413003478 wait complete. 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f9581570640 1 Processor -- start 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f9581570640 1 -- start start 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f9581570640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 0x7f957c112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f9581570640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c112660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f9581570640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c112cf0 con 0x7f957c1014c0 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f9581570640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c10c0a0 con 0x7f957c0fb480 2024-09-16T02:16:45.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957a7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c112660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957a7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c112660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53982/0 (socket says 172.21.15.110:53982) 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957a7fc640 1 -- 172.21.15.110:0/816350959 learned_addr learned my addr 172.21.15.110:0/816350959 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957affd640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 0x7f957c112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957a7fc640 1 -- 172.21.15.110:0/816350959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 msgr2=0x7f957c112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957a7fc640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 0x7f957c112120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957a7fc640 1 -- 172.21.15.110:0/816350959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c005040 con 0x7f957c1014c0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.228+0000 7f957affd640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 0x7f957c112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.229+0000 7f957a7fc640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c112660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f957000daf0 tx=0x7f957000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.229+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957000edb0 con 0x7f957c1014c0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.229+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9570017910 con 0x7f957c1014c0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.229+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c10c320 con 0x7f957c1014c0 2024-09-16T02:16:45.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.229+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95700169f0 con 0x7f957c1014c0 2024-09-16T02:16:45.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.229+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c10c840 con 0x7f957c1014c0 2024-09-16T02:16:45.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.230+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957c0fcbc0 con 0x7f957c1014c0 2024-09-16T02:16:45.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.230+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9570014070 con 0x7f957c1014c0 2024-09-16T02:16:45.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.231+0000 7f95637fe640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f956406e530 0x7f95640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:45.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.231+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f9570090610 con 0x7f957c1014c0 2024-09-16T02:16:45.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.231+0000 7f957affd640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f956406e530 0x7f95640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:45.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.231+0000 7f957affd640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f956406e530 0x7f95640709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b020 tx=0x7f956c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:45.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.235+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9570059650 con 0x7f957c1014c0 2024-09-16T02:16:45.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.467+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f957c108520 con 0x7f957c1014c0 2024-09-16T02:16:45.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.467+0000 7f95637fe640 1 -- 172.21.15.110:0/816350959 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f957005cd10 con 0x7f957c1014c0 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.469+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f956406e530 msgr2=0x7f95640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.469+0000 7f9581570640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f956406e530 0x7f95640709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b020 tx=0x7f956c009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.469+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 msgr2=0x7f957c112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.469+0000 7f9581570640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c112660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f957000daf0 tx=0x7f957000b460 comp rx=0 tx=0).stop 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 shutdown_connections 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f956406e530 0x7f95640709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f957c1014c0 0x7f957c112660 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 --2- 172.21.15.110:0/816350959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f957c0fb480 0x7f957c112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:45.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 >> 172.21.15.110:0/816350959 conn(0x7f957c0f7000 msgr2=0x7f957c0f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:45.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 shutdown_connections 2024-09-16T02:16:45.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:45.470+0000 7f9581570640 1 -- 172.21.15.110:0/816350959 wait complete. 2024-09-16T02:16:45.479 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)" 2024-09-16T02:16:45.763 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:45 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/816350959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:16:45.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:45 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/816350959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T02:16:46.096 DEBUG:teuthology.parallel:result is None 2024-09-16T02:16:46.096 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T02:16:46.110 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:16:46.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T02:16:46.351 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:46.734 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:46 smithi110 ceph-mon[98215]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:46 smithi165 ceph-mon[77258]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 -- 172.21.15.110:0/2230093059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102ed0 msgr2=0x7f47600fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 --2- 172.21.15.110:0/2230093059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102ed0 0x7f47600fc590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f47540048d0 tx=0x7f4754009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 -- 172.21.15.110:0/2230093059 shutdown_connections 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 --2- 172.21.15.110:0/2230093059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102ed0 0x7f47600fc590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 --2- 172.21.15.110:0/2230093059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4760102530 0x7f4760102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 -- 172.21.15.110:0/2230093059 >> 172.21.15.110:0/2230093059 conn(0x7f47600f80f0 msgr2=0x7f47600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 -- 172.21.15.110:0/2230093059 shutdown_connections 2024-09-16T02:16:48.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.125+0000 7f4765e4d640 1 -- 172.21.15.110:0/2230093059 wait complete. 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f4765e4d640 1 Processor -- start 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f4765e4d640 1 -- start start 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f4765e4d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 0x7f476006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f4765e4d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4760102ed0 0x7f476006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f4765e4d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760070490 con 0x7f4760102530 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f4765e4d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760070600 con 0x7f4760102ed0 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 0x7f476006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 0x7f476006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53990/0 (socket says 172.21.15.110:53990) 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f475f7fe640 1 -- 172.21.15.110:0/78431286 learned_addr learned my addr 172.21.15.110:0/78431286 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f475effd640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4760102ed0 0x7f476006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f475f7fe640 1 -- 172.21.15.110:0/78431286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4760102ed0 msgr2=0x7f476006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:48.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.126+0000 7f475f7fe640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4760102ed0 0x7f476006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f475f7fe640 1 -- 172.21.15.110:0/78431286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754005040 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f475f7fe640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 0x7f476006fa10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4750002a80 tx=0x7f4750004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4750007c30 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4760070890 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f475000f040 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4750009530 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.127+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4760119850 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.128+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47600fdcb0 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.128+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f47500097a0 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.129+0000 7f4747fff640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f474806e530 0x7f47480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.129+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f475008dc50 con 0x7f4760102530 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.129+0000 7f475effd640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f474806e530 0x7f47480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.129+0000 7f475effd640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f474806e530 0x7f47480709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4754000c00 tx=0x7f4754035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:48.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.133+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4750056c70 con 0x7f4760102530 2024-09-16T02:16:48.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.335+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4760071100 con 0x7f4760102530 2024-09-16T02:16:48.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.335+0000 7f4747fff640 1 -- 172.21.15.110:0/78431286 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+2006 (secure 0 0 0) 0x7f475005a330 con 0x7f4760102530 2024-09-16T02:16:48.336 INFO:teuthology.orchestra.run.smithi110.stdout:e36 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:btime 2024-09-16T02:14:57:601730+0000 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 36 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-16T02:03:08.960050+0000 2024-09-16T02:16:48.337 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-16T02:14:57.601720+0000 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 60 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 90 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 1 2024-09-16T02:16:48.338 INFO:teuthology.orchestra.run.smithi110.stdout:in 0 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=34380} 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data enabled 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 1 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 34380 members: 34380 2024-09-16T02:16:48.339 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.yaugxw{0:34380} state up:active seq 15 join_fscid=1 addr [v2:172.21.15.110:6826/3147803170,v1:172.21.15.110:6827/3147803170] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi110.svegdg{0:34412} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.110:6828/926668832,v1:172.21.15.110:6829/926668832] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.hskfht{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/2342221402,v1:172.21.15.165:6825/2342221402] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:16:48.340 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.cephfs.smithi165.gxrypw{-1:44333} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/3028375374,v1:172.21.15.165:6827/3028375374] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 36 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f474806e530 msgr2=0x7f47480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f474806e530 0x7f47480709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4754000c00 tx=0x7f4754035040 comp rx=0 tx=0).stop 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 msgr2=0x7f476006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 0x7f476006fa10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4750002a80 tx=0x7f4750004600 comp rx=0 tx=0).stop 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 shutdown_connections 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f474806e530 0x7f47480709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4760102ed0 0x7f476006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 --2- 172.21.15.110:0/78431286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760102530 0x7f476006fa10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 >> 172.21.15.110:0/78431286 conn(0x7f47600f80f0 msgr2=0x7f47600f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 shutdown_connections 2024-09-16T02:16:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:48.337+0000 7f4765e4d640 1 -- 172.21.15.110:0/78431286 wait complete. 2024-09-16T02:16:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:48 smithi110 ceph-mon[98215]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:48.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:48 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/78431286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:16:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:48 smithi165 ceph-mon[77258]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:48 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/78431286' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T02:16:49.019 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-16T02:16:49.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T02:16:49.277 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:50.771 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:50 smithi110 ceph-mon[98215]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:50 smithi165 ceph-mon[77258]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:51.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 -- 172.21.15.110:0/363802812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 msgr2=0x7f822c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:51.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 --2- 172.21.15.110:0/363802812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c0fc5b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82200048d0 tx=0x7f8220009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 -- 172.21.15.110:0/363802812 shutdown_connections 2024-09-16T02:16:51.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 --2- 172.21.15.110:0/363802812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c0fc5b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 --2- 172.21.15.110:0/363802812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 0x7f822c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 -- 172.21.15.110:0/363802812 >> 172.21.15.110:0/363802812 conn(0x7f822c0f80f0 msgr2=0x7f822c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 -- 172.21.15.110:0/363802812 shutdown_connections 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 -- 172.21.15.110:0/363802812 wait complete. 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 Processor -- start 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 -- start start 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 0x7f822c1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.988+0000 7f823252d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f823252d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c1141d0 con 0x7f822c102ef0 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f823252d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c10d550 con 0x7f822c102550 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60990/0 (socket says 172.21.15.110:60990) 2024-09-16T02:16:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 -- 172.21.15.110:0/378539522 learned_addr learned my addr 172.21.15.110:0/378539522 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822bfff640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 0x7f822c1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 -- 172.21.15.110:0/378539522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 msgr2=0x7f822c1135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 0x7f822c1135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 -- 172.21.15.110:0/378539522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220005040 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822bfff640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 0x7f822c1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f822b7fe640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c113af0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8220003080 tx=0x7f8220009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8220038070 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8220009760 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c10d780 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8220033420 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.989+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c10dbe0 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.990+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c0fdcd0 con 0x7f822c102ef0 2024-09-16T02:16:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.991+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8220030020 con 0x7f822c102ef0 2024-09-16T02:16:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.991+0000 7f8228ff9640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f821406e530 0x7f82140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.991+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f82200ae000 con 0x7f822c102ef0 2024-09-16T02:16:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.991+0000 7f822bfff640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f821406e530 0x7f82140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.992+0000 7f822bfff640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f821406e530 0x7f82140709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f821c006fd0 tx=0x7f821c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:50.996+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8220077020 con 0x7f822c102ef0 2024-09-16T02:16:51.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.195+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f822c04b720 con 0x7f822c102ef0 2024-09-16T02:16:51.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.195+0000 7f8228ff9640 1 -- 172.21.15.110:0/378539522 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5266 (secure 0 0 0) 0x7f822007a6e0 con 0x7f822c102ef0 2024-09-16T02:16:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:51.197 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":36,"btime":"2024-09-16T02:14:57:601730+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:57.601720+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-16T02:16:51.197 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 36 2024-09-16T02:16:51.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f821406e530 msgr2=0x7f82140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:51.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f821406e530 0x7f82140709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f821c006fd0 tx=0x7f821c008040 comp rx=0 tx=0).stop 2024-09-16T02:16:51.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 msgr2=0x7f822c113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:51.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c113af0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8220003080 tx=0x7f8220009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 shutdown_connections 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f821406e530 0x7f82140709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f822c102ef0 0x7f822c113af0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 --2- 172.21.15.110:0/378539522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c102550 0x7f822c1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 >> 172.21.15.110:0/378539522 conn(0x7f822c0f80f0 msgr2=0x7f822c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 shutdown_connections 2024-09-16T02:16:51.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:51.198+0000 7f823252d640 1 -- 172.21.15.110:0/378539522 wait complete. 2024-09-16T02:16:51.933 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:51 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/378539522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T02:16:51.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:51 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/378539522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T02:16:51.959 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 1, 'flags': 50} 2024-09-16T02:16:51.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-16T02:16:52.206 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:52.636 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:52 smithi110 ceph-mon[98215]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:52.637 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:52 smithi165 ceph-mon[77258]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:16:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 -- 172.21.15.110:0/1330130852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 msgr2=0x7f4bf806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 --2- 172.21.15.110:0/1330130852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf806fab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40048d0 tx=0x7f4bf4009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 -- 172.21.15.110:0/1330130852 shutdown_connections 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 --2- 172.21.15.110:0/1330130852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 0x7f4bf8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 --2- 172.21.15.110:0/1330130852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf806fab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 -- 172.21.15.110:0/1330130852 >> 172.21.15.110:0/1330130852 conn(0x7f4bf80f80f0 msgr2=0x7f4bf80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 -- 172.21.15.110:0/1330130852 shutdown_connections 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.895+0000 7f4c000e4640 1 -- 172.21.15.110:0/1330130852 wait complete. 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4c000e4640 1 Processor -- start 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4c000e4640 1 -- start start 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4c000e4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 0x7f4bf8119b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4c000e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf811a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4c000e4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf811a730 con 0x7f4bf80716e0 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4c000e4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8113b70 con 0x7f4bf806fff0 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfd67f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf811a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfd67f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf811a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32776/0 (socket says 172.21.15.110:32776) 2024-09-16T02:16:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfd67f640 1 -- 172.21.15.110:0/4045789806 learned_addr learned my addr 172.21.15.110:0/4045789806 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfde80640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 0x7f4bf8119b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfd67f640 1 -- 172.21.15.110:0/4045789806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 msgr2=0x7f4bf8119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfd67f640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 0x7f4bf8119b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfd67f640 1 -- 172.21.15.110:0/4045789806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4005040 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.896+0000 7f4bfde80640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 0x7f4bf8119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.897+0000 7f4bfd67f640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf811a0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4be800b790 tx=0x7f4be80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.897+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be800c700 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.897+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4be800cd00 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.897+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf8113e50 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.897+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be8015e70 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.897+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf8114370 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.898+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf80711f0 con 0x7f4bf80716e0 2024-09-16T02:16:53.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.898+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4be8012070 con 0x7f4bf80716e0 2024-09-16T02:16:53.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.899+0000 7f4bee7fc640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4be406e530 0x7f4be40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:53.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.899+0000 7f4bfde80640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4be406e530 0x7f4be40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:53.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.899+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f4be808de50 con 0x7f4bf80716e0 2024-09-16T02:16:53.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.900+0000 7f4bfde80640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4be406e530 0x7f4be40709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40048a0 tx=0x7f4bf4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:53.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:53.903+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4be8056e70 con 0x7f4bf80716e0 2024-09-16T02:16:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.106+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f4bf80fbd50 con 0x7f4bf80716e0 2024-09-16T02:16:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.106+0000 7f4bee7fc640 1 -- 172.21.15.110:0/4045789806 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v36) v1 ==== 107+0+4914 (secure 0 0 0) 0x7f4be805a530 con 0x7f4bf80716e0 2024-09-16T02:16:54.108 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:54.108 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":16,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:03:24.623988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14444":{"gid":14444,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6827/3304502676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3304502676},{"type":"v1","addr":"172.21.15.110:6827","nonce":3304502676}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14454":{"gid":14454,"name":"cephfs.smithi110.svegdg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.110:6829/1889333536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1889333536},{"type":"v1","addr":"172.21.15.110:6829","nonce":1889333536}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:16:54.108 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4be406e530 msgr2=0x7f4be40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4be406e530 0x7f4be40709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40048a0 tx=0x7f4bf4009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 msgr2=0x7f4bf811a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf811a0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4be800b790 tx=0x7f4be80091d0 comp rx=0 tx=0).stop 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 shutdown_connections 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f4be406e530 0x7f4be40709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bf80716e0 0x7f4bf811a0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 --2- 172.21.15.110:0/4045789806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf806fff0 0x7f4bf8119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.108+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 >> 172.21.15.110:0/4045789806 conn(0x7f4bf80f80f0 msgr2=0x7f4bf80f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.109+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 shutdown_connections 2024-09-16T02:16:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:54.109+0000 7f4c000e4640 1 -- 172.21.15.110:0/4045789806 wait complete. 2024-09-16T02:16:54.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:54 smithi110 ceph-mon[98215]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:54.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:54 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/4045789806' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-16T02:16:54.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-16T02:16:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:54 smithi165 ceph-mon[77258]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:54 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/4045789806' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-16T02:16:54.983 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 -- 172.21.15.110:0/2853242980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 msgr2=0x7f30500fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 --2- 172.21.15.110:0/2853242980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f30500fb920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f30400048d0 tx=0x7f3040009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 -- 172.21.15.110:0/2853242980 shutdown_connections 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 --2- 172.21.15.110:0/2853242980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f30500fb920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 --2- 172.21.15.110:0/2853242980 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30501014f0 0x7f30501018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 -- 172.21.15.110:0/2853242980 >> 172.21.15.110:0/2853242980 conn(0x7f30500f7030 msgr2=0x7f30500f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 -- 172.21.15.110:0/2853242980 shutdown_connections 2024-09-16T02:16:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.679+0000 7f3057f27640 1 -- 172.21.15.110:0/2853242980 wait complete. 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3057f27640 1 Processor -- start 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3057f27640 1 -- start start 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3057f27640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f305010e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3057f27640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30501014f0 0x7f305010e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3057f27640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305010edb0 con 0x7f30500fb4b0 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3057f27640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305010ef20 con 0x7f30501014f0 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f305010e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f305010e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32784/0 (socket says 172.21.15.110:32784) 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 -- 172.21.15.110:0/1390632086 learned_addr learned my addr 172.21.15.110:0/1390632086 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f30554c2640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30501014f0 0x7f305010e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 -- 172.21.15.110:0/1390632086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30501014f0 msgr2=0x7f305010e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30501014f0 0x7f305010e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 -- 172.21.15.110:0/1390632086 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040005040 con 0x7f30500fb4b0 2024-09-16T02:16:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.680+0000 7f3055cc3640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f305010e330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f304c00b790 tx=0x7f304c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.681+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304c00c700 con 0x7f30500fb4b0 2024-09-16T02:16:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.681+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3050117260 con 0x7f30500fb4b0 2024-09-16T02:16:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.681+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f304c00cd00 con 0x7f30500fb4b0 2024-09-16T02:16:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.681+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304c013370 con 0x7f30500fb4b0 2024-09-16T02:16:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.681+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3050117780 con 0x7f30500fb4b0 2024-09-16T02:16:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.682+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30500fcbf0 con 0x7f30500fb4b0 2024-09-16T02:16:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.682+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f304c012070 con 0x7f30500fb4b0 2024-09-16T02:16:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.683+0000 7f30467fc640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f303c06e530 0x7f303c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.683+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f304c08dec0 con 0x7f30500fb4b0 2024-09-16T02:16:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.683+0000 7f30554c2640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f303c06e530 0x7f303c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.683+0000 7f30554c2640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f303c06e530 0x7f303c0709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f30500664f0 tx=0x7f3040035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:56.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.687+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f304c056ee0 con 0x7f30500fb4b0 2024-09-16T02:16:56.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.890+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f30501084f0 con 0x7f30500fb4b0 2024-09-16T02:16:56.892 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:56 smithi110 ceph-mon[98215]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:56.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.891+0000 7f30467fc640 1 -- 172.21.15.110:0/1390632086 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+4135 (secure 0 0 0) 0x7f304c05a5a0 con 0x7f30500fb4b0 2024-09-16T02:16:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:56.893 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"btime":"2024-09-16T02:13:48:660289+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:13:48.660284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14444":{"gid":14444,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6827/3304502676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3304502676},{"type":"v1","addr":"172.21.15.110:6827","nonce":3304502676}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14444,"qdb_cluster":[14444]},"id":1}]} 2024-09-16T02:16:56.893 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 17 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f303c06e530 msgr2=0x7f303c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f303c06e530 0x7f303c0709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f30500664f0 tx=0x7f3040035040 comp rx=0 tx=0).stop 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 msgr2=0x7f305010e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f305010e330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f304c00b790 tx=0x7f304c0091d0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 shutdown_connections 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f303c06e530 0x7f303c0709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30501014f0 0x7f305010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 --2- 172.21.15.110:0/1390632086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30500fb4b0 0x7f305010e330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:56.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.893+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 >> 172.21.15.110:0/1390632086 conn(0x7f30500f7030 msgr2=0x7f30500f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:56.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.894+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 shutdown_connections 2024-09-16T02:16:56.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:56.894+0000 7f3057f27640 1 -- 172.21.15.110:0/1390632086 wait complete. 2024-09-16T02:16:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:56 smithi165 ceph-mon[77258]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:16:57.625 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-16T02:16:57.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-16T02:16:57.648 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:57 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1390632086' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-16T02:16:57.871 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:16:57.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:57 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1390632086' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-16T02:16:58.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:58 smithi165 ceph-mon[77258]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:58.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:58 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:16:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:58 smithi110 ceph-mon[98215]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:16:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:58 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:16:59.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 -- 172.21.15.110:0/1391921891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 msgr2=0x7f28840fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:59.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 --2- 172.21.15.110:0/1391921891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f28840fd3d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f286c0048d0 tx=0x7f286c009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 -- 172.21.15.110:0/1391921891 shutdown_connections 2024-09-16T02:16:59.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 --2- 172.21.15.110:0/1391921891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f28840fd3d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 --2- 172.21.15.110:0/1391921891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28840fb810 0x7f28840fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 -- 172.21.15.110:0/1391921891 >> 172.21.15.110:0/1391921891 conn(0x7f28840723b0 msgr2=0x7f28840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 -- 172.21.15.110:0/1391921891 shutdown_connections 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 -- 172.21.15.110:0/1391921891 wait complete. 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.528+0000 7f2889ae7640 1 Processor -- start 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2889ae7640 1 -- start start 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2889ae7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28840fb810 0x7f288410e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2889ae7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f288410e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2889ae7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288410ed50 con 0x7f28840fcf80 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2889ae7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288410eec0 con 0x7f28840fb810 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f288410e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f288410e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32798/0 (socket says 172.21.15.110:32798) 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 -- 172.21.15.110:0/2975860414 learned_addr learned my addr 172.21.15.110:0/2975860414 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:16:59.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f28837fe640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28840fb810 0x7f288410e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 -- 172.21.15.110:0/2975860414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28840fb810 msgr2=0x7f288410e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28840fb810 0x7f288410e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 -- 172.21.15.110:0/2975860414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c005040 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.529+0000 7f2882ffd640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f288410e810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f286c003080 tx=0x7f286c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.530+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c038070 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.530+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28841171a0 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.530+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f286c0097e0 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.530+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c03d420 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.530+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2884117660 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.531+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28840fcbc0 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.531+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f286c030020 con 0x7f28840fcf80 2024-09-16T02:16:59.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.532+0000 7f287bfff640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f287006e530 0x7f28700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:16:59.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.532+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f286c0ae7f0 con 0x7f28840fcf80 2024-09-16T02:16:59.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.532+0000 7f28837fe640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f287006e530 0x7f28700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:16:59.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.532+0000 7f28837fe640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f287006e530 0x7f28700709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f287c0041d0 tx=0x7f287c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:16:59.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.536+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f286c077810 con 0x7f28840fcf80 2024-09-16T02:16:59.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:16:59.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:16:59.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:16:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:16:59.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.741+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f2884072ec0 con 0x7f28840fcf80 2024-09-16T02:16:59.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.741+0000 7f287bfff640 1 -- 172.21.15.110:0/2975860414 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4914 (secure 0 0 0) 0x7f286c07aed0 con 0x7f28840fcf80 2024-09-16T02:16:59.744 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:16:59.744 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"btime":"2024-09-16T02:13:49:673832+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/591551052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":591551052},{"type":"v1","addr":"172.21.15.110:6829","nonce":591551052}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:13:48.660284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14444":{"gid":14444,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6827/3304502676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3304502676},{"type":"v1","addr":"172.21.15.110:6827","nonce":3304502676}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14444,"qdb_cluster":[14444]},"id":1}]} 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 18 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.743+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f287006e530 msgr2=0x7f28700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.743+0000 7f2889ae7640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f287006e530 0x7f28700709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f287c0041d0 tx=0x7f287c009040 comp rx=0 tx=0).stop 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.743+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 msgr2=0x7f288410e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f288410e810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f286c003080 tx=0x7f286c009da0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 shutdown_connections 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f287006e530 0x7f28700709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28840fcf80 0x7f288410e810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 --2- 172.21.15.110:0/2975860414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28840fb810 0x7f288410e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:16:59.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 >> 172.21.15.110:0/2975860414 conn(0x7f28840723b0 msgr2=0x7f28840fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:16:59.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 shutdown_connections 2024-09-16T02:16:59.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:16:59.744+0000 7f2889ae7640 1 -- 172.21.15.110:0/2975860414 wait complete. 2024-09-16T02:16:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:16:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:16:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:16:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:17:00.466 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-16T02:17:00.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-16T02:17:00.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:00 smithi110 ceph-mon[98215]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:00.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:00 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2975860414' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-16T02:17:00.754 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:00 smithi165 ceph-mon[77258]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:00 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2975860414' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1739201805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 msgr2=0x7fa3640fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1739201805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa3640fc590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa3600048d0 tx=0x7fa360009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1739201805 shutdown_connections 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1739201805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa3640fc590 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1739201805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 0x7fa364102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1739201805 >> 172.21.15.110:0/1739201805 conn(0x7fa3640f80f0 msgr2=0x7fa3640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1739201805 shutdown_connections 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1739201805 wait complete. 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 Processor -- start 2024-09-16T02:17:02.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.253+0000 7fa36bf8f640 1 -- start start 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36bf8f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 0x7fa36406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36bf8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa36406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36bf8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364070490 con 0x7fa364102ed0 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36bf8f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364070600 con 0x7fa364102530 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa36406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa36406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44592/0 (socket says 172.21.15.110:44592) 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 -- 172.21.15.110:0/1903902672 learned_addr learned my addr 172.21.15.110:0/1903902672 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa369d2b640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 0x7fa36406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 -- 172.21.15.110:0/1903902672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 msgr2=0x7fa36406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 0x7fa36406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 -- 172.21.15.110:0/1903902672 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360005040 con 0x7fa364102ed0 2024-09-16T02:17:02.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa369d2b640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 0x7fa36406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36952a640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa36406ff50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa36002a530 tx=0x7fa360009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa360038070 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa364070830 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.254+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa36002ade0 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.255+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36002c810 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.255+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa364119870 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.256+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3640fdcb0 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.257+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa360030020 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.257+0000 7fa3567fc640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa35006e530 0x7fa3500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.257+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fa3600adf90 con 0x7fa364102ed0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.257+0000 7fa369d2b640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa35006e530 0x7fa3500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.257+0000 7fa369d2b640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa35006e530 0x7fa3500709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa358004d80 tx=0x7fa35800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:02.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.266+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa360076fb0 con 0x7fa364102ed0 2024-09-16T02:17:02.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.469+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fa36404b720 con 0x7fa364102ed0 2024-09-16T02:17:02.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.470+0000 7fa3567fc640 1 -- 172.21.15.110:0/1903902672 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4114 (secure 0 0 0) 0x7fa36007a670 con 0x7fa364102ed0 2024-09-16T02:17:02.471 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:02.471 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":19,"btime":"2024-09-16T02:13:52:401766+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/591551052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":591551052},{"type":"v1","addr":"172.21.15.110:6829","nonce":591551052}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:13:52.401764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:02.472 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 19 2024-09-16T02:17:02.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa35006e530 msgr2=0x7fa3500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:02.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa35006e530 0x7fa3500709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa358004d80 tx=0x7fa35800b040 comp rx=0 tx=0).stop 2024-09-16T02:17:02.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 msgr2=0x7fa36406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa36406ff50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa36002a530 tx=0x7fa360009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 shutdown_connections 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa35006e530 0x7fa3500709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa364102ed0 0x7fa36406ff50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 --2- 172.21.15.110:0/1903902672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa364102530 0x7fa36406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 >> 172.21.15.110:0/1903902672 conn(0x7fa3640f80f0 msgr2=0x7fa3640f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 shutdown_connections 2024-09-16T02:17:02.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:02.472+0000 7fa36bf8f640 1 -- 172.21.15.110:0/1903902672 wait complete. 2024-09-16T02:17:02.885 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:02 smithi110 ceph-mon[98215]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:02.886 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:02 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1903902672' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-16T02:17:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:02 smithi165 ceph-mon[77258]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:02 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1903902672' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-16T02:17:03.105 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-16T02:17:03.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-16T02:17:03.354 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:04.783 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:04 smithi110 ceph-mon[98215]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:04 smithi165 ceph-mon[77258]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:04.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 -- 172.21.15.110:0/1630959594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fcf80 msgr2=0x7f631c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:04.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 --2- 172.21.15.110:0/1630959594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fcf80 0x7f631c0fd3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f63040048d0 tx=0x7f6304009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 -- 172.21.15.110:0/1630959594 shutdown_connections 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 --2- 172.21.15.110:0/1630959594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fcf80 0x7f631c0fd3d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 --2- 172.21.15.110:0/1630959594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f631c0fb810 0x7f631c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 -- 172.21.15.110:0/1630959594 >> 172.21.15.110:0/1630959594 conn(0x7f631c0723b0 msgr2=0x7f631c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 -- 172.21.15.110:0/1630959594 shutdown_connections 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.967+0000 7f63222e9640 1 -- 172.21.15.110:0/1630959594 wait complete. 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f63222e9640 1 Processor -- start 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f63222e9640 1 -- start start 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f63222e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 0x7f631c10e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f63222e9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f631c0fcf80 0x7f631c10e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f63222e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c10ed50 con 0x7f631c0fb810 2024-09-16T02:17:04.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f63222e9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c10eec0 con 0x7f631c0fcf80 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f631bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 0x7f631c10e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f631bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 0x7f631c10e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44604/0 (socket says 172.21.15.110:44604) 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f631bfff640 1 -- 172.21.15.110:0/2099849567 learned_addr learned my addr 172.21.15.110:0/2099849567 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.968+0000 7f6313fff640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f631c0fcf80 0x7f631c10e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f631bfff640 1 -- 172.21.15.110:0/2099849567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f631c0fcf80 msgr2=0x7f631c10e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f631bfff640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f631c0fcf80 0x7f631c10e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f631bfff640 1 -- 172.21.15.110:0/2099849567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304005040 con 0x7f631c0fb810 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f631bfff640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 0x7f631c10e2d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f630c002a50 tx=0x7f630c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f630c007c30 con 0x7f631c0fb810 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f630c00f040 con 0x7f631c0fb810 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c1171a0 con 0x7f631c0fb810 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f630c00da90 con 0x7f631c0fb810 2024-09-16T02:17:04.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.969+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c117710 con 0x7f631c0fb810 2024-09-16T02:17:04.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.970+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c0fcbc0 con 0x7f631c0fb810 2024-09-16T02:17:04.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.971+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f630c00dc30 con 0x7f631c0fb810 2024-09-16T02:17:04.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.971+0000 7f63197fa640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f630806e530 0x7f63080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:04.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.971+0000 7f6313fff640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f630806e530 0x7f63080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:04.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.971+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f630c08da50 con 0x7f631c0fb810 2024-09-16T02:17:04.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.972+0000 7f6313fff640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f630806e530 0x7f63080709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f631c0659e0 tx=0x7f6304035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:04.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:04.976+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f630c056af0 con 0x7f631c0fb810 2024-09-16T02:17:05.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.176+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f631c065790 con 0x7f631c0fb810 2024-09-16T02:17:05.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.177+0000 7f63197fa640 1 -- 172.21.15.110:0/2099849567 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4125 (secure 0 0 0) 0x7f630c05a1b0 con 0x7f631c0fb810 2024-09-16T02:17:05.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:05.178 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":20,"btime":"2024-09-16T02:13:52:406089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/591551052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":591551052},{"type":"v1","addr":"172.21.15.110:6829","nonce":591551052}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:13:52.406079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:replay","state_seq":2,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:05.178 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 20 2024-09-16T02:17:05.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f630806e530 msgr2=0x7f63080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:05.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f630806e530 0x7f63080709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f631c0659e0 tx=0x7f6304035040 comp rx=0 tx=0).stop 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 msgr2=0x7f631c10e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 0x7f631c10e2d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f630c002a50 tx=0x7f630c004600 comp rx=0 tx=0).stop 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 shutdown_connections 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f630806e530 0x7f63080709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f631c0fcf80 0x7f631c10e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 --2- 172.21.15.110:0/2099849567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f631c0fb810 0x7f631c10e2d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 >> 172.21.15.110:0/2099849567 conn(0x7f631c0723b0 msgr2=0x7f631c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 shutdown_connections 2024-09-16T02:17:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:05.180+0000 7f63222e9640 1 -- 172.21.15.110:0/2099849567 wait complete. 2024-09-16T02:17:05.786 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:05 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2099849567' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-16T02:17:05.813 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-16T02:17:05.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-16T02:17:05.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:05 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2099849567' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-16T02:17:06.062 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:06.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:06 smithi110 ceph-mon[98215]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:06 smithi165 ceph-mon[77258]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:07.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 -- 172.21.15.110:0/3966994213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 msgr2=0x7f95540fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:07.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 --2- 172.21.15.110:0/3966994213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f95540fc590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95480048d0 tx=0x7f9548009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 -- 172.21.15.110:0/3966994213 shutdown_connections 2024-09-16T02:17:07.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 --2- 172.21.15.110:0/3966994213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f95540fc590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 --2- 172.21.15.110:0/3966994213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 0x7f9554102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 -- 172.21.15.110:0/3966994213 >> 172.21.15.110:0/3966994213 conn(0x7f95540f8110 msgr2=0x7f95540fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 -- 172.21.15.110:0/3966994213 shutdown_connections 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.782+0000 7f955967b640 1 -- 172.21.15.110:0/3966994213 wait complete. 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f955967b640 1 Processor -- start 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f955967b640 1 -- start start 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f955967b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 0x7f9554113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f955967b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f9554113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f955967b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9554113d50 con 0x7f9554102ed0 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f955967b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955410d190 con 0x7f9554102530 2024-09-16T02:17:07.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f9554113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f9554113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44612/0 (socket says 172.21.15.110:44612) 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 -- 172.21.15.110:0/1200450762 learned_addr learned my addr 172.21.15.110:0/1200450762 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f9552ffd640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 0x7f9554113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 -- 172.21.15.110:0/1200450762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 msgr2=0x7f9554113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 0x7f9554113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 -- 172.21.15.110:0/1200450762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548005040 con 0x7f9554102ed0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f9552ffd640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 0x7f9554113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.783+0000 7f95527fc640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f9554113750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95480043d0 tx=0x7f9548009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.784+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9548038070 con 0x7f9554102ed0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.784+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95480096e0 con 0x7f9554102ed0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.784+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955410d410 con 0x7f9554102ed0 2024-09-16T02:17:07.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.784+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954802c8a0 con 0x7f9554102ed0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.784+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955410d950 con 0x7f9554102ed0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.785+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95540fdcb0 con 0x7f9554102ed0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.785+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9548030020 con 0x7f9554102ed0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.786+0000 7f953b7fe640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f953c06e530 0x7f953c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.786+0000 7f9552ffd640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f953c06e530 0x7f953c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.786+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f95480ae000 con 0x7f9554102ed0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.786+0000 7f9552ffd640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f953c06e530 0x7f953c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9544004d80 tx=0x7f954400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.790+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9548077020 con 0x7f9554102ed0 2024-09-16T02:17:07.817 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:07.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.995+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f9554109560 con 0x7f9554102ed0 2024-09-16T02:17:07.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.995+0000 7f953b7fe640 1 -- 172.21.15.110:0/1200450762 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4130 (secure 0 0 0) 0x7f954807a6e0 con 0x7f9554102ed0 2024-09-16T02:17:07.997 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:07.997 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"btime":"2024-09-16T02:14:00:581672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/591551052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":591551052},{"type":"v1","addr":"172.21.15.110:6829","nonce":591551052}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:00.355983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":161,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:07.997 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 21 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f953c06e530 msgr2=0x7f953c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f953c06e530 0x7f953c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9544004d80 tx=0x7f954400b040 comp rx=0 tx=0).stop 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 msgr2=0x7f9554113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f9554113750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95480043d0 tx=0x7f9548009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 shutdown_connections 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f953c06e530 0x7f953c0709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9554102ed0 0x7f9554113750 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 --2- 172.21.15.110:0/1200450762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9554102530 0x7f9554113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 >> 172.21.15.110:0/1200450762 conn(0x7f95540f8110 msgr2=0x7f95540f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.997+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 shutdown_connections 2024-09-16T02:17:07.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:07.998+0000 7f955967b640 1 -- 172.21.15.110:0/1200450762 wait complete. 2024-09-16T02:17:08.720 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-16T02:17:08.720 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-16T02:17:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:08 smithi165 ceph-mon[77258]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:08 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1200450762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-16T02:17:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:08 smithi110 ceph-mon[98215]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:08 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1200450762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-16T02:17:08.966 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.605+0000 7f48b5911640 1 -- 172.21.15.110:0/497378510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fdf00 msgr2=0x7f48b0106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.605+0000 7f48b5911640 1 --2- 172.21.15.110:0/497378510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fdf00 0x7f48b0106540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f48980048d0 tx=0x7f4898009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.605+0000 7f48b5911640 1 -- 172.21.15.110:0/497378510 shutdown_connections 2024-09-16T02:17:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.605+0000 7f48b5911640 1 --2- 172.21.15.110:0/497378510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fdf00 0x7f48b0106540 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.605+0000 7f48b5911640 1 --2- 172.21.15.110:0/497378510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48b00fd560 0x7f48b00fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.605+0000 7f48b5911640 1 -- 172.21.15.110:0/497378510 >> 172.21.15.110:0/497378510 conn(0x7f48b00f7030 msgr2=0x7f48b00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 -- 172.21.15.110:0/497378510 shutdown_connections 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 -- 172.21.15.110:0/497378510 wait complete. 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 Processor -- start 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 -- start start 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 0x7f48b0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48b00fdf00 0x7f48b0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0113d50 con 0x7f48b00fd560 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.606+0000 7f48b5911640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b010d190 con 0x7f48b00fdf00 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 0x7f48b0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 0x7f48b0113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60512/0 (socket says 172.21.15.110:60512) 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 -- 172.21.15.110:0/3319645160 learned_addr learned my addr 172.21.15.110:0/3319645160 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:10.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48a67fc640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48b00fdf00 0x7f48b0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 -- 172.21.15.110:0/3319645160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48b00fdf00 msgr2=0x7f48b0113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48b00fdf00 0x7f48b0113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 -- 172.21.15.110:0/3319645160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898005040 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48aeffd640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 0x7f48b0113210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c830 tx=0x7f48a0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a000a7d0 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b010d470 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f48a000add0 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a00113a0 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.607+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b010d960 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.608+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b00660f0 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.609+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f48a0012400 con 0x7f48b00fd560 2024-09-16T02:17:10.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.609+0000 7f48a7fff640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f489c06e530 0x7f489c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:10.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.609+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f48a008e350 con 0x7f48b00fd560 2024-09-16T02:17:10.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.609+0000 7f48a67fc640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f489c06e530 0x7f489c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:10.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.610+0000 7f48a67fc640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f489c06e530 0x7f489c0709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4898009ac0 tx=0x7f4898035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:10.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.614+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48a00573f0 con 0x7f48b00fd560 2024-09-16T02:17:10.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:10 smithi110 ceph-mon[98215]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:10.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.815+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f48b00fac30 con 0x7f48b00fd560 2024-09-16T02:17:10.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.816+0000 7f48a7fff640 1 -- 172.21.15.110:0/3319645160 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4127 (secure 0 0 0) 0x7f48a005aab0 con 0x7f48b00fd560 2024-09-16T02:17:10.818 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:10.818 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"btime":"2024-09-16T02:14:01:587386+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/591551052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":591551052},{"type":"v1","addr":"172.21.15.110:6829","nonce":591551052}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:00.589714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":162,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:10.818 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 22 2024-09-16T02:17:10.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f489c06e530 msgr2=0x7f489c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:10.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f489c06e530 0x7f489c0709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4898009ac0 tx=0x7f4898035040 comp rx=0 tx=0).stop 2024-09-16T02:17:10.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 msgr2=0x7f48b0113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:10.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 0x7f48b0113210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c830 tx=0x7f48a0004430 comp rx=0 tx=0).stop 2024-09-16T02:17:10.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 shutdown_connections 2024-09-16T02:17:10.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f489c06e530 0x7f489c0709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f48b00fdf00 0x7f48b0113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 --2- 172.21.15.110:0/3319645160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48b00fd560 0x7f48b0113210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:10.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 >> 172.21.15.110:0/3319645160 conn(0x7f48b00f7030 msgr2=0x7f48b00f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:10.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 shutdown_connections 2024-09-16T02:17:10.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:10.818+0000 7f48b5911640 1 -- 172.21.15.110:0/3319645160 wait complete. 2024-09-16T02:17:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:10 smithi165 ceph-mon[77258]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:11.424 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-16T02:17:11.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-16T02:17:11.669 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:11.907 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:11 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3319645160' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-16T02:17:11.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:11 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3319645160' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-16T02:17:12.930 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:12 smithi110 ceph-mon[98215]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:12 smithi165 ceph-mon[77258]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:13.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.152+0000 7f783cd7b640 1 -- 172.21.15.110:0/2905863060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 msgr2=0x7f78380fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:13.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.152+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2905863060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f78380fb8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f782c0048d0 tx=0x7f782c009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- 172.21.15.110:0/2905863060 shutdown_connections 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2905863060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f78380fb8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2905863060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78381014c0 0x7f7838101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- 172.21.15.110:0/2905863060 >> 172.21.15.110:0/2905863060 conn(0x7f78380f7000 msgr2=0x7f78380f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- 172.21.15.110:0/2905863060 shutdown_connections 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- 172.21.15.110:0/2905863060 wait complete. 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 Processor -- start 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- start start 2024-09-16T02:17:13.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f7838113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78381014c0 0x7f7838113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838113e10 con 0x7f78380fb480 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.153+0000 7f783cd7b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783810d1c0 con 0x7f78381014c0 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f7838113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f7838113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60520/0 (socket says 172.21.15.110:60520) 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 -- 172.21.15.110:0/2421224806 learned_addr learned my addr 172.21.15.110:0/2421224806 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f7835d9b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78381014c0 0x7f7838113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:13.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 -- 172.21.15.110:0/2421224806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78381014c0 msgr2=0x7f7838113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78381014c0 0x7f7838113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 -- 172.21.15.110:0/2421224806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c005040 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783659c640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f7838113240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f782800b790 tx=0x7f78280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f782800c700 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f782800cd00 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783810d4a0 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7828015e80 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.154+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783810d9c0 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.155+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78380fcbc0 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.156+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7828012070 con 0x7f78380fb480 2024-09-16T02:17:13.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.156+0000 7f7826ffd640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f782006e530 0x7f78200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:13.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.156+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f782808dbf0 con 0x7f78380fb480 2024-09-16T02:17:13.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.156+0000 7f7835d9b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f782006e530 0x7f78200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:13.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.157+0000 7f7835d9b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f782006e530 0x7f78200709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f782c007ac0 tx=0x7f782c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:13.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.160+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7828056c10 con 0x7f78380fb480 2024-09-16T02:17:13.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.364+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f783804b720 con 0x7f78380fb480 2024-09-16T02:17:13.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.365+0000 7f7826ffd640 1 -- 172.21.15.110:0/2421224806 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4986 (secure 0 0 0) 0x7f782805a2d0 con 0x7f78380fb480 2024-09-16T02:17:13.367 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:13.367 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"btime":"2024-09-16T02:14:02:593141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34376,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/591551052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":591551052},{"type":"v1","addr":"172.21.15.110:6829","nonce":591551052}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:02.593138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:active","state_seq":163,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-16T02:17:13.367 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 23 2024-09-16T02:17:13.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f782006e530 msgr2=0x7f78200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:13.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f782006e530 0x7f78200709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f782c007ac0 tx=0x7f782c009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 msgr2=0x7f7838113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f7838113240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f782800b790 tx=0x7f78280091d0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 shutdown_connections 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f782006e530 0x7f78200709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78381014c0 0x7f7838113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 --2- 172.21.15.110:0/2421224806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78380fb480 0x7f7838113240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 >> 172.21.15.110:0/2421224806 conn(0x7f78380f7000 msgr2=0x7f78380f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 shutdown_connections 2024-09-16T02:17:13.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:13.367+0000 7f783cd7b640 1 -- 172.21.15.110:0/2421224806 wait complete. 2024-09-16T02:17:13.681 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:13 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2421224806' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-16T02:17:13.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:13 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2421224806' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-16T02:17:13.983 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-16T02:17:13.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-16T02:17:14.230 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:14 smithi165 ceph-mon[77258]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:14 smithi110 ceph-mon[98215]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:15.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 -- 172.21.15.110:0/2427691315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 msgr2=0x7fcacc0fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:15.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 --2- 172.21.15.110:0/2427691315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc0fb060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0048d0 tx=0x7fcabc009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:15.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 -- 172.21.15.110:0/2427691315 shutdown_connections 2024-09-16T02:17:15.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 --2- 172.21.15.110:0/2427691315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc0fb060 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 --2- 172.21.15.110:0/2427691315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 0x7fcacc0fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 -- 172.21.15.110:0/2427691315 >> 172.21.15.110:0/2427691315 conn(0x7fcacc070c10 msgr2=0x7fcacc071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 -- 172.21.15.110:0/2427691315 shutdown_connections 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.843+0000 7fcad4023640 1 -- 172.21.15.110:0/2427691315 wait complete. 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad4023640 1 Processor -- start 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad4023640 1 -- start start 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad4023640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad4023640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 0x7fcacc115880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad4023640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc115e80 con 0x7fcacc0fac10 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad4023640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc10f2c0 con 0x7fcacc0fd3a0 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad1dbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:15.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad1dbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc115340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60544/0 (socket says 172.21.15.110:60544) 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad1dbf640 1 -- 172.21.15.110:0/4137297053 learned_addr learned my addr 172.21.15.110:0/4137297053 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.844+0000 7fcad15be640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 0x7fcacc115880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad1dbf640 1 -- 172.21.15.110:0/4137297053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 msgr2=0x7fcacc115880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad1dbf640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 0x7fcacc115880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad1dbf640 1 -- 172.21.15.110:0/4137297053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc005040 con 0x7fcacc0fac10 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad15be640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 0x7fcacc115880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad1dbf640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc115340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcac8002a50 tx=0x7fcac8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac8007c30 con 0x7fcacc0fac10 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc10f5a0 con 0x7fcacc0fac10 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcac800f040 con 0x7fcacc0fac10 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac800da90 con 0x7fcacc0fac10 2024-09-16T02:17:15.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.845+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc10fb10 con 0x7fcacc0fac10 2024-09-16T02:17:15.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.846+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc0fbc20 con 0x7fcacc0fac10 2024-09-16T02:17:15.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.847+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcac800dd00 con 0x7fcacc0fac10 2024-09-16T02:17:15.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.847+0000 7fcac27fc640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcab806e530 0x7fcab80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:15.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.847+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fcac808db70 con 0x7fcacc0fac10 2024-09-16T02:17:15.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.847+0000 7fcad15be640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcab806e530 0x7fcab80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:15.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.847+0000 7fcad15be640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcab806e530 0x7fcab80709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcacc071a20 tx=0x7fcabc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:15.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:15.851+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcac8056b90 con 0x7fcacc0fac10 2024-09-16T02:17:16.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.054+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fcacc04b750 con 0x7fcacc0fac10 2024-09-16T02:17:16.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.054+0000 7fcac27fc640 1 -- 172.21.15.110:0/4137297053 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4207 (secure 0 0 0) 0x7fcac805a250 con 0x7fcacc0fac10 2024-09-16T02:17:16.057 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:16.057 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":24,"btime":"2024-09-16T02:14:14:453570+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:02.593138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:active","state_seq":163,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-16T02:17:16.058 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 24 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.056+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcab806e530 msgr2=0x7fcab80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.056+0000 7fcad4023640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcab806e530 0x7fcab80709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcacc071a20 tx=0x7fcabc035040 comp rx=0 tx=0).stop 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.056+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 msgr2=0x7fcacc115340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.056+0000 7fcad4023640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc115340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcac8002a50 tx=0x7fcac8004600 comp rx=0 tx=0).stop 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 shutdown_connections 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fcab806e530 0x7fcab80709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcacc0fd3a0 0x7fcacc115880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 --2- 172.21.15.110:0/4137297053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcacc0fac10 0x7fcacc115340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 >> 172.21.15.110:0/4137297053 conn(0x7fcacc070c10 msgr2=0x7fcacc0f8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 shutdown_connections 2024-09-16T02:17:16.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:16.057+0000 7fcad4023640 1 -- 172.21.15.110:0/4137297053 wait complete. 2024-09-16T02:17:16.756 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-16T02:17:16.757 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-16T02:17:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:16 smithi165 ceph-mon[77258]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:16 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/4137297053' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-16T02:17:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:16 smithi110 ceph-mon[98215]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:16 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/4137297053' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-16T02:17:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:18.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 -- 172.21.15.110:0/1666871832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c0fb4a0 msgr2=0x7fba9c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:18.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 --2- 172.21.15.110:0/1666871832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c0fb4a0 0x7fba9c0fb910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba900048d0 tx=0x7fba90009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 -- 172.21.15.110:0/1666871832 shutdown_connections 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 --2- 172.21.15.110:0/1666871832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c0fb4a0 0x7fba9c0fb910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 --2- 172.21.15.110:0/1666871832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c1014e0 0x7fba9c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 -- 172.21.15.110:0/1666871832 >> 172.21.15.110:0/1666871832 conn(0x7fba9c0f7020 msgr2=0x7fba9c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 -- 172.21.15.110:0/1666871832 shutdown_connections 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 -- 172.21.15.110:0/1666871832 wait complete. 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.692+0000 7fbaa413d640 1 Processor -- start 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa413d640 1 -- start start 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa413d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c0fb4a0 0x7fba9c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa413d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 0x7fba9c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa413d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c10ed20 con 0x7fba9c1014e0 2024-09-16T02:17:18.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa413d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c10ee90 con 0x7fba9c0fb4a0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 0x7fba9c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 0x7fba9c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60566/0 (socket says 172.21.15.110:60566) 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 -- 172.21.15.110:0/209832321 learned_addr learned my addr 172.21.15.110:0/209832321 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa1ed9640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c0fb4a0 0x7fba9c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 -- 172.21.15.110:0/209832321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c0fb4a0 msgr2=0x7fba9c10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c0fb4a0 0x7fba9c10e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 -- 172.21.15.110:0/209832321 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90005040 con 0x7fba9c1014e0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.693+0000 7fbaa16d8640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 0x7fba9c10e6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba90003080 tx=0x7fba90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.694+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba90038070 con 0x7fba9c1014e0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.694+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba900097e0 con 0x7fba9c1014e0 2024-09-16T02:17:18.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.694+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c117200 con 0x7fba9c1014e0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.694+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9003d420 con 0x7fba9c1014e0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.694+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c117660 con 0x7fba9c1014e0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.695+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c0fcbe0 con 0x7fba9c1014e0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.695+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fba90030020 con 0x7fba9c1014e0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.696+0000 7fba9a7fc640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fba8406e530 0x7fba840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.696+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fba900ae750 con 0x7fba9c1014e0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.696+0000 7fbaa1ed9640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fba8406e530 0x7fba840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.696+0000 7fbaa1ed9640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fba8406e530 0x7fba840709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba94004550 tx=0x7fba94009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:18.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.700+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fba90077750 con 0x7fba9c1014e0 2024-09-16T02:17:18.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.902+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fba9c1084f0 con 0x7fba9c1014e0 2024-09-16T02:17:18.905 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:18 smithi110 ceph-mon[98215]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:18.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.903+0000 7fba9a7fc640 1 -- 172.21.15.110:0/209832321 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+5054 (secure 0 0 0) 0x7fba9007ae10 con 0x7fba9c1014e0 2024-09-16T02:17:18.906 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:18.906 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-16T02:14:18:466577+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24251,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3082327974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3082327974},{"type":"v1","addr":"172.21.15.165:6825","nonce":3082327974}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:02.593138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:active","state_seq":163,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-16T02:17:18.906 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fba8406e530 msgr2=0x7fba840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fba8406e530 0x7fba840709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba94004550 tx=0x7fba94009040 comp rx=0 tx=0).stop 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 msgr2=0x7fba9c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 0x7fba9c10e6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba90003080 tx=0x7fba90009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 shutdown_connections 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fba8406e530 0x7fba840709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba9c1014e0 0x7fba9c10e6d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 --2- 172.21.15.110:0/209832321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba9c0fb4a0 0x7fba9c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.905+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 >> 172.21.15.110:0/209832321 conn(0x7fba9c0f7020 msgr2=0x7fba9c0f73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.906+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 shutdown_connections 2024-09-16T02:17:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:18.906+0000 7fbaa413d640 1 -- 172.21.15.110:0/209832321 wait complete. 2024-09-16T02:17:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:18 smithi165 ceph-mon[77258]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:19.554 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-16T02:17:19.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-16T02:17:19.799 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:19.919 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:19 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/209832321' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-16T02:17:19.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:19 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/209832321' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-16T02:17:20.920 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:20 smithi110 ceph-mon[98215]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:20 smithi165 ceph-mon[77258]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- 172.21.15.110:0/2339838457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf8100c90 msgr2=0x7f0cf8101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/2339838457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf8100c90 0x7f0cf8101060 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80048d0 tx=0x7f0ce8009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- 172.21.15.110:0/2339838457 shutdown_connections 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/2339838457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cf80fac60 0x7f0cf80fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/2339838457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf8100c90 0x7f0cf8101060 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- 172.21.15.110:0/2339838457 >> 172.21.15.110:0/2339838457 conn(0x7f0cf8070c80 msgr2=0x7f0cf8071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- 172.21.15.110:0/2339838457 shutdown_connections 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- 172.21.15.110:0/2339838457 wait complete. 2024-09-16T02:17:21.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 Processor -- start 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- start start 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 0x7f0cf810bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cf8100c90 0x7f0cf810c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf810cad0 con 0x7f0cf80fac60 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.391+0000 7f0cff9d2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf810cc10 con 0x7f0cf8100c90 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 0x7f0cf810bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 0x7f0cf810bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33062/0 (socket says 172.21.15.110:33062) 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 -- 172.21.15.110:0/3596184194 learned_addr learned my addr 172.21.15.110:0/3596184194 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfcf6d640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cf8100c90 0x7f0cf810c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 -- 172.21.15.110:0/3596184194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cf8100c90 msgr2=0x7f0cf810c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cf8100c90 0x7f0cf810c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 -- 172.21.15.110:0/3596184194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8005040 con 0x7f0cf80fac60 2024-09-16T02:17:21.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cfd76e640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 0x7f0cf810bfc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009ac0 tx=0x7f0ce8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce8038070 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ce8032b20 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce803da10 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf8119630 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.392+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf8119960 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.393+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf80fc350 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.394+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0ce8030020 con 0x7f0cf80fac60 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.394+0000 7f0cedffb640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0ce406e530 0x7f0ce40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:21.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.394+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f0ce80aec90 con 0x7f0cf80fac60 2024-09-16T02:17:21.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.394+0000 7f0cfcf6d640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0ce406e530 0x7f0ce40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:21.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.395+0000 7f0cfcf6d640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0ce406e530 0x7f0ce40709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80f9aa0 tx=0x7f0cf4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:21.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.399+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0ce8077cb0 con 0x7f0cf80fac60 2024-09-16T02:17:21.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.600+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f0cf80f97a0 con 0x7f0cf80fac60 2024-09-16T02:17:21.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.601+0000 7f0cedffb640 1 -- 172.21.15.110:0/3596184194 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4272 (secure 0 0 0) 0x7f0ce807b370 con 0x7f0cf80fac60 2024-09-16T02:17:21.604 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:21.604 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":26,"btime":"2024-09-16T02:14:29:543354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:02.593138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:active","state_seq":163,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-16T02:17:21.604 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 26 2024-09-16T02:17:21.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0ce406e530 msgr2=0x7f0ce40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0ce406e530 0x7f0ce40709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80f9aa0 tx=0x7f0cf4008040 comp rx=0 tx=0).stop 2024-09-16T02:17:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 msgr2=0x7f0cf810bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 0x7f0cf810bfc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009ac0 tx=0x7f0ce8009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 shutdown_connections 2024-09-16T02:17:21.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0ce406e530 0x7f0ce40709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0cf8100c90 0x7f0cf810c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 --2- 172.21.15.110:0/3596184194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0cf80fac60 0x7f0cf810bfc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:21.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 >> 172.21.15.110:0/3596184194 conn(0x7f0cf8070c80 msgr2=0x7f0cf8103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:21.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 shutdown_connections 2024-09-16T02:17:21.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:21.603+0000 7f0cff9d2640 1 -- 172.21.15.110:0/3596184194 wait complete. 2024-09-16T02:17:21.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:21 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3596184194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-16T02:17:21.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:21 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3596184194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-16T02:17:22.235 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-16T02:17:22.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-16T02:17:22.483 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:22.947 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:22 smithi110 ceph-mon[98215]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:22.947 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:22 smithi165 ceph-mon[77258]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:23.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:23 smithi110 ceph-mon[98215]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:23.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:23 smithi165 ceph-mon[77258]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:24.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 -- 172.21.15.110:0/162911549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 msgr2=0x7f3fd4101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 --2- 172.21.15.110:0/162911549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd4101880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00048d0 tx=0x7f3fd0009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 -- 172.21.15.110:0/162911549 shutdown_connections 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 --2- 172.21.15.110:0/162911549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fd40fb470 0x7f3fd40fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 --2- 172.21.15.110:0/162911549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd4101880 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 -- 172.21.15.110:0/162911549 >> 172.21.15.110:0/162911549 conn(0x7f3fd40f7030 msgr2=0x7f3fd40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 -- 172.21.15.110:0/162911549 shutdown_connections 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.221+0000 7f3fdc620640 1 -- 172.21.15.110:0/162911549 wait complete. 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fdc620640 1 Processor -- start 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fdc620640 1 -- start start 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fdc620640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fd40fb470 0x7f3fd41120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:24.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fdc620640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd41125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fdc620640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4112be0 con 0x7f3fd41014b0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fdc620640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd410c020 con 0x7f3fd40fb470 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fd9bbb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd41125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fd9bbb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd41125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33080/0 (socket says 172.21.15.110:33080) 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fd9bbb640 1 -- 172.21.15.110:0/4209553933 learned_addr learned my addr 172.21.15.110:0/4209553933 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.222+0000 7f3fda3bc640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fd40fb470 0x7f3fd41120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fd9bbb640 1 -- 172.21.15.110:0/4209553933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fd40fb470 msgr2=0x7f3fd41120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fd9bbb640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fd40fb470 0x7f3fd41120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fd9bbb640 1 -- 172.21.15.110:0/4209553933 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0005040 con 0x7f3fd41014b0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fd9bbb640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd41125e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400fd10 tx=0x7f3fc4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc400de30 con 0x7f3fd41014b0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd410c2a0 con 0x7f3fd41014b0 2024-09-16T02:17:24.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fc40090d0 con 0x7f3fd41014b0 2024-09-16T02:17:24.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc40126a0 con 0x7f3fd41014b0 2024-09-16T02:17:24.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.223+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd410c7c0 con 0x7f3fd41014b0 2024-09-16T02:17:24.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.224+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd40fcbb0 con 0x7f3fd41014b0 2024-09-16T02:17:24.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.225+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3fc4007a20 con 0x7f3fd41014b0 2024-09-16T02:17:24.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.225+0000 7f3fcaffd640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3fc006e530 0x7f3fc00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:24.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.225+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f3fc4090a30 con 0x7f3fd41014b0 2024-09-16T02:17:24.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.225+0000 7f3fda3bc640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3fc006e530 0x7f3fc00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:24.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.226+0000 7f3fda3bc640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3fc006e530 0x7f3fc00709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ac0 tx=0x7f3fd0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:24.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.229+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3fc4059b00 con 0x7f3fd41014b0 2024-09-16T02:17:24.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.428+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f3fd4108460 con 0x7f3fd41014b0 2024-09-16T02:17:24.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.429+0000 7f3fcaffd640 1 -- 172.21.15.110:0/4209553933 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+5122 (secure 0 0 0) 0x7f3fc405d1c0 con 0x7f3fd41014b0 2024-09-16T02:17:24.432 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:24.432 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":27,"btime":"2024-09-16T02:14:32:552097+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:02.593138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24247":{"gid":24247,"name":"cephfs.smithi165.gxrypw","rank":0,"incarnation":20,"state":"up:active","state_seq":163,"addr":"172.21.15.165:6827/441401724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":441401724},{"type":"v1","addr":"172.21.15.165:6827","nonce":441401724}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24247,"qdb_cluster":[24247]},"id":1}]} 2024-09-16T02:17:24.432 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 27 2024-09-16T02:17:24.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3fc006e530 msgr2=0x7f3fc00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:24.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3fc006e530 0x7f3fc00709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ac0 tx=0x7f3fd0035040 comp rx=0 tx=0).stop 2024-09-16T02:17:24.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 msgr2=0x7f3fd41125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd41125e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400fd10 tx=0x7f3fc4004600 comp rx=0 tx=0).stop 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 shutdown_connections 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f3fc006e530 0x7f3fc00709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd41014b0 0x7f3fd41125e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 --2- 172.21.15.110:0/4209553933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fd40fb470 0x7f3fd41120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 >> 172.21.15.110:0/4209553933 conn(0x7f3fd40f7030 msgr2=0x7f3fd40f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 shutdown_connections 2024-09-16T02:17:24.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:24.431+0000 7f3fdc620640 1 -- 172.21.15.110:0/4209553933 wait complete. 2024-09-16T02:17:24.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:24 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/4209553933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-16T02:17:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:24 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/4209553933' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-16T02:17:25.135 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-16T02:17:25.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-16T02:17:25.379 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:25.751 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:25 smithi110 ceph-mon[98215]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:25.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:25 smithi165 ceph-mon[77258]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:26.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 -- 172.21.15.110:0/3287534938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 msgr2=0x7effb8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:26.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 --2- 172.21.15.110:0/3287534938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8102900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effb40048d0 tx=0x7effb4009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:26.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 -- 172.21.15.110:0/3287534938 shutdown_connections 2024-09-16T02:17:26.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 --2- 172.21.15.110:0/3287534938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 0x7effb80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 --2- 172.21.15.110:0/3287534938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8102900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 -- 172.21.15.110:0/3287534938 >> 172.21.15.110:0/3287534938 conn(0x7effb80f80f0 msgr2=0x7effb80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 -- 172.21.15.110:0/3287534938 shutdown_connections 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.881+0000 7effbefe2640 1 -- 172.21.15.110:0/3287534938 wait complete. 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbefe2640 1 Processor -- start 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbefe2640 1 -- start start 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbefe2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbefe2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 0x7effb8113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbefe2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8113e20 con 0x7effb8102530 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbefe2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb810d1d0 con 0x7effb8102ed0 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbcd7e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbcd7e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33110/0 (socket says 172.21.15.110:33110) 2024-09-16T02:17:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbcd7e640 1 -- 172.21.15.110:0/2611222668 learned_addr learned my addr 172.21.15.110:0/2611222668 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effaffff640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 0x7effb8113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbcd7e640 1 -- 172.21.15.110:0/2611222668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 msgr2=0x7effb8113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbcd7e640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 0x7effb8113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effbcd7e640 1 -- 172.21.15.110:0/2611222668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4005040 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.882+0000 7effaffff640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 0x7effb8113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.883+0000 7effbcd7e640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8113250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7effb4000c00 tx=0x7effb4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.883+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb4038070 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.883+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7effb403daf0 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.883+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb810d450 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.883+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb4033b20 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.883+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb810d970 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.884+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb80fdcb0 con 0x7effb8102530 2024-09-16T02:17:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.884+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7effb4030020 con 0x7effb8102530 2024-09-16T02:17:26.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.885+0000 7effad7fa640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7effa006e530 0x7effa00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:26.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.885+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7effb40ae4a0 con 0x7effb8102530 2024-09-16T02:17:26.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.885+0000 7effaffff640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7effa006e530 0x7effa00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:26.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.885+0000 7effaffff640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7effa006e530 0x7effa00709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effa8006fd0 tx=0x7effa8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:26.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:26.889+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7effb4077570 con 0x7effb8102530 2024-09-16T02:17:27.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.091+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7effb80fbd30 con 0x7effb8102530 2024-09-16T02:17:27.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.091+0000 7effad7fa640 1 -- 172.21.15.110:0/2611222668 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4321 (secure 0 0 0) 0x7effb80fbd30 con 0x7effb8102530 2024-09-16T02:17:27.094 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:27.094 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":28,"btime":"2024-09-16T02:14:41:652605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:41.652601+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:27.094 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 28 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.093+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7effa006e530 msgr2=0x7effa00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.093+0000 7effbefe2640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7effa006e530 0x7effa00709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effa8006fd0 tx=0x7effa8008040 comp rx=0 tx=0).stop 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.093+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 msgr2=0x7effb8113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.093+0000 7effbefe2640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8113250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7effb4000c00 tx=0x7effb4009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.093+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 shutdown_connections 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.094+0000 7effbefe2640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7effa006e530 0x7effa00709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.094+0000 7effbefe2640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb8102ed0 0x7effb8113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:27.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.094+0000 7effbefe2640 1 --2- 172.21.15.110:0/2611222668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb8102530 0x7effb8113250 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:27.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.094+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 >> 172.21.15.110:0/2611222668 conn(0x7effb80f80f0 msgr2=0x7effb80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:27.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.094+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 shutdown_connections 2024-09-16T02:17:27.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:27.094+0000 7effbefe2640 1 -- 172.21.15.110:0/2611222668 wait complete. 2024-09-16T02:17:27.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:27 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2611222668' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-16T02:17:27.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:27 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2611222668' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-16T02:17:27.724 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-16T02:17:27.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-16T02:17:27.970 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:28.369 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:28 smithi110 ceph-mon[98215]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:28.450 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:28 smithi165 ceph-mon[77258]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:29.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 -- 172.21.15.110:0/3594173230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fb810 msgr2=0x7f18380fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 --2- 172.21.15.110:0/3594173230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fb810 0x7f18380fbbe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18280048d0 tx=0x7f1828009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 -- 172.21.15.110:0/3594173230 shutdown_connections 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 --2- 172.21.15.110:0/3594173230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fcf80 0x7f18380fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 --2- 172.21.15.110:0/3594173230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fb810 0x7f18380fbbe0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 -- 172.21.15.110:0/3594173230 >> 172.21.15.110:0/3594173230 conn(0x7f18380723b0 msgr2=0x7f18380727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 -- 172.21.15.110:0/3594173230 shutdown_connections 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.485+0000 7f183f330640 1 -- 172.21.15.110:0/3594173230 wait complete. 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183f330640 1 Processor -- start 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183f330640 1 -- start start 2024-09-16T02:17:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183f330640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fb810 0x7f183810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183f330640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 0x7f183810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183f330640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183810ec90 con 0x7f18380fcf80 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183f330640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183810ee00 con 0x7f18380fb810 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 0x7f183810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 0x7f183810e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33138/0 (socket says 172.21.15.110:33138) 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 -- 172.21.15.110:0/289193553 learned_addr learned my addr 172.21.15.110:0/289193553 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183d0cc640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fb810 0x7f183810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 -- 172.21.15.110:0/289193553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fb810 msgr2=0x7f183810e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fb810 0x7f183810e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 -- 172.21.15.110:0/289193553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828005040 con 0x7f18380fcf80 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183d0cc640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fb810 0x7f183810e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:17:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.486+0000 7f183c8cb640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 0x7f183810e690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f183400c810 tx=0x7f18340043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.487+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f183400a820 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.487+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f183400ae20 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.487+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381171c0 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.487+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18340115c0 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.487+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838117700 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.488+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18380fcbc0 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.488+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1834012840 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.488+0000 7f182dffb640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f182406e530 0x7f18240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.489+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f183408e770 con 0x7f18380fcf80 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.489+0000 7f183d0cc640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f182406e530 0x7f18240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.489+0000 7f183d0cc640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f182406e530 0x7f18240709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f182800b020 tx=0x7f1828009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:29.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.493+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f183405b340 con 0x7f18380fcf80 2024-09-16T02:17:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.695+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f1838072ec0 con 0x7f18380fcf80 2024-09-16T02:17:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.695+0000 7f182dffb640 1 -- 172.21.15.110:0/289193553 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4400 (secure 0 0 0) 0x7f183405aed0 con 0x7f18380fcf80 2024-09-16T02:17:29.698 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:29.698 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":29,"btime":"2024-09-16T02:14:41:657659+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:41.657644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 29 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f182406e530 msgr2=0x7f18240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f182406e530 0x7f18240709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f182800b020 tx=0x7f1828009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 msgr2=0x7f183810e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 0x7f183810e690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f183400c810 tx=0x7f18340043c0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 shutdown_connections 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f182406e530 0x7f18240709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.697+0000 7f183f330640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18380fcf80 0x7f183810e690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.698+0000 7f183f330640 1 --2- 172.21.15.110:0/289193553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18380fb810 0x7f183810e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.698+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 >> 172.21.15.110:0/289193553 conn(0x7f18380723b0 msgr2=0x7f18380fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.698+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 shutdown_connections 2024-09-16T02:17:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:29.698+0000 7f183f330640 1 -- 172.21.15.110:0/289193553 wait complete. 2024-09-16T02:17:30.313 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-16T02:17:30.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-16T02:17:30.556 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:30.677 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:30 smithi110 ceph-mon[98215]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:30.677 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:30 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/289193553' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-16T02:17:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:30 smithi165 ceph-mon[77258]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:30 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/289193553' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-16T02:17:32.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.160+0000 7fb7afe33640 1 -- 172.21.15.110:0/2660814420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 msgr2=0x7fb7a80fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:32.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.160+0000 7fb7afe33640 1 --2- 172.21.15.110:0/2660814420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a80fbbe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40048d0 tx=0x7fb7a4009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.160+0000 7fb7afe33640 1 -- 172.21.15.110:0/2660814420 shutdown_connections 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.160+0000 7fb7afe33640 1 --2- 172.21.15.110:0/2660814420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 0x7fb7a80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.160+0000 7fb7afe33640 1 --2- 172.21.15.110:0/2660814420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a80fbbe0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.160+0000 7fb7afe33640 1 -- 172.21.15.110:0/2660814420 >> 172.21.15.110:0/2660814420 conn(0x7fb7a80723b0 msgr2=0x7fb7a80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.161+0000 7fb7afe33640 1 -- 172.21.15.110:0/2660814420 shutdown_connections 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.161+0000 7fb7afe33640 1 -- 172.21.15.110:0/2660814420 wait complete. 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.161+0000 7fb7afe33640 1 Processor -- start 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.161+0000 7fb7afe33640 1 -- start start 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7afe33640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a8113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7afe33640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 0x7fb7a8113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7afe33640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8113d40 con 0x7fb7a80fb810 2024-09-16T02:17:32.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7afe33640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a810d180 con 0x7fb7a80fcf80 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a8113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a8113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50972/0 (socket says 172.21.15.110:50972) 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 -- 172.21.15.110:0/3466210019 learned_addr learned my addr 172.21.15.110:0/3466210019 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7ad3ce640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 0x7fb7a8113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 -- 172.21.15.110:0/3466210019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 msgr2=0x7fb7a8113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 0x7fb7a8113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 -- 172.21.15.110:0/3466210019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4005040 con 0x7fb7a80fb810 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7ad3ce640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 0x7fb7a8113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb7adbcf640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a8113200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000c00 tx=0x7fb7a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.162+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7a4038070 con 0x7fb7a80fb810 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.163+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a810d400 con 0x7fb7a80fb810 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.163+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb7a402ade0 con 0x7fb7a80fb810 2024-09-16T02:17:32.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.163+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7a402c7b0 con 0x7fb7a80fb810 2024-09-16T02:17:32.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.163+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a810d940 con 0x7fb7a80fb810 2024-09-16T02:17:32.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.164+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a80fcbc0 con 0x7fb7a80fb810 2024-09-16T02:17:32.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.164+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb7a4030020 con 0x7fb7a80fb810 2024-09-16T02:17:32.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.165+0000 7fb79e7fc640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb79406e580 0x7fb794070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:32.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.165+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fb7a40ae7e0 con 0x7fb7a80fb810 2024-09-16T02:17:32.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.165+0000 7fb7ad3ce640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb79406e580 0x7fb794070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:32.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.166+0000 7fb7ad3ce640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb79406e580 0x7fb794070a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb7a810eac0 tx=0x7fb79800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:32.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.170+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb7a4077760 con 0x7fb7a80fb810 2024-09-16T02:17:32.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.382+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fb7a804b750 con 0x7fb7a80fb810 2024-09-16T02:17:32.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.383+0000 7fb79e7fc640 1 -- 172.21.15.110:0/3466210019 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+5250 (secure 0 0 0) 0x7fb7a407ae20 con 0x7fb7a80fb810 2024-09-16T02:17:32.385 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:32.385 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"btime":"2024-09-16T02:14:49:522692+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:41.657644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:32.386 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb79406e580 msgr2=0x7fb794070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb79406e580 0x7fb794070a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb7a810eac0 tx=0x7fb79800b040 comp rx=0 tx=0).stop 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 msgr2=0x7fb7a8113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a8113200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000c00 tx=0x7fb7a4009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 shutdown_connections 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fb79406e580 0x7fb794070a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7a80fcf80 0x7fb7a8113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 --2- 172.21.15.110:0/3466210019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7a80fb810 0x7fb7a8113200 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:32.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 >> 172.21.15.110:0/3466210019 conn(0x7fb7a80723b0 msgr2=0x7fb7a8064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:32.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 shutdown_connections 2024-09-16T02:17:32.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:32.385+0000 7fb7afe33640 1 -- 172.21.15.110:0/3466210019 wait complete. 2024-09-16T02:17:32.755 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:32 smithi110 ceph-mon[98215]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:32.755 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:32 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3466210019' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-16T02:17:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:32 smithi165 ceph-mon[77258]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:32 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3466210019' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-16T02:17:33.038 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-16T02:17:33.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-16T02:17:33.289 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:34.688 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:34 smithi110 ceph-mon[98215]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:34 smithi165 ceph-mon[77258]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:35.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 -- 172.21.15.110:0/2676668037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 msgr2=0x7fcaac065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:35.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2676668037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac065430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009c50 tx=0x7fca9c004d10 comp rx=0 tx=0).stop 2024-09-16T02:17:35.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 -- 172.21.15.110:0/2676668037 shutdown_connections 2024-09-16T02:17:35.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2676668037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac065430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2676668037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 0x7fcaac0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 -- 172.21.15.110:0/2676668037 >> 172.21.15.110:0/2676668037 conn(0x7fcaac0723b0 msgr2=0x7fcaac0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 -- 172.21.15.110:0/2676668037 shutdown_connections 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 -- 172.21.15.110:0/2676668037 wait complete. 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.000+0000 7fcab0d28640 1 Processor -- start 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcab0d28640 1 -- start start 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcab0d28640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcab0d28640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 0x7fcaac113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcab0d28640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac113d10 con 0x7fcaac064fc0 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcab0d28640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac10d1a0 con 0x7fcaac0fe460 2024-09-16T02:17:35.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac1131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50996/0 (socket says 172.21.15.110:50996) 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 -- 172.21.15.110:0/2662270176 learned_addr learned my addr 172.21.15.110:0/2662270176 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaa9d9b640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 0x7fcaac113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 -- 172.21.15.110:0/2662270176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 msgr2=0x7fcaac113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 0x7fcaac113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 -- 172.21.15.110:0/2662270176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0098b0 con 0x7fcaac064fc0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaa9d9b640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 0x7fcaac113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcaaa59c640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac1131d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0002a50 tx=0x7fcaa0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa0007c30 con 0x7fcaac064fc0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac10d480 con 0x7fcaac064fc0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcaa000f040 con 0x7fcaac064fc0 2024-09-16T02:17:35.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.001+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa000da90 con 0x7fcaac064fc0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.002+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac10da20 con 0x7fcaac064fc0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.003+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0fdcf0 con 0x7fcaac064fc0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.003+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcaa000dd00 con 0x7fcaac064fc0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.003+0000 7fca9affd640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fca9406e530 0x7fca940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.004+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fcaa008db40 con 0x7fcaac064fc0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.004+0000 7fcaa9d9b640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fca9406e530 0x7fca940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.004+0000 7fcaa9d9b640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fca9406e530 0x7fca940709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca9c000f80 tx=0x7fca9c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:35.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.008+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcaa0056b60 con 0x7fcaac064fc0 2024-09-16T02:17:35.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.210+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fcaac04b780 con 0x7fcaac064fc0 2024-09-16T02:17:35.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.211+0000 7fca9affd640 1 -- 172.21.15.110:0/2662270176 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+5254 (secure 0 0 0) 0x7fcaa005a220 con 0x7fcaac064fc0 2024-09-16T02:17:35.212 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:35.213 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":31,"btime":"2024-09-16T02:14:50:525646+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:49.541956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:35.213 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 31 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fca9406e530 msgr2=0x7fca940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fca9406e530 0x7fca940709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca9c000f80 tx=0x7fca9c004d10 comp rx=0 tx=0).stop 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 msgr2=0x7fcaac1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac1131d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0002a50 tx=0x7fcaa0004600 comp rx=0 tx=0).stop 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 shutdown_connections 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fca9406e530 0x7fca940709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaac0fe460 0x7fcaac113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 --2- 172.21.15.110:0/2662270176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcaac064fc0 0x7fcaac1131d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 >> 172.21.15.110:0/2662270176 conn(0x7fcaac0723b0 msgr2=0x7fcaac1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 shutdown_connections 2024-09-16T02:17:35.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:35.213+0000 7fcab0d28640 1 -- 172.21.15.110:0/2662270176 wait complete. 2024-09-16T02:17:35.803 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:35 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/2662270176' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-16T02:17:35.830 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-16T02:17:35.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-16T02:17:35.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:35 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/2662270176' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-16T02:17:36.074 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:36 smithi165 ceph-mon[77258]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:36 smithi110 ceph-mon[98215]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 -- 172.21.15.110:0/853632168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 msgr2=0x7fe9300fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 --2- 172.21.15.110:0/853632168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe9300fbbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0048d0 tx=0x7fe92c009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 -- 172.21.15.110:0/853632168 shutdown_connections 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 --2- 172.21.15.110:0/853632168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9300fcf80 0x7fe9300fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 --2- 172.21.15.110:0/853632168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe9300fbbe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 -- 172.21.15.110:0/853632168 >> 172.21.15.110:0/853632168 conn(0x7fe9300723b0 msgr2=0x7fe9300727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 -- 172.21.15.110:0/853632168 shutdown_connections 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 -- 172.21.15.110:0/853632168 wait complete. 2024-09-16T02:17:37.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.657+0000 7fe937f95640 1 Processor -- start 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe937f95640 1 -- start start 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe937f95640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe93010e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe937f95640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9300fcf80 0x7fe93010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe937f95640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93010ed00 con 0x7fe9300fb810 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe937f95640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93010ee70 con 0x7fe9300fcf80 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe93010e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe93010e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51000/0 (socket says 172.21.15.110:51000) 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 -- 172.21.15.110:0/1630391539 learned_addr learned my addr 172.21.15.110:0/1630391539 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 -- 172.21.15.110:0/1630391539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9300fcf80 msgr2=0x7fe93010e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9300fcf80 0x7fe93010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 -- 172.21.15.110:0/1630391539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c005040 con 0x7fe9300fb810 2024-09-16T02:17:37.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe935d31640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe93010e170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe92c003080 tx=0x7fe92c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:37.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92c038070 con 0x7fe9300fb810 2024-09-16T02:17:37.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe92c02ade0 con 0x7fe9300fb810 2024-09-16T02:17:37.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.658+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9301171e0 con 0x7fe9300fb810 2024-09-16T02:17:37.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.659+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92c02c880 con 0x7fe9300fb810 2024-09-16T02:17:37.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.659+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9301175e0 con 0x7fe9300fb810 2024-09-16T02:17:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.659+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9300fcbc0 con 0x7fe9300fb810 2024-09-16T02:17:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.660+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe92c030020 con 0x7fe9300fb810 2024-09-16T02:17:37.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.660+0000 7fe9267fc640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe91c06e530 0x7fe91c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:37.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.661+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fe92c0ae2f0 con 0x7fe9300fb810 2024-09-16T02:17:37.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.661+0000 7fe935530640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe91c06e530 0x7fe91c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:37.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.661+0000 7fe935530640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe91c06e530 0x7fe91c0709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe930065980 tx=0x7fe920007c30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:37.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.665+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe92c077310 con 0x7fe9300fb810 2024-09-16T02:17:37.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.863+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fe930072ec0 con 0x7fe9300fb810 2024-09-16T02:17:37.865 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:37.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.864+0000 7fe9267fc640 1 -- 172.21.15.110:0/1630391539 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+5251 (secure 0 0 0) 0x7fe92c07a9d0 con 0x7fe9300fb810 2024-09-16T02:17:37.866 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:37.866 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"btime":"2024-09-16T02:14:51:527300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:50.530268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":14,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T02:17:37.866 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 32 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe91c06e530 msgr2=0x7fe91c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe91c06e530 0x7fe91c0709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe930065980 tx=0x7fe920007c30 comp rx=0 tx=0).stop 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 msgr2=0x7fe93010e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe93010e170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe92c003080 tx=0x7fe92c009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 shutdown_connections 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fe91c06e530 0x7fe91c0709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9300fcf80 0x7fe93010e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 --2- 172.21.15.110:0/1630391539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9300fb810 0x7fe93010e170 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:37.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.866+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 >> 172.21.15.110:0/1630391539 conn(0x7fe9300723b0 msgr2=0x7fe9300fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:37.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.867+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 shutdown_connections 2024-09-16T02:17:37.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:37.867+0000 7fe937f95640 1 -- 172.21.15.110:0/1630391539 wait complete. 2024-09-16T02:17:37.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:38.627 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:38 smithi110 ceph-mon[98215]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:38.627 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:38 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/1630391539' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-16T02:17:38.651 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-16T02:17:38.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-16T02:17:38.898 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:38 smithi165 ceph-mon[77258]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:38 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/1630391539' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-16T02:17:40.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 -- 172.21.15.110:0/369035045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 msgr2=0x7fa8980fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:40.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 --2- 172.21.15.110:0/369035045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa8980fb0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0048d0 tx=0x7fa88c009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 -- 172.21.15.110:0/369035045 shutdown_connections 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 --2- 172.21.15.110:0/369035045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa8980fb0d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 --2- 172.21.15.110:0/369035045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa898102660 0x7fa898102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 -- 172.21.15.110:0/369035045 >> 172.21.15.110:0/369035045 conn(0x7fa898070ce0 msgr2=0x7fa8980710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 -- 172.21.15.110:0/369035045 shutdown_connections 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 -- 172.21.15.110:0/369035045 wait complete. 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 Processor -- start 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.481+0000 7fa89dc85640 1 -- start start 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa89dc85640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa898113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa89dc85640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa898102660 0x7fa8981137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa89dc85640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898113db0 con 0x7fa8980fac80 2024-09-16T02:17:40.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa89dc85640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89810d1f0 con 0x7fa898102660 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa898113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa898113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59438/0 (socket says 172.21.15.110:59438) 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 -- 172.21.15.110:0/3221244966 learned_addr learned my addr 172.21.15.110:0/3221244966 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa896ffd640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa898102660 0x7fa8981137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 -- 172.21.15.110:0/3221244966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa898102660 msgr2=0x7fa8981137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa898102660 0x7fa8981137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 -- 172.21.15.110:0/3221244966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c005040 con 0x7fa8980fac80 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa8977fe640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa898113270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa888002a50 tx=0x7fa888004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa888007c30 con 0x7fa8980fac80 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa88800f040 con 0x7fa8980fac80 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa88800da10 con 0x7fa8980fac80 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.482+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89810d4d0 con 0x7fa8980fac80 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.483+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89810d970 con 0x7fa8980fac80 2024-09-16T02:17:40.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.484+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8980657d0 con 0x7fa8980fac80 2024-09-16T02:17:40.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.484+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa88800dc80 con 0x7fa8980fac80 2024-09-16T02:17:40.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.485+0000 7fa87ffff640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa88006e530 0x7fa8800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:40.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.485+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7fa88808da00 con 0x7fa8980fac80 2024-09-16T02:17:40.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.485+0000 7fa896ffd640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa88006e530 0x7fa8800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:40.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.485+0000 7fa896ffd640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa88006e530 0x7fa8800709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009ac0 tx=0x7fa88c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:40.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.489+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa888056ad0 con 0x7fa8980fac80 2024-09-16T02:17:40.528 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:40 smithi110 ceph-mon[98215]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:40.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.691+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fa89804b750 con 0x7fa8980fac80 2024-09-16T02:17:40.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.692+0000 7fa87ffff640 1 -- 172.21.15.110:0/3221244966 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+5260 (secure 0 0 0) 0x7fa88805a190 con 0x7fa8980fac80 2024-09-16T02:17:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":33,"btime":"2024-09-16T02:14:52:547382+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:52.547380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-16T02:17:40.694 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 33 2024-09-16T02:17:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa88006e530 msgr2=0x7fa8800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:40.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa88006e530 0x7fa8800709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009ac0 tx=0x7fa88c035040 comp rx=0 tx=0).stop 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 msgr2=0x7fa898113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa898113270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa888002a50 tx=0x7fa888004600 comp rx=0 tx=0).stop 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 shutdown_connections 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7fa88006e530 0x7fa8800709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa898102660 0x7fa8981137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 --2- 172.21.15.110:0/3221244966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8980fac80 0x7fa898113270 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 >> 172.21.15.110:0/3221244966 conn(0x7fa898070ce0 msgr2=0x7fa8980fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 shutdown_connections 2024-09-16T02:17:40.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:40.694+0000 7fa89dc85640 1 -- 172.21.15.110:0/3221244966 wait complete. 2024-09-16T02:17:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:40 smithi165 ceph-mon[77258]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:41.366 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-16T02:17:41.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-16T02:17:41.618 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:41.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:41 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3221244966' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-16T02:17:41.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:41 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3221244966' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-16T02:17:42.665 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:42 smithi110 ceph-mon[98215]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:42 smithi165 ceph-mon[77258]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:43.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 -- 172.21.15.110:0/3433524125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102530 msgr2=0x7f3150102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:43.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 --2- 172.21.15.110:0/3433524125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102530 0x7f3150102900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f31400048d0 tx=0x7f3140009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 -- 172.21.15.110:0/3433524125 shutdown_connections 2024-09-16T02:17:43.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 --2- 172.21.15.110:0/3433524125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3150102ed0 0x7f31500fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 --2- 172.21.15.110:0/3433524125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102530 0x7f3150102900 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 -- 172.21.15.110:0/3433524125 >> 172.21.15.110:0/3433524125 conn(0x7f31500f8110 msgr2=0x7f31500fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:43.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 -- 172.21.15.110:0/3433524125 shutdown_connections 2024-09-16T02:17:43.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.155+0000 7f3156c99640 1 -- 172.21.15.110:0/3433524125 wait complete. 2024-09-16T02:17:43.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f3156c99640 1 Processor -- start 2024-09-16T02:17:43.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f3156c99640 1 -- start start 2024-09-16T02:17:43.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f3156c99640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3150102530 0x7f315006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:43.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f3156c99640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 0x7f315006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:43.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f3156c99640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150070520 con 0x7f3150102ed0 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f3156c99640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150070690 con 0x7f3150102530 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f314ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 0x7f315006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f314ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 0x7f315006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59456/0 (socket says 172.21.15.110:59456) 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.156+0000 7f314ffff640 1 -- 172.21.15.110:0/3152996857 learned_addr learned my addr 172.21.15.110:0/3152996857 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f3154a35640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3150102530 0x7f315006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314ffff640 1 -- 172.21.15.110:0/3152996857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3150102530 msgr2=0x7f315006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314ffff640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3150102530 0x7f315006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314ffff640 1 -- 172.21.15.110:0/3152996857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140005040 con 0x7f3150102ed0 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314ffff640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 0x7f315006ff50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f314400b540 tx=0x7f31440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f314400f6f0 con 0x7f3150102ed0 2024-09-16T02:17:43.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f314400fcf0 con 0x7f3150102ed0 2024-09-16T02:17:43.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3150119590 con 0x7f3150102ed0 2024-09-16T02:17:43.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3144011e80 con 0x7f3150102ed0 2024-09-16T02:17:43.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.157+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31501199d0 con 0x7f3150102ed0 2024-09-16T02:17:43.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.158+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31500fdcb0 con 0x7f3150102ed0 2024-09-16T02:17:43.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.159+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f31440116b0 con 0x7f3150102ed0 2024-09-16T02:17:43.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.159+0000 7f314d7fa640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f313806e530 0x7f31380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:43.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.159+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f314408e150 con 0x7f3150102ed0 2024-09-16T02:17:43.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.159+0000 7f3154a35640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f313806e530 0x7f31380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:43.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.160+0000 7f3154a35640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f313806e530 0x7f31380709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3140000c00 tx=0x7f3140035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:43.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.164+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f31440571f0 con 0x7f3150102ed0 2024-09-16T02:17:43.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.364+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f3150109640 con 0x7f3150102ed0 2024-09-16T02:17:43.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.365+0000 7f314d7fa640 1 -- 172.21.15.110:0/3152996857 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+5260 (secure 0 0 0) 0x7f314405a8b0 con 0x7f3150102ed0 2024-09-16T02:17:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:43.366 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":34,"btime":"2024-09-16T02:14:56:591956+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:55.595201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-16T02:17:43.366 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 34 2024-09-16T02:17:43.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f313806e530 msgr2=0x7f31380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:43.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f313806e530 0x7f31380709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3140000c00 tx=0x7f3140035040 comp rx=0 tx=0).stop 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 msgr2=0x7f315006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 0x7f315006ff50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f314400b540 tx=0x7f31440091a0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 shutdown_connections 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f313806e530 0x7f31380709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3150102ed0 0x7f315006ff50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 --2- 172.21.15.110:0/3152996857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3150102530 0x7f315006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 >> 172.21.15.110:0/3152996857 conn(0x7f31500f8110 msgr2=0x7f31500f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 shutdown_connections 2024-09-16T02:17:43.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:43.367+0000 7f3156c99640 1 -- 172.21.15.110:0/3152996857 wait complete. 2024-09-16T02:17:43.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:43 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3152996857' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-16T02:17:43.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:43 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3152996857' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-16T02:17:44.075 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-16T02:17:44.075 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-16T02:17:44.321 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:44.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:44 smithi110 ceph-mon[98215]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:44 smithi165 ceph-mon[77258]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:45.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 -- 172.21.15.110:0/479618230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f80fb4d0 msgr2=0x7f50f80fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/479618230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f80fb4d0 0x7f50f80fb940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f50e80048d0 tx=0x7f50e8009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 -- 172.21.15.110:0/479618230 shutdown_connections 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/479618230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f80fb4d0 0x7f50f80fb940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/479618230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f8101510 0x7f50f81018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 -- 172.21.15.110:0/479618230 >> 172.21.15.110:0/479618230 conn(0x7f50f80f7090 msgr2=0x7f50f80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 -- 172.21.15.110:0/479618230 shutdown_connections 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.962+0000 7f50ff6b6640 1 -- 172.21.15.110:0/479618230 wait complete. 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50ff6b6640 1 Processor -- start 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50ff6b6640 1 -- start start 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50ff6b6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f80fb4d0 0x7f50f810e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:45.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50ff6b6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 0x7f50f810e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50ff6b6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f810edd0 con 0x7f50f8101510 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50ff6b6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f810ef40 con 0x7f50f80fb4d0 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fcc51640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 0x7f50f810e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fcc51640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 0x7f50f810e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59472/0 (socket says 172.21.15.110:59472) 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fcc51640 1 -- 172.21.15.110:0/878994387 learned_addr learned my addr 172.21.15.110:0/878994387 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fd452640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f80fb4d0 0x7f50f810e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fcc51640 1 -- 172.21.15.110:0/878994387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f80fb4d0 msgr2=0x7f50f810e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fcc51640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f80fb4d0 0x7f50f810e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.963+0000 7f50fcc51640 1 -- 172.21.15.110:0/878994387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8005040 con 0x7f50f8101510 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.964+0000 7f50fcc51640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 0x7f50f810e890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50e8003080 tx=0x7f50e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.964+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e8038070 con 0x7f50f8101510 2024-09-16T02:17:45.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.964+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50e80097e0 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.964+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e803d420 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.964+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f8117220 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.964+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f81176e0 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.965+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f80fcc10 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.966+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f50e8030020 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.966+0000 7f50edffb640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f50e406e530 0x7f50e40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.966+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f50e80ae7d0 con 0x7f50f8101510 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.966+0000 7f50fd452640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f50e406e530 0x7f50e40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.966+0000 7f50fd452640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f50e406e530 0x7f50e40709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:45.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:45.970+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f50e8077870 con 0x7f50f8101510 2024-09-16T02:17:46.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.185+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f50f80fac90 con 0x7f50f8101510 2024-09-16T02:17:46.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.186+0000 7f50edffb640 1 -- 172.21.15.110:0/878994387 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5259 (secure 0 0 0) 0x7f50e807af30 con 0x7f50f8101510 2024-09-16T02:17:46.188 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T02:17:46.188 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":35,"btime":"2024-09-16T02:14:57:593855+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi110.svegdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6829/926668832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":926668832},{"type":"v1","addr":"172.21.15.110:6829","nonce":926668832}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44319,"name":"cephfs.smithi165.hskfht","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/2342221402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2342221402},{"type":"v1","addr":"172.21.15.165:6825","nonce":2342221402}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44333,"name":"cephfs.smithi165.gxrypw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3028375374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3028375374},{"type":"v1","addr":"172.21.15.165:6827","nonce":3028375374}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T02:03:08.960050+0000","modified":"2024-09-16T02:14:56.597103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi110.yaugxw","rank":0,"incarnation":29,"state":"up:active","state_seq":15,"addr":"172.21.15.110:6827/3147803170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3147803170},{"type":"v1","addr":"172.21.15.110:6827","nonce":3147803170}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-16T02:17:46.188 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 35 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f50e406e530 msgr2=0x7f50e40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f50e406e530 0x7f50e40709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50f4006fd0 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 msgr2=0x7f50f810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 0x7f50f810e890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50e8003080 tx=0x7f50e8009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 shutdown_connections 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f50e406e530 0x7f50e40709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50f8101510 0x7f50f810e890 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 --2- 172.21.15.110:0/878994387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50f80fb4d0 0x7f50f810e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 >> 172.21.15.110:0/878994387 conn(0x7f50f80f7090 msgr2=0x7f50f80f8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.188+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 shutdown_connections 2024-09-16T02:17:46.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:46.189+0000 7f50ff6b6640 1 -- 172.21.15.110:0/878994387 wait complete. 2024-09-16T02:17:46.874 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:46 smithi110 ceph-mon[98215]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:46.874 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:46 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/878994387' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-16T02:17:46.900 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-16T02:17:46.910 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-16T02:17:46.910 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T02:17:46.910 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T02:17:46.929 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T02:17:46.929 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T02:17:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:46 smithi165 ceph-mon[77258]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:46 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/878994387' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-16T02:17:46.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T02:17:47.273 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:48.695 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:48 smithi110 ceph-mon[98215]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:48.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 -- 172.21.15.110:0/905942255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 msgr2=0x7f03f00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 --2- 172.21.15.110:0/905942255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f00fc5b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f03d80048d0 tx=0x7f03d8009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 -- 172.21.15.110:0/905942255 shutdown_connections 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 --2- 172.21.15.110:0/905942255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f00fc5b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 --2- 172.21.15.110:0/905942255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f0102550 0x7f03f0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 -- 172.21.15.110:0/905942255 >> 172.21.15.110:0/905942255 conn(0x7f03f00f80f0 msgr2=0x7f03f00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 -- 172.21.15.110:0/905942255 shutdown_connections 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.903+0000 7f03f5b58640 1 -- 172.21.15.110:0/905942255 wait complete. 2024-09-16T02:17:48.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03f5b58640 1 Processor -- start 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03f5b58640 1 -- start start 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03f5b58640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f0102550 0x7f03f0113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03f5b58640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f0113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03f5b58640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0114090 con 0x7f03f0102ef0 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03f5b58640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f010d4a0 con 0x7f03f0102550 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f0113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f0113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59494/0 (socket says 172.21.15.110:59494) 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03e7fff640 1 -- 172.21.15.110:0/546958776 learned_addr learned my addr 172.21.15.110:0/546958776 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03ef7fe640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f0102550 0x7f03f0113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03e7fff640 1 -- 172.21.15.110:0/546958776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f0102550 msgr2=0x7f03f0113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03e7fff640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f0102550 0x7f03f0113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:48.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.904+0000 7f03e7fff640 1 -- 172.21.15.110:0/546958776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8005040 con 0x7f03f0102ef0 2024-09-16T02:17:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.905+0000 7f03e7fff640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f0113a40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f03d8003080 tx=0x7f03d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.905+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d8038070 con 0x7f03f0102ef0 2024-09-16T02:17:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.905+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f03d8009760 con 0x7f03f0102ef0 2024-09-16T02:17:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.905+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d8033420 con 0x7f03f0102ef0 2024-09-16T02:17:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.905+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f010d720 con 0x7f03f0102ef0 2024-09-16T02:17:48.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.905+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f010dc00 con 0x7f03f0102ef0 2024-09-16T02:17:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.906+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00fdcd0 con 0x7f03f0102ef0 2024-09-16T02:17:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.906+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f03d8030020 con 0x7f03f0102ef0 2024-09-16T02:17:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.907+0000 7f03ecff9640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f03dc06e530 0x7f03dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.907+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f03d80aded0 con 0x7f03f0102ef0 2024-09-16T02:17:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.907+0000 7f03ef7fe640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f03dc06e530 0x7f03dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:48.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.907+0000 7f03ef7fe640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f03dc06e530 0x7f03dc0709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03e0007fd0 tx=0x7f03e0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:48.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:48.911+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03d8076ef0 con 0x7f03f0102ef0 2024-09-16T02:17:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:48 smithi165 ceph-mon[77258]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:49.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.090+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03f00fbd50 con 0x7f03f0102ef0 2024-09-16T02:17:49.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.091+0000 7f03ecff9640 1 -- 172.21.15.110:0/546958776 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v90) v1 ==== 81+0+2217 (secure 0 0 0) 0x7f03d807a5b0 con 0x7f03f0102ef0 2024-09-16T02:17:49.092 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6827/441401724 2024-09-17T02:14:41.652294+0000 2024-09-16T02:17:49.092 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3922987002 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:49.092 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3922987002 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:49.092 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3146550769 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/3621391978 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1315429218 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/1015288142 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/4287951481 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/1015288142 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3914114363 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3244469834 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1388363081 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3914114363 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/2073782143 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6828/1935931447 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:49.093 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6826/3304502676 2024-09-17T02:13:52.401504+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/507819561 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3472936084 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1760065388 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1150541288 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/350261868 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/2073782143 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/519121796 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6827/3304502676 2024-09-17T02:13:52.401504+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/44402193 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/841598639 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2684868236 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/2246690447 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/101234097 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:49.094 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6829/1935931447 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/750341792 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/29058709 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6826/441401724 2024-09-17T02:14:41.652294+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/750341792 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/728530367 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/2275099102 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:49.095 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/4106647831 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:49.096 INFO:teuthology.orchestra.run.smithi110.stderr:listed 37 entries 2024-09-16T02:17:49.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.092+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f03dc06e530 msgr2=0x7f03dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:49.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.092+0000 7f03f5b58640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f03dc06e530 0x7f03dc0709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03e0007fd0 tx=0x7f03e0009040 comp rx=0 tx=0).stop 2024-09-16T02:17:49.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.092+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 msgr2=0x7f03f0113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:49.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.092+0000 7f03f5b58640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f0113a40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f03d8003080 tx=0x7f03d8009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:49.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 shutdown_connections 2024-09-16T02:17:49.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f03dc06e530 0x7f03dc0709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:49.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03f0102ef0 0x7f03f0113a40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:49.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 --2- 172.21.15.110:0/546958776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f0102550 0x7f03f0113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:49.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 >> 172.21.15.110:0/546958776 conn(0x7f03f00f80f0 msgr2=0x7f03f00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:49.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 shutdown_connections 2024-09-16T02:17:49.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:49.093+0000 7f03f5b58640 1 -- 172.21.15.110:0/546958776 wait complete. 2024-09-16T02:17:49.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:49 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/546958776' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T02:17:49.817 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T02:17:49.817 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T02:17:49.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T02:17:49.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:49 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/546958776' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T02:17:50.121 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/mon.smithi110/config 2024-09-16T02:17:50.889 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:50 smithi110 ceph-mon[98215]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:50 smithi165 ceph-mon[77258]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3163433545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fb810 msgr2=0x7f0bd00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3163433545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fb810 0x7f0bd00fbbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0048d0 tx=0x7f0bcc009da0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3163433545 shutdown_connections 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3163433545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bd00fcf80 0x7f0bd00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3163433545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fb810 0x7f0bd00fbbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3163433545 >> 172.21.15.110:0/3163433545 conn(0x7f0bd00723b0 msgr2=0x7f0bd00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.760+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3163433545 shutdown_connections 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3163433545 wait complete. 2024-09-16T02:17:51.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 Processor -- start 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 -- start start 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bd00fb810 0x7f0bd0112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 0x7f0bd0112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0112cd0 con 0x7f0bd00fcf80 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.761+0000 7f0bd72f9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd010c080 con 0x7f0bd00fb810 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 0x7f0bd0112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 0x7f0bd0112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43204/0 (socket says 172.21.15.110:43204) 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 -- 172.21.15.110:0/3175417950 learned_addr learned my addr 172.21.15.110:0/3175417950 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd5095640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bd00fb810 0x7f0bd0112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 -- 172.21.15.110:0/3175417950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bd00fb810 msgr2=0x7f0bd0112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bd00fb810 0x7f0bd0112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 -- 172.21.15.110:0/3175417950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc005040 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd4894640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 0x7f0bd0112640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000b790 tx=0x7f0bc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc000c700 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd010c360 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0bc000cd00 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc0015e70 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.762+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd010c880 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.763+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00fcbc0 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.764+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0bc0012070 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.764+0000 7f0bc5ffb640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0bbc06e530 0x7f0bbc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.764+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f0bc008de50 con 0x7f0bd00fcf80 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.764+0000 7f0bd5095640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0bbc06e530 0x7f0bbc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.765+0000 7f0bd5095640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0bbc06e530 0x7f0bbc0709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009ac0 tx=0x7f0bcc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T02:17:51.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.769+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0bc0056e70 con 0x7f0bd00fcf80 2024-09-16T02:17:51.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.946+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0bd004b720 con 0x7f0bd00fcf80 2024-09-16T02:17:51.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.947+0000 7f0bc5ffb640 1 -- 172.21.15.110:0/3175417950 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v90) v1 ==== 81+0+2217 (secure 0 0 0) 0x7f0bc005a530 con 0x7f0bd00fcf80 2024-09-16T02:17:51.948 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6827/441401724 2024-09-17T02:14:41.652294+0000 2024-09-16T02:17:51.948 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3922987002 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3922987002 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3146550769 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/3621391978 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1315429218 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/1015288142 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/4287951481 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/1015288142 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3914114363 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3244469834 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1388363081 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:51.949 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3914114363 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/2073782143 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6828/1935931447 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6826/3304502676 2024-09-17T02:13:52.401504+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/507819561 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3472936084 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1760065388 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1150541288 2024-09-17T02:05:17.605375+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/350261868 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/2073782143 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:51.950 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/519121796 2024-09-17T01:57:33.044545+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6827/3304502676 2024-09-17T02:13:52.401504+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/44402193 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/841598639 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2684868236 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/2246690447 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/101234097 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6829/1935931447 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/750341792 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/29058709 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:6826/441401724 2024-09-17T02:14:41.652294+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/750341792 2024-09-17T01:57:04.101594+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/728530367 2024-09-17T01:58:32.725210+0000 2024-09-16T02:17:51.951 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.165:0/2275099102 2024-09-17T02:07:29.116126+0000 2024-09-16T02:17:51.952 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/4106647831 2024-09-17T02:09:37.285675+0000 2024-09-16T02:17:51.952 INFO:teuthology.orchestra.run.smithi110.stderr:listed 37 entries 2024-09-16T02:17:51.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0bbc06e530 msgr2=0x7f0bbc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:51.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0bbc06e530 0x7f0bbc0709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009ac0 tx=0x7f0bcc035040 comp rx=0 tx=0).stop 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 msgr2=0x7f0bd0112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 0x7f0bd0112640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000b790 tx=0x7f0bc00091d0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 shutdown_connections 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:6800/1811753471,v1:172.21.15.110:6801/1811753471] conn(0x7f0bbc06e530 0x7f0bbc0709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bd00fcf80 0x7f0bd0112640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 --2- 172.21.15.110:0/3175417950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bd00fb810 0x7f0bd0112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 >> 172.21.15.110:0/3175417950 conn(0x7f0bd00723b0 msgr2=0x7f0bd00fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 shutdown_connections 2024-09-16T02:17:51.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T02:17:51.949+0000 7f0bd72f9640 1 -- 172.21.15.110:0/3175417950 wait complete. 2024-09-16T02:17:52.563 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi110.front.sepia.ceph.com... 2024-09-16T02:17:52.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T02:17:52.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-16T02:17:52.590 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T02:17:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:52 smithi165 ceph-mon[77258]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:52 smithi165 ceph-mon[77258]: from='client.? 172.21.15.110:0/3175417950' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T02:17:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:52 smithi110 ceph-mon[98215]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:52 smithi110 ceph-mon[98215]: from='client.? 172.21.15.110:0/3175417950' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T02:17:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:17:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:54 smithi165 ceph-mon[77258]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:54 smithi110 ceph-mon[98215]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:56 smithi165 ceph-mon[77258]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:56.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:56 smithi110 ceph-mon[98215]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:17:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:58 smithi165 ceph-mon[77258]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:58 smithi110 ceph-mon[98215]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:17:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:17:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:17:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:17:59 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:17:59.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:17:59.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:17:59.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:17:59 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:18:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:00 smithi110 ceph-mon[98215]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:18:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:18:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:18:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:00 smithi165 ceph-mon[77258]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:18:00.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:18:00.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:18:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:02 smithi165 ceph-mon[77258]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:02 smithi110 ceph-mon[98215]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:04 smithi165 ceph-mon[77258]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:04 smithi110 ceph-mon[98215]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:06 smithi165 ceph-mon[77258]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:06 smithi110 ceph-mon[98215]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:07.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:08 smithi165 ceph-mon[77258]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:08 smithi110 ceph-mon[98215]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:10 smithi165 ceph-mon[77258]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:10.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:10 smithi110 ceph-mon[98215]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:12 smithi165 ceph-mon[77258]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:12.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:12 smithi110 ceph-mon[98215]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:14 smithi165 ceph-mon[77258]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:14 smithi110 ceph-mon[98215]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:16 smithi165 ceph-mon[77258]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:16 smithi110 ceph-mon[98215]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:18 smithi165 ceph-mon[77258]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:18 smithi110 ceph-mon[98215]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:20 smithi165 ceph-mon[77258]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:20 smithi110 ceph-mon[98215]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:22 smithi165 ceph-mon[77258]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:22 smithi110 ceph-mon[98215]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:24 smithi165 ceph-mon[77258]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:24 smithi110 ceph-mon[98215]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:26 smithi165 ceph-mon[77258]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:26 smithi110 ceph-mon[98215]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:28 smithi165 ceph-mon[77258]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:28 smithi110 ceph-mon[98215]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:30 smithi165 ceph-mon[77258]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:30 smithi110 ceph-mon[98215]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:32 smithi165 ceph-mon[77258]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:32.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:32 smithi110 ceph-mon[98215]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:34 smithi165 ceph-mon[77258]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:34.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:34 smithi110 ceph-mon[98215]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:36 smithi165 ceph-mon[77258]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:36 smithi110 ceph-mon[98215]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:37.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:37.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:38 smithi165 ceph-mon[77258]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:38.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:38 smithi110 ceph-mon[98215]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:40 smithi165 ceph-mon[77258]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:40 smithi110 ceph-mon[98215]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:42 smithi165 ceph-mon[77258]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:42.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:42 smithi110 ceph-mon[98215]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:44.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:44 smithi165 ceph-mon[77258]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:44.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:44 smithi110 ceph-mon[98215]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:46 smithi165 ceph-mon[77258]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:46 smithi110 ceph-mon[98215]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:48 smithi165 ceph-mon[77258]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:48 smithi110 ceph-mon[98215]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:50 smithi165 ceph-mon[77258]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:50.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:50 smithi110 ceph-mon[98215]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:52 smithi165 ceph-mon[77258]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:52 smithi110 ceph-mon[98215]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:18:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:54 smithi165 ceph-mon[77258]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:54 smithi110 ceph-mon[98215]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:56 smithi165 ceph-mon[77258]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:56.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:56 smithi110 ceph-mon[98215]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:58 smithi165 ceph-mon[77258]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:58 smithi110 ceph-mon[98215]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:18:59.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:18:59 smithi165 ceph-mon[77258]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:18:59.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:18:59 smithi110 ceph-mon[98215]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:19:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:19:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:19:00.858 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:19:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:19:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:19:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:19:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:19:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:01 smithi165 ceph-mon[77258]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:01.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:01 smithi110 ceph-mon[98215]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:04 smithi165 ceph-mon[77258]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:04 smithi110 ceph-mon[98215]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:06 smithi165 ceph-mon[77258]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:06 smithi110 ceph-mon[98215]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:07.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:08 smithi165 ceph-mon[77258]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:08.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:08 smithi110 ceph-mon[98215]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:10 smithi165 ceph-mon[77258]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:10 smithi110 ceph-mon[98215]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:12.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:12 smithi110 ceph-mon[98215]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:12 smithi165 ceph-mon[77258]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:14 smithi165 ceph-mon[77258]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:14.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:14 smithi110 ceph-mon[98215]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:16 smithi165 ceph-mon[77258]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:16 smithi110 ceph-mon[98215]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:18 smithi165 ceph-mon[77258]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:18.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:18 smithi110 ceph-mon[98215]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:20 smithi165 ceph-mon[77258]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:20.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:20 smithi110 ceph-mon[98215]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:22 smithi110 ceph-mon[98215]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:22 smithi165 ceph-mon[77258]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:24 smithi165 ceph-mon[77258]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:24 smithi110 ceph-mon[98215]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:26 smithi165 ceph-mon[77258]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:26.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:26 smithi110 ceph-mon[98215]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:28 smithi165 ceph-mon[77258]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:28 smithi110 ceph-mon[98215]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:30 smithi165 ceph-mon[77258]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:30.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:30 smithi110 ceph-mon[98215]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:32.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:32 smithi110 ceph-mon[98215]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:32 smithi165 ceph-mon[77258]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:34 smithi165 ceph-mon[77258]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:34.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:34 smithi110 ceph-mon[98215]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:36 smithi165 ceph-mon[77258]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:36 smithi110 ceph-mon[98215]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:37.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:38 smithi165 ceph-mon[77258]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:38.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:38 smithi110 ceph-mon[98215]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:40 smithi165 ceph-mon[77258]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:40 smithi110 ceph-mon[98215]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:42 smithi110 ceph-mon[98215]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:42 smithi165 ceph-mon[77258]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:44 smithi165 ceph-mon[77258]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:44.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:44 smithi110 ceph-mon[98215]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:46.953 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:46 smithi165 ceph-mon[77258]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:46 smithi110 ceph-mon[98215]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:48 smithi165 ceph-mon[77258]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:48 smithi110 ceph-mon[98215]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:50 smithi165 ceph-mon[77258]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:50 smithi110 ceph-mon[98215]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:52 smithi165 ceph-mon[77258]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:52 smithi110 ceph-mon[98215]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:19:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:54 smithi165 ceph-mon[77258]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:54 smithi110 ceph-mon[98215]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:56.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:56 smithi165 ceph-mon[77258]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:56.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:56 smithi110 ceph-mon[98215]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:19:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:19:58 smithi165 ceph-mon[77258]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:19:58.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:19:58 smithi110 ceph-mon[98215]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:00 smithi165 ceph-mon[77258]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:00 smithi165 ceph-mon[77258]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:20:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:00 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:20:00.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:00 smithi110 ceph-mon[98215]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:00.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:00 smithi110 ceph-mon[98215]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T02:20:00.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:00 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:20:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:20:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:20:02.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:20:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:20:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:20:02.201 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:01 smithi165 ceph-mon[77258]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:20:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:20:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:20:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:20:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:20:02.207 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:01 smithi110 ceph-mon[98215]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:04 smithi165 ceph-mon[77258]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:04 smithi110 ceph-mon[98215]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:06 smithi165 ceph-mon[77258]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:06.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:06 smithi110 ceph-mon[98215]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:07.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:08 smithi165 ceph-mon[77258]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:08.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:08 smithi110 ceph-mon[98215]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:10 smithi165 ceph-mon[77258]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:10 smithi110 ceph-mon[98215]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:12.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:12 smithi110 ceph-mon[98215]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:12.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:12 smithi165 ceph-mon[77258]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:14 smithi165 ceph-mon[77258]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:14.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:14 smithi110 ceph-mon[98215]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:16 smithi165 ceph-mon[77258]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:16 smithi110 ceph-mon[98215]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:18 smithi165 ceph-mon[77258]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:18 smithi110 ceph-mon[98215]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:20 smithi165 ceph-mon[77258]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:20 smithi110 ceph-mon[98215]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:22 smithi110 ceph-mon[98215]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:22.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:22 smithi165 ceph-mon[77258]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:24 smithi165 ceph-mon[77258]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:24 smithi110 ceph-mon[98215]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:26 smithi165 ceph-mon[77258]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:26.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:26 smithi110 ceph-mon[98215]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:28 smithi165 ceph-mon[77258]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:28.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:28 smithi110 ceph-mon[98215]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:30.952 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:30 smithi165 ceph-mon[77258]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:30.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:30 smithi110 ceph-mon[98215]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:32.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:32 smithi110 ceph-mon[98215]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:32 smithi165 ceph-mon[77258]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:34 smithi165 ceph-mon[77258]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:34.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:34 smithi110 ceph-mon[98215]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:36 smithi165 ceph-mon[77258]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:36 smithi110 ceph-mon[98215]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:38 smithi165 ceph-mon[77258]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:38.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:38 smithi110 ceph-mon[98215]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:40 smithi165 ceph-mon[77258]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:40.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:40 smithi110 ceph-mon[98215]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:42 smithi165 ceph-mon[77258]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:42.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:42 smithi110 ceph-mon[98215]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:44 smithi165 ceph-mon[77258]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:44.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:44 smithi110 ceph-mon[98215]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:46 smithi165 ceph-mon[77258]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:46.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:46 smithi110 ceph-mon[98215]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:48 smithi165 ceph-mon[77258]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:48 smithi110 ceph-mon[98215]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:50 smithi165 ceph-mon[77258]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:50.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:50 smithi110 ceph-mon[98215]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:52 smithi165 ceph-mon[77258]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:52 smithi110 ceph-mon[98215]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:20:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:54 smithi165 ceph-mon[77258]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:54 smithi110 ceph-mon[98215]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:56 smithi165 ceph-mon[77258]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:56.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:56 smithi110 ceph-mon[98215]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:20:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:20:58 smithi165 ceph-mon[77258]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:20:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:20:58 smithi110 ceph-mon[98215]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:00 smithi165 ceph-mon[77258]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:00.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:00 smithi110 ceph-mon[98215]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:01.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:01 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:21:01.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:01 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:21:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:02 smithi165 ceph-mon[77258]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:21:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:21:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:21:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:02 smithi110 ceph-mon[98215]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:21:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:21:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:21:04.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:04 smithi165 ceph-mon[77258]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:04.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:04 smithi110 ceph-mon[98215]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:06 smithi165 ceph-mon[77258]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:06 smithi110 ceph-mon[98215]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:08 smithi165 ceph-mon[77258]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:08.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:08 smithi110 ceph-mon[98215]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:10 smithi165 ceph-mon[77258]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:10.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:10 smithi110 ceph-mon[98215]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:12 smithi165 ceph-mon[77258]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:12.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:12 smithi110 ceph-mon[98215]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:14 smithi165 ceph-mon[77258]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:14.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:14 smithi110 ceph-mon[98215]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:16 smithi165 ceph-mon[77258]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:16.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:16 smithi110 ceph-mon[98215]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:18 smithi165 ceph-mon[77258]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:18 smithi110 ceph-mon[98215]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:20 smithi165 ceph-mon[77258]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:20 smithi110 ceph-mon[98215]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:22 smithi165 ceph-mon[77258]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:22.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:22.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:22 smithi110 ceph-mon[98215]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:24 smithi165 ceph-mon[77258]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:24.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:24 smithi110 ceph-mon[98215]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:26 smithi165 ceph-mon[77258]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:26.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:26 smithi110 ceph-mon[98215]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:28.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:28 smithi165 ceph-mon[77258]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:28.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:28 smithi110 ceph-mon[98215]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:30 smithi165 ceph-mon[77258]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:30.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:30 smithi110 ceph-mon[98215]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:32 smithi165 ceph-mon[77258]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:32.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:32 smithi110 ceph-mon[98215]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:33.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:33 smithi165 ceph-mon[77258]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:33.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:33 smithi110 ceph-mon[98215]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:36 smithi165 ceph-mon[77258]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:36.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:36 smithi110 ceph-mon[98215]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:37.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:37.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:38 smithi165 ceph-mon[77258]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:38.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:38 smithi110 ceph-mon[98215]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:40 smithi165 ceph-mon[77258]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:40 smithi110 ceph-mon[98215]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:42.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:42 smithi110 ceph-mon[98215]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:42 smithi165 ceph-mon[77258]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:44 smithi165 ceph-mon[77258]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:44.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:44 smithi110 ceph-mon[98215]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:46 smithi165 ceph-mon[77258]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:46 smithi110 ceph-mon[98215]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:48 smithi165 ceph-mon[77258]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:48.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:48 smithi110 ceph-mon[98215]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:50 smithi165 ceph-mon[77258]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:50 smithi110 ceph-mon[98215]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:52 smithi165 ceph-mon[77258]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:52.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:52 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:52.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:52 smithi110 ceph-mon[98215]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:52.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:52 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:21:54.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:54 smithi165 ceph-mon[77258]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:54.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:54 smithi110 ceph-mon[98215]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:56.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:56 smithi165 ceph-mon[77258]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:56.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:56 smithi110 ceph-mon[98215]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:21:58.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:21:58 smithi165 ceph-mon[77258]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:21:58.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:21:58 smithi110 ceph-mon[98215]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:00.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:00 smithi165 ceph-mon[77258]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:00.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:00 smithi110 ceph-mon[98215]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:02 smithi165 ceph-mon[77258]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:22:02.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:22:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:22:02.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:02 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:22:02.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:02 smithi110 ceph-mon[98215]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:02.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T02:22:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T02:22:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T02:22:02.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:02 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' 2024-09-16T02:22:04.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:04 smithi165 ceph-mon[77258]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:04.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:04 smithi110 ceph-mon[98215]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:06.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:06 smithi165 ceph-mon[77258]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:06.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:06 smithi110 ceph-mon[98215]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:07.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:07 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:22:07.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:07 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:22:08.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:08 smithi165 ceph-mon[77258]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:08.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:08 smithi110 ceph-mon[98215]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:10.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:10 smithi165 ceph-mon[77258]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:10.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:10 smithi110 ceph-mon[98215]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:12.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:12 smithi165 ceph-mon[77258]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:12.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:12 smithi110 ceph-mon[98215]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:14.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:14 smithi165 ceph-mon[77258]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:14.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:14 smithi110 ceph-mon[98215]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:16.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:16 smithi165 ceph-mon[77258]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:16.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:16 smithi110 ceph-mon[98215]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:18.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:18 smithi165 ceph-mon[77258]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:18.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:18 smithi110 ceph-mon[98215]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:20.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:20 smithi165 ceph-mon[77258]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:20.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:20 smithi110 ceph-mon[98215]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:22.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:22 smithi165 ceph-mon[77258]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:22.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:22 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:22:22.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:22 smithi110 ceph-mon[98215]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:22.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:22 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:22:24.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:24 smithi165 ceph-mon[77258]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:24.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:24 smithi110 ceph-mon[98215]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:26.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:26 smithi165 ceph-mon[77258]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:26.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:26 smithi110 ceph-mon[98215]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:28.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:27 smithi165 ceph-mon[77258]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:22:28.206 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:27 smithi110 ceph-mon[98215]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:22:30.910 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:30 smithi110 ceph-mon[98215]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:30.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:30 smithi165 ceph-mon[77258]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:32.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:32 smithi110 ceph-mon[98215]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:22:32.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:32 smithi165 ceph-mon[77258]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:22:34.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:34 smithi165 ceph-mon[77258]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:22:34.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:34 smithi110 ceph-mon[98215]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T02:22:36.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:36 smithi165 ceph-mon[77258]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:36.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:36 smithi110 ceph-mon[98215]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:37.951 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:37 smithi165 ceph-mon[77258]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:22:38.016 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:37 smithi110 ceph-mon[98215]: from='mgr.34102 172.21.15.110:0/2138873380' entity='mgr.smithi110.hfirap' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T02:22:38.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:38 smithi165 ceph-mon[77258]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:38.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:38 smithi110 ceph-mon[98215]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:40.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:40 smithi165 ceph-mon[77258]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:40.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:40 smithi110 ceph-mon[98215]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:42.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:42 smithi165 ceph-mon[77258]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:42.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:42 smithi110 ceph-mon[98215]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:44.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:44 smithi165 ceph-mon[77258]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:44.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:44 smithi110 ceph-mon[98215]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:46.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:46 smithi165 ceph-mon[77258]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:46.956 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:46 smithi110 ceph-mon[98215]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:48.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:48 smithi165 ceph-mon[77258]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:48.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:48 smithi110 ceph-mon[98215]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T02:22:50.950 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:50 smithi165 ceph-mon[77258]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:50.957 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:50 smithi110 ceph-mon[98215]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T02:22:51.662 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-16T02:22:51.662 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-16T02:22:51.664 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-16T02:22:51.678 INFO:tasks.cephadm:Teardown begin 2024-09-16T02:22:51.678 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-16T02:22:51.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T02:22:51.713 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T02:22:51.747 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-16T02:22:51.747 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T02:22:51.773 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T02:22:51.805 INFO:tasks.cephadm:Stopping all daemons... 2024-09-16T02:22:51.805 INFO:tasks.cephadm.mon.smithi110:Stopping mon.smithi110... 2024-09-16T02:22:51.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110 2024-09-16T02:22:52.095 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:51 smithi110 systemd[1]: Stopping Ceph mon.smithi110 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:22:52.438 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:52 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[98211]: 2024-09-16T02:22:52.094+0000 7f61aae81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi110 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:22:52.438 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:52 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110[98211]: 2024-09-16T02:22:52.094+0000 7f61aae81640 -1 mon.smithi110@0(leader) e3 *** Got Signal Terminated *** 2024-09-16T02:22:52.438 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:52 smithi110 podman[140866]: 2024-09-16 02:22:52.12525028 +0000 UTC m=+0.123351967 container died fdcdc064e607437657aa9949a0f1ea656716d9986665077c5637feabe305da07 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-16T02:22:52.706 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:52 smithi110 podman[140866]: 2024-09-16 02:22:52.62801652 +0000 UTC m=+0.626118216 container cleanup fdcdc064e607437657aa9949a0f1ea656716d9986665077c5637feabe305da07 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True) 2024-09-16T02:22:52.707 INFO:journalctl@ceph.mon.smithi110.smithi110.stdout:Sep 16 02:22:52 smithi110 bash[140866]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi110 2024-09-16T02:22:53.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi110.service' 2024-09-16T02:22:53.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:22:53.058 INFO:tasks.cephadm.mon.smithi110:Stopped mon.smithi110 2024-09-16T02:22:53.058 INFO:tasks.cephadm.mon.smithi165:Stopping mon.smithi165... 2024-09-16T02:22:53.059 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165 2024-09-16T02:22:53.361 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:53 smithi165 systemd[1]: Stopping Ceph mon.smithi165 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:22:53.700 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:53 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165[77254]: 2024-09-16T02:22:53.359+0000 7fe2d35e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi165 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:22:53.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:53 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165[77254]: 2024-09-16T02:22:53.359+0000 7fe2d35e6640 -1 mon.smithi165@1(peon) e3 *** Got Signal Terminated *** 2024-09-16T02:22:53.701 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:53 smithi165 podman[109453]: 2024-09-16 02:22:53.593517217 +0000 UTC m=+0.335519985 container died d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-16T02:22:54.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:54 smithi165 podman[109453]: 2024-09-16 02:22:54.058942646 +0000 UTC m=+0.800945444 container cleanup d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e) 2024-09-16T02:22:54.200 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:54 smithi165 bash[109453]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165 2024-09-16T02:22:54.487 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165.service' 2024-09-16T02:22:54.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:54 smithi165 podman[109467]: 2024-09-16 02:22:54.24963477 +0000 UTC m=+0.656449730 container remove d551eee6c53ccd3c688ce6bcfc6b9bb1b97eab99f74d1254ab3e489aa0504cf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-mon-smithi165, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:22:54.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:54 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165.service: Deactivated successfully. 2024-09-16T02:22:54.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:54 smithi165 systemd[1]: Stopped Ceph mon.smithi165 for c3aa8d62-73ce-11ef-bceb-c7b262605968. 2024-09-16T02:22:54.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 16 02:22:54 smithi165 systemd[1]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@mon.smithi165.service: Consumed 6.126s CPU time. 2024-09-16T02:22:54.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:22:54.538 INFO:tasks.cephadm.mon.smithi165:Stopped mon.smithi165 2024-09-16T02:22:54.538 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-16T02:22:54.538 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.0 2024-09-16T02:22:54.859 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:22:54 smithi110 systemd[1]: Stopping Ceph osd.0 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:22:55.206 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:22:54 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[109240]: 2024-09-16T02:22:54.857+0000 7f0d04fc4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:22:55.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:22:54 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[109240]: 2024-09-16T02:22:54.858+0000 7f0d04fc4640 -1 osd.0 90 *** Got signal Terminated *** 2024-09-16T02:22:55.207 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:22:54 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0[109240]: 2024-09-16T02:22:54.858+0000 7f0d04fc4640 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:23:00.596 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:00 smithi110 podman[141000]: 2024-09-16 02:23:00.323093989 +0000 UTC m=+5.592393952 container died 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T02:23:00.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:00 smithi110 podman[141000]: 2024-09-16 02:23:00.691636288 +0000 UTC m=+5.960936242 container cleanup 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-16T02:23:00.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:00 smithi110 bash[141000]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0 2024-09-16T02:23:01.313 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:00 smithi110 podman[141016]: 2024-09-16 02:23:00.9932758 +0000 UTC m=+0.665068360 container remove 49fe1eb49bf9ad9f16ce69535ea694e3035e87ca878ccd762e2b9e450f91abac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-16T02:23:01.640 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:01 smithi110 podman[141105]: 2024-09-16 02:23:01.215119964 +0000 UTC m=+0.015983892 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:23:01.641 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:01 smithi110 podman[141105]: 2024-09-16 02:23:01.352651586 +0000 UTC m=+0.153515505 container create 348177a7a96764ceced45066b1665de032f4769819edbb4bb8ad8ae28df1827f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T02:23:01.641 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:01 smithi110 podman[141105]: 2024-09-16 02:23:01.539418699 +0000 UTC m=+0.340282618 container init 348177a7a96764ceced45066b1665de032f4769819edbb4bb8ad8ae28df1827f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:23:01.641 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:01 smithi110 podman[141105]: 2024-09-16 02:23:01.542973444 +0000 UTC m=+0.343837364 container start 348177a7a96764ceced45066b1665de032f4769819edbb4bb8ad8ae28df1827f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T02:23:01.641 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:01 smithi110 podman[141105]: 2024-09-16 02:23:01.639386746 +0000 UTC m=+0.440250686 container attach 348177a7a96764ceced45066b1665de032f4769819edbb4bb8ad8ae28df1827f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T02:23:01.957 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 16 02:23:01 smithi110 podman[141105]: 2024-09-16 02:23:01.734372282 +0000 UTC m=+0.535236209 container died 348177a7a96764ceced45066b1665de032f4769819edbb4bb8ad8ae28df1827f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:23:02.390 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.0.service' 2024-09-16T02:23:02.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:23:02.433 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-16T02:23:02.433 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-16T02:23:02.433 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.1 2024-09-16T02:23:02.706 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:02 smithi110 systemd[1]: Stopping Ceph osd.1 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:23:03.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:02 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[114576]: 2024-09-16T02:23:02.796+0000 7fc4ab163640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:23:03.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:02 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[114576]: 2024-09-16T02:23:02.796+0000 7fc4ab163640 -1 osd.1 90 *** Got signal Terminated *** 2024-09-16T02:23:03.207 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:02 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1[114576]: 2024-09-16T02:23:02.796+0000 7fc4ab163640 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:23:08.549 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:08 smithi110 podman[141211]: 2024-09-16 02:23:08.245597215 +0000 UTC m=+5.581306741 container died ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-16T02:23:08.832 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:08 smithi110 podman[141211]: 2024-09-16 02:23:08.646943134 +0000 UTC m=+5.982652648 container cleanup ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-16T02:23:08.833 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:08 smithi110 bash[141211]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1 2024-09-16T02:23:09.206 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:08 smithi110 podman[141228]: 2024-09-16 02:23:08.831819308 +0000 UTC m=+0.586085583 container remove ce907e4f548afcdbbeb624fb76702334308f364a1f6b57565a60cfc1c661d5a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T02:23:09.553 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:09 smithi110 podman[141321]: 2024-09-16 02:23:09.158657166 +0000 UTC m=+0.016124684 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:23:09.553 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:09 smithi110 podman[141321]: 2024-09-16 02:23:09.274376462 +0000 UTC m=+0.131843966 container create b1a6986ac40929c3c3e4f0ea82b903e6b9e49874c87eb11b6b41df8bf91271fc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T02:23:09.553 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:09 smithi110 podman[141321]: 2024-09-16 02:23:09.452097117 +0000 UTC m=+0.309564620 container init b1a6986ac40929c3c3e4f0ea82b903e6b9e49874c87eb11b6b41df8bf91271fc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T02:23:09.553 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:09 smithi110 podman[141321]: 2024-09-16 02:23:09.455411702 +0000 UTC m=+0.312879215 container start b1a6986ac40929c3c3e4f0ea82b903e6b9e49874c87eb11b6b41df8bf91271fc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T02:23:09.553 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:09 smithi110 podman[141321]: 2024-09-16 02:23:09.551933792 +0000 UTC m=+0.409401311 container attach b1a6986ac40929c3c3e4f0ea82b903e6b9e49874c87eb11b6b41df8bf91271fc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-16T02:23:09.956 INFO:journalctl@ceph.osd.1.smithi110.stdout:Sep 16 02:23:09 smithi110 podman[141321]: 2024-09-16 02:23:09.645657215 +0000 UTC m=+0.503124732 container died b1a6986ac40929c3c3e4f0ea82b903e6b9e49874c87eb11b6b41df8bf91271fc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-16T02:23:10.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.1.service' 2024-09-16T02:23:10.283 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:23:10.283 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-16T02:23:10.284 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-16T02:23:10.284 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.2 2024-09-16T02:23:10.528 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:10 smithi110 systemd[1]: Stopping Ceph osd.2 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:23:10.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:10 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[120079]: 2024-09-16T02:23:10.633+0000 7fa523369640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:23:10.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:10 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[120079]: 2024-09-16T02:23:10.633+0000 7fa523369640 -1 osd.2 90 *** Got signal Terminated *** 2024-09-16T02:23:10.957 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:10 smithi110 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2[120079]: 2024-09-16T02:23:10.633+0000 7fa523369640 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:23:16.387 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:16 smithi110 podman[141427]: 2024-09-16 02:23:16.134712029 +0000 UTC m=+5.633175205 container died feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-16T02:23:16.703 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:16 smithi110 podman[141427]: 2024-09-16 02:23:16.4673354 +0000 UTC m=+5.965798561 container cleanup feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-16T02:23:16.703 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:16 smithi110 bash[141427]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2 2024-09-16T02:23:16.956 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:16 smithi110 podman[141442]: 2024-09-16 02:23:16.70221343 +0000 UTC m=+0.569087101 container remove feb249c713be9234053a40a2bb4c9477c903edf5ec3164cfe2fe7ddf40270c60 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:23:17.302 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:17 smithi110 podman[141532]: 2024-09-16 02:23:17.020750664 +0000 UTC m=+0.015928274 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:23:17.302 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:17 smithi110 podman[141532]: 2024-09-16 02:23:17.186908722 +0000 UTC m=+0.182086324 container create a9332980acca813b4c8029d328c2f82fff6d4520eedf5866ad45c2694ac72e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-16T02:23:17.616 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:17 smithi110 podman[141532]: 2024-09-16 02:23:17.423181519 +0000 UTC m=+0.418359126 container init a9332980acca813b4c8029d328c2f82fff6d4520eedf5866ad45c2694ac72e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T02:23:17.616 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:17 smithi110 podman[141532]: 2024-09-16 02:23:17.426762958 +0000 UTC m=+0.421940562 container start a9332980acca813b4c8029d328c2f82fff6d4520eedf5866ad45c2694ac72e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T02:23:17.617 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:17 smithi110 podman[141532]: 2024-09-16 02:23:17.5066028 +0000 UTC m=+0.501780401 container attach a9332980acca813b4c8029d328c2f82fff6d4520eedf5866ad45c2694ac72e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-16T02:23:17.919 INFO:journalctl@ceph.osd.2.smithi110.stdout:Sep 16 02:23:17 smithi110 podman[141532]: 2024-09-16 02:23:17.615832213 +0000 UTC m=+0.611009823 container died a9332980acca813b4c8029d328c2f82fff6d4520eedf5866ad45c2694ac72e5b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-16T02:23:18.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.2.service' 2024-09-16T02:23:18.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:23:18.447 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-16T02:23:18.447 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-16T02:23:18.447 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.3 2024-09-16T02:23:18.747 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:18 smithi165 systemd[1]: Stopping Ceph osd.3 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:23:19.005 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:18 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:23:18.744+0000 7f71e77ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:23:19.005 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:18 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:23:18.744+0000 7f71e77ce640 -1 osd.3 90 *** Got signal Terminated *** 2024-09-16T02:23:19.005 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:18 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:23:18.744+0000 7f71e77ce640 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:23:22.450 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:22 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:23:22.138+0000 7f71dfdcb640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:59.188254+0000 front 2024-09-16T02:22:59.188279+0000 (oldest deadline 2024-09-16T02:23:22.088010+0000) 2024-09-16T02:23:22.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:22 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:22.455+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:23.416 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:23 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3[86683]: 2024-09-16T02:23:23.098+0000 7f71dfdcb640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:59.188254+0000 front 2024-09-16T02:22:59.188279+0000 (oldest deadline 2024-09-16T02:23:22.088010+0000) 2024-09-16T02:23:23.700 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:23 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:23.415+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:24.559 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:24 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:24.368+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:24.560 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:24 smithi165 podman[109577]: 2024-09-16 02:23:24.287269726 +0000 UTC m=+5.645097872 container died 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:23:24.907 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:24 smithi165 podman[109577]: 2024-09-16 02:23:24.655810934 +0000 UTC m=+6.013639069 container cleanup 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:23:24.908 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:24 smithi165 bash[109577]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3 2024-09-16T02:23:25.200 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:24 smithi165 podman[109605]: 2024-09-16 02:23:24.906930782 +0000 UTC m=+0.620995514 container remove 0a846f393eb0841016b54e8ba0309c6405789720b03df39d58e24297511e58bb (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T02:23:25.535 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:25 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:25.370+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:25.536 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:25 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:25.297+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:25.536 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:25 smithi165 podman[109695]: 2024-09-16 02:23:25.132239371 +0000 UTC m=+0.015615516 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:23:25.536 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:25 smithi165 podman[109695]: 2024-09-16 02:23:25.241185377 +0000 UTC m=+0.124561554 container create 480a243a7ab2213c5f5e3df6de635bf792195469eb1ec6f1b93d09ea13337330 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-16T02:23:25.536 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:25 smithi165 podman[109695]: 2024-09-16 02:23:25.451810409 +0000 UTC m=+0.335186544 container init 480a243a7ab2213c5f5e3df6de635bf792195469eb1ec6f1b93d09ea13337330 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-16T02:23:25.536 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:25 smithi165 podman[109695]: 2024-09-16 02:23:25.455056543 +0000 UTC m=+0.338432681 container start 480a243a7ab2213c5f5e3df6de635bf792195469eb1ec6f1b93d09ea13337330 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T02:23:25.536 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:25 smithi165 podman[109695]: 2024-09-16 02:23:25.534857417 +0000 UTC m=+0.418233570 container attach 480a243a7ab2213c5f5e3df6de635bf792195469eb1ec6f1b93d09ea13337330 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:23:25.939 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:25 smithi165 podman[109695]: 2024-09-16 02:23:25.647240935 +0000 UTC m=+0.530617081 container died 480a243a7ab2213c5f5e3df6de635bf792195469eb1ec6f1b93d09ea13337330 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T02:23:26.191 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 16 02:23:26 smithi165 podman[109719]: 2024-09-16 02:23:26.169962351 +0000 UTC m=+0.517063653 container remove 480a243a7ab2213c5f5e3df6de635bf792195469eb1ec6f1b93d09ea13337330 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-16T02:23:26.196 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.3.service' 2024-09-16T02:23:26.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:23:26.238 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-16T02:23:26.238 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-16T02:23:26.238 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.4 2024-09-16T02:23:26.450 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:26.309+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:26.451 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:26 smithi165 systemd[1]: Stopping Ceph osd.4 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:23:26.451 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:26.365+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:26.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:26.555+0000 7ff40687f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:23:26.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:26.555+0000 7ff40687f640 -1 osd.4 90 *** Got signal Terminated *** 2024-09-16T02:23:26.950 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:26 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:26.555+0000 7ff40687f640 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:23:27.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:27 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:27.312+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:27.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:27 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:27.370+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:28.700 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:28 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:28.415+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:28.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:28 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:28.327+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:29.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:29 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:29.376+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:29.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:29 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:29.376+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:04.347253+0000 front 2024-09-16T02:23:04.347268+0000 (oldest deadline 2024-09-16T02:23:29.046966+0000) 2024-09-16T02:23:29.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:29 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:29.288+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:30.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:30 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:30.307+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:30.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:30 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:30.326+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:30.701 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:30 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:30.326+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:04.347253+0000 front 2024-09-16T02:23:04.347268+0000 (oldest deadline 2024-09-16T02:23:29.046966+0000) 2024-09-16T02:23:31.700 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:31 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:31.308+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:57.346469+0000 front 2024-09-16T02:22:57.346459+0000 (oldest deadline 2024-09-16T02:23:22.046369+0000) 2024-09-16T02:23:31.700 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:31 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4[91679]: 2024-09-16T02:23:31.308+0000 7ff402e84640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:04.347253+0000 front 2024-09-16T02:23:04.347268+0000 (oldest deadline 2024-09-16T02:23:29.046966+0000) 2024-09-16T02:23:31.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:31 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:31.273+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:32.190 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:31 smithi165 podman[109798]: 2024-09-16 02:23:31.869056143 +0000 UTC m=+5.405674644 container died 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-16T02:23:32.190 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:32 smithi165 podman[109798]: 2024-09-16 02:23:32.189222369 +0000 UTC m=+5.725840872 container cleanup 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-16T02:23:32.450 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:32 smithi165 bash[109798]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4 2024-09-16T02:23:32.450 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:32 smithi165 podman[109814]: 2024-09-16 02:23:32.373861648 +0000 UTC m=+0.497754759 container remove 8ed078cd81d0825ca2c9e1831ad5a89dd4cc8df78d8f4c6c25f6f11ebfde1acc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-16T02:23:32.451 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:32 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:32.282+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:32.451 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:32 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:32.282+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:33.094 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:32 smithi165 podman[109900]: 2024-09-16 02:23:32.707971544 +0000 UTC m=+0.016107630 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:23:33.094 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:32 smithi165 podman[109900]: 2024-09-16 02:23:32.824622189 +0000 UTC m=+0.132758344 container create d2c250fa1f964c9c35051eff28e4f55b429246387750953b4f9e2d474d213ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T02:23:33.094 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:33 smithi165 podman[109900]: 2024-09-16 02:23:33.026784208 +0000 UTC m=+0.334920294 container init d2c250fa1f964c9c35051eff28e4f55b429246387750953b4f9e2d474d213ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T02:23:33.094 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:33 smithi165 podman[109900]: 2024-09-16 02:23:33.030246333 +0000 UTC m=+0.338382420 container start d2c250fa1f964c9c35051eff28e4f55b429246387750953b4f9e2d474d213ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:23:33.094 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:33 smithi165 podman[109900]: 2024-09-16 02:23:33.093280547 +0000 UTC m=+0.401416643 container attach d2c250fa1f964c9c35051eff28e4f55b429246387750953b4f9e2d474d213ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T02:23:33.450 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 16 02:23:33 smithi165 podman[109900]: 2024-09-16 02:23:33.22251931 +0000 UTC m=+0.530655397 container died d2c250fa1f964c9c35051eff28e4f55b429246387750953b4f9e2d474d213ab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T02:23:33.451 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:33.250+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:33.451 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:33 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:33.250+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:33.861 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.4.service' 2024-09-16T02:23:33.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:23:33.900 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-16T02:23:33.900 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-16T02:23:33.900 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.5 2024-09-16T02:23:34.200 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:33 smithi165 systemd[1]: Stopping Ceph osd.5 for c3aa8d62-73ce-11ef-bceb-c7b262605968... 2024-09-16T02:23:34.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:34.205+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:34.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:34.205+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:34.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:34.231+0000 7f8187962640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T02:23:34.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:34.231+0000 7f8187962640 -1 osd.5 90 *** Got signal Terminated *** 2024-09-16T02:23:34.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:34 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:34.231+0000 7f8187962640 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T02:23:35.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:35 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:35.215+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:35.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:35 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:35.215+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:36.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:36 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:36.252+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:36.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:36 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:36.252+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:37.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:37 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:37.299+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:37.701 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:37 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:37.299+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:38.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:38.265+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-16T02:22:56.751647+0000 front 2024-09-16T02:22:56.751682+0000 (oldest deadline 2024-09-16T02:23:24.351679+0000) 2024-09-16T02:23:38.700 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:38 smithi165 ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5[96959]: 2024-09-16T02:23:38.265+0000 7f817ff5f640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.110:6814 osd.1 since back 2024-09-16T02:23:06.052566+0000 front 2024-09-16T02:23:06.052522+0000 (oldest deadline 2024-09-16T02:23:31.952333+0000) 2024-09-16T02:23:39.950 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:39 smithi165 podman[110001]: 2024-09-16 02:23:39.617582085 +0000 UTC m=+5.494181860 container died a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T02:23:40.218 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110001]: 2024-09-16 02:23:40.032156932 +0000 UTC m=+5.908756695 container cleanup a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T02:23:40.218 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 bash[110001]: ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5 2024-09-16T02:23:40.535 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110017]: 2024-09-16 02:23:40.216729359 +0000 UTC m=+0.591883437 container remove a01a4f216cf50ebd98bbbf3b73f2ed5d886380942245e83cdce34df07818983c (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T02:23:40.795 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110105]: 2024-09-16 02:23:40.534189791 +0000 UTC m=+0.098650576 container create cccd613c270b7c4a1d448cec1e03cced40cf7e3e7534cca7a96d7e96a3f5b33b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-16T02:23:40.795 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110105]: 2024-09-16 02:23:40.451074303 +0000 UTC m=+0.015535089 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T02:23:40.795 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110105]: 2024-09-16 02:23:40.728242598 +0000 UTC m=+0.292703375 container init cccd613c270b7c4a1d448cec1e03cced40cf7e3e7534cca7a96d7e96a3f5b33b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T02:23:40.796 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110105]: 2024-09-16 02:23:40.73183155 +0000 UTC m=+0.296292330 container start cccd613c270b7c4a1d448cec1e03cced40cf7e3e7534cca7a96d7e96a3f5b33b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-16T02:23:40.796 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110105]: 2024-09-16 02:23:40.794612478 +0000 UTC m=+0.359073267 container attach cccd613c270b7c4a1d448cec1e03cced40cf7e3e7534cca7a96d7e96a3f5b33b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-16T02:23:41.200 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:40 smithi165 podman[110105]: 2024-09-16 02:23:40.920524769 +0000 UTC m=+0.484985547 container died cccd613c270b7c4a1d448cec1e03cced40cf7e3e7534cca7a96d7e96a3f5b33b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T02:23:41.468 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 16 02:23:41 smithi165 podman[110128]: 2024-09-16 02:23:41.464688129 +0000 UTC m=+0.534244394 container remove cccd613c270b7c4a1d448cec1e03cced40cf7e3e7534cca7a96d7e96a3f5b33b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T02:23:41.488 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c3aa8d62-73ce-11ef-bceb-c7b262605968@osd.5.service' 2024-09-16T02:23:41.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T02:23:41.525 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-16T02:23:41.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T02:23:44.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi110.stderr:ceph-fuse[74916]: fuse finished with error 0 and tester_r 0 2024-09-16T02:24:03.833 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T02:24:18.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T02:24:18.824 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T02:24:18.851 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-16T02:24:18.853 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499/remote/smithi110/crash 2024-09-16T02:24:18.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/crash -- . 2024-09-16T02:24:18.891 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T02:24:18.891 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now 2024-09-16T02:24:18.893 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499/remote/smithi165/crash 2024-09-16T02:24:18.894 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/crash -- . 2024-09-16T02:24:18.917 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T02:24:18.917 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now 2024-09-16T02:24:18.918 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-16T02:24:18.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-16T02:24:19.036 INFO:tasks.cephadm:Compressing logs... 2024-09-16T02:24:19.037 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T02:24:19.039 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T02:24:19.062 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-16T02:24:19.062 INFO:teuthology.orchestra.run.smithi110.stderr:: No such file or directory 2024-09-16T02:24:19.062 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-16T02:24:19.062 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mon.smithi110.log 2024-09-16T02:24:19.065 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mon.smithi110.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi110.svegdg.log 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi110.yaugxw.log 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi110.svegdg.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr: 86.5% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T02:24:19.066 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi110.yaugxw.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mgr.smithi110.hfirap.log 2024-09-16T02:24:19.070 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-16T02:24:19.070 INFO:teuthology.orchestra.run.smithi165.stderr:: No such file or directory 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mgr.smithi165.afwhot.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mgr.smithi165.afwhot.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mon.smithi165.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi165.hskfht.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mon.smithi165.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi165.hskfht.log: gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.cephadm.log: 85.4% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T02:24:19.071 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log 2024-09-16T02:24:19.072 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.5.log: 91.4% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T02:24:19.072 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-16T02:24:19.073 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.2% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T02:24:19.074 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log: 88.2% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T02:24:19.074 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi165.gxrypw.log 2024-09-16T02:24:19.075 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.3.log: 92.4% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi165.hskfht.log.gz 2024-09-16T02:24:19.075 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T02:24:19.081 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log 2024-09-16T02:24:19.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi165.gxrypw.log: 91.0% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T02:24:19.085 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mgr.smithi110.hfirap.log: 91.0% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T02:24:19.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T02:24:19.094 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-16T02:24:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log: 88.2% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T02:24:19.102 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T02:24:19.136 INFO:teuthology.orchestra.run.smithi165.stderr: 89.7% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mgr.smithi165.afwhot.log.gz 2024-09-16T02:24:19.186 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T02:24:19.384 INFO:teuthology.orchestra.run.smithi165.stderr: 92.5% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mon.smithi165.log.gz 2024-09-16T02:24:19.458 INFO:teuthology.orchestra.run.smithi110.stderr: 89.0% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mgr.smithi110.hfirap.log.gz 2024-09-16T02:24:20.273 INFO:teuthology.orchestra.run.smithi110.stderr: 90.4% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mon.smithi110.log.gz 2024-09-16T02:24:22.325 INFO:teuthology.orchestra.run.smithi165.stderr: 93.5% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-16T02:24:24.437 INFO:teuthology.orchestra.run.smithi165.stderr: 93.6% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-16T02:24:24.577 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-16T02:24:24.602 INFO:teuthology.orchestra.run.smithi165.stderr: 93.7% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-16T02:24:25.076 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-16T02:24:25.172 INFO:teuthology.orchestra.run.smithi165.stderr: 94.8% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi165.gxrypw.log.gz 2024-09-16T02:24:25.680 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-16T02:24:31.897 INFO:teuthology.orchestra.run.smithi110.stderr: 94.9% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi110.svegdg.log.gz 2024-09-16T02:24:33.602 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-16T02:24:33.602 INFO:teuthology.orchestra.run.smithi165.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-16T02:24:33.604 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-16T02:24:33.604 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m14.550s 2024-09-16T02:24:33.604 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m34.121s 2024-09-16T02:24:33.604 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m1.055s 2024-09-16T02:24:35.339 INFO:teuthology.orchestra.run.smithi110.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-16T02:25:48.325 INFO:teuthology.orchestra.run.smithi110.stderr: 92.9% -- replaced with /var/log/ceph/c3aa8d62-73ce-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi110.yaugxw.log.gz 2024-09-16T02:25:48.327 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-16T02:25:48.327 INFO:teuthology.orchestra.run.smithi110.stderr:real 1m29.275s 2024-09-16T02:25:48.327 INFO:teuthology.orchestra.run.smithi110.stderr:user 2m13.665s 2024-09-16T02:25:48.327 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m4.197s 2024-09-16T02:25:48.327 INFO:tasks.cephadm:Archiving logs... 2024-09-16T02:25:48.327 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499/remote/smithi110/log 2024-09-16T02:25:48.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T02:26:07.656 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499/remote/smithi165/log 2024-09-16T02:26:07.657 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T02:26:13.033 INFO:tasks.cephadm:Removing cluster... 2024-09-16T02:26:13.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 --force 2024-09-16T02:26:13.642 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c3aa8d62-73ce-11ef-bceb-c7b262605968 --force 2024-09-16T02:26:14.140 INFO:tasks.cephadm:Removing cephadm ... 2024-09-16T02:26:14.140 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T02:26:14.156 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T02:26:14.172 INFO:tasks.cephadm:Teardown complete 2024-09-16T02:26:14.172 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T02:26:14.183 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-16T02:26:14.184 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T02:26:14.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T02:26:14.198 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T02:26:14.288 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T02:26:14.299 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T02:26:14.299 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T02:26:14.302 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T02:26:14.315 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-16T02:26:14.316 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-16T02:26:14.319 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T02:26:14.319 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-16T02:26:14.319 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -444us[ -438us] +/- 44ms 2024-09-16T02:26:14.319 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 +563us[ +569us] +/- 56ms 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +44us[ +50us] +/- 66ms 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 -439us[ -439us] +/- 44ms 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +577us[ +577us] +/- 56ms 2024-09-16T02:26:14.320 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +38us[ +38us] +/- 66ms 2024-09-16T02:26:14.321 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T02:26:14.321 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T02:26:14.333 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T02:26:14.333 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T02:26:14.344 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T02:26:14.442 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T02:26:14.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T02:26:14.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:26:14.545 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T02:26:14.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:26:14.574 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T02:26:14.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T02:26:14.597 INFO:teuthology.task.internal:Duration was 2189.347262 seconds 2024-09-16T02:26:14.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T02:26:14.610 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T02:26:14.610 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T02:26:14.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T02:26:14.649 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T02:26:14.653 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T02:26:15.001 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T02:26:15.001 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T02:26:15.001 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T02:26:15.062 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-16T02:26:15.063 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T02:26:15.090 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T02:26:15.090 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T02:26:15.105 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T02:26:15.156 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T02:26:15.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T02:26:15.172 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T02:26:15.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T02:26:15.822 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T02:26:15.823 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T02:26:15.848 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T02:26:15.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T02:26:15.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T02:26:15.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T02:26:15.912 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-16T02:26:15.939 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-16T02:26:15.966 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T02:26:15.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:26:15.984 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T02:26:16.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:26:16.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T02:26:16.033 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T02:26:16.034 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499/remote/smithi110 2024-09-16T02:26:16.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T02:26:16.085 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906499/remote/smithi165 2024-09-16T02:26:16.086 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T02:26:16.124 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T02:26:16.125 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T02:26:16.127 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T02:26:16.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T02:26:16.186 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T02:26:16.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T02:26:16.199 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T02:26:16.199 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T02:26:16.202 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T02:26:16.215 INFO:teuthology.orchestra.run.smithi110.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 16 02:26 /home/ubuntu/cephtest 2024-09-16T02:26:16.215 INFO:teuthology.orchestra.run.smithi110.stdout: 424761 4 d--------- 2 ubuntu ubuntu 4096 Sep 16 02:03 /home/ubuntu/cephtest/mnt.0 2024-09-16T02:26:16.216 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-16T02:26:16.216 INFO:teuthology.orchestra.run.smithi110.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-16T02:26:16.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T02:26:16.217 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-16T02:26:16.219 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T02:26:16.230 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T02:26:16.243 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-16T02:26:16.246 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2189.3472616672516 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-16T02:26:16.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T02:26:16.342 INFO:teuthology.run:FAIL